-- Logs begin at Wed 2022-11-02 20:28:59 UTC, end at Wed 2022-11-02 23:10:26 UTC. -- Nov 02 21:10:22.303742 n-d-860863-4 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 21:10:22.313637 n-d-860863-4 devstack@n-api.service[105143]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 21:10:22 2022] *** Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: nodename: n-d-860863-4 Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: machine: x86_64 Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: clock source: unix Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: pcre jit disabled Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: detected number of CPU cores: 4 Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: current working directory: / Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: detected binary path: /usr/bin/uwsgi-core Nov 02 21:10:22.317437 n-d-860863-4 devstack@n-api.service[105143]: your processes number limit is 47680 Nov 02 21:10:22.318172 n-d-860863-4 devstack@n-api.service[105143]: your memory page size is 4096 bytes Nov 02 21:10:22.318172 n-d-860863-4 devstack@n-api.service[105143]: detected max file descriptor number: 2048 Nov 02 21:10:22.318172 n-d-860863-4 devstack@n-api.service[105143]: lock engine: pthread robust mutexes Nov 02 21:10:22.318172 n-d-860863-4 devstack@n-api.service[105143]: thunder lock: enabled Nov 02 21:10:22.318172 n-d-860863-4 devstack@n-api.service[105143]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 21:10:22.318172 n-d-860863-4 devstack@n-api.service[105143]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 21:10:22.357868 n-d-860863-4 devstack@n-api.service[105143]: Python main interpreter initialized at 0x55de350259c0 Nov 02 21:10:22.357868 n-d-860863-4 devstack@n-api.service[105143]: python threads support enabled Nov 02 21:10:22.357868 n-d-860863-4 devstack@n-api.service[105143]: your server socket listen backlog is limited to 100 connections Nov 02 21:10:22.357868 n-d-860863-4 devstack@n-api.service[105143]: your mercy for graceful operations on workers is 90 seconds Nov 02 21:10:22.358224 n-d-860863-4 devstack@n-api.service[105143]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 21:10:22.358301 n-d-860863-4 devstack@n-api.service[105143]: *** Operational MODE: preforking *** Nov 02 21:10:22.358546 n-d-860863-4 devstack@n-api.service[105143]: *** uWSGI is running in multiple interpreter mode *** Nov 02 21:10:22.358546 n-d-860863-4 devstack@n-api.service[105143]: spawned uWSGI master process (pid: 105143) Nov 02 21:10:22.358749 n-d-860863-4 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 21:10:22.359805 n-d-860863-4 devstack@n-api.service[105143]: spawned uWSGI worker 1 (pid: 105157, cores: 1) Nov 02 21:10:22.359805 n-d-860863-4 devstack@n-api.service[105143]: spawned uWSGI worker 2 (pid: 105158, cores: 1) Nov 02 21:10:22.359805 n-d-860863-4 devstack@n-api.service[105143]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 21:10:23.019782 n-d-860863-4 devstack@n-api.service[105157]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 21:10:23.025739 n-d-860863-4 devstack@n-api.service[105158]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 21:10:24.102390 n-d-860863-4 devstack@n-api.service[105157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:10:24.102390 n-d-860863-4 devstack@n-api.service[105157]: from cryptography.utils import int_from_bytes Nov 02 21:10:24.102982 n-d-860863-4 devstack@n-api.service[105157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:10:24.102982 n-d-860863-4 devstack@n-api.service[105157]: from cryptography.utils import int_from_bytes Nov 02 21:10:24.137244 n-d-860863-4 devstack@n-api.service[105158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:10:24.137244 n-d-860863-4 devstack@n-api.service[105158]: from cryptography.utils import int_from_bytes Nov 02 21:10:24.137742 n-d-860863-4 devstack@n-api.service[105158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:10:24.137742 n-d-860863-4 devstack@n-api.service[105158]: from cryptography.utils import int_from_bytes Nov 02 21:10:26.614056 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 21:10:26.614621 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 21:10:26.614836 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 21:10:26.615196 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 21:10:26.615450 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 21:10:26.615838 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.616161 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.616483 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.616802 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.617157 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.617468 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.617787 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.618104 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.618431 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.618692 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.619008 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.619331 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-4 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.619654 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.619961 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.620274 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.620597 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.620796 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 21:10:26.621195 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.621287 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 21:10:26.621367 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.621530 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.621623 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 21:10:26.621964 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 21:10:26.622062 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.622800 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 21:10:26.623007 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.623315 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.623567 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.623681 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.623903 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.624047 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.624228 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.624438 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.624633 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.624790 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.625063 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.625238 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.625427 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.625639 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.625821 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.625971 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.626146 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.626353 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.626353 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.626704 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-4 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.626855 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.627076 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.627258 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.627456 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.627639 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-4 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.627795 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.627970 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.628185 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.628401 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.628557 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.628709 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.628867 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629024 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629149 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629287 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629434 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629557 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629677 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629797 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629918 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.629918 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.630182 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.630316 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.630444 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.630573 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.630702 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.630833 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.630956 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.631076 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.631209 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.631345 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.631563 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.631690 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.631811 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.631932 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.632071 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.632196 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.632325 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.632453 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.632583 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.632705 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.632869 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633022 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633148 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633277 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-4 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633440 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633578 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633701 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633823 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.633950 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.634115 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.634245 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.634456 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.634583 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.634774 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.634907 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.635089 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.635216 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.635411 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.635536 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.635720 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.635853 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.636027 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.636159 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.636335 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.636461 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.636642 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.636776 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.636966 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.637113 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.637288 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.637414 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.637603 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.637740 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.638588 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.638779 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.639069 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.639197 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.639473 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.639608 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.639731 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.639853 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.639974 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.640095 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.640229 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.640357 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.640481 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.640638 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.640772 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.640969 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.641114 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.641290 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.641423 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.641635 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.641777 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.641915 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.642046 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.642201 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.642335 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.642509 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.642644 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.642827 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.642993 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.643158 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.643276 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.643464 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.643590 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.643719 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.643851 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.643997 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.644129 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.644298 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.644440 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.644614 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.644740 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.644919 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.645090 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.645257 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.645392 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.645563 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.645689 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.645862 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.645994 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.646168 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.646301 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.646473 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.646598 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.646778 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.646911 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.647084 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.647222 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.647388 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.647513 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.647694 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.647834 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.647997 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.648134 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.648301 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.648427 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.648606 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.648731 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.648912 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.649081 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.649258 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.649394 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.649579 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.649705 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.649886 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.650012 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.650191 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.650329 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.650497 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.650622 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.650808 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.650934 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.651127 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.651252 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.651373 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.651492 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.651748 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.651884 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.652007 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.652129 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.652296 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.652429 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.652607 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.652732 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.652960 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.653104 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.653252 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.653415 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.653710 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.654163 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.654290 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.654487 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.654612 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.654799 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.654938 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.655115 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.655246 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.655423 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.655547 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.655732 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.655866 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.656040 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.656167 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.656345 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.656470 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.656650 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.656776 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.656975 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.657104 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.657284 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.657410 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.657590 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.657717 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.657891 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.658017 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.658210 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.658345 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.658518 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.658642 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.658829 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.658959 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.659138 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.659275 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.659440 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.659565 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.659757 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.659883 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.660067 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.660200 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.660395 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.660526 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.660705 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.660830 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.661041 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.661177 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.661368 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.661494 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.661689 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.661828 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.662022 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.662158 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.662311 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.662438 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.662617 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.662750 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.662929 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.663092 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.663246 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.663378 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.663556 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.663681 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.663866 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.663993 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.664175 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.664301 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.664487 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.664607 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.664798 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.664996 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.665135 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.665259 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.665426 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.665553 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.665736 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.665875 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.666041 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.666167 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.666359 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.666560 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.666685 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.666806 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.666986 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.667115 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.667297 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.667431 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.667607 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.667732 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.667931 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:10:26.668056 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.668266 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.668414 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.668593 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.668720 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.668914 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.669162 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.669478 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.669798 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.669924 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.670115 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.670240 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.670458 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.670584 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.670775 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.670909 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.671098 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.671230 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.671420 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.671546 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.671735 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.671862 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.672072 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.672207 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.672369 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.672495 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.672680 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.672808 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.673017 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.673177 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.673334 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.673481 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.673645 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.673778 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.673980 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.674106 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.674305 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.674461 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.674618 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.674744 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.674932 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.675058 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.675242 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.675376 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.675560 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.675685 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.675872 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.675997 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.676183 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.676317 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.676492 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.676617 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.676796 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.676921 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.677121 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.677246 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.677417 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.677543 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.677720 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.677843 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.678023 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.678152 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.678344 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.678470 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.678670 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.678799 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.678976 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.679103 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.679307 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.679432 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.679614 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.679746 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.679927 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.680053 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.680238 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.680365 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.680548 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.680686 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.680854 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.681013 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.681194 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.681321 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.681505 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.681644 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.681810 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.681937 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.682179 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.682314 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.682438 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.682569 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.682735 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.682862 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.683057 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.683223 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.683349 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.683483 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.683656 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.683783 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.683971 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.684097 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.684283 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.684417 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.684595 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.685248 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.685549 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.685867 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.686048 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.686182 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.686376 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.686502 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.686695 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.686827 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.687014 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.687141 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.687339 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.687472 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.687656 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.687782 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.687987 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.688114 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.688323 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.688448 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.688638 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.688777 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.689005 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.689134 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.689283 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.689408 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.689588 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.689724 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.689893 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.690019 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.690198 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.690327 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.690507 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.690708 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.690861 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.690985 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.691105 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.691233 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.691397 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.691531 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.691700 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.691836 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.692004 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.692136 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.692346 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.692487 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.692611 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.692739 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.692918 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.693060 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.693279 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.693412 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.693541 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.693664 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.693888 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.694017 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.694195 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.694328 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.694516 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.694640 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.694835 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.694962 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.695164 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.695291 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.695483 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.695608 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.695795 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.695931 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.696112 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.696245 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.696423 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.696549 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.696735 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.696869 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.697071 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.697197 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.697386 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.697521 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.697708 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.697846 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.698017 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.698144 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.698333 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.698459 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.698643 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.698775 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.698948 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.699073 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.699258 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.699384 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.699573 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.699707 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.699877 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.700013 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.700184 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.700395 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.700780 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.701161 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.701293 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.701491 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.701617 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.701807 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.701945 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.702141 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.702269 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.702487 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.702622 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.702782 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.702924 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.703094 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.703218 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.703389 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.703520 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.703702 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.703834 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.704021 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.704154 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.704333 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.704461 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.704650 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.704777 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.704980 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.705111 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.705307 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.705438 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.705616 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.705743 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.705934 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.706059 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.706240 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.706366 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.706556 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.706682 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.706877 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.707002 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.707195 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.707321 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.707506 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.707633 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.707817 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.707942 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.708139 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.708270 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.708449 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.708574 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.708759 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.708885 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.709096 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.709235 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.709403 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.709536 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.709708 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.709833 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.710018 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.710151 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.710331 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.710464 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.710643 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.710778 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.710954 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.711088 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.711266 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.711393 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.711581 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.711722 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.711878 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.712010 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.712182 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.712308 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.712485 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.712693 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.712830 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.713030 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.713159 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.713289 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.713473 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.713608 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.713739 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.713863 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.714049 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.714176 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.714356 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.714481 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.714664 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.714816 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.714986 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.715110 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.715296 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.715420 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.715604 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.715730 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.716449 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.716582 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.716823 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.717194 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.717322 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.717512 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.717639 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.717820 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.717946 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.718138 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.718265 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.718461 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.718594 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.718773 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.718899 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.719089 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.719216 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.719401 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.719527 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.719713 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.719839 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.720036 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.720163 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.720353 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.720478 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.720665 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.720870 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.721051 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.721183 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.721306 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.721427 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.721603 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.721737 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.721916 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.722041 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.722230 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.722354 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.722541 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.722688 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.722875 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.722999 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.723150 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.723284 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.723453 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.723622 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.723754 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.723876 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.724067 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.724193 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.724408 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.724640 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.724765 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.725003 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.725132 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.725321 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.725460 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.725642 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.725768 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.725959 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.726084 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.726271 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.726410 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.726584 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.726716 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.726931 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.727057 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.727244 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.727369 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.727552 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.727678 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.727864 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.727990 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.728170 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.728295 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.728477 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.728605 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.728791 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.728917 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.729125 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.729251 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.729432 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.729560 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.729738 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.729863 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.730049 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.730182 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.730353 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.730478 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.730660 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.730792 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.730965 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.731099 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.731269 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.731396 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.731633 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.731765 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.732039 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.732355 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.732480 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.732662 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.732788 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.733017 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.733156 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.733313 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.733440 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.733621 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.733751 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.733927 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.734066 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.734233 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.734359 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.734577 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.734883 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.735008 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.735223 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.735350 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.735800 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.735931 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.736128 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.736254 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.736436 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.736568 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.736743 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.736884 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.737091 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.737218 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.737397 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.737535 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.737704 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.737831 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.738010 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.738137 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.738318 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.738453 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.738637 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.738767 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.738923 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.739050 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.739234 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.739368 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.739543 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.739670 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.739852 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.739976 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.740159 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.740284 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.740462 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.740588 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.740769 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.740894 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.741095 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.741222 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.741406 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.741532 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.741713 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.741838 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.742017 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.742152 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.742320 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.742446 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.742628 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.742762 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.742936 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.743132 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.743259 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.743380 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.743531 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.743706 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.743832 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.743954 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.744136 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.744271 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.744439 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.744574 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.744744 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.744878 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.745083 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.745212 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.745394 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.745604 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.745730 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.745850 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.745992 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.746125 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.746315 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.746450 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.746627 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.746752 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.746929 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.747055 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.747742 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.748138 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.748275 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.748445 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.748649 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.748776 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.749018 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.749149 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.749365 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.749501 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.749697 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.749821 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.750004 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.750131 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.750315 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.750441 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.750621 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.750756 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.750926 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.751060 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.751230 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.751356 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.751540 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.751675 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.751849 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.751976 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.752152 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.752279 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.752456 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.752592 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.752760 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.752886 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.753090 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.753307 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.753434 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.753559 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.753711 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.753883 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.754006 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.754134 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.754310 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.754437 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.754614 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.754749 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.754954 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.755087 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.755257 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.755383 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.755580 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.755704 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.755893 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.756018 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.756205 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.756332 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.756521 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.756645 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.756832 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.757005 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.757165 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.757304 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.757477 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.757602 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.757782 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.757917 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.758096 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.758229 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.758406 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.758532 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.758717 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.758856 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.759021 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.759147 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.759325 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.759458 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.759638 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.759771 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.759949 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.760076 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.760260 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.760390 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.760574 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.760706 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.760890 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.761036 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.761225 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.761351 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.761527 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.761659 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.761834 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.761965 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.762142 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.762267 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.762447 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.762572 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.762788 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.763547 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.763676 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.763837 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.763972 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.764096 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.764226 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.764349 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.764492 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.764653 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.764788 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.764993 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.765124 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.765574 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.765709 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.765845 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.765969 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.766088 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.766209 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.766331 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.766459 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.766590 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.766719 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.766881 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.767001 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.767193 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.767321 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.767501 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.767634 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.767806 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.767932 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.768116 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.768242 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.768424 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.768551 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.768745 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.768877 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.769079 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.769226 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.769400 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.769526 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.769715 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.769849 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.770031 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.770165 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.770339 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.770473 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.770646 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.770771 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.770960 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.771093 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.771266 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.771392 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.771580 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.771705 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.771904 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.772039 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.772230 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.772364 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.772557 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.772695 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.772865 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.773038 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.773192 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.773317 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.773578 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.773715 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.773846 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.774006 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.774128 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.774250 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.774406 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.774539 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.774710 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.774844 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.775022 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.775147 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.775324 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.775458 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.775657 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.775789 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.775942 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.776069 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.776253 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.776379 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.776567 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.776695 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.776881 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.777054 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.777212 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.777371 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.777540 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.777666 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.777856 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.777981 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.778162 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.778301 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.778518 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.778809 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.778936 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.779125 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.779251 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.779441 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.779569 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.779755 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.780081 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.780206 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.780408 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.780547 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.780723 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.781071 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.781380 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.781711 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.781849 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.782036 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.782352 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.782675 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.783091 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.783414 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.783689 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.783824 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.783987 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.784117 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.784344 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.784651 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.784975 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.785288 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.785464 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.785601 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.785819 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.785953 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.786164 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.786291 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.786492 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.786626 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.786802 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.787016 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.787150 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.787348 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.787483 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.787675 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.787802 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.787989 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.788127 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.788328 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.788452 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.788604 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.788737 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.788922 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.789085 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.789257 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.789385 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.789576 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.789701 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.789891 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.790017 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.790196 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.790321 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.790520 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.790647 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.790830 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.790988 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.791121 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.791251 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.791431 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.791685 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.791811 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.792010 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.792138 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.792324 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.792451 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.792660 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.792785 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.793015 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.793145 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.793349 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.793476 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.793662 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.793878 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.794098 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.794272 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.794383 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.794488 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.794677 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.794791 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.794998 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.795113 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.795316 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.795442 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.795645 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.795779 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.795973 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.796110 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.796290 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.796425 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.796607 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.796745 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.796914 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.797073 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.797243 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.797368 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.797549 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.797694 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.797859 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.797986 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.798163 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.798296 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.798468 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.798607 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.798773 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.798901 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.799099 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.799234 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.799406 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.799540 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.799729 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.799856 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.800040 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.800167 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.800345 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.800473 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.800650 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.800776 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.800972 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.801101 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.801320 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.801448 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.801631 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.801758 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.801959 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.802086 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.802272 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.802399 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.802593 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.802717 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.802909 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.803022 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.803217 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.803314 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.803525 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.803621 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.803837 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.803938 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.804147 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.804241 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.804457 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.804542 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.804770 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.804872 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.805104 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.805205 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.805417 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.805505 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.805730 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.805825 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.806044 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.806202 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.806357 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.806582 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.806678 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.806911 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.806997 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.807223 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.807309 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.807538 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.807642 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.807849 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.807936 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.808162 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.808257 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.808475 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.808575 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.808787 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.808887 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.809128 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.809278 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.809425 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.809566 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.810268 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.810408 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.810590 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.810725 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.810905 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.811040 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.811228 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.811364 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.811559 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.811722 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.811905 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.812046 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.812182 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.812320 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.812475 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.812618 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.812783 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.812946 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.813115 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.813245 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.813425 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.813569 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.813739 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.813873 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.814102 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.814294 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.814438 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.814586 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.814741 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.814879 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815022 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815160 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815308 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815445 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815589 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815727 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815864 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.815999 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.816144 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.816282 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.816425 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.816573 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.816718 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.816855 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.817058 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.817201 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.817373 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.817539 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.817702 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.817846 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.818058 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.818198 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.818342 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.818497 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.818635 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.818780 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.818925 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.819062 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.819245 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.819516 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.819661 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.819832 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.819977 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.820164 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.820308 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.820477 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.820633 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.820780 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.820918 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.821115 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.821260 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.821434 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.821578 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.821753 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.821898 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.822057 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.822302 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.822446 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.822634 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.822787 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.822955 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.823099 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.823260 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.823403 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.823556 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.823693 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.823876 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.824021 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.824239 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.824417 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.824567 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.824723 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.824861 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.825025 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.825164 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.825883 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.826033 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.826247 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.826392 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.826571 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.826715 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.826903 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.827048 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.827234 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.827387 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.827555 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.827706 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.827852 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.827990 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.828181 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.828324 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.828490 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.828643 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.828788 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.828949 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.829132 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.829288 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.829446 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.829599 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.829738 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.829874 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.830048 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.830193 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.830360 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.830512 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.830651 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.830786 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.830968 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.831121 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.831272 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.831409 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.831570 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.831720 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.831885 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.832028 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.832199 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.832350 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.832510 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.832654 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.832819 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.832998 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.833163 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.833302 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.833440 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.833576 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.833744 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.833896 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.834034 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.834171 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.834390 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.834576 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.834712 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.834861 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.835014 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.835200 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.835344 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.835516 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.835668 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.835814 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.835957 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.836161 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.836305 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.836476 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.836620 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.836767 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.836905 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.837106 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.837245 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.837413 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.837567 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.837706 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.837843 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.838023 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.838165 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.838331 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.838482 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.838643 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.838785 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.838951 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.839104 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.839262 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.839417 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.839577 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.839719 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.839883 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.840027 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.840206 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.840429 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.840573 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.840767 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.841150 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.841307 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.841488 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.841634 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.841826 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.841971 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.842136 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.842287 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.842433 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.842571 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.842738 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.842889 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.843065 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.843209 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.843363 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.843502 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.843680 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.843825 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.843993 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.844137 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.844304 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.844565 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.844708 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.844846 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.845056 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.845208 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.845208 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.845490 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.845627 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.845761 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.845897 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.846042 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.846179 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.846315 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.846452 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.846587 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.846730 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.846880 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.847018 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.847164 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.847301 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.847437 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.847651 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.847792 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.847929 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.848072 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.848211 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.848347 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.848495 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.848634 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.848771 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.848914 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.849090 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.849228 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.849380 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.849524 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.849693 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.849837 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.849998 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.850144 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.850293 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.850431 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.850601 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.850752 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.850913 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.851079 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.851258 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.851401 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.851563 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.851707 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.851867 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.852197 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.852341 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.852505 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.852649 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.852811 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.853011 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.853177 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.853316 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.853454 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.853653 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.853800 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.853946 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.854100 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.854239 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.854376 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.854525 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.854683 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.854829 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.854973 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.855121 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.855333 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.855515 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.855667 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.855857 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.856007 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.856183 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.856333 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.857099 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.857265 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.857414 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.857608 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.857804 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.857949 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.858125 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.858278 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.858447 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.858592 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.858758 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.858916 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.859055 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.859204 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.859341 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.859478 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.859650 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.859810 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.859947 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.860092 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.860236 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.860621 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.860788 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.860961 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.861117 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.861264 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.861402 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.861538 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.861705 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.861859 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.862009 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.862147 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.862305 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.862449 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.862608 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.862753 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.862897 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.863043 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.863202 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.863354 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.863498 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.863635 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.863790 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.863934 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.864139 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.864289 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.864427 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.864571 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.864716 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.864858 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.865037 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.865178 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.865314 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.865458 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.865633 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.865788 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.865948 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.866092 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.866270 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.866422 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.866581 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.866725 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.866902 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.867055 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.867203 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.867341 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.867518 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.867671 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.867840 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.868154 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.868309 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.868447 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.868584 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.868779 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.868923 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.869115 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.869279 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.869417 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.869553 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.869731 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.869892 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.870031 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.870180 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.870341 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.870486 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.870650 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.870804 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.870950 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.871089 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.871256 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.871407 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.871545 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.871691 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.871873 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.872025 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.872257 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.872404 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.872588 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.872730 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.872899 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.873062 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.873231 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.873375 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.873544 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.873708 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.873847 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.873983 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.874161 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.874305 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.874467 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.874619 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.874757 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.874894 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.875067 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.875211 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.875358 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.875503 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.875653 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.875789 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.875953 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.876096 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.876241 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.876380 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.876554 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.876698 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.876856 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.877050 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.877272 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.877413 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.877559 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.877695 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.877831 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.877974 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.878119 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.878262 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.878400 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.878537 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.878673 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.878815 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.878961 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.879106 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.879244 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.879416 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.879561 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.879730 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.879875 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.880043 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.880187 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.880349 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.880493 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.880639 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 21:10:26.880777 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.881062 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.881388 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.881702 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.882025 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.882336 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.882663 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.882985 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.883301 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.883612 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.883945 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.884259 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.884572 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.884889 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.885227 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.885540 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.885851 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.886164 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.886476 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.886782 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.887110 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.887428 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.888258 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.888678 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.889021 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.889358 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.889674 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.889990 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.890304 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.890619 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.890955 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.891253 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.891565 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.891878 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.892196 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.892518 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.892846 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.893200 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.893515 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.893844 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.894173 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.894522 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.895234 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.895234 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.895514 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.895794 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.896109 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.896417 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:10:26.896661 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 21:10:27.035302 n-d-860863-4 devstack@n-api.service[105157]: INFO dbcounter [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Registered counter for database nova_api Nov 02 21:10:27.049465 n-d-860863-4 devstack@n-api.service[105158]: INFO dbcounter [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Registered counter for database nova_api Nov 02 21:10:27.056689 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_db.sqlalchemy.engines [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.063283 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writer thread running {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.069860 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_db.sqlalchemy.engines [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.077177 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writer thread running {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.121151 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.context [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=105157) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 21:10:27.125029 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:10:27.125504 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:10:27.127118 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:10:27.127827 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:10:27.128272 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:10:27.130287 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:10:27.132278 n-d-860863-4 devstack@n-api.service[105157]: INFO dbcounter [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Registered counter for database nova_cell0 Nov 02 21:10:27.133573 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.context [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=105158) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 21:10:27.136350 n-d-860863-4 devstack@n-api.service[105157]: INFO dbcounter [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Registered counter for database nova_cell1 Nov 02 21:10:27.137447 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_concurrency.lockutils [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:10:27.138585 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_concurrency.lockutils [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:10:27.140258 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_concurrency.lockutils [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:10:27.141007 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_concurrency.lockutils [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:10:27.141457 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_concurrency.lockutils [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:10:27.143498 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_concurrency.lockutils [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:10:27.145816 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_db.sqlalchemy.engines [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.145940 n-d-860863-4 devstack@n-api.service[105158]: INFO dbcounter [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Registered counter for database nova_cell0 Nov 02 21:10:27.146658 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_db.sqlalchemy.engines [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.149725 n-d-860863-4 devstack@n-api.service[105158]: INFO dbcounter [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Registered counter for database nova_cell1 Nov 02 21:10:27.152771 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writer thread running {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.154836 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writer thread running {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.157515 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_db.sqlalchemy.engines [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.159311 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_db.sqlalchemy.engines [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.166345 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writer thread running {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.166683 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writer thread running {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.300214 n-d-860863-4 devstack@n-api.service[105157]: INFO dbcounter [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Registered counter for database nova_cell0 Nov 02 21:10:27.309019 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_db.sqlalchemy.engines [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.311942 n-d-860863-4 devstack@n-api.service[105158]: INFO dbcounter [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Registered counter for database nova_cell0 Nov 02 21:10:27.314954 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writer thread running {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.320625 n-d-860863-4 devstack@n-api.service[105158]: DEBUG oslo_db.sqlalchemy.engines [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:10:27.325971 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writer thread running {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:10:27.724655 n-d-860863-4 devstack@n-api.service[105157]: WARNING keystonemiddleware.auth_token [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:10:27.732006 n-d-860863-4 devstack@n-api.service[105157]: WARNING keystonemiddleware.auth_token [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:10:27.751031 n-d-860863-4 devstack@n-api.service[105158]: WARNING keystonemiddleware.auth_token [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:10:27.758315 n-d-860863-4 devstack@n-api.service[105158]: WARNING keystonemiddleware.auth_token [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:10:28.074467 n-d-860863-4 devstack@n-api.service[105157]: WARNING keystonemiddleware.auth_token [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:10:28.080700 n-d-860863-4 devstack@n-api.service[105157]: WARNING keystonemiddleware.auth_token [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:10:28.085982 n-d-860863-4 devstack@n-api.service[105157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de350259c0 pid: 105157 (default app) Nov 02 21:10:28.088039 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:10:28.089266 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 Nov 02 21:10:28.089684 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Wed Nov 2 21:10:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:10:28.100214 n-d-860863-4 devstack@n-api.service[105158]: WARNING keystonemiddleware.auth_token [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:10:28.106173 n-d-860863-4 devstack@n-api.service[105158]: WARNING keystonemiddleware.auth_token [None req-a37c2e71-4574-46f6-b058-44004edc79a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:10:28.112348 n-d-860863-4 devstack@n-api.service[105158]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de350259c0 pid: 105158 (default app) Nov 02 21:11:52.473314 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:11:52.474318 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 02 21:11:52.474890 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:11:52.493000 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_api:SELECT=3 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:52.494204 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_cell0:SELECT=3 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:52.495011 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_cell1:SELECT=3 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:52.496330 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:53.398771 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-5ed417f4-2ab2-4161-ba56-71007cf169f3 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:11:53.432459 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-5ed417f4-2ab2-4161-ba56-71007cf169f3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.949794 Nov 02 21:11:53.441240 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:11:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:11:56.062032 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:11:56.063031 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-490a6be6-bf0b-4a16-b049-691f9c8119f8 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Nov 02 21:11:56.063654 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:11:56.526902 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-e99a2aab-71ea-4a06-8906-b272c83643ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 256}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:11:56.633076 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-e99a2aab-71ea-4a06-8906-b272c83643ce admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.563360 Nov 02 21:11:56.633639 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:11:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:11:56.647426 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writing DB stats nova_api:SELECT=3 {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:56.648075 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writing DB stats nova_cell0:SELECT=3 {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:56.649977 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writing DB stats nova_cell1:SELECT=3 {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:56.650872 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:11:56.858261 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-8c029c91-74a2-4fa1-8928-ec986bf3abd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:11:56.984024 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-8c029c91-74a2-4fa1-8928-ec986bf3abd3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341904 Nov 02 21:11:56.984793 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 21:11:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:11:59.646473 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-e99a2aab-71ea-4a06-8906-b272c83643ce admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:11:59.648018 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-e99a2aab-71ea-4a06-8906-b272c83643ce admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Nov 02 21:11:59.650444 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:00.491944 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-a86421f1-1817-45fa-8aaa-453af30acd9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "swap": 0, "ram": 512}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:00.658100 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-a86421f1-1817-45fa-8aaa-453af30acd9a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.002262 Nov 02 21:12:00.658672 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:11:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:12:00.671412 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-2fc4456f-adf8-4a5c-87d2-4ae0ceebeccb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:00.866214 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-2fc4456f-adf8-4a5c-87d2-4ae0ceebeccb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.198770 Nov 02 21:12:00.880967 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 21:12:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:12:03.800605 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-a86421f1-1817-45fa-8aaa-453af30acd9a admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:03.801666 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-a86421f1-1817-45fa-8aaa-453af30acd9a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Nov 02 21:12:03.803461 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:04.249506 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-f63d45b8-433a-4614-87c4-c333ae29dae6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:04.328524 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-f63d45b8-433a-4614-87c4-c333ae29dae6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520024 Nov 02 21:12:04.329186 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:12:04.341456 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-e513f249-3a42-4927-9bb4-ffdbee1eac3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:04.435627 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-e513f249-3a42-4927-9bb4-ffdbee1eac3d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097880 Nov 02 21:12:04.436210 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 21:12:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:12:07.057122 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-f63d45b8-433a-4614-87c4-c333ae29dae6 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:07.059187 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-f63d45b8-433a-4614-87c4-c333ae29dae6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002570 Nov 02 21:12:07.059800 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:07.521749 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-1ef765a5-c257-43bc-972c-fab47a72df07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:07.608641 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-1ef765a5-c257-43bc-972c-fab47a72df07 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538016 Nov 02 21:12:07.608641 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:12:07.618424 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-05156587-842b-4104-85d9-9fb4c72756a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:07.701812 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-05156587-842b-4104-85d9-9fb4c72756a2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087300 Nov 02 21:12:07.702558 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 21:12:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:12:10.393382 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-1ef765a5-c257-43bc-972c-fab47a72df07 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:10.394998 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-1ef765a5-c257-43bc-972c-fab47a72df07 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Nov 02 21:12:10.406528 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:10 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:10.825942 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-f5653e70-9822-4aa6-bc09-4d21497c2d09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "swap": 0}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:10.893428 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-f5653e70-9822-4aa6-bc09-4d21497c2d09 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491500 Nov 02 21:12:10.894092 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:12:10.906374 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-5be2c8ae-48d2-46de-af27-c30511d9d416 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:10.989338 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-5be2c8ae-48d2-46de-af27-c30511d9d416 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086632 Nov 02 21:12:10.990197 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Nov 2 21:12:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:12:13.716132 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-f5653e70-9822-4aa6-bc09-4d21497c2d09 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:13.818452 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-f5653e70-9822-4aa6-bc09-4d21497c2d09 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003212 Nov 02 21:12:13.818452 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:14.203380 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-f5a8359f-b227-4583-af03-2988408cf4d8 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:14.227607 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-f5a8359f-b227-4583-af03-2988408cf4d8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.503577 Nov 02 21:12:14.228158 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:12:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:12:17.081104 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-f5653e70-9822-4aa6-bc09-4d21497c2d09 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:17.082535 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-f5653e70-9822-4aa6-bc09-4d21497c2d09 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Nov 02 21:12:17.083029 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:17.529921 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-fe8ac538-4ac2-462e-9fe6-ad5484ff5c34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "swap": 0}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:17.609930 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-fe8ac538-4ac2-462e-9fe6-ad5484ff5c34 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518564 Nov 02 21:12:17.610733 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:12:17.627280 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-0ef38bc9-2259-4bc2-bfd6-a504f9ed196a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:17.708390 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-0ef38bc9-2259-4bc2-bfd6-a504f9ed196a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086627 Nov 02 21:12:17.708915 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 21:12:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:12:20.657427 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-fe8ac538-4ac2-462e-9fe6-ad5484ff5c34 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:20.658435 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-fe8ac538-4ac2-462e-9fe6-ad5484ff5c34 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Nov 02 21:12:20.659088 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:21.053003 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-7b26d56e-e45f-45d1-ae3c-37e74ea50eed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "id": "2"}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:21.141219 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-7b26d56e-e45f-45d1-ae3c-37e74ea50eed admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476207 Nov 02 21:12:21.141778 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:12:21.153954 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-2e92d368-3a3d-4c5b-94c5-f00c0f5cde27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:21.254635 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-2e92d368-3a3d-4c5b-94c5-f00c0f5cde27 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104457 Nov 02 21:12:21.255215 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 21:12:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:12:23.861218 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-7b26d56e-e45f-45d1-ae3c-37e74ea50eed admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:23.862484 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-7b26d56e-e45f-45d1-ae3c-37e74ea50eed admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Nov 02 21:12:23.863146 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:24.217279 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-f9b5b66c-eabd-43ac-b241-8a1d23faba81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:24.304108 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-f9b5b66c-eabd-43ac-b241-8a1d23faba81 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.434149 Nov 02 21:12:24.304667 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:12:24.317569 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-1e5a452c-0aa8-4173-b497-de80d002b647 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:24.323128 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:12:25.268131 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-1e5a452c-0aa8-4173-b497-de80d002b647 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.954201 Nov 02 21:12:25.281255 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 21:12:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:12:27.876856 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-f9b5b66c-eabd-43ac-b241-8a1d23faba81 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:27.878044 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-f9b5b66c-eabd-43ac-b241-8a1d23faba81 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Nov 02 21:12:27.878485 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:28.337666 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-833ce67f-341f-4dab-9bba-62454dcb30b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:28.418874 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-833ce67f-341f-4dab-9bba-62454dcb30b4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.533504 Nov 02 21:12:28.419627 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:12:28.431301 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-11a40e52-bde7-4cdf-a9c7-78f4b92e64a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:28.533411 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-11a40e52-bde7-4cdf-a9c7-78f4b92e64a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105617 Nov 02 21:12:28.533994 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 21:12:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:12:31.176568 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-833ce67f-341f-4dab-9bba-62454dcb30b4 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:31.176568 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-833ce67f-341f-4dab-9bba-62454dcb30b4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 02 21:12:31.177413 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:31.619975 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-292a3ea8-0c59-4730-82bc-4f552f20f70a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "disk": 160}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:31.627659 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:12:31.747525 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-292a3ea8-0c59-4730-82bc-4f552f20f70a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.564486 Nov 02 21:12:31.748972 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Nov 2 21:12:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:12:31.760432 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-79909961-fbea-424d-a325-53ab63e66e27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:31.837428 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-79909961-fbea-424d-a325-53ab63e66e27 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080593 Nov 02 21:12:31.838020 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Nov 2 21:12:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:12:51.657471 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-292a3ea8-0c59-4730-82bc-4f552f20f70a admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:51.658495 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-292a3ea8-0c59-4730-82bc-4f552f20f70a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Nov 02 21:12:51.658893 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:51.669336 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:12:52.049579 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-ee9e0bcc-eba9-4688-9b94-b9021317fb13 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:52.067615 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-ee9e0bcc-eba9-4688-9b94-b9021317fb13 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402682 Nov 02 21:12:52.068145 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:12:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:12:53.371861 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-292a3ea8-0c59-4730-82bc-4f552f20f70a admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:53.372914 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-292a3ea8-0c59-4730-82bc-4f552f20f70a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 02 21:12:53.373337 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:53.911555 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d63b3af9-3b48-4cc7-9ab3-0617949c00ad admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:53.916785 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.wsgi [None req-d63b3af9-3b48-4cc7-9ab3-0617949c00ad admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d63b3af9-3b48-4cc7-9ab3-0617949c00ad admin admin] Request method failure captured: Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: Accept: application/json Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: Accept-Encoding: gzip, deflate Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: Connection: keep-alive Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: Content-Length: 0 Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: Host: 10.222.0.25 Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: Openstack-Api-Version: compute 2.92 Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: Openstack-System-Scope: None Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: User-Agent: python-novaclient Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Auth-Token: gAAAAABjYt1V9zkx8HXXWTyYy-6yYEF4KbKzi0DpxfkF74ljz47ge31NMJ7IVEpKV74PweMnrw1NchbxoFwyMicjZpilEJ_TeypPIUWmzDKjEveQFL-hJahAgnCTPPnlkDRHLozEJjuD-pYaiEuVsiYYiCd-OwetPWvlkxypJEme21HTmFMaok8 Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Domain-Id: None Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Domain-Name: None Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Identity-Status: Confirmed Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Is-Admin-Project: True Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Domain-Id: default Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Domain-Name: Default Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Name: admin Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Role: member,admin,reader Nov 02 21:12:53.920550 n-d-860863-4 devstack@n-api.service[105158]: X-Roles: member,admin,reader Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16180e4161dd405aad09648ec8c4da20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant: admin Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant-Name: admin Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-User: admin Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-User-Domain-Id: default Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-User-Domain-Name: Default Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-User-Id: da6c176786ca4e38a671cbdf0a8bd06f Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: X-User-Name: admin Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: method: > Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: exception: Flavor 42 could not be found. Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: action_args: {'id': '42'} Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:12:53.926557 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:53.927625 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:53.929092 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d63b3af9-3b48-4cc7-9ab3-0617949c00ad admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:12:53.930369 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d63b3af9-3b48-4cc7-9ab3-0617949c00ad admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396762 Nov 02 21:12:53.930369 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 21:12:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 21:12:53.932353 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-3a3d1444-c93a-448f-8e14-301b1acbb3ac admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:53.955582 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-3a3d1444-c93a-448f-8e14-301b1acbb3ac admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027441 Nov 02 21:12:53.956150 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 21:12:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:12:53.967558 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-69b33564-fed7-423b-bc9f-d212d1ee6d26 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:53.989946 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-69b33564-fed7-423b-bc9f-d212d1ee6d26 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027039 Nov 02 21:12:53.990517 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 21:12:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:12:54.000568 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-ea8c73c3-848d-486f-970f-f6140e981cb0 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:54.005807 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.wsgi [None req-ea8c73c3-848d-486f-970f-f6140e981cb0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-ea8c73c3-848d-486f-970f-f6140e981cb0 admin admin] Request method failure captured: Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: Accept: application/json Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: Accept-Encoding: gzip, deflate Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: Connection: keep-alive Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: Content-Length: 0 Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: Host: 10.222.0.25 Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: Openstack-Api-Version: compute 2.92 Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: Openstack-System-Scope: None Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: User-Agent: python-novaclient Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Auth-Token: gAAAAABjYt1V9zkx8HXXWTyYy-6yYEF4KbKzi0DpxfkF74ljz47ge31NMJ7IVEpKV74PweMnrw1NchbxoFwyMicjZpilEJ_TeypPIUWmzDKjEveQFL-hJahAgnCTPPnlkDRHLozEJjuD-pYaiEuVsiYYiCd-OwetPWvlkxypJEme21HTmFMaok8 Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Domain-Id: None Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Domain-Name: None Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Identity-Status: Confirmed Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Is-Admin-Project: True Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Domain-Id: default Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Domain-Name: Default Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Name: admin Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Role: member,admin,reader Nov 02 21:12:54.016619 n-d-860863-4 devstack@n-api.service[105157]: X-Roles: member,admin,reader Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16180e4161dd405aad09648ec8c4da20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant: admin Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant-Name: admin Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-User: admin Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-User-Domain-Id: default Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-User-Domain-Name: Default Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-User-Id: da6c176786ca4e38a671cbdf0a8bd06f Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: X-User-Name: admin Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: method: > Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: exception: Flavor 42 could not be found. Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: action_args: {'id': '42'} Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:12:54.018188 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:54.019156 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:54.020436 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-ea8c73c3-848d-486f-970f-f6140e981cb0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:12:54.021696 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-ea8c73c3-848d-486f-970f-f6140e981cb0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014152 Nov 02 21:12:54.021696 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 21:12:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 21:12:55.214864 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-69b33564-fed7-423b-bc9f-d212d1ee6d26 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:55.215898 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-69b33564-fed7-423b-bc9f-d212d1ee6d26 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 02 21:12:55.216428 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:55.728759 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-cbaa0e4a-3dee-4b76-b238-54b7fe6c473a admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:55.734399 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.wsgi [None req-cbaa0e4a-3dee-4b76-b238-54b7fe6c473a admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-cbaa0e4a-3dee-4b76-b238-54b7fe6c473a admin admin] Request method failure captured: Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: Accept: application/json Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: Accept-Encoding: gzip, deflate Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: Connection: keep-alive Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: Content-Length: 0 Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: Host: 10.222.0.25 Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: Openstack-Api-Version: compute 2.92 Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: Openstack-System-Scope: None Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: User-Agent: python-novaclient Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Auth-Token: gAAAAABjYt1XIQc1YVpu70aHcmMbqUcbwJBdS7-o2YN0P1HSeGz827oVd4AqG47pu78icuYUqbflbBka_Lv8ttx57SRPzDXegxbPU7pDgyV0K9gLyoGESQmSCl8_R6umaSH9vxpGk3ocmGIMbB7mjN47EeZthOMKi3FyP5S2TVjYaHJJMtuMEWo Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Domain-Id: None Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Domain-Name: None Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Identity-Status: Confirmed Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Is-Admin-Project: True Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Domain-Id: default Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Domain-Name: Default Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Name: admin Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Role: member,admin,reader Nov 02 21:12:55.735903 n-d-860863-4 devstack@n-api.service[105157]: X-Roles: member,admin,reader Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16180e4161dd405aad09648ec8c4da20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant: admin Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant-Name: admin Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-User: admin Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-User-Domain-Id: default Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-User-Domain-Name: Default Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-User-Id: da6c176786ca4e38a671cbdf0a8bd06f Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: X-User-Name: admin Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: method: > Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: exception: Flavor 84 could not be found. Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: action_args: {'id': '84'} Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:12:55.737761 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:55.738724 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.740002 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-cbaa0e4a-3dee-4b76-b238-54b7fe6c473a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:12:55.741317 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-cbaa0e4a-3dee-4b76-b238-54b7fe6c473a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.385654 Nov 02 21:12:55.741317 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 21:12:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:12:55.747106 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-47cffa51-7277-4148-bd78-94ea56bd5352 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:55.762365 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-47cffa51-7277-4148-bd78-94ea56bd5352 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018836 Nov 02 21:12:55.762817 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 21:12:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:12:55.771933 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-8579fc6b-37b3-4a22-99e3-159878bdc58c admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:55.787577 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-8579fc6b-37b3-4a22-99e3-159878bdc58c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019159 Nov 02 21:12:55.788096 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 21:12:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:12:55.797721 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-90829f1b-66c6-49c4-a157-b231e4956a65 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:55.802581 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.wsgi [None req-90829f1b-66c6-49c4-a157-b231e4956a65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-90829f1b-66c6-49c4-a157-b231e4956a65 admin admin] Request method failure captured: Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: Accept: application/json Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: Accept-Encoding: gzip, deflate Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: Connection: keep-alive Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: Content-Length: 0 Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: Host: 10.222.0.25 Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: Openstack-Api-Version: compute 2.92 Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: Openstack-System-Scope: None Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: User-Agent: python-novaclient Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Auth-Token: gAAAAABjYt1XIQc1YVpu70aHcmMbqUcbwJBdS7-o2YN0P1HSeGz827oVd4AqG47pu78icuYUqbflbBka_Lv8ttx57SRPzDXegxbPU7pDgyV0K9gLyoGESQmSCl8_R6umaSH9vxpGk3ocmGIMbB7mjN47EeZthOMKi3FyP5S2TVjYaHJJMtuMEWo Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Domain-Id: None Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Domain-Name: None Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Identity-Status: Confirmed Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Is-Admin-Project: True Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Domain-Id: default Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Domain-Name: Default Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Name: admin Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Role: member,admin,reader Nov 02 21:12:55.804068 n-d-860863-4 devstack@n-api.service[105158]: X-Roles: member,admin,reader Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16180e4161dd405aad09648ec8c4da20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant: admin Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant-Name: admin Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-User: admin Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-User-Domain-Id: default Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-User-Domain-Name: Default Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-User-Id: da6c176786ca4e38a671cbdf0a8bd06f Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: X-User-Name: admin Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: method: > Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: exception: Flavor 84 could not be found. Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: action_args: {'id': '84'} Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:12:55.805570 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:55.806450 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:55.807788 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-90829f1b-66c6-49c4-a157-b231e4956a65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:12:55.809022 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-90829f1b-66c6-49c4-a157-b231e4956a65 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011850 Nov 02 21:12:55.809022 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Wed Nov 2 21:12:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:12:57.003766 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-8579fc6b-37b3-4a22-99e3-159878bdc58c admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:57.004774 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-8579fc6b-37b3-4a22-99e3-159878bdc58c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 02 21:12:57.005208 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:12:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:57.529826 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-735acda4-5946-4e5b-a7d8-ea20a07022d8 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:57.535567 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.wsgi [None req-735acda4-5946-4e5b-a7d8-ea20a07022d8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-735acda4-5946-4e5b-a7d8-ea20a07022d8 admin admin] Request method failure captured: Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: Accept: application/json Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: Accept-Encoding: gzip, deflate Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: Connection: keep-alive Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: Content-Length: 0 Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: Host: 10.222.0.25 Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: Openstack-Api-Version: compute 2.92 Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: Openstack-System-Scope: None Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: User-Agent: python-novaclient Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Auth-Token: gAAAAABjYt1YY1VyeX7ZqHwHdYwC_Xng9SwRa2JRae4dzZXgp91CWjPdlsiqUPSdPhJCGAqV1bzpDl4WzTtrTpoyST6RfFELDg3eTtvp3PQ1kdb5w9Q7Rtmm48WLfAVo6UPrDZEITMix0j4tafTqY29U6Bovq7_BQmV6PcqBF6QMwYZvu76BstU Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Domain-Id: None Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Domain-Name: None Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Identity-Status: Confirmed Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Is-Admin-Project: True Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Domain-Id: default Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Domain-Name: Default Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Project-Name: admin Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Role: member,admin,reader Nov 02 21:12:57.537093 n-d-860863-4 devstack@n-api.service[105158]: X-Roles: member,admin,reader Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16180e4161dd405aad09648ec8c4da20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant: admin Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-Tenant-Name: admin Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-User: admin Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-User-Domain-Id: default Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-User-Domain-Name: Default Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-User-Id: da6c176786ca4e38a671cbdf0a8bd06f Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: X-User-Name: admin Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: method: > Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: exception: Flavor 451 could not be found. Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: action_args: {'id': '451'} Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:12:57.538465 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:57.539368 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.540400 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-735acda4-5946-4e5b-a7d8-ea20a07022d8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:12:57.541455 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-735acda4-5946-4e5b-a7d8-ea20a07022d8 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394369 Nov 02 21:12:57.541455 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 21:12:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:12:57.548008 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-4f7440ab-7ba8-469e-ae79-88d1e45e0a47 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:57.563568 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-4f7440ab-7ba8-469e-ae79-88d1e45e0a47 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019159 Nov 02 21:12:57.564087 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 21:12:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:12:57.573387 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:57.588531 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018623 Nov 02 21:12:57.589085 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Wed Nov 2 21:12:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:12:57.598561 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-498e5f57-6d38-41cb-8c7e-d96f582fcbe7 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:57.603394 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.wsgi [None req-498e5f57-6d38-41cb-8c7e-d96f582fcbe7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-498e5f57-6d38-41cb-8c7e-d96f582fcbe7 admin admin] Request method failure captured: Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: Accept: application/json Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: Accept-Encoding: gzip, deflate Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: Connection: keep-alive Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: Content-Length: 0 Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: Host: 10.222.0.25 Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: Openstack-Api-Version: compute 2.92 Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: Openstack-System-Scope: None Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: User-Agent: python-novaclient Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Auth-Token: gAAAAABjYt1YY1VyeX7ZqHwHdYwC_Xng9SwRa2JRae4dzZXgp91CWjPdlsiqUPSdPhJCGAqV1bzpDl4WzTtrTpoyST6RfFELDg3eTtvp3PQ1kdb5w9Q7Rtmm48WLfAVo6UPrDZEITMix0j4tafTqY29U6Bovq7_BQmV6PcqBF6QMwYZvu76BstU Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Domain-Id: None Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Domain-Name: None Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Identity-Status: Confirmed Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Is-Admin-Project: True Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Domain-Id: default Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Domain-Name: Default Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Project-Name: admin Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Role: member,admin,reader Nov 02 21:12:57.604921 n-d-860863-4 devstack@n-api.service[105157]: X-Roles: member,admin,reader Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16180e4161dd405aad09648ec8c4da20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16180e4161dd405aad09648ec8c4da20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant: admin Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant-Id: 16180e4161dd405aad09648ec8c4da20 Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-Tenant-Name: admin Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-User: admin Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-User-Domain-Id: default Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-User-Domain-Name: Default Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-User-Id: da6c176786ca4e38a671cbdf0a8bd06f Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: X-User-Name: admin Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: method: > Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: exception: Flavor 451 could not be found. Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: action_args: {'id': '451'} Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:12:57.606558 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:57.607939 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: ERROR nova.api.openstack.wsgi Nov 02 21:12:57.609137 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-498e5f57-6d38-41cb-8c7e-d96f582fcbe7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:12:57.610391 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-498e5f57-6d38-41cb-8c7e-d96f582fcbe7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011393 Nov 02 21:12:57.610391 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 21:12:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:12:58.807653 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:12:58.808662 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 02 21:12:58.809090 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:12:59.326493 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-3f7fe522-0e4b-408e-a571-519e8b6afb74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:12:59.400189 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-3f7fe522-0e4b-408e-a571-519e8b6afb74 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.452776 Nov 02 21:12:59.400748 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 21:12:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:13:00.607860 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:13:00.608897 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Nov 02 21:13:00.609329 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:13:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:13:01.126856 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-1275f398-d660-49d1-92ce-3082f82e462f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:13:01.211860 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-1275f398-d660-49d1-92ce-3082f82e462f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.465957 Nov 02 21:13:01.212429 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 21:13:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:13:02.415579 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:13:02.416579 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Nov 02 21:13:02.416999 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:13:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:13:02.940267 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-8f3aecc7-44bd-4ce4-b0ae-fc589c0c5ec5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:13:03.023094 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-8f3aecc7-44bd-4ce4-b0ae-fc589c0c5ec5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.468600 Nov 02 21:13:03.023663 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 21:13:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:13:04.238248 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:13:04.239250 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Nov 02 21:13:04.239665 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:13:04.752892 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-394ed5db-e384-4dc1-afac-5de6ffc82ebc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:13:04.843521 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-394ed5db-e384-4dc1-afac-5de6ffc82ebc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.467884 Nov 02 21:13:04.844077 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Wed Nov 2 21:13:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:13:06.050623 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:13:06.051623 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Nov 02 21:13:06.052015 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:13:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:13:06.568916 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-3b0858c8-e44a-4bc4-92bf-0fb81047213e admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:13:06.589286 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-3b0858c8-e44a-4bc4-92bf-0fb81047213e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402177 Nov 02 21:13:06.589817 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Nov 2 21:13:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:14:03.276705 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:14:03.278233 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-d36ad6ac-7c93-4b96-a479-5cc6b559367e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Nov 02 21:14:03.278609 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Wed Nov 2 21:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:14:03.289189 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:14:03.670187 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-5f903068-9c5e-49d5-b3d8-1984c9aec07c admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:14:03.690381 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-5f903068-9c5e-49d5-b3d8-1984c9aec07c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405639 Nov 02 21:14:03.690923 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:14:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:14:03.712253 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_api:SELECT=14 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:14:03.716595 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-698765e8-7d22-409d-83fc-c92eb54a1ef7 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:14:03.724860 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-698765e8-7d22-409d-83fc-c92eb54a1ef7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012918 Nov 02 21:14:03.724860 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Nov 2 21:14:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:14:03.735778 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-ca40c2a7-cb54-48d6-a6ea-d871af246e43 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:14:03.743311 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-ca40c2a7-cb54-48d6-a6ea-d871af246e43 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011099 Nov 02 21:14:03.743826 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Nov 2 21:14:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:14:03.755140 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-cd734a7b-8f62-4676-91f2-b50bc13c3b66 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:14:03.763244 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-cd734a7b-8f62-4676-91f2-b50bc13c3b66 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011552 Nov 02 21:14:03.763763 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Nov 2 21:14:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:14:03.774677 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-19b233db-43cc-473f-9f0d-7eae0c4026c0 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:14:03.782358 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-19b233db-43cc-473f-9f0d-7eae0c4026c0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011091 Nov 02 21:14:03.782869 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Nov 2 21:14:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:19:45.714029 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-cd734a7b-8f62-4676-91f2-b50bc13c3b66 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:19:45.715074 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-cd734a7b-8f62-4676-91f2-b50bc13c3b66 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Nov 02 21:19:45.715476 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:19:45.858395 n-d-860863-4 devstack@n-api.service[105157]: DEBUG dbcounter [-] [105157] Writing DB stats nova_api:SELECT=6 {{(pid=105157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:19:46.002847 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:19:46.007601 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:19:46.008063 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:19:46.008495 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:19:46.009246 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:19:46.009698 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:19:46.010119 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:19:46.055838 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-d706b675-fd1e-4ea5-9725-b2c65a603b6b admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.199201 Nov 02 21:19:46.056419 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 21:19:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:19:47.118020 n-d-860863-4 devstack@n-api.service[105158]: DEBUG nova.api.openstack.wsgi [None req-cd734a7b-8f62-4676-91f2-b50bc13c3b66 admin admin] Calling method '>' {{(pid=105158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:19:47.119034 n-d-860863-4 devstack@n-api.service[105158]: INFO nova.api.openstack.requestlog [None req-cd734a7b-8f62-4676-91f2-b50bc13c3b66 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001729 Nov 02 21:19:47.119432 n-d-860863-4 devstack@n-api.service[105158]: [pid: 105158|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Wed Nov 2 21:19:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:19:47.306010 n-d-860863-4 devstack@n-api.service[105157]: DEBUG nova.api.openstack.wsgi [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] Calling method '>' {{(pid=105157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:19:47.309490 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:19:47.309965 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:19:47.310899 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:19:47.311616 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:19:47.312063 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:19:47.312476 n-d-860863-4 devstack@n-api.service[105157]: DEBUG oslo_concurrency.lockutils [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:19:47.336500 n-d-860863-4 devstack@n-api.service[105157]: INFO nova.api.openstack.requestlog [None req-273c8368-d05d-4e76-96a8-a7dcbe335d92 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.081234 Nov 02 21:19:47.337081 n-d-860863-4 devstack@n-api.service[105157]: [pid: 105157|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 21:19:47 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:20:31.732798 n-d-860863-4 devstack@n-api.service[105143]: Wed Nov 2 21:20:31 2022 - graceful shutdown triggered... Nov 02 21:20:31.733500 n-d-860863-4 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 21:20:31.734621 n-d-860863-4 devstack@n-api.service[105157]: Gracefully killing worker 1 (pid: 105157)... Nov 02 21:20:31.735055 n-d-860863-4 devstack@n-api.service[105158]: Gracefully killing worker 2 (pid: 105158)... Nov 02 21:20:31.860232 n-d-860863-4 devstack@n-api.service[105158]: DEBUG dbcounter [-] [105158] Writing DB stats nova_api:SELECT=4 {{(pid=105158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:20:32.735698 n-d-860863-4 devstack@n-api.service[105143]: worker 1 buried after 1 seconds Nov 02 21:20:32.735698 n-d-860863-4 devstack@n-api.service[105143]: worker 2 buried after 1 seconds Nov 02 21:20:32.735698 n-d-860863-4 devstack@n-api.service[105143]: goodbye to uWSGI. Nov 02 21:20:32.737402 n-d-860863-4 systemd[1]: devstack@n-api.service: Succeeded. Nov 02 21:20:32.737956 n-d-860863-4 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 21:20:32.740666 n-d-860863-4 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 21:20:32.763092 n-d-860863-4 devstack@n-api.service[121027]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 21:20:32 2022] *** Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: nodename: n-d-860863-4 Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: machine: x86_64 Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: clock source: unix Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: pcre jit disabled Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: detected number of CPU cores: 4 Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: current working directory: / Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: detected binary path: /usr/bin/uwsgi-core Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: your processes number limit is 47680 Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: your memory page size is 4096 bytes Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: detected max file descriptor number: 2048 Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: lock engine: pthread robust mutexes Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: thunder lock: enabled Nov 02 21:20:32.784490 n-d-860863-4 devstack@n-api.service[121027]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 21:20:32.785711 n-d-860863-4 devstack@n-api.service[121027]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 21:20:32.824077 n-d-860863-4 devstack@n-api.service[121027]: Python main interpreter initialized at 0x55883e9d09c0 Nov 02 21:20:32.824077 n-d-860863-4 devstack@n-api.service[121027]: python threads support enabled Nov 02 21:20:32.824077 n-d-860863-4 devstack@n-api.service[121027]: your server socket listen backlog is limited to 100 connections Nov 02 21:20:32.824077 n-d-860863-4 devstack@n-api.service[121027]: your mercy for graceful operations on workers is 90 seconds Nov 02 21:20:32.824549 n-d-860863-4 devstack@n-api.service[121027]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 21:20:32.824549 n-d-860863-4 devstack@n-api.service[121027]: *** Operational MODE: preforking *** Nov 02 21:20:32.824759 n-d-860863-4 devstack@n-api.service[121027]: *** uWSGI is running in multiple interpreter mode *** Nov 02 21:20:32.824759 n-d-860863-4 devstack@n-api.service[121027]: spawned uWSGI master process (pid: 121027) Nov 02 21:20:32.824993 n-d-860863-4 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 21:20:32.826209 n-d-860863-4 devstack@n-api.service[121027]: spawned uWSGI worker 1 (pid: 121039, cores: 1) Nov 02 21:20:32.826209 n-d-860863-4 devstack@n-api.service[121027]: spawned uWSGI worker 2 (pid: 121040, cores: 1) Nov 02 21:20:32.826209 n-d-860863-4 devstack@n-api.service[121027]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 21:20:33.491608 n-d-860863-4 devstack@n-api.service[121039]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 21:20:33.498676 n-d-860863-4 devstack@n-api.service[121040]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 21:20:34.761975 n-d-860863-4 devstack@n-api.service[121039]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:20:34.761975 n-d-860863-4 devstack@n-api.service[121039]: from cryptography.utils import int_from_bytes Nov 02 21:20:34.762618 n-d-860863-4 devstack@n-api.service[121039]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:20:34.762618 n-d-860863-4 devstack@n-api.service[121039]: from cryptography.utils import int_from_bytes Nov 02 21:20:34.762842 n-d-860863-4 devstack@n-api.service[121040]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:20:34.762842 n-d-860863-4 devstack@n-api.service[121040]: from cryptography.utils import int_from_bytes Nov 02 21:20:34.763274 n-d-860863-4 devstack@n-api.service[121040]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 21:20:34.763274 n-d-860863-4 devstack@n-api.service[121040]: from cryptography.utils import int_from_bytes Nov 02 21:20:37.245610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 21:20:37.246291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 21:20:37.246387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 21:20:37.246747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 21:20:37.247000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 21:20:37.247380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.247707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.248024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.249061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.249419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.249725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.250044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.250365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.250692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.250952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.251265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.251589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-4 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.251963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.252220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.252533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.252899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.253241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.253607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.253927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.254553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.254999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.255308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.255659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.255956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.256271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.256581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.257139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.257469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.257796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.258207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.258664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-4 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.258932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.259245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.259563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.259983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.260294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.260604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.261123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.261451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.261760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.262135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.262901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.263268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.263611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.264008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.264339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.264948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.265336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.265650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.265956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.266209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.266533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.266839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.267160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.267481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.267736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.267986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.268300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.268618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.268983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.269251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.269557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.269862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.270167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.270470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.270773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.271077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.271396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.271709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.272029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.272336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.272654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.273073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.273326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.273636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.273973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.274289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.274596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.274912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.275230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.275534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.275839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.276142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.276459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.276792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.277115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.277368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.277668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.277974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.278295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.278602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.278905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.279209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.279524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.280051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.280303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.280614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.280942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.281302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.281609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.281915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.282511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.282827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.283131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.283449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.283770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.284143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.284450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.284811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.285135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.285468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.285638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 21:20:37.286115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 21:20:37.286263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.286263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.286565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 21:20:37.286730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.286887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 21:20:37.287045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.287201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 21:20:37.287359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.287514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.287719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.287719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.288002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.288168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.288316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.288472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.288646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.289934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.290089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.290240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.290396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.290569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.290720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.290874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.291030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.291177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.291324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.291485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.291651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.291808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.291962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.292116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.292272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-4 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.292488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.292667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.292910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.293096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.293244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.293402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.293566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.293733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.293888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.294046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.294203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.294368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.294518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.294665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.294810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.294810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.295093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.296150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.296315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.296485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.296642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.296642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.296959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.297134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.297285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.297431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.297586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.297778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.297939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.298095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.298095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.298408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.298563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.298721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.298885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.299041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.299041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.299318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-4 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.299470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.299633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.299781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.299935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.300083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.300237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.300405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.300562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.300712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.300857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.301037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.301185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.301340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.301498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.301653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.301812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.301960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.302105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.302272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.302421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.302567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.302712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.302866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.303131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.303303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.303460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.303616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.303770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.303927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.304089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.304244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.304403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.304561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.304716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.304865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.305101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.305263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.305411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.305566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.305713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.305860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.306017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.306164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.306311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.306479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.306634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.306792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.306949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.306949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.307228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.307336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.307432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.307536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.307639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.307739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.307826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.307912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.308010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.308123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.308212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.308307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.308395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.308488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.308604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.308693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.308780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.308877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.309014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.309110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.309212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.309324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.309407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.309493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.309586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.309673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.309769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.309857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.309951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.310046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.310134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.310218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.310318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.310318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.310492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.310492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.310659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.310758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.311420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.311420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.311574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.311728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.311824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.312091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.312196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.312384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.312562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.312723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.312871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.313072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.313323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.313485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.313642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.313798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.313953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.314116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.314273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.314443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.314592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.314739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.314900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.315047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.315202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.315352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.315498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.315645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.315801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.315950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.316096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.316251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.316430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.316586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.316743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.316905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.317086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.317246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.317404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.317562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.317719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.317998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.318161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.318309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.318463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.318630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.318786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.318943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.319110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.319334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.319599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.319760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.319909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.320071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.320220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.320366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.320366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.320664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.320664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.320985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.321138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.321297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.321297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.321585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.321748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.321903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.322051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.322224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.322454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.322617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.322784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.322942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.323090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.323246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.323498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.323661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.323826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.323982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.324130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.324291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.324449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.324605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.324759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.324944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.325109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.325276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.325432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.325580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.325725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.325880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.326040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.326188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.326334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.326557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.327268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.327440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.327617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.327617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.327899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.328094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.328242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.328405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.328564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.328712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.328867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.329080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.329242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.329491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.329765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.329944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.330095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.330250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.330398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.330557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.330712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.330862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.330862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.331141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.331296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.331453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.331610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.331769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.331917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 21:20:37.332064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.332064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.332366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.332601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.332753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.332900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.333120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.333278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.333436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.333686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.333838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.334014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.334162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.334320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.334467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.334613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.334768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.334916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.335078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.335236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.335392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.335540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.335686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.335832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.335997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.336160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.336310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.336457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.336602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.336748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.336902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.337098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.337247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.337402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.337563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.337725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.337904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.338103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.338260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.338415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.338568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.338829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.339005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.339161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.339324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.339498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.339742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.339984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.340157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.340324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.340486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.340645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.340805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.341956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.342814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.342992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.343146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.343146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.343449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.343449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.343741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.344007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.344169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.344331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.344499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.344654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.344816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.345006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.345177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.345345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.345520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.345675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.345837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.345992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.346153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.346322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.346486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.346646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.346809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.347042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.347232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.347402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.347564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.347720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.347873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.348032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.348236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.348405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.348567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.348721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.348886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.349085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.349249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.349498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.349655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.349897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.350166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.350339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.350508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.350678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.350843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.351007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.351161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.351324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.351487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.351651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.351825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.351981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.352143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.352298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.352460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.352622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.352792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.353091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.353263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.353419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.353582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.353738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.353889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.354163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.354324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.354486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.354650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.354813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.354967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.355127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.355283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.355444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.355598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.355763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.355918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.356079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.356244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.356406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.356560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.356712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.356871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.357060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.357222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.357390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.357544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.358320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.359010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.359179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.359348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.359515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.359664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.359820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.360067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.360329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.360498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.360648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.360802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.361006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.361161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.361316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.361480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.361648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.361804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.361953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.362156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.362318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.362481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.363848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.364027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.364210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.364462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.364637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.364789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.364965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.365131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.365294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.365449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.365449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.365749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.365897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.366054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.366216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.366364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.366519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.366674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.366829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.366994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.367154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.367304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.367459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.367613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.368021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.368181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.368376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.368543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.368543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.368543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.369187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.369353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.369513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.369661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.369815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.369964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.370202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.370385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.370624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.370783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.370942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.371091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.371238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.371398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.371553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.371732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.371880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.372035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.372204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.372359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.372359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.372659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.372813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.373007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.373181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.374697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.374874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.375031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.375207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.375369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.375539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.375693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.375855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.376011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.376293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.376468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.376634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.376790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.376969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.377969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.378769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.378932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.379093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.379257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.379436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.379591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.379752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.379918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.380080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.380328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.380328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.380662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.381054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.381305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.381568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.381843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.382124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.382405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.382657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.382928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.383183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.383463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.383729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.384001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.384259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.384259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.385125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.385514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.385780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.386040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.386318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.386591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.386591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.387107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.387363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.387363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.387363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.387363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.387363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.388642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.388994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.388994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.388994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.388994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.388994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.388994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.390596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.390863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.391053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.391321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.391321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.391321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.391321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.391321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.392326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.392493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.392661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.392816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.402336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.402547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.402547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.402888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.403048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.403213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.403378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.403536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.403697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.403862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.404030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.404183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.404337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.404499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.404654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.404818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.405004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.405004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.405304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.405458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.405628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.405783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.405936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.406116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.406279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.406435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.406610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.406774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.406936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.407091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.407252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.407409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.407572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.407737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.407891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.408053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.408226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.408389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.408558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.408715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.408877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.409070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.409234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.409389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.409632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.409810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.409975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.410188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.410353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.410538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.410692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.410845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.411002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.411161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.411320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.411486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.411644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.411803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.411954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.412517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.412677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.412839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.412839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.413187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.413349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.413507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.413657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.413819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.413971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.414128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.414278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.414428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.414586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.414586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.414895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.415046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.415203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.415454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.415636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.415792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.415950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.416111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.416261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.416419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.416582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.416741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.416891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.417106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.417267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.417418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.417580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.417739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.417896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.418053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.418205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.418373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.418525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.418682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.418839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.418990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.419150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.419150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.419461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.419612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.419761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.419917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.420067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.420759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.420920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.421096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.421248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.421397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.421558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.421721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.421721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.422015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.422166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.422740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.422740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.423054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.423206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.423357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.423507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.423665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.423865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.424028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.424186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.424338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.424505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.424671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.424823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.425004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.425162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.425322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.425474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.425623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.425781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.425932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.426100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.426260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.426417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.426576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.426726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.426876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.427025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.427188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.427347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.427496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.427646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.427795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.427959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.428131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.428284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.428440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.428592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.428748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.428748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.429139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.429301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.429472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.429632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.429790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.430022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.430194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.430352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.430503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.430652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.430804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.430964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.431122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.431272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.431421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.431578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.431731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.431894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.432053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.432213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.432377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.433536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.433720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.433875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.434035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.434186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.434347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.434506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.434668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.434819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.434984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.435134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.435302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.435454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.435617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.435791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.436528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.436690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.436842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.437027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.437191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.437343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.437493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.437643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.437803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.437966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.438127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.438286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.438524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.438755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.438919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.439095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.439345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.439507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.439666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.439817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.439975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.440140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.440291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.440517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.440672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.440830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.441119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.441280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.441438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.441588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.441747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.441898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.442061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.442213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.442377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.442526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.442695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.443215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.443403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.443655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.443819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.443979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.444139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.444305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.444458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.444607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.444759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.444919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.445094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.445260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.445413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.445563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.445720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.445878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.446039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.446267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.446432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.446432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.446717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.446875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.447121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.447297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.447452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.447602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.447751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.447901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.448064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.448215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.448365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.448515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.448673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.448824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.449956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.450247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.450405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.450405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.450706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.450865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.451027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.451185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.451185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.452015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.452187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.452187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.452488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.452648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.452648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.452964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.453412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.453412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.453813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.453990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.453990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.454277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.454502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.454664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.454824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.454824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.455126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.455291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.455291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.455583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.455741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.455741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.456035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.456201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.456201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.456485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.456485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.456776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.456954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.457125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.457125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.457425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.457576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.457576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.457887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.458954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.459548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.460720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.460720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.460720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.460720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.460720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.460720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.461646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.461806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.461956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.462115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.462314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.462484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.462644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.462803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.462954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.463112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.463112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.463676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.463855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.464091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.464258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.464420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.464579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.464738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.464897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.465072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.465241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.465395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.465544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.465703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.465853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.466011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.466186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.466339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.466489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.466651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.466801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.466959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.467703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.467873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.468026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.468213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.468401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.468564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.468725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.468725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.469105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.469267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.469432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.469597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.469756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.469906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.470056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.470204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.470361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.470361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.470361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.470817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.470976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.471132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.471291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.471451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.471603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.471761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.471920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.472071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.472230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.472388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.472539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.472699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.472850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.473031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.473199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.473631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.473795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.473947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.474116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.474367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.474524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.474682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.474834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.474993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.475155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.475313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.475465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.475615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.475766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.475924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.476076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.476244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.476396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.476553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.476703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.476861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.476861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.477360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.477513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.477664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.477820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.477980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.478145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.478296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.478296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.478578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.478739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.478897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.479058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.479228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.479387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.479549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.479708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.479858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.480023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.480174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.480323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.480472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.480629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.480779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.480958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.481116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.481287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.481438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.481596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.481761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.481920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.482072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.482230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.482379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.482542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.482740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.482927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.483135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.483135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.483458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.483868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.484043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.484198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.484377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.484613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.484778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.484956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.485114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.485114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.485420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.485573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.485741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.485902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.486053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.486210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.486362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.486520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.486670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.486830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.486988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.487140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.487290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.487440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.487589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.487759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.487918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.488078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.488228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.488379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.488538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.488690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.488839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.489030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.489196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.489355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.489519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.489681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.489839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.489989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.490144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.490296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.490455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.490614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.490772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.490929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.491080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.491231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.491388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.491541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.491705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.491865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.492015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.492165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.492165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.492467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.492619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.493052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.493217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.493217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.493516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.493667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.494079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.494251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.494401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.494561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.494819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.494985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.495137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.495287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.495287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.495586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.495788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.495957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.496116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.496275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.496436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.496595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.496756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.496906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.497128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.497287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.497449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.497449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.497735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.497735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.498029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.498180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.498880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.499033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.499183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.499349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.499512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.499662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.499825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.499986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.500138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.500138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.500431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.500597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.500597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.500901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.501999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.502299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.502469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.502619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.502770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.502929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.503089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.503241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.503400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.503550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.503708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.503865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.504281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.504488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.504646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.504822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.505130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.505302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.505454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.505616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.505776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.505936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.506088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.506240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.506406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.506566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.506725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.506875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.507033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.507184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.507355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.507509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.507669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.507820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.507979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.508129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.508360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.508529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.508683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.508833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.509001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.509156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.509331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.509500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.509651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.509800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.509950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.510098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.510293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.510456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.510615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.510765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.510925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.511086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.511246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.511246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.511246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.511690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.511841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.511841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.512134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.512284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.512433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.512593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.512748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.512907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.513091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.513252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.513403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.513564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.513728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.513911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.514137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.514554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.514708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.514859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.514859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.515183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.515429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.515591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.515764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.515915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.516080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.516238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.516397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.517130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.517296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.517457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.517617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.517769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.517928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.518087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.518259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.518426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.518587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.518738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.518890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.519052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.519205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.519205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.519515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.519676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.519828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.519978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.520149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.520302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.520460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.520612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.520761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.520912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.521119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.521272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.521272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.521272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.521706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.522642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.522819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.522988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.523141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.523306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.523457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.523607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.523607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.523976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.524173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.524604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.524766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.524945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.525124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.525412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.525690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.525856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.526009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.526160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.526320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.526479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.526645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.526803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.526964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.527121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.527282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.527452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.527617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.527617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.527911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.528063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.528221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.528379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.528539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.528691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.528691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.529060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.529229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.529391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.530104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.530267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.530428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.530579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.530737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.530902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.531055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.531205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.531363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.531513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.531662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.531821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.531998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.532158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.532316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.532468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.532625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.532785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.532956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.532956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.533260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.533411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.533411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.533664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.533754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.533840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.533925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.534852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.535016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.535121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.535210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.535351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.535617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.535805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.535906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.536961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.537696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.538997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.539599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.540376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.541626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.542813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.543198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.543290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.543598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.543933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.544253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.544586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.544921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.545903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.546394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.546722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.547068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.547421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.547760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.548097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.548417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.548733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.549081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.549403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.549730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.550046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.550359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.550857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.551178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.551521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.551836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.552148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.552462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.552779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.553116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.553431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.553743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.554056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.554368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.554679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.554997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.555307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.555619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.555987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.556244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.556555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.556894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.557259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.557583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.557919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.558234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.558560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.558875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.559203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.559558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.559891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.560283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.560659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.561951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.562333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.562660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.562982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.563425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.563622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.563944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.564264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.564578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.564914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.565260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.565588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.565912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.566240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.566578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.566893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.567214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.567528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.567844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.568161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.568484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.568797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.569153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.569477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.569797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.570136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.570469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.570817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.571173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.571673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.571871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.572171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.572524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.572860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.573210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.573530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.573844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 21:20:37.574094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 21:20:37.580777 n-d-860863-4 devstack@n-api.service[121040]: INFO dbcounter [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Registered counter for database nova_api Nov 02 21:20:37.604167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.611224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:37.637647 n-d-860863-4 devstack@n-api.service[121039]: INFO dbcounter [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Registered counter for database nova_api Nov 02 21:20:37.658237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_db.sqlalchemy.engines [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.665314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writer thread running {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:37.669320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.context [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=121040) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 21:20:37.673572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:20:37.674048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:20:37.675737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:20:37.676470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:20:37.676911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:20:37.678933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:20:37.680970 n-d-860863-4 devstack@n-api.service[121040]: INFO dbcounter [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Registered counter for database nova_cell0 Nov 02 21:20:37.685154 n-d-860863-4 devstack@n-api.service[121040]: INFO dbcounter [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Registered counter for database nova_cell1 Nov 02 21:20:37.693217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.695588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.699494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:37.723644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.context [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=121039) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 21:20:37.727685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:20:37.728156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:20:37.729769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:20:37.730496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:20:37.730936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:20:37.733571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:20:37.735584 n-d-860863-4 devstack@n-api.service[121039]: INFO dbcounter [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Registered counter for database nova_cell0 Nov 02 21:20:37.739858 n-d-860863-4 devstack@n-api.service[121039]: INFO dbcounter [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Registered counter for database nova_cell1 Nov 02 21:20:37.747781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_db.sqlalchemy.engines [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.750650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_db.sqlalchemy.engines [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.758392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writer thread running {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:37.758732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writer thread running {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:37.843302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:37.854035 n-d-860863-4 devstack@n-api.service[121040]: INFO dbcounter [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Registered counter for database nova_cell0 Nov 02 21:20:37.862171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.866890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:37.912675 n-d-860863-4 devstack@n-api.service[121039]: INFO dbcounter [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Registered counter for database nova_cell0 Nov 02 21:20:37.921596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_db.sqlalchemy.engines [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 21:20:37.926295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writer thread running {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 21:20:38.184549 n-d-860863-4 devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:20:38.192448 n-d-860863-4 devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:20:38.249843 n-d-860863-4 devstack@n-api.service[121039]: WARNING keystonemiddleware.auth_token [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:20:38.257222 n-d-860863-4 devstack@n-api.service[121039]: WARNING keystonemiddleware.auth_token [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:20:38.539047 n-d-860863-4 devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:20:38.545097 n-d-860863-4 devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-f1f18169-4004-4629-b864-7cca473bfddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:20:38.550959 n-d-860863-4 devstack@n-api.service[121040]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55883e9d09c0 pid: 121040 (default app) Nov 02 21:20:38.610978 n-d-860863-4 devstack@n-api.service[121039]: WARNING keystonemiddleware.auth_token [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 21:20:38.617127 n-d-860863-4 devstack@n-api.service[121039]: WARNING keystonemiddleware.auth_token [None req-2b1855fc-4b08-40bf-9e69-cffc7e65c574 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 21:20:38.622520 n-d-860863-4 devstack@n-api.service[121039]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55883e9d09c0 pid: 121039 (default app) Nov 02 21:21:20.891312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:20.891312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:20.891312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:20.891312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:21.220974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:21.223938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:21.225690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:21.228996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:22.379952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:22.381428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:22.381909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:22.382346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:22.383220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:22.383586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:22.384166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:22.433231 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a022c2e3-4b7a-4310-a9ba-b68c6c291d01 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.698982 Nov 02 21:21:22.434115 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1/1] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 21:21:20 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:22.820521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Calling method '.version_select at 0x7f9b6a889820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:22.829938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:22.830660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:22.831259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:22.832155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:22.838748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:22.838748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:22.885496 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cace0282-75fb-45de-81db-5b8272fc668b tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.449899 Nov 02 21:21:22.886850 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 21:21:22 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:22.931046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44b3a2a1-731d-4be6-91dc-a6eac28381c4 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1726440468", "id": 1303421548, "os-flavor-access:is_public": "True"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:23.073936 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44b3a2a1-731d-4be6-91dc-a6eac28381c4 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.869372 Nov 02 21:21:23.084409 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1/3] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:21:21 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:21:23.089544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:23.089770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:23.092422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:23.092919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:23.095563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:23.095668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:23.095756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:23.095834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:23.095930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:23.095930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:23.096072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:23.097397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:23.101788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:23.102465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:23.135334 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28df68ec-a81c-4955-b7f7-28af363c150e tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.247066 Nov 02 21:21:23.141976 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:21:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:23.169808 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-95a369ca-2188-4745-8129-1b2e05dc2750 tempest-AZAdminV2TestJSON-475801334 tempest-AZAdminV2TestJSON-475801334-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.083724 Nov 02 21:21:23.170809 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2/5] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 21:21:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:23.226616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '.version_select at 0x7f9b6a8baca0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:23.239278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=121040) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 21:21:23.240323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:23.241077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:23.241721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:23.302425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:23.302863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:23.303292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:23.329880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:23.330628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:23.351237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:23.351237 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fcd41c14-8dc6-4323-9939-d2b7ecf15a55 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.194509 Nov 02 21:21:23.352112 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 21:21:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:23.361794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-474d6cfd-d772-4e87-b7bf-56c8faf2ca3a tempest-AZAdminNegativeTestJSON-464308124 tempest-AZAdminNegativeTestJSON-464308124-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:23.363777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-474d6cfd-d772-4e87-b7bf-56c8faf2ca3a tempest-AZAdminNegativeTestJSON-464308124 tempest-AZAdminNegativeTestJSON-464308124-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2278081a6f4243a0acae2ed40fec11b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4c42dd69914630aaa5bc11a8135c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-474d6cfd-d772-4e87-b7bf-56c8faf2ca3a tempest-AZAdminNegativeTestJSON-464308124 tempest-AZAdminNegativeTestJSON-464308124-project] Request method failure captured: Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9PYGPy94IhTPtge3bUg40pDLrMQigqj6yTRM9rTcugvAf1zqC0GvpAXgEgdBKhWPowtjEhLsPyBLqI0bQrMiOwUL62R5WO44kTh22rbTJVRIsehwM8kKJO3LFpZDkokCSfGceN8DJyrNZmMtJhX5KqUZbacAm7tos9fdhSKY2Xg2M Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 5c4c42dd69914630aaa5bc11a8135c6e Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AZAdminNegativeTestJSON-464308124 Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:23.371991 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5c4c42dd69914630aaa5bc11a8135c6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c4c42dd69914630aaa5bc11a8135c6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5c4c42dd69914630aaa5bc11a8135c6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5c4c42dd69914630aaa5bc11a8135c6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AZAdminNegativeTestJSON-464308124 Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 5c4c42dd69914630aaa5bc11a8135c6e Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-464308124 Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AZAdminNegativeTestJSON-464308124-project Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 2278081a6f4243a0acae2ed40fec11b6 Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AZAdminNegativeTestJSON-464308124-project Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 21:21:23.373981 n-d-860863-4 devstack@n-api.service[121039]: action_args: {} Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:23.374644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 21:21:23.375506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.377900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-474d6cfd-d772-4e87-b7bf-56c8faf2ca3a tempest-AZAdminNegativeTestJSON-464308124 tempest-AZAdminNegativeTestJSON-464308124-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:23.378946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-474d6cfd-d772-4e87-b7bf-56c8faf2ca3a tempest-AZAdminNegativeTestJSON-464308124 tempest-AZAdminNegativeTestJSON-464308124-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.207202 Nov 02 21:21:23.379663 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 21:21:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 208 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:23.385844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3399da36-ce37-4065-822d-d01bf70addb5 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:23.483052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f574f383-6b47-41e1-949a-c7a4ebfe08b6 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Calling method '.version_select at 0x7f9b6a865430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:23.487347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f574f383-6b47-41e1-949a-c7a4ebfe08b6 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a73c111e57964da19b19c75b5a9485e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e8ce285f434ee2a4c05401598a602c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f574f383-6b47-41e1-949a-c7a4ebfe08b6 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Request method failure captured: Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OVv2wxbAejNgXlVIoaUkW2N4layiLa30AQskHRxaxcVqoOWhsLp1J3-preq13KFZ_qonYwOuonXIAt41dEXX8hk27Ad5eCI_VYEm2n6k5lnCVyIE7pAFAQqQrtZ94y5GN2OY23aI60znazEY1788MJ5Adh0Z_VOm_KkYltlEVNTM Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:23.490985 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: a73c111e57964da19b19c75b5a9485e9 Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: action_args: {} Nov 02 21:21:23.492046 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:23.493722 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 21:21:23.505180 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.506886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f574f383-6b47-41e1-949a-c7a4ebfe08b6 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:23.506886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f574f383-6b47-41e1-949a-c7a4ebfe08b6 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.142005 Nov 02 21:21:23.508343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 21:21:23 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 155 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:23.742970 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3399da36-ce37-4065-822d-d01bf70addb5 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1303421548/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.362204 Nov 02 21:21:23.743848 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 4/9] 10.222.0.25 () {62 vars in 1265 bytes} [Wed Nov 2 21:21:23 2022] POST /compute/v2.1/flavors/1303421548/os-extra_specs => generated 62 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:23.755514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f9d73b2-3d0e-4406-bc54-14552e14ee86 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-214765462"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:23.759074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-2f9d73b2-3d0e-4406-bc54-14552e14ee86 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid 1ddff423-1c0c-49e3-bc98-3267e9525f27 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:23.974080 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f9d73b2-3d0e-4406-bc54-14552e14ee86 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.226805 Nov 02 21:21:23.974700 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 5/10] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:23.979595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e0e1276-317e-4e2a-a329-4d5169de2497 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1701720209", "ram": 512, "vcpus": 1, "disk": 10, "id": 1495119503, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:23.985849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a99a0c39-fa1a-462e-9971-7ab2871aea56 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Calling method '.version_select at 0x7f9b6a7624c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:23.990405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a99a0c39-fa1a-462e-9971-7ab2871aea56 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a73c111e57964da19b19c75b5a9485e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e8ce285f434ee2a4c05401598a602c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a99a0c39-fa1a-462e-9971-7ab2871aea56 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Request method failure captured: Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-hosts/n-d-860863-4/reboot HTTP/1.1 Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9OVv2wxbAejNgXlVIoaUkW2N4layiLa30AQskHRxaxcVqoOWhsLp1J3-preq13KFZ_qonYwOuonXIAt41dEXX8hk27Ad5eCI_VYEm2n6k5lnCVyIE7pAFAQqQrtZ94y5GN2OY23aI60znazEY1788MJ5Adh0Z_VOm_KkYltlEVNTM Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:23.994854 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: a73c111e57964da19b19c75b5a9485e9 Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'n-d-860863-4'} Nov 02 21:21:23.996091 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:23.996823 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 21:21:23.998443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.006549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a99a0c39-fa1a-462e-9971-7ab2871aea56 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:24.011840 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a99a0c39-fa1a-462e-9971-7ab2871aea56 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-860863-4/reboot" status: 403 len: 111 microversion: 2.1 time: 0.036209 Nov 02 21:21:24.019163 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Nov 2 21:21:23 2022] GET /compute/v2.1/os-hosts/n-d-860863-4/reboot => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:24.027397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-13afded5-d246-45de-9165-5ced45cc1242 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.178502 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e0e1276-317e-4e2a-a329-4d5169de2497 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.666405 Nov 02 21:21:24.187059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-13afded5-d246-45de-9165-5ced45cc1242 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1303421548" status: 202 len: 0 microversion: 2.86 time: 0.166346 Nov 02 21:21:24.187815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 7/12] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Nov 2 21:21:24 2022] DELETE /compute/v2.1/flavors/1303421548 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:21:24.202929 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 6/13] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:23 2022] POST /compute/v2.1/flavors => generated 416 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:24.203096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-39b92583-5643-4359-9c82-a57ec67a258f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:24.211553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1075bc22-9309-43e7-97e6-75f86de2942f tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Calling method '.version_select at 0x7f9b6a865280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.245489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39b92583-5643-4359-9c82-a57ec67a258f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:24.246359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39b92583-5643-4359-9c82-a57ec67a258f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:24.247142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39b92583-5643-4359-9c82-a57ec67a258f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:24.275195 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-1075bc22-9309-43e7-97e6-75f86de2942f tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1075bc22-9309-43e7-97e6-75f86de2942f tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:24.288913 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'nonexistent_hostname'} Nov 02 21:21:24.290691 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:24.291320 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 21:21:24.292289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.294626 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.300857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1075bc22-9309-43e7-97e6-75f86de2942f tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:24.302643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1075bc22-9309-43e7-97e6-75f86de2942f tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.103657 Nov 02 21:21:24.308906 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1212 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:24.324815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-416dbfbf-8d5a-47fc-91d7-c72eb5580922 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.401819 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-416dbfbf-8d5a-47fc-91d7-c72eb5580922 tempest-FlavorMetadataValidation-1229678621 tempest-FlavorMetadataValidation-1229678621-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.86 time: 0.089707 Nov 02 21:21:24.402396 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 8/15] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:21:24.408521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58aa8d8a-0390-409a-aa5e-7822f6b3a806 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:24.552020 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58aa8d8a-0390-409a-aa5e-7822f6b3a806 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1495119503/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.147702 Nov 02 21:21:24.552620 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 9/16] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 21:21:24 2022] POST /compute/v2.1/flavors/1495119503/os-extra_specs => generated 66 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:24.557250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-003755ed-e16f-455d-bfd0-37030c29b177 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Calling method '.version_select at 0x7f9b6a6a2af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.559267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-003755ed-e16f-455d-bfd0-37030c29b177 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a73c111e57964da19b19c75b5a9485e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e8ce285f434ee2a4c05401598a602c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-003755ed-e16f-455d-bfd0-37030c29b177 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Request method failure captured: Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts/n-d-860863-4 HTTP/1.1 Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OVv2wxbAejNgXlVIoaUkW2N4layiLa30AQskHRxaxcVqoOWhsLp1J3-preq13KFZ_qonYwOuonXIAt41dEXX8hk27Ad5eCI_VYEm2n6k5lnCVyIE7pAFAQqQrtZ94y5GN2OY23aI60znazEY1788MJ5Adh0Z_VOm_KkYltlEVNTM Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:24.561237 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: a73c111e57964da19b19c75b5a9485e9 Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'n-d-860863-4'} Nov 02 21:21:24.562389 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:24.562997 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 21:21:24.564004 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.566368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-003755ed-e16f-455d-bfd0-37030c29b177 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:24.567330 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-003755ed-e16f-455d-bfd0-37030c29b177 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-860863-4" status: 403 len: 109 microversion: 2.1 time: 0.013769 Nov 02 21:21:24.568479 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 10/17] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/os-hosts/n-d-860863-4 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:24.808373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7fa1ec8-328b-4d82-b07c-be3a6e82aa9e tempest-FlavorsExtraSpecsTestJSON-1037532743 tempest-FlavorsExtraSpecsTestJSON-1037532743-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.831664 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7fa1ec8-328b-4d82-b07c-be3a6e82aa9e tempest-FlavorsExtraSpecsTestJSON-1037532743 tempest-FlavorsExtraSpecsTestJSON-1037532743-project] 10.222.0.25 "GET /compute/v2.1/flavors/1495119503/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.261652 Nov 02 21:21:24.832646 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 11/18] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/flavors/1495119503/os-extra_specs => generated 66 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:24.837403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44cc8068-4f75-4a98-a511-3253802e7430 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Calling method '.version_select at 0x7f9b6a64a700>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.849957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-44cc8068-4f75-4a98-a511-3253802e7430 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44cc8068-4f75-4a98-a511-3253802e7430 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:24.851723 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'nonexistent_hostname'} Nov 02 21:21:24.852756 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.853715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:24.854600 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.855451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44cc8068-4f75-4a98-a511-3253802e7430 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:24.855451 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44cc8068-4f75-4a98-a511-3253802e7430 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021119 Nov 02 21:21:24.856010 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 12/19] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:24.865576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7439db2f-e61e-4b55-81b4-1a8370922b61 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:24.905281 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7439db2f-e61e-4b55-81b4-1a8370922b61 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1495119503/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043718 Nov 02 21:21:24.906400 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 13/20] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 21:21:24 2022] POST /compute/v2.1/flavors/1495119503/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:24.917941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e66b1024-ce8d-410b-956b-ce1df7ac2ed8 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Calling method '.version_select at 0x7f9b6a69a160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.925678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e66b1024-ce8d-410b-956b-ce1df7ac2ed8 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a73c111e57964da19b19c75b5a9485e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e8ce285f434ee2a4c05401598a602c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e66b1024-ce8d-410b-956b-ce1df7ac2ed8 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Request method failure captured: Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts/n-d-860863-4/shutdown HTTP/1.1 Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OVv2wxbAejNgXlVIoaUkW2N4layiLa30AQskHRxaxcVqoOWhsLp1J3-preq13KFZ_qonYwOuonXIAt41dEXX8hk27Ad5eCI_VYEm2n6k5lnCVyIE7pAFAQqQrtZ94y5GN2OY23aI60znazEY1788MJ5Adh0Z_VOm_KkYltlEVNTM Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:24.930435 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: a73c111e57964da19b19c75b5a9485e9 Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'n-d-860863-4'} Nov 02 21:21:24.931940 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:24.932713 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 21:21:24.933912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:24.935770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e66b1024-ce8d-410b-956b-ce1df7ac2ed8 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:24.936347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e66b1024-ce8d-410b-956b-ce1df7ac2ed8 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-860863-4/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.022708 Nov 02 21:21:24.937300 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 14/21] 10.222.0.25 () {58 vars in 1194 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/os-hosts/n-d-860863-4/shutdown => generated 113 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:24.943948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3cbc77f3-a3a8-4279-9e2d-32330b14562b tempest-FlavorsExtraSpecsTestJSON-1037532743 tempest-FlavorsExtraSpecsTestJSON-1037532743-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:24.957400 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3cbc77f3-a3a8-4279-9e2d-32330b14562b tempest-FlavorsExtraSpecsTestJSON-1037532743 tempest-FlavorsExtraSpecsTestJSON-1037532743-project] 10.222.0.25 "GET /compute/v2.1/flavors/1495119503/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018099 Nov 02 21:21:24.959508 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 15/22] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/flavors/1495119503/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:24.976444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bd15d5c-79f4-4a92-a7fb-b7b42f321b35 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Calling method '.version_select at 0x7f9b6a669790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.001850 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3bd15d5c-79f4-4a92-a7fb-b7b42f321b35 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bd15d5c-79f4-4a92-a7fb-b7b42f321b35 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:25.004469 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'nonexistent_hostname'} Nov 02 21:21:25.011229 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:25.012474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 21:21:25.013976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.015207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bd15d5c-79f4-4a92-a7fb-b7b42f321b35 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.017715 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3bd15d5c-79f4-4a92-a7fb-b7b42f321b35 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.049565 Nov 02 21:21:25.018501 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 16/23] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:21:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:25.025067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5631597c-dada-45b3-9f5e-17f35a0dd71b tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.062901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5631597c-dada-45b3-9f5e-17f35a0dd71b tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1495119503/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042572 Nov 02 21:21:25.064115 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 17/24] 10.222.0.25 () {60 vars in 1224 bytes} [Wed Nov 2 21:21:25 2022] POST /compute/v2.1/flavors/1495119503/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:25.073175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f45efe51-42cd-46ee-b167-dbb7e8429704 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Calling method '.version_select at 0x7f9b6a64a550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.075210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f45efe51-42cd-46ee-b167-dbb7e8429704 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a73c111e57964da19b19c75b5a9485e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e8ce285f434ee2a4c05401598a602c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f45efe51-42cd-46ee-b167-dbb7e8429704 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Request method failure captured: Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts/n-d-860863-4/startup HTTP/1.1 Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OVv2wxbAejNgXlVIoaUkW2N4layiLa30AQskHRxaxcVqoOWhsLp1J3-preq13KFZ_qonYwOuonXIAt41dEXX8hk27Ad5eCI_VYEm2n6k5lnCVyIE7pAFAQqQrtZ94y5GN2OY23aI60znazEY1788MJ5Adh0Z_VOm_KkYltlEVNTM Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:25.077450 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: a73c111e57964da19b19c75b5a9485e9 Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'n-d-860863-4'} Nov 02 21:21:25.078606 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:25.079343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 21:21:25.080949 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.087426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f45efe51-42cd-46ee-b167-dbb7e8429704 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.087426 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f45efe51-42cd-46ee-b167-dbb7e8429704 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-d-860863-4/startup" status: 403 len: 110 microversion: 2.1 time: 0.017728 Nov 02 21:21:25.087426 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 18/25] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 21:21:25 2022] GET /compute/v2.1/os-hosts/n-d-860863-4/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:25.092695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-867f67da-e19d-4eae-96d8-a502bfe321dc tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.109014 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-867f67da-e19d-4eae-96d8-a502bfe321dc tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1495119503/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022428 Nov 02 21:21:25.109014 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 19/26] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 21:21:25 2022] GET /compute/v2.1/flavors/1495119503/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:25.116518 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-39b92583-5643-4359-9c82-a57ec67a258f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.927610 Nov 02 21:21:25.117516 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 8/27] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:21:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:25.128894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24ca5f4d-a1c9-406e-8476-9ae46b18779a tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.130192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-456e6749-2bc7-42e6-97af-205521f988c2 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Calling method '.version_select at 0x7f9b6a831dc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.144177 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-456e6749-2bc7-42e6-97af-205521f988c2 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-456e6749-2bc7-42e6-97af-205521f988c2 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:25.146476 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'nonexistent_hostname'} Nov 02 21:21:25.147538 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:25.148168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 21:21:25.149416 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.150779 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.153531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-456e6749-2bc7-42e6-97af-205521f988c2 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.155513 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-456e6749-2bc7-42e6-97af-205521f988c2 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.044435 Nov 02 21:21:25.156669 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 20/28] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 21:21:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:25.165014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.202629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:25.203142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:25.204343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:25.271575 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24ca5f4d-a1c9-406e-8476-9ae46b18779a tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1495119503/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.150995 Nov 02 21:21:25.276446 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 9/29] 10.222.0.25 () {60 vars in 1265 bytes} [Wed Nov 2 21:21:25 2022] PUT /compute/v2.1/flavors/1495119503/os-extra_specs/hw:numa_nodes => generated 22 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:25.289960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e5cd61b4-24b9-4125-87f4-19d2b7cbc3cf tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Action: 'update', calling method: .version_select at 0x7f9b69f3f700>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.294745 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-860863-4. Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e5cd61b4-24b9-4125-87f4-19d2b7cbc3cf tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/os-hosts/n-d-860863-4 HTTP/1.1 Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 51 Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:25.303466 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: {"status": "enable", "maintenance_mode": "invalid"} Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:21:25.304764 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'n-d-860863-4', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance: Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.305573 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.307023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.308129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.308129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:21:25.308129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:21:25.308129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.308129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 39 Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:25.308433 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: {"add_host": {"host": "n-h2-860863-4"}} Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:25.309783 n-d-860863-4 devstack@n-api.service[121040]: exception: Aggregate 1 already has host n-h2-860863-4. Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-860863-4'}}} Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result.read() Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 21:21:25.314235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-860863-4-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 21:21:25.315227 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 21:21:25.316162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 21:21:25.317248 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result.read() Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-860863-4-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 21, 21, 25, 247354), 'updated_at': None, 'host': 'n-h2-860863-4', 'aggregate_id': 1}] Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.318117 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-860863-4. Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.319238 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-860863-4. Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:25.320404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:25.323760 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-860863-4. Nov 02 21:21:25.323760 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.323760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-860863-4. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.323760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3062a5e3-e7c4-4618-8c25-a2c0a5b54883 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.152092 Nov 02 21:21:25.324286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e5cd61b4-24b9-4125-87f4-19d2b7cbc3cf tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.324446 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 21/30] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:21:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 02 21:21:25.324570 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e5cd61b4-24b9-4125-87f4-19d2b7cbc3cf tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-860863-4" status: 400 len: 199 microversion: 2.1 time: 0.034151 Nov 02 21:21:25.324570 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 10/31] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:25 2022] PUT /compute/v2.1/os-hosts/n-d-860863-4 => generated 199 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:21:25.324802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65493964-cacf-4616-b474-34ac97872a7d tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.332868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65493964-cacf-4616-b474-34ac97872a7d tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1495119503/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020214 Nov 02 21:21:25.333693 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 22/32] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 21:21:25 2022] GET /compute/v2.1/flavors/1495119503/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:25.338201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df3c336d-2668-422f-9686-b20e3f7f76ef tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.338943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-994c1151-915a-4e49-bc58-75530a4a8ca3 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Action: 'update', calling method: .version_select at 0x7f9b6a469040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-994c1151-915a-4e49-bc58-75530a4a8ca3 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/os-hosts/n-d-860863-4 HTTP/1.1 Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 51 Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:25.343891 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: {"status": "invalid", "maintenance_mode": "enable"} Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:25.345051 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'n-d-860863-4', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance: Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.345737 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.346905 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-994c1151-915a-4e49-bc58-75530a4a8ca3 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-994c1151-915a-4e49-bc58-75530a4a8ca3 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-860863-4" status: 400 len: 189 microversion: 2.1 time: 0.010328 Nov 02 21:21:25.348670 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 23/33] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:25 2022] PUT /compute/v2.1/os-hosts/n-d-860863-4 => generated 189 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:21:25.353737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-717777dc-e737-4911-ac91-0372975dc646 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.367170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df3c336d-2668-422f-9686-b20e3f7f76ef tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:25.368629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df3c336d-2668-422f-9686-b20e3f7f76ef tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:25.369330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df3c336d-2668-422f-9686-b20e3f7f76ef tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:25.454288 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-717777dc-e737-4911-ac91-0372975dc646 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1495119503/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.106131 Nov 02 21:21:25.458670 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 24/34] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:21:25 2022] DELETE /compute/v2.1/flavors/1495119503/os-extra_specs/hw:numa_nodes => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:21:25.464538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ff9c4f6-67b7-4909-84ff-e77a5073c701 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Action: 'update', calling method: .version_select at 0x7f9b6a46f040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.470244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ff9c4f6-67b7-4909-84ff-e77a5073c701 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a73c111e57964da19b19c75b5a9485e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e8ce285f434ee2a4c05401598a602c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ff9c4f6-67b7-4909-84ff-e77a5073c701 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Request method failure captured: Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/os-hosts/n-d-860863-4 HTTP/1.1 Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 50 Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OVv2wxbAejNgXlVIoaUkW2N4layiLa30AQskHRxaxcVqoOWhsLp1J3-preq13KFZ_qonYwOuonXIAt41dEXX8hk27Ad5eCI_VYEm2n6k5lnCVyIE7pAFAQqQrtZ94y5GN2OY23aI60znazEY1788MJ5Adh0Z_VOm_KkYltlEVNTM Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:25.473122 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e0e8ce285f434ee2a4c05401598a602c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e0e8ce285f434ee2a4c05401598a602c Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1314164973 Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: a73c111e57964da19b19c75b5a9485e9 Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1314164973-project Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 21:21:25.474486 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'n-d-860863-4', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:25.475395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 21:21:25.478361 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.481042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ff9c4f6-67b7-4909-84ff-e77a5073c701 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.483881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ff9c4f6-67b7-4909-84ff-e77a5073c701 tempest-HostsAdminNegativeTestJSON-1314164973 tempest-HostsAdminNegativeTestJSON-1314164973-project] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-860863-4" status: 403 len: 111 microversion: 2.1 time: 0.022486 Nov 02 21:21:25.484431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 25/35] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:25 2022] PUT /compute/v2.1/os-hosts/n-d-860863-4 => generated 111 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:25.513187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79fe65e1-e809-454d-9818-d3a7ae04a587 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.683309 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79fe65e1-e809-454d-9818-d3a7ae04a587 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1495119503/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.196444 Nov 02 21:21:25.685607 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 26/36] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:21:25 2022] DELETE /compute/v2.1/flavors/1495119503/os-extra_specs/hw:cpu_policy => generated 0 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:21:25.701213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11b8209f-8acb-4b65-9a27-fe0970c256f4 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Action: 'update', calling method: .version_select at 0x7f9b6a40c9d0>, body: {"status": null, "maintenance_mode": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11b8209f-8acb-4b65-9a27-fe0970c256f4 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/os-hosts/n-d-860863-4 HTTP/1.1 Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 42 Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:25.705348 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: {"status": null, "maintenance_mode": null} Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 21:21:25.706621 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'n-d-860863-4', 'body': {'status': None, 'maintenance_mode': None}} Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance: Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi None Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.707549 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.708881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.710015 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:21:25.710015 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:21:25.710015 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 21:21:25.710015 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.711018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11b8209f-8acb-4b65-9a27-fe0970c256f4 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.721909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11b8209f-8acb-4b65-9a27-fe0970c256f4 tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/n-d-860863-4" status: 400 len: 127 microversion: 2.1 time: 0.030354 Nov 02 21:21:25.721909 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 27/37] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:25 2022] PUT /compute/v2.1/os-hosts/n-d-860863-4 => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:21:25.727430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff794aed-eefe-483c-a5e9-f746906f3889 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.757047 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff794aed-eefe-483c-a5e9-f746906f3889 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1495119503/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035280 Nov 02 21:21:25.759639 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 28/38] 10.222.0.25 () {58 vars in 1203 bytes} [Wed Nov 2 21:21:25 2022] GET /compute/v2.1/flavors/1495119503/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:25.771148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fea03644-255a-4035-a312-ee428ceefd7a tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Action: 'update', calling method: .version_select at 0x7f9b6a6699d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:25.784805 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df3c336d-2668-422f-9686-b20e3f7f76ef tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.461926 Nov 02 21:21:25.786073 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 11/39] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:21:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:25.791914 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.hosts [None req-fea03644-255a-4035-a312-ee428ceefd7a tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Enabling host nonexistent_hostname. Nov 02 21:21:25.798699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15de359f-99bd-460a-9f04-d6d0ec274002 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.827224 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-fea03644-255a-4035-a312-ee428ceefd7a tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fea03644-255a-4035-a312-ee428ceefd7a tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Request method failure captured: Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 50 Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SZnZyfuYEUgJd_Ro8wv0mqo_5T7m9zOm6edl1ZZ26xGYvEhPcpz2q47SKIbl0JV93gnbQTkYqEiarloR9XXfo6K1hs4TF-9JISAVH0CXiwhV4C2mrtI7gqDOCOj-_VKqj04gSGbOtCUvWLbrpUyMNTgy3glstAX50xF8ye8tPJWc Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:25.830729 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_45a864664d07487e85e53e3f0391fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/45a864664d07487e85e53e3f0391fee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 45a864664d07487e85e53e3f0391fee8 Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1282951556 Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7941e94e38214351bc7e967ad438008b Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1282951556-project-admin Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.831855 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 21:21:25.832517 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:25.833409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 21:21:25.834518 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:25.838178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fea03644-255a-4035-a312-ee428ceefd7a tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:25.839698 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fea03644-255a-4035-a312-ee428ceefd7a tempest-HostsAdminNegativeTestJSON-1282951556 tempest-HostsAdminNegativeTestJSON-1282951556-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.078843 Nov 02 21:21:25.843151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 29/40] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Nov 2 21:21:25 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:25.858318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-088ef2f0-47be-4b17-94d4-2df22e2f4600 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.869397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:DELETE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:25.894161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15de359f-99bd-460a-9f04-d6d0ec274002 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1495119503" status: 202 len: 0 microversion: 2.1 time: 0.105712 Nov 02 21:21:25.899426 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 12/41] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:21:25 2022] DELETE /compute/v2.1/flavors/1495119503 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:21:25.903095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1f2b674e-a0e6-4577-a1a5-2e8bf7760b05 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:25.950126 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1f2b674e-a0e6-4577-a1a5-2e8bf7760b05 tempest-FlavorsExtraSpecsTestJSON-574622288 tempest-FlavorsExtraSpecsTestJSON-574622288-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050876 Nov 02 21:21:25.955304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 13/42] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:25.984334 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-088ef2f0-47be-4b17-94d4-2df22e2f4600 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.139307 Nov 02 21:21:25.985070 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 30/43] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:25 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:21:25.996493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e035bfa3-8fc1-4504-ada9-3fca34543651 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1017680718"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:26.015737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0da9117d-4e45-4b94-8bd6-35f3b9733ae6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1764970827", "name": "tempest-test_aggregate-1644215988"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:26.031959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-e035bfa3-8fc1-4504-ada9-3fca34543651 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid ff6633f9-2291-467d-b2dc-d75510ff027b for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:26.054044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.aggregate [None req-0da9117d-4e45-4b94-8bd6-35f3b9733ae6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 5899e587-3cc6-4d93-bc2d-61be70655c08 for aggregate {{(pid=121040) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:26.161310 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e035bfa3-8fc1-4504-ada9-3fca34543651 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.169595 Nov 02 21:21:26.167640 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 14/44] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:26.171096 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0da9117d-4e45-4b94-8bd6-35f3b9733ae6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.159300 Nov 02 21:21:26.172081 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 31/45] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 21:21:26 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:26.187044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8b265a4-8884-489a-b2de-042f953e23c3 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:26.209291 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8b265a4-8884-489a-b2de-042f953e23c3 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.029635 Nov 02 21:21:26.211436 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 32/46] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:21:26 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:26.224816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e7d6a7c-c5dd-40f7-9b7e-002bda995929 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:26.242020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7d6a7c-c5dd-40f7-9b7e-002bda995929 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:26.242590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7d6a7c-c5dd-40f7-9b7e-002bda995929 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:26.242977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7d6a7c-c5dd-40f7-9b7e-002bda995929 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:26.938105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e252b411-fc1c-4b36-a9e5-4444d97593e3 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:26.942019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e252b411-fc1c-4b36-a9e5-4444d97593e3 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '889cc35902d74921bd2848ae9f100f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d0128e4f9a49b6b16ccd973a0dec5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e252b411-fc1c-4b36-a9e5-4444d97593e3 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Request method failure captured: Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 39 Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9OR8fuvYRgJSEyRcTdzgS6fl2WRzBBldzqmjgY-dTJISUst9k4_81ghxIjpx9NdISipG720-sdmx4ynlwlmHLn5SFpGm9Kfh2d7YdoObbUpISSaVDUjAgGf4S3riB_iWU9BDEIWFOJsrAdrXRjw9yGaWjy7LF_6alUa6KclDy2_5I Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:26.951174 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 889cc35902d74921bd2848ae9f100f5f Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: {"add_host": {"host": "n-h2-860863-4"}} Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:26.952521 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-860863-4'}}} Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:26.953211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 21:21:26.957441 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:26.958542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e252b411-fc1c-4b36-a9e5-4444d97593e3 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:26.958542 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e252b411-fc1c-4b36-a9e5-4444d97593e3 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.774915 Nov 02 21:21:26.958542 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 15/47] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:21:26 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 776 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:26.961736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d54aeae7-c828-4132-a6c1-e14072f4101c tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:27.112174 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d54aeae7-c828-4132-a6c1-e14072f4101c tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.154400 Nov 02 21:21:27.113012 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 16/48] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:26 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 21:21:27.123047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36d4287c-4843-43c3-a7e1-e06dc4f1f11f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1539839027"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.126889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-36d4287c-4843-43c3-a7e1-e06dc4f1f11f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid 725e9d43-6332-46dc-82c8-4d0e1d2effb6 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:27.259617 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36d4287c-4843-43c3-a7e1-e06dc4f1f11f tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.141009 Nov 02 21:21:27.269153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 17/49] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:27.275556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1359375154"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.292666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=121039) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 21:21:27.293511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:27.294118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:27.294615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:27.303191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:27.303657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:27.304096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:27.317644 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1359375154 could not be found. Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 58 Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:27.323391 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: {"add_host": {"host": "tempest-nonexist_host-1359375154"}} Nov 02 21:21:27.324713 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: exception: Compute host tempest-nonexist_host-1359375154 could not be found. Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1359375154'}}} Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1359375154' is not mapped to any cell Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.326164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 02 21:21:27.327873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1359375154 could not be found. Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1359375154 could not be found. Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.333784 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1359375154 could not be found. Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1359375154 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2dfaa02f-2186-4dae-a224-a177a29315e7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.057985 Nov 02 21:21:27.336223 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 18/50] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:27.345790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bdfe60cd-60cc-4e74-a424-cce7666d149c tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:27.438465 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bdfe60cd-60cc-4e74-a424-cce7666d149c tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.104170 Nov 02 21:21:27.439087 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 19/51] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:27 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 21:21:27.451639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33c8bedb-a00f-42ff-ab23-786214deede7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33c8bedb-a00f-42ff-ab23-786214deede7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 283 Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:27.466174 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.467917 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:21:27.468428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:27.468991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.469871 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.470717 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:21:27.470717 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:21:27.470717 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:21:27.470717 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.470717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33c8bedb-a00f-42ff-ab23-786214deede7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:27.471102 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-33c8bedb-a00f-42ff-ab23-786214deede7 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016230 Nov 02 21:21:27.471102 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 20/52] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:21:27.477276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56cb7e58-5adc-4e2d-bc83-b4e8e944c0b1 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56cb7e58-5adc-4e2d-bc83-b4e8e944c0b1 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 27 Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:27.480825 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: {"aggregate": {"name": ""}} Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:27.482538 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi '' Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:27.488116 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:21:27.491216 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.493791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56cb7e58-5adc-4e2d-bc83-b4e8e944c0b1 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:27.493791 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-56cb7e58-5adc-4e2d-bc83-b4e8e944c0b1 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010208 Nov 02 21:21:27.493791 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 21/53] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:21:27.500495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2caed8b4-0665-427f-813f-a9629d7b3042 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-788141520"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.503981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2caed8b4-0665-427f-813f-a9629d7b3042 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '889cc35902d74921bd2848ae9f100f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d0128e4f9a49b6b16ccd973a0dec5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2caed8b4-0665-427f-813f-a9629d7b3042 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Request method failure captured: Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 59 Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9OR8fuvYRgJSEyRcTdzgS6fl2WRzBBldzqmjgY-dTJISUst9k4_81ghxIjpx9NdISipG720-sdmx4ynlwlmHLn5SFpGm9Kfh2d7YdoObbUpISSaVDUjAgGf4S3riB_iWU9BDEIWFOJsrAdrXRjw9yGaWjy7LF_6alUa6KclDy2_5I Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:27.505609 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 889cc35902d74921bd2848ae9f100f5f Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: {"aggregate": {"name": "tempest-test_aggregate-788141520"}} Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:27.506702 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-788141520'}}} Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:27.508581 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:27.509590 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 21:21:27.510536 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.510536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2caed8b4-0665-427f-813f-a9629d7b3042 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:27.510536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2caed8b4-0665-427f-813f-a9629d7b3042 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011650 Nov 02 21:21:27.510536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 22/54] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:27.518528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55dd7362-c635-4ecd-b3e2-5a844ef3b732 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2107186924"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.526716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-55dd7362-c635-4ecd-b3e2-5a844ef3b732 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid 7bb183f4-ca8a-4088-850c-c82222e83d02 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:27.637014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55dd7362-c635-4ecd-b3e2-5a844ef3b732 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.120341 Nov 02 21:21:27.637654 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 23/55] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:27.666087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e807a72-88e1-4d9b-8e7e-389efd360749 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2107186924"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.671033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-9e807a72-88e1-4d9b-8e7e-389efd360749 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid bb91e74a-2bf6-4ca4-a504-323296734837 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:27.690914 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9e807a72-88e1-4d9b-8e7e-389efd360749 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2107186924 already exists. Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e807a72-88e1-4d9b-8e7e-389efd360749 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 60 Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:27.693125 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: {"aggregate": {"name": "tempest-test_aggregate-2107186924"}} Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:27.694430 n-d-860863-4 devstack@n-api.service[121039]: exception: Aggregate tempest-test_aggregate-2107186924 already exists. Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2107186924'}}} Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 02 21:21:27.695779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2107186924 already exists. Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:27.696919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2107186924 already exists. Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2107186924 already exists. Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e807a72-88e1-4d9b-8e7e-389efd360749 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2107186924 already exists. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:27.699642 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e807a72-88e1-4d9b-8e7e-389efd360749 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.042838 Nov 02 21:21:27.701233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 24/56] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:27.710726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-becac478-e503-4efd-9b26-ac15cc958f5d tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:27.724445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:27.820801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-becac478-e503-4efd-9b26-ac15cc958f5d tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.117596 Nov 02 21:21:27.826815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 25/57] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:27 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 21:21:27.835299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0464e3c6-81b4-4728-8c28-5ce1c45aa2dc tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-7374721"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:27.839042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-0464e3c6-81b4-4728-8c28-5ce1c45aa2dc tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid a8a45ffe-5265-4a27-a244-e4ac4e03d1aa for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:27.944710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0464e3c6-81b4-4728-8c28-5ce1c45aa2dc tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.116501 Nov 02 21:21:27.952053 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 26/58] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:27 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:27.958656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-533fa5cb-ebb5-48b4-9d01-543c25ecc17e tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-533fa5cb-ebb5-48b4-9d01-543c25ecc17e tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '889cc35902d74921bd2848ae9f100f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d0128e4f9a49b6b16ccd973a0dec5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-533fa5cb-ebb5-48b4-9d01-543c25ecc17e tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Request method failure captured: Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9OR8fuvYRgJSEyRcTdzgS6fl2WRzBBldzqmjgY-dTJISUst9k4_81ghxIjpx9NdISipG720-sdmx4ynlwlmHLn5SFpGm9Kfh2d7YdoObbUpISSaVDUjAgGf4S3riB_iWU9BDEIWFOJsrAdrXRjw9yGaWjy7LF_6alUa6KclDy2_5I Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:27.968606 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 889cc35902d74921bd2848ae9f100f5f Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 21:21:27.970068 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '6'} Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:27.970828 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:27.971941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-533fa5cb-ebb5-48b4-9d01-543c25ecc17e tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:27.972992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-533fa5cb-ebb5-48b4-9d01-543c25ecc17e tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.009208 Nov 02 21:21:27.972992 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 27/59] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:27 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:27.976395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54a0dacb-c985-4c0e-810f-c3434aae8d81 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:28.074810 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54a0dacb-c985-4c0e-810f-c3434aae8d81 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.102869 Nov 02 21:21:28.076690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 28/60] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:27 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:21:28.086503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e81331e1-6f5c-41e1-ad5d-9553028acfc3 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:28.104996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e81331e1-6f5c-41e1-ad5d-9553028acfc3 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e81331e1-6f5c-41e1-ad5d-9553028acfc3 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:28.108143 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: exception: Aggregate -1 could not be found. Nov 02 21:21:28.109675 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '-1'} Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 21:21:28.110544 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.111670 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.114564 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.114564 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.114564 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:28.114564 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:28.114564 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 21:21:28.114564 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.123714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e81331e1-6f5c-41e1-ad5d-9553028acfc3 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:28.124499 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e81331e1-6f5c-41e1-ad5d-9553028acfc3 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042872 Nov 02 21:21:28.125544 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 29/61] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:21:28 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:28.145310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1407e436-a182-44d9-9c3f-1343c1a21433 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-720257678"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:28.152502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-1407e436-a182-44d9-9c3f-1343c1a21433 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid e9b21bcf-231b-42b2-85c6-844adaf8fe10 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:21:28.230148 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1407e436-a182-44d9-9c3f-1343c1a21433 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.098308 Nov 02 21:21:28.230822 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 30/62] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:21:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:28.245244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9f4e335-da03-464a-9d5f-4764c26bcb1a tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:28.248550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9f4e335-da03-464a-9d5f-4764c26bcb1a tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '889cc35902d74921bd2848ae9f100f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d0128e4f9a49b6b16ccd973a0dec5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9f4e335-da03-464a-9d5f-4764c26bcb1a tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Request method failure captured: Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9OR8fuvYRgJSEyRcTdzgS6fl2WRzBBldzqmjgY-dTJISUst9k4_81ghxIjpx9NdISipG720-sdmx4ynlwlmHLn5SFpGm9Kfh2d7YdoObbUpISSaVDUjAgGf4S3riB_iWU9BDEIWFOJsrAdrXRjw9yGaWjy7LF_6alUa6KclDy2_5I Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:28.250296 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 889cc35902d74921bd2848ae9f100f5f Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 21:21:28.251927 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '7'} Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:28.252661 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.261916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9f4e335-da03-464a-9d5f-4764c26bcb1a tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:28.263520 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9f4e335-da03-464a-9d5f-4764c26bcb1a tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.016522 Nov 02 21:21:28.263520 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:21:28 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:28.271254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bec10529-6533-4ea3-bca4-74543136d071 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:28.372798 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bec10529-6533-4ea3-bca4-74543136d071 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.110374 Nov 02 21:21:28.378528 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 32/64] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:28 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:21:28.391405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7232121-e5b7-4a69-bebf-e996a072c395 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:28.415462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f7232121-e5b7-4a69-bebf-e996a072c395 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7232121-e5b7-4a69-bebf-e996a072c395 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:28.422952 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: exception: Aggregate -1 could not be found. Nov 02 21:21:28.424916 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '-1'} Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.425655 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 21:21:28.426647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.432336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7232121-e5b7-4a69-bebf-e996a072c395 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:28.433493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f7232121-e5b7-4a69-bebf-e996a072c395 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.050508 Nov 02 21:21:28.437376 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 33/65] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:28 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:28.460417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19ba283d-4f92-4a06-97b7-26a9812b6188 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:28.465172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19ba283d-4f92-4a06-97b7-26a9812b6188 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '889cc35902d74921bd2848ae9f100f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d0128e4f9a49b6b16ccd973a0dec5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19ba283d-4f92-4a06-97b7-26a9812b6188 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Request method failure captured: Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9OR8fuvYRgJSEyRcTdzgS6fl2WRzBBldzqmjgY-dTJISUst9k4_81ghxIjpx9NdISipG720-sdmx4ynlwlmHLn5SFpGm9Kfh2d7YdoObbUpISSaVDUjAgGf4S3riB_iWU9BDEIWFOJsrAdrXRjw9yGaWjy7LF_6alUa6KclDy2_5I Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:28.467295 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 889cc35902d74921bd2848ae9f100f5f Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 21:21:28.468403 n-d-860863-4 devstack@n-api.service[121039]: action_args: {} Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:28.469129 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:28.471162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19ba283d-4f92-4a06-97b7-26a9812b6188 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:28.472136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19ba283d-4f92-4a06-97b7-26a9812b6188 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.023955 Nov 02 21:21:28.479365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 34/66] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:21:28 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:29.197128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e7d6a7c-c5dd-40f7-9b7e-002bda995929 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 2.973871 Nov 02 21:21:29.198230 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:21:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 2979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:30.494683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-766876609", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "availability_zone": "tempest-test_az-1764970827"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:30.520634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:30.521390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:30.522024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:30.522942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:30.523658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:30.524188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:31.795173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:21:32.168599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:21:32.169653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:21:32.170543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:21:32.171152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:21:32.171790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:21:32.186806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:32.187301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:32.187756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:32.188668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:32.189154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:32.189731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:32.224651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Getting quotas for project a078ad61024a48d89e1c94da25107c21. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:21:32.233554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Getting quotas for user bd4ae61cbd8048c181c7573734cde312 and project a078ad61024a48d89e1c94da25107c21. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:21:32.253377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:21:32.257225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:21:32.412119 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-99897389-8415-4c32-ac06-0504f6e45887 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.633377 Nov 02 21:21:32.413464 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:21:32.426518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bee8c74-0383-45cc-b744-dbef619c38e9 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:32.428345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1bee8c74-0383-45cc-b744-dbef619c38e9 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:33.113171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:34.261905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1bee8c74-0383-45cc-b744-dbef619c38e9 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:34.282573 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1bee8c74-0383-45cc-b744-dbef619c38e9 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1242 microversion: 2.1 time: 1.861621 Nov 02 21:21:34.291312 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:32 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1242 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:34.915260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3f46cac-321f-40ef-b085-96567fac5384 tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-192850255", "id": 1090085238, "os-flavor-access:is_public": "True"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:35.022787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3f46cac-321f-40ef-b085-96567fac5384 tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.487039 Nov 02 21:21:35.026093 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 36/70] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:21:34 2022] POST /compute/v2.1/flavors => generated 448 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:21:35.306741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:35.307369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:35.335325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:35.335828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:35.336273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:35.344332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:35.344332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:35.346700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:35.598969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:35.601753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50557db5-93d6-47d2-9865-a8f51d15ca71 tempest-FlavorsV255TestJSON-682188878 tempest-FlavorsV255TestJSON-682188878-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:35.618636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50557db5-93d6-47d2-9865-a8f51d15ca71 tempest-FlavorsV255TestJSON-682188878 tempest-FlavorsV255TestJSON-682188878-project] 10.222.0.25 "GET /compute/v2.1/flavors/1090085238" status: 200 len: 448 microversion: 2.55 time: 0.580435 Nov 02 21:21:35.621882 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 35/71] 10.222.0.25 () {60 vars in 1199 bytes} [Wed Nov 2 21:21:35 2022] GET /compute/v2.1/flavors/1090085238 => generated 448 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:21:35.633531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c9e5044d-e0bc-4f48-8925-ca6f3192676c tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] Action: 'update', calling method: .version_select at 0x7f9b6ada8b80>, body: {"flavor": {"description": "new"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:35.638384 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-835be0f7-cc22-4b92-b32f-05f19a87bd37 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1242 microversion: 2.1 time: 0.329947 Nov 02 21:21:35.641296 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 37/72] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:35 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1242 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:35.826809 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c9e5044d-e0bc-4f48-8925-ca6f3192676c tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1090085238" status: 200 len: 449 microversion: 2.55 time: 0.195893 Nov 02 21:21:35.828132 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 36/73] 10.222.0.25 () {62 vars in 1219 bytes} [Wed Nov 2 21:21:35 2022] PUT /compute/v2.1/flavors/1090085238 => generated 449 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:21:35.852263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cfa02129-d619-4d59-a0b1-2cf72f69a9d1 tempest-FlavorsV255TestJSON-682188878 tempest-FlavorsV255TestJSON-682188878-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:35.924889 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cfa02129-d619-4d59-a0b1-2cf72f69a9d1 tempest-FlavorsV255TestJSON-682188878 tempest-FlavorsV255TestJSON-682188878-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.078948 Nov 02 21:21:35.928155 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:35 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:21:35.957820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60f0df62-6d21-4e65-8778-0c6f068b6200 tempest-FlavorsV255TestJSON-682188878 tempest-FlavorsV255TestJSON-682188878-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:36.018281 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60f0df62-6d21-4e65-8778-0c6f068b6200 tempest-FlavorsV255TestJSON-682188878 tempest-FlavorsV255TestJSON-682188878-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.068039 Nov 02 21:21:36.020089 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 37/75] 10.222.0.25 () {60 vars in 1166 bytes} [Wed Nov 2 21:21:35 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:21:36.041483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30bc0882-b9e2-48fc-9a7a-081519690741 tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:36.174972 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30bc0882-b9e2-48fc-9a7a-081519690741 tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1090085238" status: 202 len: 0 microversion: 2.55 time: 0.140561 Nov 02 21:21:36.175566 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Nov 2 21:21:36 2022] DELETE /compute/v2.1/flavors/1090085238 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:21:36.185991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-084d546e-9e8e-4a37-9ebb-5354d41a94c0 tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:36.224226 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-084d546e-9e8e-4a37-9ebb-5354d41a94c0 tempest-FlavorsV255TestJSON-986577769 tempest-FlavorsV255TestJSON-986577769-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.044156 Nov 02 21:21:36.229450 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 38/77] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:36 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:21:36.670949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:36.673585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:36.676433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=18 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:36.702083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:36.707315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:36.707960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:36.709538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:36.714006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:36.717045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:37.114196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:37.139314 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20a1c106-b262-454b-a6b2-7c253b0829dd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1290 microversion: 2.1 time: 0.476835 Nov 02 21:21:37.143389 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 39/78] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:36 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1290 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:37.347773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c6083c5e-7427-47d3-9dc2-ba0c317c24e8 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1213634157", "ram": 512, "vcpus": 1, "disk": 10, "id": 445275545, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:37.464650 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c6083c5e-7427-47d3-9dc2-ba0c317c24e8 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.867558 Nov 02 21:21:37.465910 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 40/79] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:36 2022] POST /compute/v2.1/flavors => generated 413 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:37.864673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90851491-e54e-4ca5-96bc-ab26444f8ab9 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:37.877042 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-90851491-e54e-4ca5-96bc-ab26444f8ab9 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] HTTP exception thrown: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90851491-e54e-4ca5-96bc-ab26444f8ab9 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Request method failure captured: Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/flavors/445275545/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9dfDCqajCkxSTVfvQcc7iH1wAY_JLuWk6f0o7XRUEImtD3ZSzGSdtCj0FtBFkLpjozOsQh72e1PEliOnnbPidFcXY9Xy3LrJfJQnylLJ3zcpXQUcjroZqWNZH_KUfXtCl-fW7Cq-bK-PYgySk9lve4JW2fg6Tb3SIxB2nT49qIj_Q Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:37.883220 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1be9b1242869447399af613aff81c081 Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:37.884360 n-d-860863-4 devstack@n-api.service[121040]: exception: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'flavor_id': '445275545', 'id': 'hw:cpu_thread_policy'} Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:37.884978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90851491-e54e-4ca5-96bc-ab26444f8ab9 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Returning 404 to user: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90851491-e54e-4ca5-96bc-ab26444f8ab9 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] 10.222.0.25 "GET /compute/v2.1/flavors/445275545/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.408872 Nov 02 21:21:37.887462 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 40/80] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:21:37 2022] GET /compute/v2.1/flavors/445275545/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:21:37.922224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-decd9768-b26a-4e05-a4e2-00e67942bebd tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:37.925630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-decd9768-b26a-4e05-a4e2-00e67942bebd tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '1be9b1242869447399af613aff81c081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989639e5e6a45f9ac95c15ac035105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-decd9768-b26a-4e05-a4e2-00e67942bebd tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Request method failure captured: Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/flavors/445275545/os-extra_specs HTTP/1.1 Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 66 Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9dfDCqajCkxSTVfvQcc7iH1wAY_JLuWk6f0o7XRUEImtD3ZSzGSdtCj0FtBFkLpjozOsQh72e1PEliOnnbPidFcXY9Xy3LrJfJQnylLJ3zcpXQUcjroZqWNZH_KUfXtCl-fW7Cq-bK-PYgySk9lve4JW2fg6Tb3SIxB2nT49qIj_Q Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:37.930116 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1be9b1242869447399af613aff81c081 Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 02 21:21:37.931185 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'flavor_id': '445275545', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:37.931998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 21:21:37.932956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:37.933966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-decd9768-b26a-4e05-a4e2-00e67942bebd tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:37.933966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-decd9768-b26a-4e05-a4e2-00e67942bebd tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] 10.222.0.25 "POST /compute/v2.1/flavors/445275545/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020862 Nov 02 21:21:37.933966 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 41/81] 10.222.0.25 () {60 vars in 1221 bytes} [Wed Nov 2 21:21:37 2022] POST /compute/v2.1/flavors/445275545/os-extra_specs => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:37.952733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1dc368f9-77b0-4bb3-b46a-9ffd17337062 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:38.077054 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1dc368f9-77b0-4bb3-b46a-9ffd17337062 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/445275545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.129469 Nov 02 21:21:38.077780 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 42/82] 10.222.0.25 () {60 vars in 1221 bytes} [Wed Nov 2 21:21:37 2022] POST /compute/v2.1/flavors/445275545/os-extra_specs => generated 66 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:38.093754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fca162d3-ac5f-4f64-ac3d-1d78d3dc601b tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:38.098042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fca162d3-ac5f-4f64-ac3d-1d78d3dc601b tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '1be9b1242869447399af613aff81c081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989639e5e6a45f9ac95c15ac035105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fca162d3-ac5f-4f64-ac3d-1d78d3dc601b tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Request method failure captured: Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9dfDCqajCkxSTVfvQcc7iH1wAY_JLuWk6f0o7XRUEImtD3ZSzGSdtCj0FtBFkLpjozOsQh72e1PEliOnnbPidFcXY9Xy3LrJfJQnylLJ3zcpXQUcjroZqWNZH_KUfXtCl-fW7Cq-bK-PYgySk9lve4JW2fg6Tb3SIxB2nT49qIj_Q Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:38.099803 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1be9b1242869447399af613aff81c081 Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:38.101176 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'flavor_id': '445275545', 'id': 'hw:numa_nodes'} Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:38.101862 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.103120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fca162d3-ac5f-4f64-ac3d-1d78d3dc601b tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:38.104266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fca162d3-ac5f-4f64-ac3d-1d78d3dc601b tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] 10.222.0.25 "DELETE /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016851 Nov 02 21:21:38.110464 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 43/83] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:21:38 2022] DELETE /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:38.123149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-759862b7-051e-46ec-971a-c7a312b5d78f tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:38.165408 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-759862b7-051e-46ec-971a-c7a312b5d78f tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/445275545/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053694 Nov 02 21:21:38.165933 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 44/84] 10.222.0.25 () {60 vars in 1221 bytes} [Wed Nov 2 21:21:38 2022] POST /compute/v2.1/flavors/445275545/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:38.178930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:38.179557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:38.186301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:38.186991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:38.187562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:38.189000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:38.189601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:38.190200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:38.238278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c39de3dc-8b0d-4a85-a9c5-7cae70b38dbb tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:38.281441 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c39de3dc-8b0d-4a85-a9c5-7cae70b38dbb tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.595645 Nov 02 21:21:38.282576 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:21:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:38.288216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7870f09d-cef3-4d74-8058-3f1bed071b1a tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:38.297091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7870f09d-cef3-4d74-8058-3f1bed071b1a tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '1be9b1242869447399af613aff81c081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989639e5e6a45f9ac95c15ac035105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7870f09d-cef3-4d74-8058-3f1bed071b1a tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Request method failure captured: Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 22 Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9dfDCqajCkxSTVfvQcc7iH1wAY_JLuWk6f0o7XRUEImtD3ZSzGSdtCj0FtBFkLpjozOsQh72e1PEliOnnbPidFcXY9Xy3LrJfJQnylLJ3zcpXQUcjroZqWNZH_KUfXtCl-fW7Cq-bK-PYgySk9lve4JW2fg6Tb3SIxB2nT49qIj_Q Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:21:38.303464 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4989639e5e6a45f9ac95c15ac035105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4989639e5e6a45f9ac95c15ac035105d Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1be9b1242869447399af613aff81c081 Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: {"hw:numa_nodes": "1"} Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:38.315943 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'flavor_id': '445275545', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:38.316761 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 21:21:38.317962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.319103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7870f09d-cef3-4d74-8058-3f1bed071b1a tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:38.319103 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7870f09d-cef3-4d74-8058-3f1bed071b1a tempest-FlavorsExtraSpecsNegativeTestJSON-285922148 tempest-FlavorsExtraSpecsNegativeTestJSON-285922148-project] 10.222.0.25 "PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023596 Nov 02 21:21:38.319103 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 42/86] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:21:38 2022] PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:38.487343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:38.500520 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e639f3e1-dbb9-47e1-a377-5d83b655a996 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1296 microversion: 2.1 time: 0.326867 Nov 02 21:21:38.501416 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 45/87] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:38 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1296 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:38.506057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0ad6e29-67bb-4b93-a57d-aadbd69fdaa1 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:38.516818 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d0ad6e29-67bb-4b93-a57d-aadbd69fdaa1 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] HTTP exception thrown: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0ad6e29-67bb-4b93-a57d-aadbd69fdaa1 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Request method failure captured: Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/flavors/445275545/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9gUSNdqRDzqK1Qh-9Vnx8WmO71Iz3ocT8Qz0j9kHTZ9i7-hB79q0YE9qJQoFzdkgTJej_3XmCQSMQerBOsum2208pzAJgq7gXKKRVSUHutWialqrXFMUedCI7W9pGNVDkG3aXT7HlYMlI3nayCLbhkN2B8FmWtRvCHCfyoe-NSmh8 Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 9b78ba38a89d4c8d8641664d3960a95a Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:38.519725 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 9b78ba38a89d4c8d8641664d3960a95a Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: ff5ccda82c8e4ca9bfab03780328208c Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:38.520818 n-d-860863-4 devstack@n-api.service[121040]: exception: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'flavor_id': '445275545', 'id': 'hw:cpu_thread_policy'} Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:38.521527 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.522616 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:38.522616 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:38.522616 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:38.522616 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:38.522616 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:38.522616 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. Nov 02 21:21:38.522616 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:38.524821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0ad6e29-67bb-4b93-a57d-aadbd69fdaa1 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Returning 404 to user: Flavor 445275545 has no extra specs with key hw:cpu_thread_policy. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:38.525919 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d0ad6e29-67bb-4b93-a57d-aadbd69fdaa1 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/445275545/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.023351 Nov 02 21:21:38.527438 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:21:38 2022] DELETE /compute/v2.1/flavors/445275545/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:39.004725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f5dc12f6-f647-4888-b953-3a6d937a0ba9 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1988421882", "id": 176203017, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:39.104364 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f5dc12f6-f647-4888-b953-3a6d937a0ba9 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.782399 Nov 02 21:21:39.107714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 43/89] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:38 2022] POST /compute/v2.1/flavors => generated 422 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:39.140333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cced5662-e86a-4ac9-867f-d00d3bf48b6d tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:39.158279 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-cced5662-e86a-4ac9-867f-d00d3bf48b6d tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cced5662-e86a-4ac9-867f-d00d3bf48b6d tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Request method failure captured: Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 27 Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9gUSNdqRDzqK1Qh-9Vnx8WmO71Iz3ocT8Qz0j9kHTZ9i7-hB79q0YE9qJQoFzdkgTJej_3XmCQSMQerBOsum2208pzAJgq7gXKKRVSUHutWialqrXFMUedCI7W9pGNVDkG3aXT7HlYMlI3nayCLbhkN2B8FmWtRvCHCfyoe-NSmh8 Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 9b78ba38a89d4c8d8641664d3960a95a Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:21:39.175796 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 9b78ba38a89d4c8d8641664d3960a95a Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: ff5ccda82c8e4ca9bfab03780328208c Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: {"hw:cpu_policy": "shared"} Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:21:39.184341 n-d-860863-4 devstack@n-api.service[121039]: exception: Request body and URI mismatch Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'flavor_id': '445275545', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:39.185947 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:39.187771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:39.187771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:39.187771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 02 21:21:39.187771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.187771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cced5662-e86a-4ac9-867f-d00d3bf48b6d tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:39.187771 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cced5662-e86a-4ac9-867f-d00d3bf48b6d tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.066925 Nov 02 21:21:39.187771 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 44/90] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:21:39 2022] PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes => generated 73 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:21:39.225368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b69ab6e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:39.242964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:39.246941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:39.249840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:39.252424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:39.271340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:39.271340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:39.322451 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7a8bbff-099f-44a4-8fb6-da0b7a0c2bc3 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.793556 Nov 02 21:21:39.334043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 47/91] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 21:21:38 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:39.346486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bf40681-48b3-428c-96e7-dce9488a2723 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:39.363020 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3bf40681-48b3-428c-96e7-dce9488a2723 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027334 Nov 02 21:21:39.373701 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 48/92] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 21:21:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:39.389014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1ce5d60-c399-4692-a382-fb51597e2587 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1ce5d60-c399-4692-a382-fb51597e2587 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Request method failure captured: Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 49 Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9gUSNdqRDzqK1Qh-9Vnx8WmO71Iz3ocT8Qz0j9kHTZ9i7-hB79q0YE9qJQoFzdkgTJej_3XmCQSMQerBOsum2208pzAJgq7gXKKRVSUHutWialqrXFMUedCI7W9pGNVDkG3aXT7HlYMlI3nayCLbhkN2B8FmWtRvCHCfyoe-NSmh8 Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 9b78ba38a89d4c8d8641664d3960a95a Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:39.402233 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9b78ba38a89d4c8d8641664d3960a95a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 9b78ba38a89d4c8d8641664d3960a95a Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: ff5ccda82c8e4ca9bfab03780328208c Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 02 21:21:39.403846 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'flavor_id': '445275545', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance: Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 02 21:21:39.404599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.405983 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:39.407268 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:39.407268 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:39.407268 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:21:39.407268 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:21:39.407268 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 21:21:39.407268 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:39.409997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1ce5d60-c399-4692-a382-fb51597e2587 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:39.411026 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1ce5d60-c399-4692-a382-fb51597e2587 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.036029 Nov 02 21:21:39.414447 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 49/93] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:21:39 2022] PUT /compute/v2.1/flavors/445275545/os-extra_specs/hw:numa_nodes => generated 117 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:21:39.525868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62edf388-0e28-4d9e-9945-a3c5704c2d80 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-999605998", "id": 965919709, "os-flavor-access:is_public": "False"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:39.697620 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62edf388-0e28-4d9e-9945-a3c5704c2d80 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.518506 Nov 02 21:21:39.708358 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 45/94] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:39.714983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b69da3d30>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:39.721249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:39.721354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:39.721936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:39.722834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:39.723435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:39.724133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:39.755790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0b720b49-26ba-42c0-a189-b12aadcba80c tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.045004 Nov 02 21:21:39.763500 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 46/95] 10.222.0.25 () {58 vars in 1139 bytes} [Wed Nov 2 21:21:39 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:39.768658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47241923-0e9a-4dcd-8124-8fb64775ba01 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-160572380", "id": 464443597, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:40.061139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1962508251", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:40.077602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:21:40.093968 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47241923-0e9a-4dcd-8124-8fb64775ba01 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.328941 Nov 02 21:21:40.132689 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 47/96] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:39 2022] POST /compute/v2.1/flavors => generated 421 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:40.132689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-933ce9f3-8d92-45ef-8cc1-dd5b00543cec tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:40.430773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-933ce9f3-8d92-45ef-8cc1-dd5b00543cec tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/445275545" status: 202 len: 0 microversion: 2.1 time: 0.334772 Nov 02 21:21:40.431600 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 48/97] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:21:40 2022] DELETE /compute/v2.1/flavors/445275545 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:21:40.437011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:40.438431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:40.444336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:40.445326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:40.445988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:40.447086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:40.447765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:40.448395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:40.816702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:40.831706 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dafc8a18-01a7-49e5-adfc-84c51894a9bd tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.396810 Nov 02 21:21:40.833569 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:40 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:40.839947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:21:40.845875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:21:40.845875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:21:40.845875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:21:40.845875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:21:40.846292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c8e10c1-4db5-42f6-a290-82c11330434a tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:40.872411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:40.874600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:40.874600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:40.881005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:40.881867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:40.882532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:40.975801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Getting quotas for project afa6d9c601754827a8f2df9b9f544b10. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:21:40.992245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Getting quotas for user c27e33aa9a564bf3a7036e79125205e1 and project afa6d9c601754827a8f2df9b9f544b10. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:21:41.013345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:21:41.026854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:21:41.231619 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3804fc3b-e018-4c31-9a73-32b7fcea206a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.808784 Nov 02 21:21:41.231619 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 50/99] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:21:41.265729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b6a45ddc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:41.269629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:41.270119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:41.270562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:41.271292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:41.271740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:41.272165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:41.310322 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7c828bb7-5283-4d04-a8a3-39be5aa212fb tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.076981 Nov 02 21:21:41.310939 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 51/100] 10.222.0.25 () {58 vars in 1145 bytes} [Wed Nov 2 21:21:41 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:41.320409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-589cde4d-105a-4f5b-bdc1-3b9b52f694c6 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:41.336590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:41.340485 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-589cde4d-105a-4f5b-bdc1-3b9b52f694c6 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023698 Nov 02 21:21:41.342343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 52/101] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 21:21:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:41.347505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a871b452-3fc5-4c48-ae99-20167490cd0b tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:41.376706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a871b452-3fc5-4c48-ae99-20167490cd0b tempest-FlavorsExtraSpecsNegativeTestJSON-113509583 tempest-FlavorsExtraSpecsNegativeTestJSON-113509583-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032972 Nov 02 21:21:41.381465 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 53/102] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:41 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:41.382917 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4c8e10c1-4db5-42f6-a290-82c11330434a tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/965919709/action" status: 200 len: 96 microversion: 2.1 time: 0.547509 Nov 02 21:21:41.385525 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 50/103] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 21:21:40 2022] POST /compute/v2.1/flavors/965919709/action => generated 96 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:41.386735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09d59ea3-ab18-404e-b9c7-984d7955f9a7 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:41.387621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-09d59ea3-ab18-404e-b9c7-984d7955f9a7 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:41.417922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ffab471a-0d2c-4aa3-a3f4-0163acc748c2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Action: 'create', calling method: .version_select at 0x7f9b69c60b80>, body: {"keypair": {"name": "tempest-keypair-1112162530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlEtiDVhPOOuo+YcfpILNqO49NLgWgrhtiszqJZkDodCpS8G7NA0WP6YAdmb8RKb1gFvxfulTvUpyCQjJE8zC4aMnIXkXQD5CjFpZRtjc95/f2O/wdB+KpDUVkRbf9bhw=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:41.480355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=77,nova_api:INSERT=11 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:41.507512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ffab471a-0d2c-4aa3-a3f4-0163acc748c2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Getting quotas for project fd4894dee76f4b36a22065bbc923b04a. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:21:41.521393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ffab471a-0d2c-4aa3-a3f4-0163acc748c2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Getting quotas for user 7e5759f947464db980b4dc96a5cd984d and project fd4894dee76f4b36a22065bbc923b04a. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:21:41.637380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-09d59ea3-ab18-404e-b9c7-984d7955f9a7 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:41.649160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09d59ea3-ab18-404e-b9c7-984d7955f9a7 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1219 microversion: 2.1 time: 0.267412 Nov 02 21:21:41.649745 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 54/104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:41 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1219 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:41.665156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-414a8346-b6c9-48aa-b47e-9fc1c94dabef tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:41.712835 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ffab471a-0d2c-4aa3-a3f4-0163acc748c2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.325968 Nov 02 21:21:41.714746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 51/105] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:21:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:41.855677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:41.862863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:41.863782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:41.864331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:41.864809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:41.865602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:41.874905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:41.875835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:42.147080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:42.159422 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c67db2b1-a2eb-4b59-98b4-30417cb9555f tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.307330 Nov 02 21:21:42.172961 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 52/106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:41 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:42.673853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b797381b-c514-4d1c-9de6-dd068b790fad tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:42.675361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b797381b-c514-4d1c-9de6-dd068b790fad tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:42.968269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b797381b-c514-4d1c-9de6-dd068b790fad tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:42.985186 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b797381b-c514-4d1c-9de6-dd068b790fad tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1219 microversion: 2.1 time: 0.316357 Nov 02 21:21:42.986394 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 53/107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:42 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1219 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:42.997099 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-414a8346-b6c9-48aa-b47e-9fc1c94dabef tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] HTTP exception thrown: Flavor access already exists for flavor 20 and project 64168cc817be4013b4075d2781a14599 combination. Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-414a8346-b6c9-48aa-b47e-9fc1c94dabef tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Request method failure captured: Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/flavors/965919709/action HTTP/1.1 Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 67 Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9fBlcjQx9h7ZvcZhCI4wU9-5V0yRp6s5pqNvl8IUqi9JBFDjppmawEVrtDWm6EUS-5343bdiUHAVxGx6OugYYjMkshFLJSAz_xGDDN_BtzOzbLy0M7LyjvePCNzNTWX-BHuTv_BvqK6w-aGpZ8BdSsSslTp2WtuUUFjwtvUegSIbs Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0b1e74566a6e42dbaa563a5e953f177d Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:43.007165 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0b1e74566a6e42dbaa563a5e953f177d Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9c5b4a185ccc4721a24954afebe545a9 Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: {"addTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} Nov 02 21:21:43.008670 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: exception: Flavor access already exists for flavor 20 and project 64168cc817be4013b4075d2781a14599 combination. Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '965919709', 'body': {'addTenantAccess': {'tenant': '64168cc817be4013b4075d2781a14599'}}} Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result.read() Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 21:21:43.009514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '20-64168cc817be4013b4075d2781a14599' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 21:21:43.011069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 21:21:43.012314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 21:21:43.013443 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result.read() Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '20-64168cc817be4013b4075d2781a14599' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 21, 21, 42, 894817), 'updated_at': None, 'flavor_id': 20, 'project_id': '64168cc817be4013b4075d2781a14599'}] Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:43.014941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 20 and project 64168cc817be4013b4075d2781a14599 combination. Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:43.016310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 20 and project 64168cc817be4013b4075d2781a14599 combination. Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:43.020218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:43.022145 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 20 and project 64168cc817be4013b4075d2781a14599 combination. Nov 02 21:21:43.022145 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:43.036758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-414a8346-b6c9-48aa-b47e-9fc1c94dabef tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Returning 409 to user: Flavor access already exists for flavor 20 and project 64168cc817be4013b4075d2781a14599 combination. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:43.039096 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-414a8346-b6c9-48aa-b47e-9fc1c94dabef tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/965919709/action" status: 409 len: 152 microversion: 2.1 time: 1.384526 Nov 02 21:21:43.051645 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 55/108] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 21:21:41 2022] POST /compute/v2.1/flavors/965919709/action => generated 152 bytes in 1397 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:43.075363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71e0c0bc-0fa6-4cd6-ad5c-e391d9454fb2 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:43.552591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3cb9b367-6be7-4a3b-a341-1d9d8a30a7e1 req-e6b5729e-2463-4bca-aba9-39404aef7133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87092801-1aba-4e56-a505-74a53a15b6ea", "tag": "382d9b80-3f06-4128-bf16-c04455bbed5d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:43.572898 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71e0c0bc-0fa6-4cd6-ad5c-e391d9454fb2 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/965919709/action" status: 200 len: 21 microversion: 2.1 time: 0.513829 Nov 02 21:21:43.582625 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 54/109] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 21:21:43 2022] POST /compute/v2.1/flavors/965919709/action => generated 21 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:43.591828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3cb9b367-6be7-4a3b-a341-1d9d8a30a7e1 req-e6b5729e-2463-4bca-aba9-39404aef7133 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:43.592314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3cb9b367-6be7-4a3b-a341-1d9d8a30a7e1 req-e6b5729e-2463-4bca-aba9-39404aef7133 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:43.594061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3cb9b367-6be7-4a3b-a341-1d9d8a30a7e1 req-e6b5729e-2463-4bca-aba9-39404aef7133 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:43.595265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:43.599612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:43.612594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:43.613506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:43.614161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:43.615107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:43.615778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:43.616417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:43.633557 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3cb9b367-6be7-4a3b-a341-1d9d8a30a7e1 req-e6b5729e-2463-4bca-aba9-39404aef7133 service nova] Creating event network-changed:382d9b80-3f06-4128-bf16-c04455bbed5d for instance 87092801-1aba-4e56-a505-74a53a15b6ea on n-h2-860863-4 Nov 02 21:21:43.641968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3cb9b367-6be7-4a3b-a341-1d9d8a30a7e1 req-e6b5729e-2463-4bca-aba9-39404aef7133 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:21:43.642623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3cb9b367-6be7-4a3b-a341-1d9d8a30a7e1 req-e6b5729e-2463-4bca-aba9-39404aef7133 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:21:43.644043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:43.645880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:43.646798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:43.654051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:43.654705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:43.656347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:43.689693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.rpcapi [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 21:21:43.694727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] Releasing lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:21:43.748436 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-383d4ded-26f5-48df-8a9a-6a679275b64b None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.588901 Nov 02 21:21:43.749553 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 56/110] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:43.761547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-531cddc6-f394-405d-82f7-b04e4d057307 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:43.951801 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-531cddc6-f394-405d-82f7-b04e4d057307 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/965919709" status: 202 len: 0 microversion: 2.1 time: 0.200310 Nov 02 21:21:43.952589 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 57/111] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:21:43 2022] DELETE /compute/v2.1/flavors/965919709 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:21:43.961367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b805d71c-eda2-414c-8a5b-26017f748293 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:43.997135 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b805d71c-eda2-414c-8a5b-26017f748293 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.040076 Nov 02 21:21:43.999003 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 58/112] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:43 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:44.023368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:44.025051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:44.032884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:44.033460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:44.034698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:44.035599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:44.036246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:44.036814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:44.206890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:44.239603 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5bc42ead-c732-43a9-abb1-db5f04518c5e tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.655186 Nov 02 21:21:44.240130 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 55/113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:43 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:44.245235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c6b25603-6a85-43be-a9bd-034827f8182f tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1474168123", "id": 1141465013, "os-flavor-access:is_public": "True"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:44.260189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:44.283298 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d9ae6eb-b685-44a7-abfb-ff8e31b56fdd tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1223 microversion: 2.1 time: 0.266309 Nov 02 21:21:44.291146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 59/114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:44 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1223 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:44.355804 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c6b25603-6a85-43be-a9bd-034827f8182f tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.113951 Nov 02 21:21:44.363457 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 56/115] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:44 2022] POST /compute/v2.1/flavors => generated 438 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:44.374124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-407076fe-6d8c-4492-a0ee-fbc4728b00f2 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:44.383920 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-407076fe-6d8c-4492-a0ee-fbc4728b00f2 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-407076fe-6d8c-4492-a0ee-fbc4728b00f2 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Request method failure captured: Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/flavors/1141465013/os-flavor-access HTTP/1.1 Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9fBlcjQx9h7ZvcZhCI4wU9-5V0yRp6s5pqNvl8IUqi9JBFDjppmawEVrtDWm6EUS-5343bdiUHAVxGx6OugYYjMkshFLJSAz_xGDDN_BtzOzbLy0M7LyjvePCNzNTWX-BHuTv_BvqK6w-aGpZ8BdSsSslTp2WtuUUFjwtvUegSIbs Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0b1e74566a6e42dbaa563a5e953f177d Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:44.385861 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0b1e74566a6e42dbaa563a5e953f177d Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9c5b4a185ccc4721a24954afebe545a9 Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: exception: Access list not available for public flavors. Nov 02 21:21:44.386993 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'flavor_id': '1141465013'} Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 02 21:21:44.388339 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:44.390345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-407076fe-6d8c-4492-a0ee-fbc4728b00f2 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:44.390345 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-407076fe-6d8c-4492-a0ee-fbc4728b00f2 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1141465013/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020217 Nov 02 21:21:44.414537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d503adde-69c4-4896-b3b6-34e4d4d65ad3 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:44.417303 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 60/116] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 21:21:44 2022] GET /compute/v2.1/flavors/1141465013/os-flavor-access => generated 91 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:21:44.574370 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d503adde-69c4-4896-b3b6-34e4d4d65ad3 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1141465013" status: 202 len: 0 microversion: 2.1 time: 0.179195 Nov 02 21:21:44.578324 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 57/117] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:21:44 2022] DELETE /compute/v2.1/flavors/1141465013 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:21:44.586971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8714ffb8-873d-4461-a8d4-28be4e6a800c tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:44.642580 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8714ffb8-873d-4461-a8d4-28be4e6a800c tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.062417 Nov 02 21:21:44.660554 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 61/118] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:44 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:44.670351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4586662c-9109-4481-821e-458e773975a9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-405015672", "id": 1034263134, "os-flavor-access:is_public": "False"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:44.759659 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4586662c-9109-4481-821e-458e773975a9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.093610 Nov 02 21:21:44.760967 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 58/119] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:44 2022] POST /compute/v2.1/flavors => generated 438 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:45.267579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:45.269467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:45.282352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:45.285682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:45.286466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:45.290574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:45.292628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:45.293240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:45.756702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-038fb889-8f43-426b-b752-32202e3dd1bc tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:45.761369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-038fb889-8f43-426b-b752-32202e3dd1bc tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd0336f94555e45f399c93703a58b14e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64168cc817be4013b4075d2781a14599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-038fb889-8f43-426b-b752-32202e3dd1bc tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Request method failure captured: Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/flavors/1034263134/action HTTP/1.1 Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 67 Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9cNxgx_Q-3ef1V5UfmXIw0Mdb-YN8OHqShkb4SrMYZtsBK1O--prRIj9UjUvjm8WA4ky7nIC40da2vjlDTyDUJ0Fs6Ic3fBW6MFomgfhjswtzKnd3_YY10ggg-0nAdjCUQtJmManqTSouMFGdcw2H-X7VaYDwrSqCH01ytDY5p8Ec Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 64168cc817be4013b4075d2781a14599 Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1999581672 Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:45.766286 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64168cc817be4013b4075d2781a14599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64168cc817be4013b4075d2781a14599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64168cc817be4013b4075d2781a14599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64168cc817be4013b4075d2781a14599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1999581672 Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 64168cc817be4013b4075d2781a14599 Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1999581672 Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsAccessNegativeTestJSON-1999581672-project Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: d0336f94555e45f399c93703a58b14e4 Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1999581672-project Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: {"addTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} Nov 02 21:21:45.767791 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1034263134', 'body': {'addTenantAccess': {'tenant': '64168cc817be4013b4075d2781a14599'}}} Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:45.769018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 21:21:45.771498 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:45.781849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-038fb889-8f43-426b-b752-32202e3dd1bc tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:45.786583 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-038fb889-8f43-426b-b752-32202e3dd1bc tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] 10.222.0.25 "POST /compute/v2.1/flavors/1034263134/action" status: 403 len: 130 microversion: 2.1 time: 1.011043 Nov 02 21:21:45.787684 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 62/120] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 21:21:44 2022] POST /compute/v2.1/flavors/1034263134/action => generated 130 bytes in 1017 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:45.798219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:45.798658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:45.814664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:45.817152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:45.817745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:45.818506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:45.818982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:45.819558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:45.919167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:45.936392 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-84a64510-d641-4a02-b0d1-eab42965d193 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.673781 Nov 02 21:21:45.937779 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 59/121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:45 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:45.943952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01c6200c-88b0-41e1-9839-471f87a0cd0b tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:45.998690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:46.009548 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfde1aa4-241d-4937-9f4d-d3987dd22ae0 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1279 microversion: 2.1 time: 0.220649 Nov 02 21:21:46.026374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 63/122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:45 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:46.098750 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01c6200c-88b0-41e1-9839-471f87a0cd0b tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1034263134" status: 202 len: 0 microversion: 2.1 time: 0.159720 Nov 02 21:21:46.108326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9bd5ce7-62bc-4c7a-9810-0eae2eed2997 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:46.108631 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 60/123] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:21:45 2022] DELETE /compute/v2.1/flavors/1034263134 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:21:46.166854 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9bd5ce7-62bc-4c7a-9810-0eae2eed2997 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.062415 Nov 02 21:21:46.191722 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 64/124] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:46 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:46.198687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1bd0e27-09da-4780-9cd4-3ec4ec02efa9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1027345319", "id": 2141381083, "os-flavor-access:is_public": "False"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:46.300391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1bd0e27-09da-4780-9cd4-3ec4ec02efa9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.107207 Nov 02 21:21:46.301334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 65/125] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:46 2022] POST /compute/v2.1/flavors => generated 439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:46.316366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33282751-140a-47a0-9d9f-84b252626f24 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:46.349953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Calling method '.version_select at 0x7f9b69bb1dc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:46.351739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.352385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.369609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.383171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.383909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.384425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.399169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.399981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.400788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.409514 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aaf57a9c-b725-4451-9e9c-2c38b4118b0b tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.273345 Nov 02 21:21:46.411376 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 61/126] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:46.444942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Calling method '.version_select at 0x7f9b69bb11f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:46.458640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.459154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.459609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.514134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.515704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.516301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.592089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.592963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.593603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.607797 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a86b45c-5f67-4273-b7e8-eb1f6a81ab90 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-860863-4/servers" status: 200 len: 196 microversion: 2.1 time: 0.178274 Nov 02 21:21:46.607797 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 62/127] 10.222.0.25 () {58 vars in 1212 bytes} [Wed Nov 2 21:21:46 2022] GET /compute/v2.1/os-hypervisors/n-h2-860863-4/servers => generated 196 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:46.628917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Calling method '.version_select at 0x7f9b69b64670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:46.633483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.634339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.634909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.666490 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33282751-140a-47a0-9d9f-84b252626f24 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2141381083/action" status: 200 len: 97 microversion: 2.1 time: 0.356343 Nov 02 21:21:46.667313 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 66/128] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 21:21:46 2022] POST /compute/v2.1/flavors/2141381083/action => generated 97 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:46.673041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.673041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.673041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.679940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85e68baf-215d-469c-a858-257c9396f446 tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:46.690160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-85e68baf-215d-469c-a858-257c9396f446 tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd0336f94555e45f399c93703a58b14e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64168cc817be4013b4075d2781a14599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85e68baf-215d-469c-a858-257c9396f446 tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Request method failure captured: Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/flavors/2141381083/action HTTP/1.1 Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 70 Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9cNxgx_Q-3ef1V5UfmXIw0Mdb-YN8OHqShkb4SrMYZtsBK1O--prRIj9UjUvjm8WA4ky7nIC40da2vjlDTyDUJ0Fs6Ic3fBW6MFomgfhjswtzKnd3_YY10ggg-0nAdjCUQtJmManqTSouMFGdcw2H-X7VaYDwrSqCH01ytDY5p8Ec Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 64168cc817be4013b4075d2781a14599 Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1999581672 Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:21:46.694490 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64168cc817be4013b4075d2781a14599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64168cc817be4013b4075d2781a14599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64168cc817be4013b4075d2781a14599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64168cc817be4013b4075d2781a14599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1999581672 Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 64168cc817be4013b4075d2781a14599 Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1999581672 Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsAccessNegativeTestJSON-1999581672-project Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: d0336f94555e45f399c93703a58b14e4 Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1999581672-project Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: {"removeTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} Nov 02 21:21:46.696876 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2141381083', 'body': {'removeTenantAccess': {'tenant': '64168cc817be4013b4075d2781a14599'}}} Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can( Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:21:46.697524 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 21:21:46.698521 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:46.699517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85e68baf-215d-469c-a858-257c9396f446 tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:46.701527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.703761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.703903 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85e68baf-215d-469c-a858-257c9396f446 tempest-FlavorsAccessNegativeTestJSON-1999581672 tempest-FlavorsAccessNegativeTestJSON-1999581672-project] 10.222.0.25 "POST /compute/v2.1/flavors/2141381083/action" status: 403 len: 133 microversion: 2.1 time: 0.021631 Nov 02 21:21:46.705204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.705623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 67/129] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 21:21:46 2022] POST /compute/v2.1/flavors/2141381083/action => generated 133 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:46.718951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9087a451-fbdb-4ff7-bbb7-8999233d8992 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.099058 Nov 02 21:21:46.723118 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 63/130] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:46.724841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-922746ea-c9b7-45d7-8392-0d7082036cdd tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "64168cc817be4013b4075d2781a14599"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:46.740818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Calling method '.version_select at 0x7f9b69b643a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:46.742767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.743440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.744422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.768373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:46.769133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:46.770579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:46.782506 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0f2339a-49a9-4a3a-9d1d-7115160f9923 tempest-HypervisorAdminUnderV252Test-222713435 tempest-HypervisorAdminUnderV252Test-222713435-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-860863-4/search" status: 200 len: 104 microversion: 2.1 time: 0.043855 Nov 02 21:21:46.783948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 64/131] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 21:21:46 2022] GET /compute/v2.1/os-hypervisors/n-h2-860863-4/search => generated 104 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:46.885344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2118846849", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "464443597", "adminPass": "***", "networks": [{"uuid": "151be214-a7c0-4f14-a002-4d9a3290d39f"}], "security_groups": [{"name": "tempest-securitygroup--1564118783"}], "key_name": "tempest-keypair-1112162530", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:47.857059 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-922746ea-c9b7-45d7-8392-0d7082036cdd tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/2141381083/action" status: 200 len: 21 microversion: 2.1 time: 1.143095 Nov 02 21:21:47.863810 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 68/132] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 21:21:46 2022] POST /compute/v2.1/flavors/2141381083/action => generated 21 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:21:47.900340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:47.910003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:47.949245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:47.949245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:47.949245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:47.949245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:47.949651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:47.961364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:48.206082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:48.218139 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04226c67-8b92-43ad-8c99-131394eb8176 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.351106 Nov 02 21:21:48.218731 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 69/133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:47 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:48.242366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:48.250754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:48.251175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:48.251450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:48.251987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:48.252705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:48.253234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:48.253918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:48.512015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:48.521787 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-01bd6996-b28f-4ab4-ae71-c3e1c479b844 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.283911 Nov 02 21:21:48.522589 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 70/134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:48 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:48.527634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fd2e5bd-e2d5-4696-ad87-abfc9a7847b5 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:48.666087 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fd2e5bd-e2d5-4696-ad87-abfc9a7847b5 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2141381083" status: 202 len: 0 microversion: 2.1 time: 0.142212 Nov 02 21:21:48.667367 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 71/135] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:21:48 2022] DELETE /compute/v2.1/flavors/2141381083 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:21:48.687792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d76b77e-14c4-4b1b-a985-e626547dbb35 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:48.744697 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d76b77e-14c4-4b1b-a985-e626547dbb35 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.060857 Nov 02 21:21:48.746631 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 72/136] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:48 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:48.774297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-40ee848d-7e79-4691-8d0e-89f70dd8e9c0 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1648865572", "id": 171517526, "os-flavor-access:is_public": "False"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:48.861845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-40ee848d-7e79-4691-8d0e-89f70dd8e9c0 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.091897 Nov 02 21:21:48.863039 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 73/137] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:48 2022] POST /compute/v2.1/flavors => generated 436 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:48.897196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d46278f4-3fe5-4716-ab3a-17a63948afc9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "df12dbf85f384b2da14b340fd7300a14"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:49.295938 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d46278f4-3fe5-4716-ab3a-17a63948afc9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] HTTP exception thrown: Flavor access not found for 25 / df12dbf85f384b2da14b340fd7300a14 combination. Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d46278f4-3fe5-4716-ab3a-17a63948afc9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Request method failure captured: Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/flavors/171517526/action HTTP/1.1 Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 70 Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9fBlcjQx9h7ZvcZhCI4wU9-5V0yRp6s5pqNvl8IUqi9JBFDjppmawEVrtDWm6EUS-5343bdiUHAVxGx6OugYYjMkshFLJSAz_xGDDN_BtzOzbLy0M7LyjvePCNzNTWX-BHuTv_BvqK6w-aGpZ8BdSsSslTp2WtuUUFjwtvUegSIbs Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0b1e74566a6e42dbaa563a5e953f177d Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:21:49.297785 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1e74566a6e42dbaa563a5e953f177d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0b1e74566a6e42dbaa563a5e953f177d Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104 Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9c5b4a185ccc4721a24954afebe545a9 Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: {"removeTenantAccess": {"tenant": "df12dbf85f384b2da14b340fd7300a14"}} Nov 02 21:21:49.299746 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: exception: Flavor access not found for 25 / df12dbf85f384b2da14b340fd7300a14 combination. Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '171517526', 'body': {'removeTenantAccess': {'tenant': 'df12dbf85f384b2da14b340fd7300a14'}}} Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 02 21:21:49.300377 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / df12dbf85f384b2da14b340fd7300a14 combination. Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / df12dbf85f384b2da14b340fd7300a14 combination. Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:49.302318 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / df12dbf85f384b2da14b340fd7300a14 combination. Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d46278f4-3fe5-4716-ab3a-17a63948afc9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Returning 404 to user: Flavor access not found for 25 / df12dbf85f384b2da14b340fd7300a14 combination. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:21:49.303353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d46278f4-3fe5-4716-ab3a-17a63948afc9 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/171517526/action" status: 404 len: 124 microversion: 2.1 time: 0.423920 Nov 02 21:21:49.306072 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 74/138] 10.222.0.25 () {60 vars in 1197 bytes} [Wed Nov 2 21:21:48 2022] POST /compute/v2.1/flavors/171517526/action => generated 124 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:21:49.316158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:49.320898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:49.329409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:49.329896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:49.330337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:49.331050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:49.331505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:49.331931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:49.524512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:49.533668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5be4584-3b20-4d87-acd2-b9bd697ba6e2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.226383 Nov 02 21:21:49.534162 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 75/139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:49 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:49.539247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bb7a98c2-958c-4d4b-a9af-982408c8f4b6 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:49.614970 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bb7a98c2-958c-4d4b-a9af-982408c8f4b6 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/171517526" status: 202 len: 0 microversion: 2.1 time: 0.079381 Nov 02 21:21:49.617882 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 76/140] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:21:49 2022] DELETE /compute/v2.1/flavors/171517526 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:21:49.626233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:49.627172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:49.633206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:49.633950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:49.634392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:49.635090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:49.635542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:49.635971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:49.734451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:49.793225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:49.810216 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb50d8e3-2715-4068-8b18-d2fbbaaef081 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.182628 Nov 02 21:21:49.810216 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 77/141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:49 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:49.815763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b97b418-11e3-45cc-a7d9-909dd11be281 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:49.865570 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b97b418-11e3-45cc-a7d9-909dd11be281 tempest-FlavorsAccessNegativeTestJSON-1668950104 tempest-FlavorsAccessNegativeTestJSON-1668950104-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.061365 Nov 02 21:21:49.867273 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 78/142] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:49 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:50.795274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d9172d46-77a8-40db-813d-bd89fe359435 tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1908985541", "id": 1553412831, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:50.932736 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d9172d46-77a8-40db-813d-bd89fe359435 tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.619906 Nov 02 21:21:50.942630 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 79/143] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:21:50 2022] POST /compute/v2.1/flavors => generated 468 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:21:50.947604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:50.948239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:50.965881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:50.966606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:50.967266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:50.968161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:50.968801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:50.969468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:51.241675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:51.253654 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5537a06a-dcb3-44d7-a77e-f34e3943ce12 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.309875 Nov 02 21:21:51.258835 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 80/144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:50 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:51.260252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:51.260973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:51.267345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:51.268025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:51.268678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:51.269685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:51.270352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:51.270950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:51.484586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:51.513769 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af901396-d7b5-47c7-85e6-b2aa1f35f160 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.253098 Nov 02 21:21:51.516223 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 81/145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:51 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:51.643694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:51.864223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8fa2af1-5774-4bb1-b28b-cb1b6f02468b tempest-FlavorsV261TestJSON-397966076 tempest-FlavorsV261TestJSON-397966076-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:51.878659 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8fa2af1-5774-4bb1-b28b-cb1b6f02468b tempest-FlavorsV261TestJSON-397966076 tempest-FlavorsV261TestJSON-397966076-project] 10.222.0.25 "GET /compute/v2.1/flavors/1553412831" status: 200 len: 468 microversion: 2.61 time: 0.353687 Nov 02 21:21:51.892431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 82/146] 10.222.0.25 () {60 vars in 1199 bytes} [Wed Nov 2 21:21:51 2022] GET /compute/v2.1/flavors/1553412831 => generated 468 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:21:51.937359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02f0c7e6-fb9b-4416-970c-fb68034906ec tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:52.064863 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02f0c7e6-fb9b-4416-970c-fb68034906ec tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] 10.222.0.25 "PUT /compute/v2.1/flavors/1553412831" status: 200 len: 469 microversion: 2.61 time: 0.170685 Nov 02 21:21:52.076092 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 83/147] 10.222.0.25 () {62 vars in 1219 bytes} [Wed Nov 2 21:21:51 2022] PUT /compute/v2.1/flavors/1553412831 => generated 469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:21:52.085067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf46d871-4291-475e-b512-f1bf6ec12c85 tempest-FlavorsV261TestJSON-397966076 tempest-FlavorsV261TestJSON-397966076-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:52.094145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:52.135438 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf46d871-4291-475e-b512-f1bf6ec12c85 tempest-FlavorsV261TestJSON-397966076 tempest-FlavorsV261TestJSON-397966076-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.054125 Nov 02 21:21:52.136059 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 84/148] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:52 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:21:52.177779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef6f8e03-ce4a-42b2-9c7a-b27567e2395f tempest-FlavorsV261TestJSON-397966076 tempest-FlavorsV261TestJSON-397966076-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:52.213169 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef6f8e03-ce4a-42b2-9c7a-b27567e2395f tempest-FlavorsV261TestJSON-397966076 tempest-FlavorsV261TestJSON-397966076-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.051362 Nov 02 21:21:52.215094 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 85/149] 10.222.0.25 () {60 vars in 1166 bytes} [Wed Nov 2 21:21:52 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:21:52.235362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6b7e3bf-9820-47ef-9cae-1381d9b2c917 tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:52.335217 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6b7e3bf-9820-47ef-9cae-1381d9b2c917 tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1553412831" status: 202 len: 0 microversion: 2.61 time: 0.104798 Nov 02 21:21:52.337360 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 86/150] 10.222.0.25 () {60 vars in 1202 bytes} [Wed Nov 2 21:21:52 2022] DELETE /compute/v2.1/flavors/1553412831 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:21:52.343724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:52.344676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:52.352333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:52.353296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:52.354016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:52.362376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:52.363900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:52.364485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:52.578692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:52.589630 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d05950c7-6f89-49e8-af95-dfea1d702841 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.250301 Nov 02 21:21:52.591535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 87/151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:52 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:52.596171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-597038de-4ecd-4a22-a35a-7408eb1455ee tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:52.632833 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-597038de-4ecd-4a22-a35a-7408eb1455ee tempest-FlavorsV261TestJSON-404877602 tempest-FlavorsV261TestJSON-404877602-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.040112 Nov 02 21:21:52.634242 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 88/152] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:21:52 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:21:52.649029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:52.665791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:52.675648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:52.676158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:52.676590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:52.677446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:52.678138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:52.678499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:52.873028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:52.888803 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3935e229-737c-440d-a3f2-078d8e248841 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.249299 Nov 02 21:21:52.891579 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 89/153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:52 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:52.981681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:53.616109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:53.620388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:53.623819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:53.624304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:53.624744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:53.625466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:53.625923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:53.626347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:53.675690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:53.907731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] validate_networks() for [('151be214-a7c0-4f14-a002-4d9a3290d39f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:21:53.912021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:53.923202 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-159d6028-fac3-42b1-824e-e1fbe2221d75 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.310302 Nov 02 21:21:53.940169 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 90/154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:53 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:53.957880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:53.960856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:53.978123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:53.981859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:53.984209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:53.986077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:53.989057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:53.991205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:54.291686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:54.304141 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-574321fc-3ed1-43f1-b59d-3ad442f14613 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.360425 Nov 02 21:21:54.306123 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 91/155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:53 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:54.696386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5354acb-2f56-45ff-b552-71a21e2fbd7d tempest-NetworksTest-1960579207 tempest-NetworksTest-1960579207-project-admin] Calling method '.version_select at 0x7f9b699faaf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:54.885788 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5354acb-2f56-45ff-b552-71a21e2fbd7d tempest-NetworksTest-1960579207 tempest-NetworksTest-1960579207-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.577563 Nov 02 21:21:54.886548 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 92/156] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:21:54 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:54.900857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d79bacf-6217-4bf9-b775-7cb08fc150a2 tempest-NetworksTest-1960579207 tempest-NetworksTest-1960579207-project-admin] Calling method '.version_select at 0x7f9b699bbaf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:55.080470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d79bacf-6217-4bf9-b775-7cb08fc150a2 tempest-NetworksTest-1960579207 tempest-NetworksTest-1960579207-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks/55f73d09-d8fc-4fe3-b407-bd8011dab919" status: 200 len: 652 microversion: 2.1 time: 0.189120 Nov 02 21:21:55.081580 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 93/157] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:21:54 2022] GET /compute/v2.1/os-networks/55f73d09-d8fc-4fe3-b407-bd8011dab919 => generated 652 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:55.088294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:55.092157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:55.099166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:55.099886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:55.100485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:55.101244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:55.101699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:55.102170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:55.463256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:21:55.464296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:21:55.464773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:21:55.465410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:21:55.466336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:21:55.476392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:55.477076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:55.477518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:55.478242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:55.478740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:55.479167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:55.486254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=73 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:55.499576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Getting quotas for project fd4894dee76f4b36a22065bbc923b04a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:21:55.501760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:55.504750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Getting quotas for user 7e5759f947464db980b4dc96a5cd984d and project fd4894dee76f4b36a22065bbc923b04a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:21:55.518803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:55.528808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7656c03a-015b-428d-b7a9-efdb78aceb2a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.440992 Nov 02 21:21:55.528808 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 94/158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:55 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:55.533381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:21:55.541624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:21:55.545089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-37da89f7-27d1-44a3-ad77-70fdba0442e9 tempest-NetworksTest-1960579207 tempest-NetworksTest-1960579207-project-admin] Calling method '.version_select at 0x7f9b6994f790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:55.710596 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-37da89f7-27d1-44a3-ad77-70fdba0442e9 tempest-NetworksTest-1960579207 tempest-NetworksTest-1960579207-project-admin] 10.222.0.25 "GET /compute/v2.1/os-networks" status: 200 len: 3327 microversion: 2.1 time: 0.182852 Nov 02 21:21:55.711352 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 95/159] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:21:55 2022] GET /compute/v2.1/os-networks => generated 3327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:55.717262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:55.717872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:55.718841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b727b5d-2677-4ff9-885d-92ea725cf3c3 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.839191 Nov 02 21:21:55.719729 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 65/160] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:21:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 8841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:21:55.738260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:55.738767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:55.739207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:55.739913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:55.740370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:55.740792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:55.742313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14e5acec-0cdc-4575-8daf-d647d1268fa4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:55.743165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14e5acec-0cdc-4575-8daf-d647d1268fa4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:55.848479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-14e5acec-0cdc-4575-8daf-d647d1268fa4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:55.861692 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14e5acec-0cdc-4575-8daf-d647d1268fa4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1263 microversion: 2.1 time: 0.133032 Nov 02 21:21:55.863750 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 66/161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:55 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1263 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:55.948637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:55.957424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88cf5620-42de-4745-b3c2-f9b1cfe2b5a9 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.244665 Nov 02 21:21:55.958269 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 96/162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:55 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:56.548962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:56.549972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:56.556639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:56.562397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:56.562397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:56.562397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:56.562397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:56.562711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:56.730349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:56.745976 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6563e456-d3fb-4765-bb57-0ec012fd4f35 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.201282 Nov 02 21:21:56.756980 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 67/163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:56 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:56.888429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6cd49a4d-55e1-4f83-986c-7fcb528bb362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:56.889102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6cd49a4d-55e1-4f83-986c-7fcb528bb362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:56.981139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:56.981945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:56.994496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:56.995980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:56.997661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:56.998459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:57.000656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:57.001195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:57.032448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6cd49a4d-55e1-4f83-986c-7fcb528bb362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:57.040279 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6cd49a4d-55e1-4f83-986c-7fcb528bb362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1263 microversion: 2.1 time: 0.156162 Nov 02 21:21:57.041912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 97/164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:56 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:57.352894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:57.365713 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3689b0f9-4880-4c97-a612-58381d0509b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.386793 Nov 02 21:21:57.367765 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 68/165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:56 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:21:57.776439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:57.780048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:57.788558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:57.789318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:57.789920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:57.790774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:57.791369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:57.791944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:58.011149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:58.022448 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-80ccc643-7351-4466-8b4e-866b0e883cc8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.257102 Nov 02 21:21:58.027548 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 98/166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:57 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:58.069485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:58.070555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:58.083111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:58.084430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:58.085239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:58.086414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:58.087591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:58.089113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:58.178281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:58.191417 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff5a07ad-08af-4c80-96b1-8324888187d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1315 microversion: 2.1 time: 0.126202 Nov 02 21:21:58.196485 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 69/167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:58 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1315 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:58.398740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:58.399978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:58.411133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:58.412409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:58.413072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:58.414241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:58.414893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:58.415644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:58.787384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:58.800125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46befc48-abd9-4337-95b6-53d71e10c90b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.412795 Nov 02 21:21:58.801257 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 99/168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:58 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:59.125952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-39a41992-0bac-43f5-9269-16220e0be303 req-938b47ca-e598-4927-856d-a4c60e798ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9483dc5b-212f-45a2-beef-3e5c3cd8e10f", "tag": "2c33e0dd-385e-4ab6-bae0-a27e621c2b6f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:21:59.138782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39a41992-0bac-43f5-9269-16220e0be303 req-938b47ca-e598-4927-856d-a4c60e798ad2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.139263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39a41992-0bac-43f5-9269-16220e0be303 req-938b47ca-e598-4927-856d-a4c60e798ad2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.139685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39a41992-0bac-43f5-9269-16220e0be303 req-938b47ca-e598-4927-856d-a4c60e798ad2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.160981 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-39a41992-0bac-43f5-9269-16220e0be303 req-938b47ca-e598-4927-856d-a4c60e798ad2 service nova] Creating event network-changed:2c33e0dd-385e-4ab6-bae0-a27e621c2b6f for instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f on n-h1-860863-4 Nov 02 21:21:59.161695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39a41992-0bac-43f5-9269-16220e0be303 req-938b47ca-e598-4927-856d-a4c60e798ad2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:21:59.162271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39a41992-0bac-43f5-9269-16220e0be303 req-938b47ca-e598-4927-856d-a4c60e798ad2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:21:59.163461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.163997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.164501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.165349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.165876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.166534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.177249 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.rpcapi [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 21:21:59.177919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] Releasing lock "compute-rpcapi-router" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:21:59.185732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b69993dc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.187837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.188321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.188749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.194913 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-21cc6521-d1f1-438d-9ab2-75c2c72b1c1a None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323430 Nov 02 21:21:59.195826 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 70/169] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:59.202314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.203188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:59.204033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.204521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.204975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.209833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.210545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.211189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.212521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.212634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.213105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.216356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.216839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.217376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.228461 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d92faf07-1caa-4a59-b075-d646cd483ba2 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.195358 Nov 02 21:21:59.229382 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 100/170] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:59.248902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.251356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:59.257100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.257828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.258643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.259428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.259980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.260495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.345258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:59.353163 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31fac140-b588-4560-a965-87dff88a12b6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1323 microversion: 2.1 time: 0.115029 Nov 02 21:21:59.353740 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 101/171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1323 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:59.358673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b699bbaf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.360854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.361496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.362097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.377095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.377803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.378378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.390645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.391349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.391928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.398477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9164149d-294b-481b-863b-dcedddd9d731 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.043618 Nov 02 21:21:59.399580 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 102/172] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:59.408293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:21:59.417461 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b1d5ab9-14c1-4c66-8640-4382dce0c9d2 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.220257 Nov 02 21:21:59.417805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b699bb1f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.418356 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 71/173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:21:59.419789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.420268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.420706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.438296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.438883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.448246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.452394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.452887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.453356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.459509 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-848614e3-7977-4caa-8cd7-8b897725cb2a tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.045565 Nov 02 21:21:59.460096 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 103/174] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:59.470801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b69c60ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.472583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.473116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.473563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.489630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.492613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.492613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.498411 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-04395cc4-9c05-4cb0-88e5-bd1c0fbff72c tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.031042 Nov 02 21:21:59.499347 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 72/175] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:59.522723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6df39be-8b34-4d6d-b4c2-e3473379f8f3 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b699fa160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.532671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6df39be-8b34-4d6d-b4c2-e3473379f8f3 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.532671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6df39be-8b34-4d6d-b4c2-e3473379f8f3 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.533143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6df39be-8b34-4d6d-b4c2-e3473379f8f3 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.570356 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e6df39be-8b34-4d6d-b4c2-e3473379f8f3 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.059081 Nov 02 21:21:59.581452 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 104/176] 10.222.0.25 () {58 vars in 1179 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:59.584347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b69b98670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.586296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.587220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.588787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.608493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.609338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.610006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.619295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:21:59.622885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.623375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.623812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.631069 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89cbce62-dd32-441a-b8fa-c66e711a57ab tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050784 Nov 02 21:21:59.637910 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 73/177] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:59.643364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b699faee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.644800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.645463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.646048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.662493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.663085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.663581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.671263 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38efcfef-5703-43c2-a97b-98b72d498e82 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.031865 Nov 02 21:21:59.671949 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 105/178] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:59.687108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b69c60670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.689152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.689513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.689971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.703419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.703894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.704322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.721445 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cab84620-c81d-4ea6-878d-919503335a91 tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.037794 Nov 02 21:21:59.723091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 74/179] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:21:59.738730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Calling method '.version_select at 0x7f9b699fa0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.741220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.746650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.746650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.757128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.758128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.758745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.775848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.778330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.778330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.818920 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb8e3fdd-b6de-4feb-81ec-e3f1c34df4df tempest-HypervisorAdminTestJSON-1855668486 tempest-HypervisorAdminTestJSON-1855668486-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.080795 Nov 02 21:21:59.823472 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 106/180] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:21:59.829359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:21:59.830204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:21:59.836588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.837316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.838135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:21:59.839024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:21:59.839643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:21:59.840259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:00.057106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:00.070965 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e71024c-4036-4561-bea8-dcee519c906c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.247901 Nov 02 21:22:00.072614 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 75/181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:21:59 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:00.310097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-de2da398-2a7e-49f8-96ac-271a3dad2cab req-e124703f-606c-4518-baf2-d26946d57a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87092801-1aba-4e56-a505-74a53a15b6ea", "name": "network-vif-plugged", "status": "completed", "tag": "382d9b80-3f06-4128-bf16-c04455bbed5d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:00.321387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de2da398-2a7e-49f8-96ac-271a3dad2cab req-e124703f-606c-4518-baf2-d26946d57a72 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:00.321814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de2da398-2a7e-49f8-96ac-271a3dad2cab req-e124703f-606c-4518-baf2-d26946d57a72 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:00.322244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de2da398-2a7e-49f8-96ac-271a3dad2cab req-e124703f-606c-4518-baf2-d26946d57a72 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:00.346130 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-de2da398-2a7e-49f8-96ac-271a3dad2cab req-e124703f-606c-4518-baf2-d26946d57a72 service nova] Creating event network-vif-plugged:382d9b80-3f06-4128-bf16-c04455bbed5d for instance 87092801-1aba-4e56-a505-74a53a15b6ea on n-h2-860863-4 Nov 02 21:22:00.352304 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-de2da398-2a7e-49f8-96ac-271a3dad2cab req-e124703f-606c-4518-baf2-d26946d57a72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.327317 Nov 02 21:22:00.353136 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 107/182] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:00.379628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:00.380788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:00.391256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:00.394199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:00.394199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:00.394199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:00.394476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:00.394476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:00.442131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:00.442834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:00.451195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:00.451682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:00.452117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:00.452806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:00.453321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:00.453742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:00.712875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:00.723185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:00.729811 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-96941f18-cb2f-46c1-bbd3-e35e2035c9b4 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1401 microversion: 2.1 time: 0.354385 Nov 02 21:22:00.737609 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 76/183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:00 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1401 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:00.738024 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e620d909-83ce-43af-b4ff-9d0bbd95637b tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.299131 Nov 02 21:22:00.740096 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 108/184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:00 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:22:00.962271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af295a12-aa0f-4f46-a872-2794ce93389c tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Calling method '.version_select at 0x7f9b69b70af0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:00.964491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af295a12-aa0f-4f46-a872-2794ce93389c tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '1d847be26be64b86a286a6b5012937d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d057c73a7c94f479d04b08763b1b7a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af295a12-aa0f-4f46-a872-2794ce93389c tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Request method failure captured: Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt92BgLHnsAfdB5KiDLCYq10l3UxL-4W6WrC9afHHmCuv4IMjV82Q_7tOh6zNcDo_UVscj-ho8VjsxWqd7P5wF-fzgjSEFgO-AyocNWMzoXmEcbRDoIwFhFu3gHcAGE3ZYgFdF5oMaSW8erjV8WhCficyWXQKqD2FTVpkw0Gk7xo8OE Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:22:00.968019 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1d847be26be64b86a286a6b5012937d5 Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: action_args: {} Nov 02 21:22:00.969374 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:00.970112 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 21:22:00.971647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:00.972782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af295a12-aa0f-4f46-a872-2794ce93389c tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:00.972782 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-af295a12-aa0f-4f46-a872-2794ce93389c tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.230473 Nov 02 21:22:00.972782 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 77/185] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 21:22:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 232 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:00.985476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0b4d876-b660-4ead-8770-aee0d8f10244 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Calling method '.version_select at 0x7f9b6994f280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:00.987602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0b4d876-b660-4ead-8770-aee0d8f10244 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '1d847be26be64b86a286a6b5012937d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d057c73a7c94f479d04b08763b1b7a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0b4d876-b660-4ead-8770-aee0d8f10244 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Request method failure captured: Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt92BgLHnsAfdB5KiDLCYq10l3UxL-4W6WrC9afHHmCuv4IMjV82Q_7tOh6zNcDo_UVscj-ho8VjsxWqd7P5wF-fzgjSEFgO-AyocNWMzoXmEcbRDoIwFhFu3gHcAGE3ZYgFdF5oMaSW8erjV8WhCficyWXQKqD2FTVpkw0Gk7xo8OE Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:00.992876 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1d847be26be64b86a286a6b5012937d5 Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: action_args: {} Nov 02 21:22:00.994352 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:00.995334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 21:22:00.997313 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:00.998777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0b4d876-b660-4ead-8770-aee0d8f10244 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:00.998777 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0b4d876-b660-4ead-8770-aee0d8f10244 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017316 Nov 02 21:22:00.998777 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 109/186] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:00 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:01.019987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c06c46f-6c87-4f9d-97ee-c6dc60241b78 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Calling method '.version_select at 0x7f9b69b01550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.022248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4c06c46f-6c87-4f9d-97ee-c6dc60241b78 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '1d847be26be64b86a286a6b5012937d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d057c73a7c94f479d04b08763b1b7a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c06c46f-6c87-4f9d-97ee-c6dc60241b78 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Request method failure captured: Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt92BgLHnsAfdB5KiDLCYq10l3UxL-4W6WrC9afHHmCuv4IMjV82Q_7tOh6zNcDo_UVscj-ho8VjsxWqd7P5wF-fzgjSEFgO-AyocNWMzoXmEcbRDoIwFhFu3gHcAGE3ZYgFdF5oMaSW8erjV8WhCficyWXQKqD2FTVpkw0Gk7xo8OE Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:22:01.024707 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1d847be26be64b86a286a6b5012937d5 Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: action_args: {} Nov 02 21:22:01.026004 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:01.026699 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 21:22:01.027672 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.028595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c06c46f-6c87-4f9d-97ee-c6dc60241b78 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:01.028595 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4c06c46f-6c87-4f9d-97ee-c6dc60241b78 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.025214 Nov 02 21:22:01.028595 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 78/187] 10.222.0.25 () {58 vars in 1179 bytes} [Wed Nov 2 21:22:00 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:01.222672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Calling method '.version_select at 0x7f9b699bb0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.224485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.224976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.225583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.260687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.261660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.263304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.285620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.287293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.289876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.306419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.307267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:01.310293 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd75eff4-0849-40f4-9195-69690dd248bf tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.278289 Nov 02 21:22:01.314477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.315154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.315592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.316293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.316734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.317475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.326277 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 110/188] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:01.337753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72db4dbe-c2f3-43d0-9c43-2016a3edfa51 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Calling method '.version_select at 0x7f9b6994fee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.345957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72db4dbe-c2f3-43d0-9c43-2016a3edfa51 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '1d847be26be64b86a286a6b5012937d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d057c73a7c94f479d04b08763b1b7a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72db4dbe-c2f3-43d0-9c43-2016a3edfa51 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Request method failure captured: Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt92BgLHnsAfdB5KiDLCYq10l3UxL-4W6WrC9afHHmCuv4IMjV82Q_7tOh6zNcDo_UVscj-ho8VjsxWqd7P5wF-fzgjSEFgO-AyocNWMzoXmEcbRDoIwFhFu3gHcAGE3ZYgFdF5oMaSW8erjV8WhCficyWXQKqD2FTVpkw0Gk7xo8OE Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:01.347848 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1d847be26be64b86a286a6b5012937d5 Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1'} Nov 02 21:22:01.349280 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:01.356987 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 21:22:01.358201 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.361719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72db4dbe-c2f3-43d0-9c43-2016a3edfa51 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:01.361719 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72db4dbe-c2f3-43d0-9c43-2016a3edfa51 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021890 Nov 02 21:22:01.361719 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 111/189] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:01.361719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2c5833b-e637-4080-9cff-c45b09ac3186 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Calling method '.version_select at 0x7f9b699fa280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.361719 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d2c5833b-e637-4080-9cff-c45b09ac3186 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] HTTP exception thrown: Hypervisor with ID '82757a73-298f-4d82-ae8e-5274229cbe85' could not be found. Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2c5833b-e637-4080-9cff-c45b09ac3186 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Request method failure captured: Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hypervisors/82757a73-298f-4d82-ae8e-5274229cbe85/uptime HTTP/1.1 Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt94gGxAU6Foy2xzvkO9oObO3UiWRyzUvF5FaJxG8E9UePZBIoJOkSA36fKjbl5bwSo0vANrF4APqKEX0DmF58feZu3DfZRk3Sa8pS5puBUFGsjsBw0m1yA2wI7efj06GyNC4k1_BL32O2dU0z9nGlJaW4KHRc48LdNPIlD2QeCyg5A Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 2a8d5e9d5ea14801863fef47442f5e35 Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-102506611 Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:01.372492 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-102506611 Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 2a8d5e9d5ea14801863fef47442f5e35 Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-102506611 Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1953e14d534d4574bd736e010542fd81 Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: exception: Hypervisor with ID '82757a73-298f-4d82-ae8e-5274229cbe85' could not be found. Nov 02 21:22:01.386244 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '82757a73-298f-4d82-ae8e-5274229cbe85'} Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '82757a73-298f-4d82-ae8e-5274229cbe85' Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 21:22:01.387096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '82757a73-298f-4d82-ae8e-5274229cbe85' could not be found. Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.388724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '82757a73-298f-4d82-ae8e-5274229cbe85' could not be found. Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2c5833b-e637-4080-9cff-c45b09ac3186 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Returning 404 to user: Hypervisor with ID '82757a73-298f-4d82-ae8e-5274229cbe85' could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2c5833b-e637-4080-9cff-c45b09ac3186 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/82757a73-298f-4d82-ae8e-5274229cbe85/uptime" status: 404 len: 123 microversion: 2.1 time: 0.019029 Nov 02 21:22:01.390118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 112/190] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/os-hypervisors/82757a73-298f-4d82-ae8e-5274229cbe85/uptime => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:01.394327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Calling method '.version_select at 0x7f9b69aceee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.396151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.396627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.397097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.420009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.420496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.421541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.444288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.445730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.445730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.452689 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2736a37c-6447-4654-a702-fe1d3df27828 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065988 Nov 02 21:22:01.453685 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 113/191] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:01.465775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91459e21-a470-4c6e-83aa-02f606367526 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Calling method '.version_select at 0x7f9b699a7dc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.469768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-91459e21-a470-4c6e-83aa-02f606367526 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '1d847be26be64b86a286a6b5012937d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d057c73a7c94f479d04b08763b1b7a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91459e21-a470-4c6e-83aa-02f606367526 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Request method failure captured: Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt92BgLHnsAfdB5KiDLCYq10l3UxL-4W6WrC9afHHmCuv4IMjV82Q_7tOh6zNcDo_UVscj-ho8VjsxWqd7P5wF-fzgjSEFgO-AyocNWMzoXmEcbRDoIwFhFu3gHcAGE3ZYgFdF5oMaSW8erjV8WhCficyWXQKqD2FTVpkw0Gk7xo8OE Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:01.472542 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d057c73a7c94f479d04b08763b1b7a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4d057c73a7c94f479d04b08763b1b7a6 Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620 Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1d847be26be64b86a286a6b5012937d5 Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1529231620-project Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1'} Nov 02 21:22:01.473794 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:01.474478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 21:22:01.475500 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.479401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91459e21-a470-4c6e-83aa-02f606367526 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:01.481394 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-91459e21-a470-4c6e-83aa-02f606367526 tempest-HypervisorAdminNegativeTestJSON-1529231620 tempest-HypervisorAdminNegativeTestJSON-1529231620-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020558 Nov 02 21:22:01.482520 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 114/192] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:22:01.508861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-906e1411-7a7f-4476-baa3-a2164a545317 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Calling method '.version_select at 0x7f9b69978940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.512004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-906e1411-7a7f-4476-baa3-a2164a545317 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] HTTP exception thrown: Hypervisor with ID '2d8bda82-c83e-4da1-991e-731b3d01a51d' could not be found. Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-906e1411-7a7f-4476-baa3-a2164a545317 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Request method failure captured: Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hypervisors/2d8bda82-c83e-4da1-991e-731b3d01a51d HTTP/1.1 Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt94gGxAU6Foy2xzvkO9oObO3UiWRyzUvF5FaJxG8E9UePZBIoJOkSA36fKjbl5bwSo0vANrF4APqKEX0DmF58feZu3DfZRk3Sa8pS5puBUFGsjsBw0m1yA2wI7efj06GyNC4k1_BL32O2dU0z9nGlJaW4KHRc48LdNPIlD2QeCyg5A Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 2a8d5e9d5ea14801863fef47442f5e35 Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-102506611 Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:01.514816 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2a8d5e9d5ea14801863fef47442f5e35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-102506611 Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 2a8d5e9d5ea14801863fef47442f5e35 Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-102506611 Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1953e14d534d4574bd736e010542fd81 Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: exception: Hypervisor with ID '2d8bda82-c83e-4da1-991e-731b3d01a51d' could not be found. Nov 02 21:22:01.516071 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2d8bda82-c83e-4da1-991e-731b3d01a51d'} Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2d8bda82-c83e-4da1-991e-731b3d01a51d' Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 21:22:01.516702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:22:01.518383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2d8bda82-c83e-4da1-991e-731b3d01a51d' could not be found. Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2d8bda82-c83e-4da1-991e-731b3d01a51d' could not be found. Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-906e1411-7a7f-4476-baa3-a2164a545317 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] Returning 404 to user: Hypervisor with ID '2d8bda82-c83e-4da1-991e-731b3d01a51d' could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-906e1411-7a7f-4476-baa3-a2164a545317 tempest-HypervisorAdminNegativeTestJSON-102506611 tempest-HypervisorAdminNegativeTestJSON-102506611-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2d8bda82-c83e-4da1-991e-731b3d01a51d" status: 404 len: 123 microversion: 2.1 time: 0.027754 Nov 02 21:22:01.521315 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 115/193] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/os-hypervisors/2d8bda82-c83e-4da1-991e-731b3d01a51d => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:01.583069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:01.593427 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-af3756eb-cd9f-4cb2-9b1f-269dedc07ad5 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.496866 Nov 02 21:22:01.609775 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 79/194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:01.767728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.768710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:01.769384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:01.769995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:01.781906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.783866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.785483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.785483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.786867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.787327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.788023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.788760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:01.789447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.790894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:01.792413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:01.792871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:02.075970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:02.085211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3b6b28f-5e22-4c51-919a-3b15ce0b293c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.326320 Nov 02 21:22:02.097280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:02.097657 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 116/195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:02.108027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7f1d4500-b235-459f-9825-918c19c4a708 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1338 microversion: 2.1 time: 0.348302 Nov 02 21:22:02.108616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 80/196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:01 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:02.244297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9c5be23c-da95-434b-ad3b-55f165d26789 req-99530059-284f-4fad-8a37-c9fdadcfb667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0ab77c-58ce-40d3-9df9-4658e23b6940", "tag": "e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:02.256744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9c5be23c-da95-434b-ad3b-55f165d26789 req-99530059-284f-4fad-8a37-c9fdadcfb667 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:02.257251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9c5be23c-da95-434b-ad3b-55f165d26789 req-99530059-284f-4fad-8a37-c9fdadcfb667 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:02.258095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9c5be23c-da95-434b-ad3b-55f165d26789 req-99530059-284f-4fad-8a37-c9fdadcfb667 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:02.269180 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9c5be23c-da95-434b-ad3b-55f165d26789 req-99530059-284f-4fad-8a37-c9fdadcfb667 service nova] Creating event network-changed:e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302 for instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 on n-h1-860863-4 Nov 02 21:22:02.274415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9c5be23c-da95-434b-ad3b-55f165d26789 req-99530059-284f-4fad-8a37-c9fdadcfb667 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034423 Nov 02 21:22:02.275491 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 117/197] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:02.619381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:02.620149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:02.627941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:02.628501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:02.629120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:02.629870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:02.630378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:02.641232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:02.956008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:02.977951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e439873-9b04-4a03-a387-31a394fba713 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.360221 Nov 02 21:22:02.979289 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 81/198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:02 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:03.126961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:03.128050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:03.154867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.158369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.159909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:03.162254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.162716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.163526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:03.278872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55d51a97-6753-4218-a5f5-fc2c36d7918b tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Calling method '.version_select at 0x7f9b69da3ee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:03.370136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55d51a97-6753-4218-a5f5-fc2c36d7918b tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad" status: 200 len: 371 microversion: 2.1 time: 0.254767 Nov 02 21:22:03.374552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 82/199] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:22:03 2022] GET /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad => generated 371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:03.384885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:03.387723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:03.395985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:03.402743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.403558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.404487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:03.407697 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70b1499e-c3fb-4914-a09b-28f812419dc6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.302039 Nov 02 21:22:03.408357 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 118/200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:03 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:03.413110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.413110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.413110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:03.427042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Action: 'update', calling method: .version_select at 0x7f9b698dd820>, body: {"quota_set": {"ram": "5120"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:03.636047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:03.647415 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c082ef2e-7f6f-46b1-98d7-945558987bc7 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1488 microversion: 2.1 time: 0.271527 Nov 02 21:22:03.657311 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 83/201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:03 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1488 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:03.673831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:03.676118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:03.691978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.691978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.691978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:03.691978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.692381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.692381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:03.877863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.879000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.879558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:03.880562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:03.881358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:03.881982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.072174 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d6bbe70-cfd8-44cc-be66-b6eead2f4ae3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad" status: 200 len: 328 microversion: 2.1 time: 0.657067 Nov 02 21:22:04.079111 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 119/202] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:03 2022] PUT /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad => generated 328 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:04.079111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:04.079111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:04.086007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.086487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.087947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.087947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.088642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.089106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.132350 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a1274f1-ceba-4149-bfdd-f407eebd3a3d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1639 microversion: 2.1 time: 0.461888 Nov 02 21:22:04.135457 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 84/203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:03 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1639 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:22:04.142593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2240769a-22e2-4429-9013-2e5065805c3d tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:04.252754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:04.261297 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fe445e7-1cb6-4dc6-9010-e7ab0f71b564 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.187243 Nov 02 21:22:04.262821 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 120/204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:04 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:04.277974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:04.278917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:04.281267 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2240769a-22e2-4429-9013-2e5065805c3d tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad" status: 202 len: 0 microversion: 2.1 time: 0.142472 Nov 02 21:22:04.282246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 85/205] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:22:04 2022] DELETE /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:22:04.284764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.285456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.286045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.287117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.287729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.290216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.297649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8ec12a2-582d-4a7c-ab59-b3f2b78885e9 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Calling method '.version_select at 0x7f9b69b98280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:04.311539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:04.320962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:22:04.508099 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8ec12a2-582d-4a7c-ab59-b3f2b78885e9 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad" status: 200 len: 371 microversion: 2.1 time: 0.214717 Nov 02 21:22:04.515812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 86/206] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:22:04 2022] GET /compute/v2.1/os-quota-sets/da270923d7d047529d54115398dbe7ad => generated 371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:04.515812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:04.515812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:04.533608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.534575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.538313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.538313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.538313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.538743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.682208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:04.690252 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1603e924-03e7-4cba-8ee0-2ecc01f139d2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.180254 Nov 02 21:22:04.691499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 87/207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:04 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:04.720412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7725dfc-f947-4bcf-b6c0-de2bd7474e6c tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 204 len: 0 microversion: 2.1 time: 0.455837 Nov 02 21:22:04.723483 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 121/208] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:22:04 2022] DELETE /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:22:04.739229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:04.739822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:04.746434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.746930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.747375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.748081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:04.748537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:04.748988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:04.833183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9086d88-6571-4dde-8fe6-deaacccc72f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Calling method '.version_select at 0x7f9b69a3fd30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:04.892490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:04.904142 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0253cf8b-b8e8-4d5c-a62a-cd0814467559 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1494 microversion: 2.1 time: 0.172952 Nov 02 21:22:04.904728 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 88/209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:04 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1494 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:05.269991 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9086d88-6571-4dde-8fe6-deaacccc72f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110/defaults" status: 200 len: 371 microversion: 2.1 time: 0.442497 Nov 02 21:22:05.270562 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 122/210] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:22:04 2022] GET /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110/defaults => generated 371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:05.285194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:05.285904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:05.292072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:05.295539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:05.295539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:05.295539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:05.295539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:05.302314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:05.311578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:05.436499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:05.444221 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3915407f-b860-4d98-ac28-11f7be782a5d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.162874 Nov 02 21:22:05.444759 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 89/211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:05 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:05.713379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:05.714121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:05.720223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:05.720705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:05.721179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:05.721944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:05.722398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:05.722842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:05.758337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-99112e27-4eca-4a5e-9046-ca96d8be0c28 req-475a3348-d22c-43d9-9684-d322d7c0aa99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9483dc5b-212f-45a2-beef-3e5c3cd8e10f", "name": "network-vif-plugged", "status": "completed", "tag": "2c33e0dd-385e-4ab6-bae0-a27e621c2b6f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:05.783406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-99112e27-4eca-4a5e-9046-ca96d8be0c28 req-475a3348-d22c-43d9-9684-d322d7c0aa99 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:05.783406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-99112e27-4eca-4a5e-9046-ca96d8be0c28 req-475a3348-d22c-43d9-9684-d322d7c0aa99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:05.783406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-99112e27-4eca-4a5e-9046-ca96d8be0c28 req-475a3348-d22c-43d9-9684-d322d7c0aa99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:05.794664 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-99112e27-4eca-4a5e-9046-ca96d8be0c28 req-475a3348-d22c-43d9-9684-d322d7c0aa99 service nova] Creating event network-vif-plugged:2c33e0dd-385e-4ab6-bae0-a27e621c2b6f for instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f on n-h1-860863-4 Nov 02 21:22:05.810122 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-99112e27-4eca-4a5e-9046-ca96d8be0c28 req-475a3348-d22c-43d9-9684-d322d7c0aa99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055675 Nov 02 21:22:05.811218 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 90/212] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:05.818409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Action: 'update', calling method: .version_select at 0x7f9b69c74b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:05.889478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:05.908586 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe025aef-2591-443b-8caa-98c7e171a508 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.199135 Nov 02 21:22:05.909271 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 123/213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:05 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:05.928888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:05.929629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:05.939736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:05.940824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:05.941728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:05.942806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:05.943423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:05.943845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.115671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:06.125267 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-083b4d52-9156-476a-bc90-6222665865a8 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1494 microversion: 2.1 time: 0.200390 Nov 02 21:22:06.125840 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 124/214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:05 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1494 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:06.177241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.178403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.178403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.179162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.179801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.180545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.211078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7bf9c932-1dc9-409f-8db1-46dba7fab0c3 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:06.214341 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7bf9c932-1dc9-409f-8db1-46dba7fab0c3 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7bf9c932-1dc9-409f-8db1-46dba7fab0c3 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359-project-admin] Request method failure captured: Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt99Axeu0l05jjte-ewJjfDuLQaecOrhVYK7eY9LFeT-3PCKzXy77jRw-VmcbiVA2dXaFskdMR5GsGPXOrxQGTV7Fl-k8jjlmzdU10TATfFRPHrGR3_5vmXELUu4B1CZf90PeGUK6-C7YiyAOiG_7k1rPP3pt0aTr3AkvuAVLsi3wq8 Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 6e7b890bdf12485a8ae58af656faf297 Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:06.222836 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6e7b890bdf12485a8ae58af656faf297"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e7b890bdf12485a8ae58af656faf297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6e7b890bdf12485a8ae58af656faf297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6e7b890bdf12485a8ae58af656faf297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 6e7b890bdf12485a8ae58af656faf297 Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359-project-admin Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: fb554590c9ed498aad1a22abddc7dc67 Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359-project-admin Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:06.223987 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid timestamp for date invalid_time Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'invalid_time'} Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:06.224605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7bf9c932-1dc9-409f-8db1-46dba7fab0c3 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:06.225711 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7bf9c932-1dc9-409f-8db1-46dba7fab0c3 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359 tempest-InstanceUsageAuditLogNegativeTestJSON-1249375359-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.097349 Nov 02 21:22:06.226612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 125/215] 10.222.0.25 () {58 vars in 1224 bytes} [Wed Nov 2 21:22:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:22:06.298344 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c12755ee-e116-49b1-9efe-78ac63b612ea tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438" status: 200 len: 328 microversion: 2.1 time: 0.484986 Nov 02 21:22:06.298985 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 91/216] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:05 2022] PUT /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438 => generated 328 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:06.312883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Calling method '.version_select at 0x7f9b69ce4ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:06.357061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8dee5c19-facb-4359-8a7f-191c55e25e47 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:06.359990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8dee5c19-facb-4359-8a7f-191c55e25e47 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '6be1736e04f444a28cd5ac317c57f1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff97318fdd984236bfab1fc01617c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8dee5c19-facb-4359-8a7f-191c55e25e47 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Request method failure captured: Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt98i5nV3gFHCryPpJdg0pY1yIAk4vGXE782M-Dw6buuabYP8TqQQp4IRYY7Gk7cBmbToNt3DECpY89HDB-twjB_-AgLeOncFsKQZkwBRlDgnXYp3V1M9B7auvtn06OUbmgRPb7ApzsZQ7YThWBlzvn-qAVsHVxmC4wdTT9o3TwcuWo Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ff97318fdd984236bfab1fc01617c553 Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:06.362325 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff97318fdd984236bfab1fc01617c553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff97318fdd984236bfab1fc01617c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff97318fdd984236bfab1fc01617c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff97318fdd984236bfab1fc01617c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ff97318fdd984236bfab1fc01617c553 Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 6be1736e04f444a28cd5ac317c57f1d2 Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project Nov 02 21:22:06.363564 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: action_args: {} Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:06.364109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 21:22:06.365235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.371788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8dee5c19-facb-4359-8a7f-191c55e25e47 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:06.373114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8dee5c19-facb-4359-8a7f-191c55e25e47 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.140334 Nov 02 21:22:06.374480 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 126/217] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 21:22:06 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 142 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:22:06.384418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22e4b2f2-49eb-4305-bf2c-bf080e110cce tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:06.386563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22e4b2f2-49eb-4305-bf2c-bf080e110cce tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '6be1736e04f444a28cd5ac317c57f1d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff97318fdd984236bfab1fc01617c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22e4b2f2-49eb-4305-bf2c-bf080e110cce tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Request method failure captured: Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2021:22:06 HTTP/1.1 Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt98i5nV3gFHCryPpJdg0pY1yIAk4vGXE782M-Dw6buuabYP8TqQQp4IRYY7Gk7cBmbToNt3DECpY89HDB-twjB_-AgLeOncFsKQZkwBRlDgnXYp3V1M9B7auvtn06OUbmgRPb7ApzsZQ7YThWBlzvn-qAVsHVxmC4wdTT9o3TwcuWo Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ff97318fdd984236bfab1fc01617c553 Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:06.389767 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ff97318fdd984236bfab1fc01617c553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff97318fdd984236bfab1fc01617c553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ff97318fdd984236bfab1fc01617c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ff97318fdd984236bfab1fc01617c553"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ff97318fdd984236bfab1fc01617c553 Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 6be1736e04f444a28cd5ac317c57f1d2 Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project Nov 02 21:22:06.390932 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2022-11-02 21:22:06'} Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:06.391519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 21:22:06.392676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:06.395448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22e4b2f2-49eb-4305-bf2c-bf080e110cce tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:06.396354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22e4b2f2-49eb-4305-bf2c-bf080e110cce tempest-InstanceUsageAuditLogNegativeTestJSON-984244914 tempest-InstanceUsageAuditLogNegativeTestJSON-984244914-project] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 21:22:06" status: 403 len: 128 microversion: 2.1 time: 0.017175 Nov 02 21:22:06.396917 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 127/218] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:22:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2021%3A22%3A06 => generated 128 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:06.467888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:06.468435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:06.474540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:06.476394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.477111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.477769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.478672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.479331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.479948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.581260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.582084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.582691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.583820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.584522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.585260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.607801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c62017dc-40b4-4342-aa22-61058987984e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438/detail" status: 200 len: 916 microversion: 2.1 time: 0.300822 Nov 02 21:22:06.609032 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 92/219] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:22:06 2022] GET /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438/detail => generated 916 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:06.713088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:06.723049 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f8f2684-0694-4197-a063-f0fd3bf1afea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.259743 Nov 02 21:22:06.723907 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 128/220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:06 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:22:06.931862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:06.932654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:06.954174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.955317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.955963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.957411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.964182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.964182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.968462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-49928fb2-4d69-4ca3-a14b-b8cd5f414ec0 req-226d3f23-f207-43f1-ad59-cd9837c53f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87092801-1aba-4e56-a505-74a53a15b6ea", "name": "network-vif-deleted", "tag": "382d9b80-3f06-4128-bf16-c04455bbed5d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:06.979104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49928fb2-4d69-4ca3-a14b-b8cd5f414ec0 req-226d3f23-f207-43f1-ad59-cd9837c53f08 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:06.979579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49928fb2-4d69-4ca3-a14b-b8cd5f414ec0 req-226d3f23-f207-43f1-ad59-cd9837c53f08 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:06.980117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49928fb2-4d69-4ca3-a14b-b8cd5f414ec0 req-226d3f23-f207-43f1-ad59-cd9837c53f08 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:06.996222 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-49928fb2-4d69-4ca3-a14b-b8cd5f414ec0 req-226d3f23-f207-43f1-ad59-cd9837c53f08 service nova] Creating event network-vif-deleted:382d9b80-3f06-4128-bf16-c04455bbed5d for instance 87092801-1aba-4e56-a505-74a53a15b6ea on n-h2-860863-4 Nov 02 21:22:07.002531 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-49928fb2-4d69-4ca3-a14b-b8cd5f414ec0 req-226d3f23-f207-43f1-ad59-cd9837c53f08 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040658 Nov 02 21:22:07.007495 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 129/221] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:07.108723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Action: 'update', calling method: .version_select at 0x7f9b699788b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:07.138477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:07.148729 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-efffe098-b5d8-492c-a35e-809069ef7e0b tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.220772 Nov 02 21:22:07.149942 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 93/222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:06 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:07.165204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:07.165814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:07.175983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.176720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.177338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:07.178200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.178800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.179371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:07.454514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.455716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.456693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:07.458082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.458880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.459621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:07.464530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4ae61cbd8048c181c7573734cde312', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a078ad61024a48d89e1c94da25107c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:07.472403 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cbf9fc71-9080-48c0-a0f1-6734f91fc57a tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 200 len: 1323 microversion: 2.1 time: 0.321120 Nov 02 21:22:07.473013 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 94/223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:07 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:07.510159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.510648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.511087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:07.512147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.512760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.513393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:07.664909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63a03f08-a656-4e0a-8607-b755462adcd6 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438?user_id=871ec0a238d34572962e5f2aca458ff9" status: 200 len: 328 microversion: 2.1 time: 0.560874 Nov 02 21:22:07.667139 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 130/224] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:22:07 2022] PUT /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438?user_id=871ec0a238d34572962e5f2aca458ff9 => generated 328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:07.680271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74ec801a-dece-42d5-8862-f8effe14899e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Calling method '.version_select at 0x7f9b69870820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:07.792776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fbefce1b-2425-492f-bb4f-fc15d4361429 tempest-InstanceUsageAuditLogTestJSON-532827983 tempest-InstanceUsageAuditLogTestJSON-532827983-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:07.834169 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fbefce1b-2425-492f-bb4f-fc15d4361429 tempest-InstanceUsageAuditLogTestJSON-532827983 tempest-InstanceUsageAuditLogTestJSON-532827983-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 21:22:07" status: 200 len: 318 microversion: 2.1 time: 0.236887 Nov 02 21:22:07.836453 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 95/225] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:22:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2021%3A22%3A07 => generated 318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:07.844532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:07.845556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:07.858033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.859558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.860554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:07.862041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:07.863049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:07.863979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:08.000454 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74ec801a-dece-42d5-8862-f8effe14899e tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438?user_id=871ec0a238d34572962e5f2aca458ff9" status: 200 len: 370 microversion: 2.1 time: 0.323997 Nov 02 21:22:08.008281 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 131/226] 10.222.0.25 () {58 vars in 1323 bytes} [Wed Nov 2 21:22:07 2022] GET /compute/v2.1/os-quota-sets/475bd34b73c34eed9ec2548000868438?user_id=871ec0a238d34572962e5f2aca458ff9 => generated 370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:08.010023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aef86f85-09c1-4c91-8eec-d6b3a44f7014 tempest-InstanceUsageAuditLogTestJSON-532827983 tempest-InstanceUsageAuditLogTestJSON-532827983-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:08.023156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:08.034897 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e0021f8-ed8b-4049-a675-10e9d2b6ed90 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1319 microversion: 2.1 time: 0.196296 Nov 02 21:22:08.036334 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 96/227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:07 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:08.040199 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aef86f85-09c1-4c91-8eec-d6b3a44f7014 tempest-InstanceUsageAuditLogTestJSON-532827983 tempest-InstanceUsageAuditLogTestJSON-532827983-project-admin] 10.222.0.25 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.037240 Nov 02 21:22:08.040772 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 132/228] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 21:22:08 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:08.175880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:08.176502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:08.182438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:08.182929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:08.183373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:08.184691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:08.185178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:08.185608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:08.348395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:08.357276 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cce65569-acb5-4992-897e-7891bfb9744c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.185368 Nov 02 21:22:08.358047 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 97/229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:08 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:08.495921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:08.497009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:08.503888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:08.504822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:08.505352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:08.506145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:08.506599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:08.507028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:08.521339 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] HTTP exception thrown: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Request method failure captured: Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea HTTP/1.1 Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OBdwF6j7i0rjbs1-P9DIeF2v5f7FitZAOR2BRmsylKKqs2RSpqZI5JO1KdxHgPqQEHKQE7Ow-P4Wbd37t0XHgSnNuFrWrEolYjKztroJ6KH060NdhtP0TYQPf1ul9e3i5YoEmaWF8MLoU3inPMMUyH1F3svyzF5nS-PUUOIXSTsc Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a078ad61024a48d89e1c94da25107c21 Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:08.530253 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a078ad61024a48d89e1c94da25107c21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a078ad61024a48d89e1c94da25107c21 Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminTestJSON-211556665-project Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: bd4ae61cbd8048c181c7573734cde312 Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminTestJSON-211556665-project Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:08.531678 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '87092801-1aba-4e56-a505-74a53a15b6ea'} Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:08.532530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:08.533854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:08.535084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Returning 404 to user: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:08.535084 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61e480a8-3d9f-4057-97d3-04b2b22d3e57 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 404 len: 111 microversion: 2.1 time: 0.033640 Nov 02 21:22:08.535084 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 133/230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:08 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:08.535689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-900f58f1-7406-4ead-a921-b1474e40f85f tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:08.547363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-900f58f1-7406-4ead-a921-b1474e40f85f tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:08.547844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-900f58f1-7406-4ead-a921-b1474e40f85f tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:08.548281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-900f58f1-7406-4ead-a921-b1474e40f85f tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:08.849193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-900f58f1-7406-4ead-a921-b1474e40f85f tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.317961 Nov 02 21:22:08.850383 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 98/231] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:22:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:08.862465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf41ab86-cacd-4232-a2bc-e4ab196b1b2b tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:09.003310 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf41ab86-cacd-4232-a2bc-e4ab196b1b2b tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.144744 Nov 02 21:22:09.004118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 134/232] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:08 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 21:22:09.017761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c6e7e95-530e-45f4-9589-c1a8861302ec tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1644527685"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:09.021890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-5c6e7e95-530e-45f4-9589-c1a8861302ec tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 4c70a670-6161-40ac-8a25-43dd774e7ae2 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:09.058727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:09.059536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:09.066543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.067103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.067612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.068378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.068967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.069450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.102740 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c6e7e95-530e-45f4-9589-c1a8861302ec tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088900 Nov 02 21:22:09.104154 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 99/233] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:09.109715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bcb1cdeb-a1c9-49dc-acc5-100830ffccec tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Calling method '.version_select at 0x7f9b69a154c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:09.261706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:09.275614 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d0d0b39e-374d-4c33-b2b4-2a0fb5b261b2 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1469 microversion: 2.1 time: 0.220663 Nov 02 21:22:09.276279 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 135/234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:09 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:22:09.281255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddcd6335-63b9-48b9-8b32-273cc2373371 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:09.294788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddcd6335-63b9-48b9-8b32-273cc2373371 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.295187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddcd6335-63b9-48b9-8b32-273cc2373371 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.295683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddcd6335-63b9-48b9-8b32-273cc2373371 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.345029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bcb1cdeb-a1c9-49dc-acc5-100830ffccec tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110/defaults" status: 200 len: 371 microversion: 2.1 time: 0.239652 Nov 02 21:22:09.345764 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 100/235] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:22:09 2022] GET /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110/defaults => generated 371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:09.490318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1660841391", "block_migration": true, "disk_over_commit": false}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:09.493602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:09.500987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.501508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.501977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.502649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.503105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.503526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.600529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lazy-loading 'flavor' on Instance uuid 9483dc5b-212f-45a2-beef-3e5c3cd8e10f {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:22:09.651887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Going to try to live migrate instance to tempest-host-1660841391 {{(pid=121039) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:22:09.657467 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddcd6335-63b9-48b9-8b32-273cc2373371 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.379392 Nov 02 21:22:09.658055 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 136/236] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:22:09 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:09.659985 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] HTTP exception thrown: Compute host tempest-host-1660841391 could not be found. Nov 02 21:22:09.663008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Action: 'update', calling method: .version_select at 0x7f9b69845160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Request method failure captured: Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f/action HTTP/1.1 Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 107 Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9iwot358xrrrZTBpVouZoStkqsnAVDymBuCmyWxd8G_8DFmYyLskWJKbtZdHTq9EASNlmCLTjGbCKYy_mAoUVMmW41JE-xrzse68F9_44cn2H_xSXcjKGu1Zos2AgXLKrUplBiqoIslScuvI7lNMmTNzSpIx7CAVJdi7HJUymC6Ww Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 2025e4ee38944f18a5672059dff69d74 Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-LiveMigrationNegativeTest-1328722909 Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:22:09.664137 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2025e4ee38944f18a5672059dff69d74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2025e4ee38944f18a5672059dff69d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2025e4ee38944f18a5672059dff69d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2025e4ee38944f18a5672059dff69d74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-LiveMigrationNegativeTest-1328722909 Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 2025e4ee38944f18a5672059dff69d74 Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1328722909 Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-LiveMigrationNegativeTest-1328722909-project-admin Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7134058e68524d858e18d382699f0189 Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-LiveMigrationNegativeTest-1328722909-project-admin Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: {"os-migrateLive": {"host": "tempest-host-1660841391", "block_migration": true, "disk_over_commit": false}} Nov 02 21:22:09.665512 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: exception: Compute host tempest-host-1660841391 could not be found. Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9483dc5b-212f-45a2-beef-3e5c3cd8e10f', 'body': {'os-migrateLive': {'host': 'tempest-host-1660841391', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:22:09.666322 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1660841391 could not be found. Nov 02 21:22:09.667469 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1660841391 could not be found. Nov 02 21:22:09.669753 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1660841391 could not be found. Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Returning 400 to user: Compute host tempest-host-1660841391 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a371cbb1-4e63-4193-91c9-3b53aeec755d tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f/action" status: 400 len: 100 microversion: 2.1 time: 0.319662 Nov 02 21:22:09.671337 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 101/237] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 21:22:09 2022] POST /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f/action => generated 100 bytes in 321 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:22:09.673515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:09.673515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:09.680357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.681074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.682025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.682767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.683399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.685078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.879056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:09.894597 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63d16c3f-fc93-4324-9d9c-b1feb5bd9064 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.226635 Nov 02 21:22:09.897283 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 102/238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:09 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:09.905093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b661735e-f673-4c2e-a762-30e8ce449597 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:09.916336 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b661735e-f673-4c2e-a762-30e8ce449597 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.017638 Nov 02 21:22:09.917328 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 103/239] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:22:09 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:09.927949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:09.929780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:09.938193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.938674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.939110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.939854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.940438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.940970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.971824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.974084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.977202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:09.978793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:09.983194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:09.991560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:10.124091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:10.131805 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb180a59-151b-4335-a303-331598b683ea tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1469 microversion: 2.1 time: 0.212550 Nov 02 21:22:10.132365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 104/240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:09 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:10.136705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-909b9d81-38f2-4da1-b6cd-fcd1aa7faee7 req-450d5e3e-01cd-4af8-bc89-c49e44f41cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0ab77c-58ce-40d3-9df9-4658e23b6940", "name": "network-vif-plugged", "status": "completed", "tag": "e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:10.150122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-909b9d81-38f2-4da1-b6cd-fcd1aa7faee7 req-450d5e3e-01cd-4af8-bc89-c49e44f41cda service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:10.150562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-909b9d81-38f2-4da1-b6cd-fcd1aa7faee7 req-450d5e3e-01cd-4af8-bc89-c49e44f41cda service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:10.150997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-909b9d81-38f2-4da1-b6cd-fcd1aa7faee7 req-450d5e3e-01cd-4af8-bc89-c49e44f41cda service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:10.162986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-909b9d81-38f2-4da1-b6cd-fcd1aa7faee7 req-450d5e3e-01cd-4af8-bc89-c49e44f41cda service nova] Creating event network-vif-plugged:e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302 for instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 on n-h1-860863-4 Nov 02 21:22:10.169704 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-909b9d81-38f2-4da1-b6cd-fcd1aa7faee7 req-450d5e3e-01cd-4af8-bc89-c49e44f41cda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035093 Nov 02 21:22:10.170618 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 105/241] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:10.176453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-096f3003-ccd1-43ed-bd1e-82b3598fc9fe tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:10.189785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-096f3003-ccd1-43ed-bd1e-82b3598fc9fe tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:10.190328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-096f3003-ccd1-43ed-bd1e-82b3598fc9fe tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:10.190945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-096f3003-ccd1-43ed-bd1e-82b3598fc9fe tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:10.501191 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-096f3003-ccd1-43ed-bd1e-82b3598fc9fe tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.329447 Nov 02 21:22:10.506332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 106/242] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:22:10 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:10.506865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1232983712", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:10.568650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:10.790120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:10.790546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:10.791015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:10.791421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:10.791829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:10.801937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:10.810899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:10.811618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:10.812192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:10.813083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:10.813690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:10.814447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:10.836982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Getting quotas for project afa6d9c601754827a8f2df9b9f544b10. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:10.841765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Getting quotas for user c27e33aa9a564bf3a7036e79125205e1 and project afa6d9c601754827a8f2df9b9f544b10. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:10.854012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:22:10.856991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:22:10.972121 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2319c31e-3818-4722-b95c-9fc6da43c4b4 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469122 Nov 02 21:22:10.972760 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 107/243] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:22:10.977089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad4ab3b3-24c6-4a9e-80b0-fcfd16faa283 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:11.094293 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad4ab3b3-24c6-4a9e-80b0-fcfd16faa283 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.120428 Nov 02 21:22:11.117290 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 108/244] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:10 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:11.133259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:11.134753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:11.151684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:11.152191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:11.152695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:11.158467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:11.161580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:11.162390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:11.331575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:11.343313 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e18d3b1-1574-46de-ad6c-65edb376cec6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1389 microversion: 2.1 time: 0.224630 Nov 02 21:22:11.349054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 109/245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:11 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1389 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:11.349054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-917ecd59-12a8-4f8a-9152-7254e50fb6c3 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:11.349584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-917ecd59-12a8-4f8a-9152-7254e50fb6c3 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:11.421866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-917ecd59-12a8-4f8a-9152-7254e50fb6c3 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:11.430614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-917ecd59-12a8-4f8a-9152-7254e50fb6c3 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1219 microversion: 2.1 time: 0.085718 Nov 02 21:22:11.432381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 110/246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:11 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:11.444545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a75a1ee-64d2-4211-bbbd-e1c36673254d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1179748431"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:11.450801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-5a75a1ee-64d2-4211-bbbd-e1c36673254d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 2263f82c-8004-4e24-bcd1-eb950157b2cf for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:11.564565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a75a1ee-64d2-4211-bbbd-e1c36673254d tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.122392 Nov 02 21:22:11.567658 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 111/247] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:11.571056 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-281ee88f-fed6-493e-84aa-8231ff496fac tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110" status: 200 len: 329 microversion: 2.1 time: 1.911604 Nov 02 21:22:11.571906 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 137/248] 10.222.0.25 () {60 vars in 1263 bytes} [Wed Nov 2 21:22:09 2022] PUT /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110 => generated 329 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:11.586714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Action: 'update', calling method: .version_select at 0x7f9b698fdca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:11.587110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d6c0c4a-a4d2-4c8c-aa39-82aa188e17ea tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:11.600662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c4a-a4d2-4c8c-aa39-82aa188e17ea tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:11.600662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c4a-a4d2-4c8c-aa39-82aa188e17ea tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:11.600662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c4a-a4d2-4c8c-aa39-82aa188e17ea tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:11.928228 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d6c0c4a-a4d2-4c8c-aa39-82aa188e17ea tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.344918 Nov 02 21:22:11.929390 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 138/249] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:22:11 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:11.944731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-206e8c43-ebd8-4519-bde8-820a95073747 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:11.956797 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-206e8c43-ebd8-4519-bde8-820a95073747 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.017823 Nov 02 21:22:11.957740 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 139/250] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:22:11 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:11.971123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d93966c8-6a2e-461c-882c-df4848e1c872 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:11.984637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d93966c8-6a2e-461c-882c-df4848e1c872 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:11.985157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d93966c8-6a2e-461c-882c-df4848e1c872 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:11.985589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d93966c8-6a2e-461c-882c-df4848e1c872 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:12.009836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=17,nova_api:DELETE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:12.103017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:12.104293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:12.109027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:12.113267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:12.113267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:12.115444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:12.342772 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d93966c8-6a2e-461c-882c-df4848e1c872 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.377117 Nov 02 21:22:12.343373 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 140/251] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Nov 2 21:22:11 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:12.534089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-230841eb-d457-49f3-ba72-10c507caa3d4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Calling method '.version_select at 0x7f9b6983c430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:12.608242 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-230841eb-d457-49f3-ba72-10c507caa3d4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 371 microversion: 2.1 time: 0.256525 Nov 02 21:22:12.609305 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 141/252] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:22:12 2022] GET /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:12.613832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fee13da4-5ec8-4b41-a4d1-bb91f90fdbf2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:12.737254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fee13da4-5ec8-4b41-a4d1-bb91f90fdbf2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.126756 Nov 02 21:22:12.738529 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 142/253] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:12 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:12.743451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:12.744603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:12.751216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:12.751689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:12.752144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:12.755967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:12.755967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:12.755967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:12.909611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:12.917716 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16acb503-28d5-42f1-b367-532890cfb5ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1588 microversion: 2.1 time: 0.178097 Nov 02 21:22:12.918930 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 143/254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:12 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1588 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:12.923561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:12.924313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:12.930397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:12.930873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:12.931305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:12.932171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:12.932755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:12.933203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:13.012847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:13.021077 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-358c14cf-3cef-4b7e-8fab-072715fa458a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1271 microversion: 2.1 time: 0.101141 Nov 02 21:22:13.021688 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 144/255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:12 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:13.034076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Action: 'update', calling method: .version_select at 0x7f9b699fa160>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:13.212364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:13.212903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:13.213554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:13.214548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:13.215152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:13.215900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:13.392114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be56be3d-5313-46de-9ad1-6f083af162f7 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 328 microversion: 2.1 time: 0.361968 Nov 02 21:22:13.392986 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 145/256] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:13 2022] PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:13.398209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd38f935-bed6-4877-9ab0-d6a3fdd47202 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1322967480"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:13.402317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.aggregate [None req-cd38f935-bed6-4877-9ab0-d6a3fdd47202 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid cbda63c5-1d60-4bac-932d-0356cce90420 for aggregate {{(pid=121040) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:13.485761 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd38f935-bed6-4877-9ab0-d6a3fdd47202 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091638 Nov 02 21:22:13.486990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 146/257] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:13.494052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:13.494814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:13.504254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:13.504734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:13.508073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:13.508073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:13.508073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:13.508370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:13.659420 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ffca742-0b30-43c8-8bb3-5ca217bf1d76 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170157 Nov 02 21:22:13.660056 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 147/258] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:22:13 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:13.672217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6b0cd2c-9bdc-4b29-a599-4c024d9ab627 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:13.683444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0cd2c-9bdc-4b29-a599-4c024d9ab627 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:13.685614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0cd2c-9bdc-4b29-a599-4c024d9ab627 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:13.685614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0cd2c-9bdc-4b29-a599-4c024d9ab627 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:14.006206 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6b0cd2c-9bdc-4b29-a599-4c024d9ab627 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.343977 Nov 02 21:22:14.006795 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 148/259] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 21:22:13 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:14.075311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-856851136", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:14.138354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:14.382846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:14.383437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:14.384031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:14.384767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:14.385478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:14.395994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:14.396961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:14.397933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:14.398057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:14.398595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:14.399184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:14.422100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Getting quotas for project 5e262054d2ff4f7a9128d3809705afe1. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:14.427584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Getting quotas for user 6c7edca2c3f047858795ca1c649c59d2 and project 5e262054d2ff4f7a9128d3809705afe1. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:14.468593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.utils [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] cores quota exceeded for 5e262054d2ff4f7a9128d3809705afe1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121040) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 21:22:14.469956 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Request method failure captured: Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 144 Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-CbOIwyciqJ6DWC_tUVISlD47FJJxG65oaiSQR90yq1I6w-zScV-ax7v1lH9aC5sdmCiMKVUKW6e-CgmaxcVl-DL_MBxfXAxznouSvJjib3VVX5JlDOOoxo4pthvB6P6_AVyt5AkwZFSyq0cebMJGJOJD4ebGMmfhUG4S-XMJtfWY Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:14.474299 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 6c7edca2c3f047858795ca1c649c59d2 Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-856851136", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} Nov 02 21:22:14.475688 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-856851136', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452'}}} Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 21:22:14.476496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:14.477674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:14.479050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:14.480367 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:14.480367 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:14.480367 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:14.480367 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:14.480367 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 21:22:14.480367 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:14.489488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:14.490970 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-977d2863-4110-4c22-9862-3df5b7c7194d tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.482406 Nov 02 21:22:14.495571 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 149/260] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:14 2022] POST /compute/v2.1/servers => generated 111 bytes in 485 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:14.495711 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-46b58bc2-c0a4-442b-8538-e914ee7182f3 tempest-QuotasAdminTestJSON-1770724327 tempest-QuotasAdminTestJSON-1770724327-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110" status: 200 len: 329 microversion: 2.1 time: 2.893342 Nov 02 21:22:14.495711 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 112/261] 10.222.0.25 () {60 vars in 1263 bytes} [Wed Nov 2 21:22:11 2022] PUT /compute/v2.1/os-quota-sets/8f3bd9b8982442f5b5a412c061aa0110 => generated 329 bytes in 2913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:14.499590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2a59402-d368-442e-87f0-c065b54a5fb6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:14.501638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:14.508332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:14.518275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2a59402-d368-442e-87f0-c065b54a5fb6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:14.518911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2a59402-d368-442e-87f0-c065b54a5fb6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:14.519450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2a59402-d368-442e-87f0-c065b54a5fb6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:14.531135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:14.531912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:14.532685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:14.533421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:14.535003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:14.535003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:14.876417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:14.885034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a37ae7d-f7e2-4adb-a283-8dd572f85f48 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1319 microversion: 2.1 time: 0.388523 Nov 02 21:22:14.897160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2a59402-d368-442e-87f0-c065b54a5fb6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.398473 Nov 02 21:22:14.897160 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 150/262] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 21:22:14 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:14.903687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Action: 'update', calling method: .version_select at 0x7f9b69845700>, body: {"quota_set": {"cores": 20}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:14.907117 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 113/263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:14 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:14.917777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a345cc0c-0b9e-4f0f-bd35-6c8e6cf60999 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:14.951953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=18,nova_api:DELETE=2,nova_api:UPDATE=14 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:15.058468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a345cc0c-0b9e-4f0f-bd35-6c8e6cf60999 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.149918 Nov 02 21:22:15.060564 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 114/264] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:14 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:15.072309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-527fc14c-c993-4a1a-b6eb-c2f6451ed2ff tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1570371443"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:15.082544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-527fc14c-c993-4a1a-b6eb-c2f6451ed2ff tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 3538705b-56d1-4d31-9c55-59ed0af7cb02 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:15.245927 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-527fc14c-c993-4a1a-b6eb-c2f6451ed2ff tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.177562 Nov 02 21:22:15.248664 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 115/265] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:15.256509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b70168bf-120b-44bd-9973-639c5b7a0822 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-547143721"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:15.263015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-b70168bf-120b-44bd-9973-639c5b7a0822 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid bef619d0-8ddd-44ff-ba50-4959f0a995c8 for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:15.285730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:15.286421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:15.287099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:15.288197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:15.288862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:15.289456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:15.385014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b70168bf-120b-44bd-9973-639c5b7a0822 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.133766 Nov 02 21:22:15.385546 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 116/266] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:15.391528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9a755dc-6224-4d17-8934-2a3c910817c0 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:15.497477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7558788a-5011-465f-bcb7-240c7394c135 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 329 microversion: 2.1 time: 0.596066 Nov 02 21:22:15.502848 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9a755dc-6224-4d17-8934-2a3c910817c0 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.115998 Nov 02 21:22:15.506429 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 117/267] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:15 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:15.515851 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 151/268] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:14 2022] PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 329 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:15.517469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-885e7f18-6d4b-49e4-8205-fa899af639db tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:15.527177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0775285-6883-4d25-b7cd-4ac8db621bd6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:15.550550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885e7f18-6d4b-49e4-8205-fa899af639db tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:15.555361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885e7f18-6d4b-49e4-8205-fa899af639db tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:15.555361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885e7f18-6d4b-49e4-8205-fa899af639db tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:15.559815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b0775285-6883-4d25-b7cd-4ac8db621bd6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0775285-6883-4d25-b7cd-4ac8db621bd6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Request method failure captured: Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9Si9c7-y5ikuOs_HaXfQUOkux96jy25Wbu4CymTt24kV_Vp7EJU4GHR1m2oi4bsA85ButiEsKpYsc34wVXPcStMhIhUdIANzD2bfzqUGWd5RZhqejpUfujrCvo7lu9eVEETyXUFNY-Eh_cfVlTdY9GlQIisaWm_oKsMRfOz9_WeY4 Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:15.564870 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b68536b736bf4d4e946e470ab6743816 Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: exception: Aggregate 11 could not be found. Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '11'} Nov 02 21:22:15.566216 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:15.566922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Nov 02 21:22:15.567933 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.571773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0775285-6883-4d25-b7cd-4ac8db621bd6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:15.576118 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0775285-6883-4d25-b7cd-4ac8db621bd6 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.059015 Nov 02 21:22:15.576873 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 152/269] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:15 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:22:15.591746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b548e90-2d67-4999-a0a1-a1be5aad5900 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Calling method '.version_select at 0x7f9b697b2ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:15.675665 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b548e90-2d67-4999-a0a1-a1be5aad5900 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 371 microversion: 2.1 time: 0.091885 Nov 02 21:22:15.676778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 153/270] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:22:15 2022] GET /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:15.687563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bda0826-f054-49c0-90c9-b6a208b00122 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:15.700954 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-5bda0826-f054-49c0-90c9-b6a208b00122 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bda0826-f054-49c0-90c9-b6a208b00122 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Request method failure captured: Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9Si9c7-y5ikuOs_HaXfQUOkux96jy25Wbu4CymTt24kV_Vp7EJU4GHR1m2oi4bsA85ButiEsKpYsc34wVXPcStMhIhUdIANzD2bfzqUGWd5RZhqejpUfujrCvo7lu9eVEETyXUFNY-Eh_cfVlTdY9GlQIisaWm_oKsMRfOz9_WeY4 Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:15.703164 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b68536b736bf4d4e946e470ab6743816 Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: exception: Aggregate 11 could not be found. Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '11'} Nov 02 21:22:15.704424 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:22:15.705163 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:15.706157 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bda0826-f054-49c0-90c9-b6a208b00122 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bda0826-f054-49c0-90c9-b6a208b00122 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.026649 Nov 02 21:22:15.707229 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 154/271] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:15 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:22:15.726455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Action: 'update', calling method: .version_select at 0x7f9b697f3790>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:15.853790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:15.854435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:15.854865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:15.856735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:15.857757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:15.858334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:15.972521 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-885e7f18-6d4b-49e4-8205-fa899af639db tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.462592 Nov 02 21:22:15.977185 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 118/272] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 21:22:15 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:15.991998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c121c89-a7bf-4940-90f7-393ba2e9b5cc tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1249180621", "name": "tempest-test_aggregate-2003992612"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:16.018761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-4c121c89-a7bf-4940-90f7-393ba2e9b5cc tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 9a174faa-0771-4d10-a1bd-4a7bb8ca047f for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:16.056403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:16.080755 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94975c29-ef47-42b5-ad1e-104e27569b86 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 328 microversion: 2.1 time: 0.373677 Nov 02 21:22:16.081594 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 155/273] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:15 2022] PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 328 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:16.100035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d05081c5-4e8a-4e90-a226-76ae148f9fbd req-ceb7239e-8868-4fe8-ae60-c1c80c5194b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d9874f-026b-40b2-9e0b-62c1df42e442", "tag": "97a6e697-5a70-4a94-b843-51643c580f80"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:16.111028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d05081c5-4e8a-4e90-a226-76ae148f9fbd req-ceb7239e-8868-4fe8-ae60-c1c80c5194b3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:16.111508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d05081c5-4e8a-4e90-a226-76ae148f9fbd req-ceb7239e-8868-4fe8-ae60-c1c80c5194b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:16.112526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d05081c5-4e8a-4e90-a226-76ae148f9fbd req-ceb7239e-8868-4fe8-ae60-c1c80c5194b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:16.126673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4c121c89-a7bf-4940-90f7-393ba2e9b5cc tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.139921 Nov 02 21:22:16.129053 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 119/274] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 21:22:15 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:16.139264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:16.141718 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d05081c5-4e8a-4e90-a226-76ae148f9fbd req-ceb7239e-8868-4fe8-ae60-c1c80c5194b3 service nova] Creating event network-changed:97a6e697-5a70-4a94-b843-51643c580f80 for instance b9d9874f-026b-40b2-9e0b-62c1df42e442 on n-h2-860863-4 Nov 02 21:22:16.148061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:16.154427 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d05081c5-4e8a-4e90-a226-76ae148f9fbd req-ceb7239e-8868-4fe8-ae60-c1c80c5194b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059103 Nov 02 21:22:16.161368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 156/275] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:16.164841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:16.166262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:16.170740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:16.170740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:16.174976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:16.176175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4da35b37-f6f1-485e-8d34-d8b1da0b66a0 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:16.177197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:16.189349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4da35b37-f6f1-485e-8d34-d8b1da0b66a0 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '889cc35902d74921bd2848ae9f100f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d0128e4f9a49b6b16ccd973a0dec5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4da35b37-f6f1-485e-8d34-d8b1da0b66a0 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Request method failure captured: Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 42 Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OR8fuvYRgJSEyRcTdzgS6fl2WRzBBldzqmjgY-dTJISUst9k4_81ghxIjpx9NdISipG720-sdmx4ynlwlmHLn5SFpGm9Kfh2d7YdoObbUpISSaVDUjAgGf4S3riB_iWU9BDEIWFOJsrAdrXRjw9yGaWjy7LF_6alUa6KclDy2_5I Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:16.191256 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11d0128e4f9a49b6b16ccd973a0dec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 11d0128e4f9a49b6b16ccd973a0dec5c Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098 Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 889cc35902d74921bd2848ae9f100f5f Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2063760098-project Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: {"remove_host": {"host": "n-h2-860863-4"}} Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:16.192455 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-860863-4'}}} Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:16.193187 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 21:22:16.194272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:16.195252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4da35b37-f6f1-485e-8d34-d8b1da0b66a0 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:16.195252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4da35b37-f6f1-485e-8d34-d8b1da0b66a0 tempest-AggregatesAdminNegativeTestJSON-2063760098 tempest-AggregatesAdminNegativeTestJSON-2063760098-project] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.022347 Nov 02 21:22:16.195252 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 157/276] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 21:22:16 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:16.197795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:16.198570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:16.207425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:16.207912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:16.208345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:16.209069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:16.209520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:16.209940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:16.640566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:16.658067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0de1a30-20a5-46fd-a1a0-d0f0d9969f30 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 200 len: 1588 microversion: 2.1 time: 0.463663 Nov 02 21:22:16.658550 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 158/277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:16 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 1588 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:16.668618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b2fec52b-dc09-465e-bc41-9a037a04ee35 req-0c3b9f24-14af-462a-9da3-d0ce5f803176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0ab77c-58ce-40d3-9df9-4658e23b6940", "tag": "e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:16.703922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:16.707254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b2fec52b-dc09-465e-bc41-9a037a04ee35 req-0c3b9f24-14af-462a-9da3-d0ce5f803176 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:16.707736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b2fec52b-dc09-465e-bc41-9a037a04ee35 req-0c3b9f24-14af-462a-9da3-d0ce5f803176 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:16.709175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b2fec52b-dc09-465e-bc41-9a037a04ee35 req-0c3b9f24-14af-462a-9da3-d0ce5f803176 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:16.720197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:16.722441 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b6ea6fb-f8c7-41e3-a512-fe6375464e0b tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1319 microversion: 2.1 time: 0.591384 Nov 02 21:22:16.733070 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 120/278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:16 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:16.742760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-53d6ee20-9ed4-4ab8-856f-0409a4da3d49 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:16.756486 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b2fec52b-dc09-465e-bc41-9a037a04ee35 req-0c3b9f24-14af-462a-9da3-d0ce5f803176 service nova] Creating event network-changed:e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302 for instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 on n-h1-860863-4 Nov 02 21:22:16.763062 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b2fec52b-dc09-465e-bc41-9a037a04ee35 req-0c3b9f24-14af-462a-9da3-d0ce5f803176 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103034 Nov 02 21:22:16.767128 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 159/279] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:16.800227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a344fa7-3bba-4f5e-93f8-21c4eef733bb tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:16.829943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a344fa7-3bba-4f5e-93f8-21c4eef733bb tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:16.833319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a344fa7-3bba-4f5e-93f8-21c4eef733bb tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:16.834139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a344fa7-3bba-4f5e-93f8-21c4eef733bb tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:16.883316 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-53d6ee20-9ed4-4ab8-856f-0409a4da3d49 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.159204 Nov 02 21:22:16.884304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 121/280] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:16.891651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1261413882", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:17.030770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:17.194149 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a344fa7-3bba-4f5e-93f8-21c4eef733bb tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.420524 Nov 02 21:22:17.194149 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 160/281] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 21:22:16 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:17.209279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26734640-6ec4-44e5-9747-87cad2fc939c tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:17.226079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-26734640-6ec4-44e5-9747-87cad2fc939c tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26734640-6ec4-44e5-9747-87cad2fc939c tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Request method failure captured: Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9Si9c7-y5ikuOs_HaXfQUOkux96jy25Wbu4CymTt24kV_Vp7EJU4GHR1m2oi4bsA85ButiEsKpYsc34wVXPcStMhIhUdIANzD2bfzqUGWd5RZhqejpUfujrCvo7lu9eVEETyXUFNY-Eh_cfVlTdY9GlQIisaWm_oKsMRfOz9_WeY4 Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:17.228219 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b68536b736bf4d4e946e470ab6743816 Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: exception: Aggregate 13 could not be found. Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '13'} Nov 02 21:22:17.229536 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:17.230323 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Nov 02 21:22:17.231466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.232416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26734640-6ec4-44e5-9747-87cad2fc939c tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:17.232583 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26734640-6ec4-44e5-9747-87cad2fc939c tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.040580 Nov 02 21:22:17.233337 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 161/282] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:17 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:22:17.249774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-73528f5d-b80c-4d88-8d51-6e99389cdfb3 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:17.392010 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-73528f5d-b80c-4d88-8d51-6e99389cdfb3 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.156693 Nov 02 21:22:17.393172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 162/283] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:17 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:17.400637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6eaa071-7611-4e36-96df-d2350506e21e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:17.425571 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f6eaa071-7611-4e36-96df-d2350506e21e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6eaa071-7611-4e36-96df-d2350506e21e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Request method failure captured: Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9Si9c7-y5ikuOs_HaXfQUOkux96jy25Wbu4CymTt24kV_Vp7EJU4GHR1m2oi4bsA85ButiEsKpYsc34wVXPcStMhIhUdIANzD2bfzqUGWd5RZhqejpUfujrCvo7lu9eVEETyXUFNY-Eh_cfVlTdY9GlQIisaWm_oKsMRfOz9_WeY4 Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:17.430507 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf03b6adda4e4268b6cf1c7bbb17aef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: cf03b6adda4e4268b6cf1c7bbb17aef8 Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-580017130 Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b68536b736bf4d4e946e470ab6743816 Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminTestJSON-580017130-project-admin Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: exception: Aggregate 13 could not be found. Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '13'} Nov 02 21:22:17.431851 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:22:17.432539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:17.434132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:17.435257 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:17.435257 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:17.435257 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:17.435257 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Nov 02 21:22:17.435257 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:17.445973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6eaa071-7611-4e36-96df-d2350506e21e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:17.447327 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6eaa071-7611-4e36-96df-d2350506e21e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.053034 Nov 02 21:22:17.448954 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 163/284] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:17 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:22:17.462513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51d5a6d3-bbda-4d77-80f9-4eaa42221392 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-269604569"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:17.467323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.aggregate [None req-51d5a6d3-bbda-4d77-80f9-4eaa42221392 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Generated uuid bab8a151-2a3f-4c27-a824-bf69192b18ad for aggregate {{(pid=121040) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:17.623544 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51d5a6d3-bbda-4d77-80f9-4eaa42221392 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.172954 Nov 02 21:22:17.625220 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 164/285] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:17.645975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b697823a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:17.660170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:17.660753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:17.662147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:17.667777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:17.683350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:17.684235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:17.758596 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-677c341d-1c79-4b84-a15b-092eb4050cd9 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.117304 Nov 02 21:22:17.759288 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 165/286] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 21:22:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:17.782323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b27b43b8-e725-432d-8b8e-b6dfea51e45e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-613806694"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:17.790041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.aggregate [None req-b27b43b8-e725-432d-8b8e-b6dfea51e45e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 53830162-b2f0-4a22-b44c-ab79b3080792 for aggregate {{(pid=121040) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:17.923948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b27b43b8-e725-432d-8b8e-b6dfea51e45e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.150912 Nov 02 21:22:17.925713 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 166/287] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:17.937983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:17.956239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:17.957721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:17.958638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:17.971338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:17.972212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:17.972861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:17.988325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:17.995393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:17.995393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:17.995393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:17.995393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:18.000316 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.compute.aggregates [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Failed to remove host nonexist_host from aggregate 14. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 21:22:18.003277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 14 Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Request method failure captured: Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 42 Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9SU8BvOYVfLkpib5NP3VUcItDH2LT8Fi742ndOE5IhROR-YFHvMKmv-NzoMeuHvH8xfjmHvsE6L9pRxaPodBH1sq3hCdHq01zG4PNIxb96wfaZiAAdYUtlMEL41Z00RwZ117xUrtOnv1DNxmaKQK7d0qshBsgn-0bcaJJC_BTzCu8 Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:22:18.007556 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/688577e4cdf54173a9548a81ee0d3c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 688577e4cdf54173a9548a81ee0d3c9c Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887 Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 6f79a20ffcf54d8aaf4e82691b683f58 Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: {"remove_host": {"host": "nonexist_host"}} Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:18.008810 n-d-860863-4 devstack@n-api.service[121040]: exception: Cannot remove host nonexist_host in aggregate 14 Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 21:22:18.009607 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 02 21:22:18.010709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 14 Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.011904 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 14 Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 14 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:18.013062 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fcab0c5b-1b50-479d-bf6a-6d6c3f9a7ce9 tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/14/action" status: 404 len: 94 microversion: 2.1 time: 0.084281 Nov 02 21:22:18.013848 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 167/288] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 21:22:17 2022] POST /compute/v2.1/os-aggregates/14/action => generated 94 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:22:18.017181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.018523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.021837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.021837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.021837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.021837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.025222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.026375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:18.042038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.044675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.045190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.046929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.047981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Getting quotas for project 5e262054d2ff4f7a9128d3809705afe1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:18.048454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.048974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.053993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Getting quotas for user 6c7edca2c3f047858795ca1c649c59d2 and project 5e262054d2ff4f7a9128d3809705afe1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:18.071293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.utils [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] instances quota exceeded for 5e262054d2ff4f7a9128d3809705afe1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121039) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 21:22:18.072210 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Request method failure captured: Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 145 Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-CbOIwyciqJ6DWC_tUVISlD47FJJxG65oaiSQR90yq1I6w-zScV-ax7v1lH9aC5sdmCiMKVUKW6e-CgmaxcVl-DL_MBxfXAxznouSvJjib3VVX5JlDOOoxo4pthvB6P6_AVyt5AkwZFSyq0cebMJGJOJD4ebGMmfhUG4S-XMJtfWY Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:22:18.079386 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6c7edca2c3f047858795ca1c649c59d2 Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1261413882", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} Nov 02 21:22:18.080997 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1261413882', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452'}}} Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 21:22:18.081653 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:18.082603 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.083702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8bc8440e-715e-4783-829c-52074db89a20 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.193167 Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 122/289] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:16 2022] POST /compute/v2.1/servers => generated 119 bytes in 1194 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:18.086089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b697cf0d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.091609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.092183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.092706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.094142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.094668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.095156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.125103 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-00eb857d-0793-4dfd-9808-9f97b7e7d9d4 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.044549 Nov 02 21:22:18.134042 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 123/290] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.140667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8dcae3f-7aed-4b22-9bb8-bd8c2da157ea tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.151347 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8dcae3f-7aed-4b22-9bb8-bd8c2da157ea tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.015762 Nov 02 21:22:18.153508 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 124/291] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.158404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b096b31-775e-462d-8f9d-e8f1c13cf8dd tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.264703 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b096b31-775e-462d-8f9d-e8f1c13cf8dd tempest-AggregatesAdminNegativeTestJSON-1300453887 tempest-AggregatesAdminNegativeTestJSON-1300453887-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.109130 Nov 02 21:22:18.267274 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 125/292] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:18 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:18.277294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Action: 'update', calling method: .version_select at 0x7f9b697cfc10>, body: {"quota_set": {"instances": 10}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:18.343676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:18.352404 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1efca9fb-d231-4cb3-a937-3832ca973a62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1319 microversion: 2.1 time: 0.335842 Nov 02 21:22:18.354545 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 168/293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:18.362440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b69782ca0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.372711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.377241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.381405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.382313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.382854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.383432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.431229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e775b5c4-54e0-4f0b-9a64-a9c48a9bd9dc tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.075320 Nov 02 21:22:18.431899 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 169/294] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.444373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61fb0e38-90a8-48bc-8240-87a20be761c4 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:18.553202 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61fb0e38-90a8-48bc-8240-87a20be761c4 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.114124 Nov 02 21:22:18.553818 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 170/295] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 21:22:18 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.562943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b6970b160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.576087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.577029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.578723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.596808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.597457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.598077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.655260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.656038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.656164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.657110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.657958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.657958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.662884 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce23fd70-f75a-4ae5-9c23-156a8d270660 tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h2-860863-4" status: 200 len: 467 microversion: 2.1 time: 0.107932 Nov 02 21:22:18.669956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 171/296] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/os-hosts/n-h2-860863-4 => generated 467 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.686612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfd807fc-5309-4bb1-9330-870dd1bac156 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.700480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfd807fc-5309-4bb1-9330-870dd1bac156 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.025870 Nov 02 21:22:18.701511 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 172/297] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.708368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Calling method '.version_select at 0x7f9b697eb700>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.717878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.719461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.719461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.759142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:18.759830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:18.761434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:18.800217 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0205cea5-c882-4536-b89c-c2a5d127992f tempest-HostsAdminTestJSON-694912185 tempest-HostsAdminTestJSON-694912185-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hosts/n-h1-860863-4" status: 200 len: 598 microversion: 2.1 time: 0.096339 Nov 02 21:22:18.800217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 173/298] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/os-hosts/n-h1-860863-4 => generated 598 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.810417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d75b267-7e2a-4fbb-87d9-564c9ef9a444 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:18.920643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d75b267-7e2a-4fbb-87d9-564c9ef9a444 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.119370 Nov 02 21:22:18.923156 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 174/299] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:18 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:18.941940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-344a659f-e77a-4c60-8cf8-79c97bbbc2d2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-46915245", "availability_zone": "tempest-test_az-1665484933"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:18.952675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.aggregate [None req-344a659f-e77a-4c60-8cf8-79c97bbbc2d2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 5cdf643b-fb92-4c48-87d0-33e4649ec2e8 for aggregate {{(pid=121040) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:18.955837 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f6185baa-fbee-4c76-9909-14b1d43be2a4 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 329 microversion: 2.1 time: 0.687017 Nov 02 21:22:18.962078 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 126/300] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:18 2022] PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 329 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:18.971486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1537acb8-0704-4d8e-8ab4-d32f475b68ef tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Calling method '.version_select at 0x7f9b697cf160>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:19.107175 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-344a659f-e77a-4c60-8cf8-79c97bbbc2d2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.178615 Nov 02 21:22:19.110012 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 175/301] 10.222.0.25 () {60 vars in 1165 bytes} [Wed Nov 2 21:22:18 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:19.129475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6aa2500-2772-497e-b75c-c9d228c84ef2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-46915245_new", "availability_zone": "tempest-test_az-1665484933_new"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:19.426384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6aa2500-2772-497e-b75c-c9d228c84ef2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:19.427082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6aa2500-2772-497e-b75c-c9d228c84ef2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:19.427300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6aa2500-2772-497e-b75c-c9d228c84ef2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:19.539687 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e6aa2500-2772-497e-b75c-c9d228c84ef2 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 0.421379 Nov 02 21:22:19.541355 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 176/302] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 21:22:19 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:19.549382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:19.550018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:19.563351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:19.565274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:19.565730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:19.566453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:19.566911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:19.567343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:19.657045 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1537acb8-0704-4d8e-8ab4-d32f475b68ef tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 371 microversion: 2.1 time: 0.688030 Nov 02 21:22:19.666053 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 127/303] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:22:18 2022] GET /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 371 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:19.673177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1434c752-ad55-400d-b6a7-b3ce0ee4068b tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:19.703493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1434c752-ad55-400d-b6a7-b3ce0ee4068b tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.035277 Nov 02 21:22:19.705414 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 128/304] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:22:19 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:19.720021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Action: 'update', calling method: .version_select at 0x7f9b697cf8b0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:19.948464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:19.962163 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67ccb564-a8ae-462b-ac88-2fce452dd4d1 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1319 microversion: 2.1 time: 0.419005 Nov 02 21:22:19.978304 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 177/305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:19 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:19.985115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cddaf88d-d9ac-45a1-9431-5ee42f4df34e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:20.095329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:20.095918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:20.097469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:20.100248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:20.100803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:20.101504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:20.129340 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cddaf88d-d9ac-45a1-9431-5ee42f4df34e tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.148888 Nov 02 21:22:20.130933 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 178/306] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:19 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:20.152070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e686c4e4-1a83-46b2-9864-93a23806ae6b tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-754091173"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:20.160806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.aggregate [None req-e686c4e4-1a83-46b2-9864-93a23806ae6b tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Generated uuid 224206e1-4ee8-4456-962c-b67caf03b1e3 for aggregate {{(pid=121040) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:20.161956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=19 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:20.304657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e686c4e4-1a83-46b2-9864-93a23806ae6b tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.167655 Nov 02 21:22:20.305769 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 179/307] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 21:22:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:20.320792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ab2c6b8-7c73-4fd3-8a29-9b486955b834 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:20.331371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ab2c6b8-7c73-4fd3-8a29-9b486955b834 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.014090 Nov 02 21:22:20.340619 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a8485c99-1a9f-4bbd-9786-9363435ae221 tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 325 microversion: 2.1 time: 0.626636 Nov 02 21:22:20.340619 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 129/308] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:19 2022] PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 325 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:20.341466 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 180/309] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:22:20 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:20.354276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c61e44af-8be8-47dd-8f71-8a099d423a37 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:20.361988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:20.457431 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c61e44af-8be8-47dd-8f71-8a099d423a37 tempest-AggregatesAdminTestJSON-580017130 tempest-AggregatesAdminTestJSON-580017130-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.111202 Nov 02 21:22:20.458480 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 130/310] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:22:20 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 21:22:20.474577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:20.475827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:20.484768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=7,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:20.487703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:20.490058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:20.490718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:20.494627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:20.494627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:20.494627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:20.536422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] HTTP exception thrown: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Request method failure captured: Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea HTTP/1.1 Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OBdwF6j7i0rjbs1-P9DIeF2v5f7FitZAOR2BRmsylKKqs2RSpqZI5JO1KdxHgPqQEHKQE7Ow-P4Wbd37t0XHgSnNuFrWrEolYjKztroJ6KH060NdhtP0TYQPf1ul9e3i5YoEmaWF8MLoU3inPMMUyH1F3svyzF5nS-PUUOIXSTsc Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a078ad61024a48d89e1c94da25107c21 Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:20.542397 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a078ad61024a48d89e1c94da25107c21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a078ad61024a48d89e1c94da25107c21 Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminTestJSON-211556665-project Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: bd4ae61cbd8048c181c7573734cde312 Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminTestJSON-211556665-project Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.544113 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '87092801-1aba-4e56-a505-74a53a15b6ea'} Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:20.545062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.546400 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.551722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Returning 404 to user: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:20.560788 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6688848a-7691-43eb-8382-73d54a945f33 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "DELETE /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 404 len: 111 microversion: 2.1 time: 0.087204 Nov 02 21:22:20.560788 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 181/311] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:22:20 2022] DELETE /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:20.565947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1695525402", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:20.579120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:20.586510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] [instance: 87092801-1aba-4e56-a505-74a53a15b6ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:20.604806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:20.607219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:20.608764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:20.611320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:20.612569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:20.613205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:20.629348 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] HTTP exception thrown: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Request method failure captured: Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea HTTP/1.1 Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9OBdwF6j7i0rjbs1-P9DIeF2v5f7FitZAOR2BRmsylKKqs2RSpqZI5JO1KdxHgPqQEHKQE7Ow-P4Wbd37t0XHgSnNuFrWrEolYjKztroJ6KH060NdhtP0TYQPf1ul9e3i5YoEmaWF8MLoU3inPMMUyH1F3svyzF5nS-PUUOIXSTsc Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a078ad61024a48d89e1c94da25107c21 Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:20.631154 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a078ad61024a48d89e1c94da25107c21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a078ad61024a48d89e1c94da25107c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a078ad61024a48d89e1c94da25107c21 Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-211556665 Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AggregatesAdminTestJSON-211556665-project Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: bd4ae61cbd8048c181c7573734cde312 Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AggregatesAdminTestJSON-211556665-project Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.632364 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '87092801-1aba-4e56-a505-74a53a15b6ea'} Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:20.633109 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. Nov 02 21:22:20.634144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:20.638757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] Returning 404 to user: Instance 87092801-1aba-4e56-a505-74a53a15b6ea could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:20.639876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8ab26ac-0879-4ed4-9088-0ed8dec03b28 tempest-AggregatesAdminTestJSON-211556665 tempest-AggregatesAdminTestJSON-211556665-project] 10.222.0.25 "GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea" status: 404 len: 111 microversion: 2.1 time: 0.065373 Nov 02 21:22:20.640503 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 182/312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:20 2022] GET /compute/v2.1/servers/87092801-1aba-4e56-a505-74a53a15b6ea => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:20.672024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:21.148101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:21.148767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:21.149736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:21.150425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:21.151200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:21.161811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:21.162332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:21.162725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:21.163775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:21.164481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:21.165095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:21.200441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Getting quotas for project 5e262054d2ff4f7a9128d3809705afe1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:21.211552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Getting quotas for user 6c7edca2c3f047858795ca1c649c59d2 and project 5e262054d2ff4f7a9128d3809705afe1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:21.240879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.utils [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] ram quota exceeded for 5e262054d2ff4f7a9128d3809705afe1, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=121039) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 21:22:21.241456 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Request method failure captured: Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 145 Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-CbOIwyciqJ6DWC_tUVISlD47FJJxG65oaiSQR90yq1I6w-zScV-ax7v1lH9aC5sdmCiMKVUKW6e-CgmaxcVl-DL_MBxfXAxznouSvJjib3VVX5JlDOOoxo4pthvB6P6_AVyt5AkwZFSyq0cebMJGJOJD4ebGMmfhUG4S-XMJtfWY Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:22:21.244323 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 6c7edca2c3f047858795ca1c649c59d2 Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1695525402", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} Nov 02 21:22:21.245597 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1695525402', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452'}}} Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 21:22:21.247210 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:21.248150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:21.249382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a8b4ab1-9641-4d73-a372-348f9e56f135 tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.683754 Nov 02 21:22:21.252515 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 131/313] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 686 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:21.268580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.269482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:21.276558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:21.286459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:21.286459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:21.286459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:21.287283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:21.287887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:21.294676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:21.509761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-061ef0bd-63d9-4a45-ac14-d159c3521a5a tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.519952 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-061ef0bd-63d9-4a45-ac14-d159c3521a5a tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.757133 Nov 02 21:22:21.520534 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 183/314] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:21.548203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Action: 'update', calling method: .version_select at 0x7f9b697eb4c0>, body: {"quota_set": {"ram": 51200}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:21.695473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:21.704092 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1c101ff1-d999-4aed-bc73-8602d92f0a84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1319 microversion: 2.1 time: 0.441920 Nov 02 21:22:21.708353 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 132/315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:21 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:21.715586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91915def-1d5b-43ee-9a79-8c675432c0a0 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.751565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91915def-1d5b-43ee-9a79-8c675432c0a0 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors" status: 200 len: 3075 microversion: 2.1 time: 0.041882 Nov 02 21:22:21.766664 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 133/316] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:22:21 2022] GET /compute/v2.1/flavors => generated 3075 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:21.773686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34c419d2-afcc-4cc7-af7a-67fb8cb60fee tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.783432 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34c419d2-afcc-4cc7-af7a-67fb8cb60fee tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014842 Nov 02 21:22:21.792284 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 134/317] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:21.798313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1112a38a-fa0f-48ac-b122-583538de2d40 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.818377 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1112a38a-fa0f-48ac-b122-583538de2d40 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022559 Nov 02 21:22:21.821281 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 135/318] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:21.834060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-60312452-fc55-49b4-8707-f122924aff3b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.866037 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-60312452-fc55-49b4-8707-f122924aff3b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.035674 Nov 02 21:22:21.903894 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 136/319] 10.222.0.25 () {58 vars in 1165 bytes} [Wed Nov 2 21:22:21 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:21.921142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-716b3ae5-d85a-4091-a290-ebe849cee61e tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.940855 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-716b3ae5-d85a-4091-a290-ebe849cee61e tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046260 Nov 02 21:22:21.946703 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 137/320] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:21.962079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ccafece4-2169-43f2-b32a-ffe61a53570b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:21.996422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=99 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:22.000889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:22.006013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:22.006908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:22.008131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:22.008789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:22.009441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:22.034626 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ccafece4-2169-43f2-b32a-ffe61a53570b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.081146 Nov 02 21:22:22.045192 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 138/321] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 21:22:21 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:22.075521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5941153-8fe0-4fed-aa2f-256850cb230d tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.090861 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5941153-8fe0-4fed-aa2f-256850cb230d tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029732 Nov 02 21:22:22.103937 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 139/322] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:22.116167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f6bd080-162c-4c71-b893-65207097d35c tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.130011 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f6bd080-162c-4c71-b893-65207097d35c tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020812 Nov 02 21:22:22.133789 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 140/323] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:22.155111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f5a2d476-2dd9-4b11-acfe-ec30eb5248d7 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.203380 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f5a2d476-2dd9-4b11-acfe-ec30eb5248d7 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2911 microversion: 2.1 time: 0.059407 Nov 02 21:22:22.204304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 141/324] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2911 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:22.224016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-363928a4-93c2-4d2f-9e11-137a88011e3b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.234852 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-363928a4-93c2-4d2f-9e11-137a88011e3b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015522 Nov 02 21:22:22.236056 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 142/325] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:22.248201 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3d2bda4-984f-4bfc-94a3-249a7ef8a35e tempest-QuotasAdminNegativeTest-1426873829 tempest-QuotasAdminNegativeTest-1426873829-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 200 len: 329 microversion: 2.1 time: 0.726283 Nov 02 21:22:22.249048 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 184/326] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:21 2022] PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 329 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:22.250089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f63e611a-08f3-4ffe-8001-7dd922a49d99 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.264273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2bd67ed2-1b8d-4282-8b76-cb0fb3b3822a tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Action: 'update', calling method: .version_select at 0x7f9b69724d30>, body: {"quota_set": {"ram": 0}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:22.275601 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f63e611a-08f3-4ffe-8001-7dd922a49d99 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.031334 Nov 02 21:22:22.276553 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 143/327] 10.222.0.25 () {58 vars in 1144 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:22:22.281377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bd67ed2-1b8d-4282-8b76-cb0fb3b3822a tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '6c7edca2c3f047858795ca1c649c59d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e262054d2ff4f7a9128d3809705afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2bd67ed2-1b8d-4282-8b76-cb0fb3b3822a tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Request method failure captured: Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 HTTP/1.1 Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 25 Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-CbOIwyciqJ6DWC_tUVISlD47FJJxG65oaiSQR90yq1I6w-zScV-ax7v1lH9aC5sdmCiMKVUKW6e-CgmaxcVl-DL_MBxfXAxznouSvJjib3VVX5JlDOOoxo4pthvB6P6_AVyt5AkwZFSyq0cebMJGJOJD4ebGMmfhUG4S-XMJtfWY Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:22.284521 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5e262054d2ff4f7a9128d3809705afe1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 5e262054d2ff4f7a9128d3809705afe1 Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1857874529 Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 6c7edca2c3f047858795ca1c649c59d2 Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-QuotasAdminNegativeTest-1857874529-project Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: {"quota_set": {"ram": 0}} Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 21:22:22.285979 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '5e262054d2ff4f7a9128d3809705afe1', 'body': {'quota_set': {'ram': 0}}} Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:22.286975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:22.287962 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:22.297723 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:22.297723 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:22.297723 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:22:22.297723 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:22:22.297723 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 21:22:22.297723 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:22.298220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48c63efe-c299-41ec-99fe-d269d5c70d4c tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.298320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2bd67ed2-1b8d-4282-8b76-cb0fb3b3822a tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:22.298680 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2bd67ed2-1b8d-4282-8b76-cb0fb3b3822a tempest-QuotasAdminNegativeTest-1857874529 tempest-QuotasAdminNegativeTest-1857874529-project] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1" status: 403 len: 116 microversion: 2.1 time: 0.040260 Nov 02 21:22:22.299095 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 185/328] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:22:22 2022] PUT /compute/v2.1/os-quota-sets/5e262054d2ff4f7a9128d3809705afe1 => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:22.304733 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48c63efe-c299-41ec-99fe-d269d5c70d4c tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016362 Nov 02 21:22:22.308224 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 144/329] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:22:22.320364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b304b1c-fb4a-4967-8a8c-c2dd61c4f06d tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.363490 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b304b1c-fb4a-4967-8a8c-c2dd61c4f06d tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.046932 Nov 02 21:22:22.364714 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 186/330] 10.222.0.25 () {58 vars in 1148 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:22.378958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc1a5734-c0a5-4602-87e0-d9665f256ffa tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.405172 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc1a5734-c0a5-4602-87e0-d9665f256ffa tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026609 Nov 02 21:22:22.406125 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 145/331] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:22.432628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a67d84eb-6345-4a19-9970-07ced9f72a46 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.442079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a67d84eb-6345-4a19-9970-07ced9f72a46 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026123 Nov 02 21:22:22.443763 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 187/332] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:22.456251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e6cf0d2d-8332-4497-abb5-516245f8232b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.483421 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e6cf0d2d-8332-4497-abb5-516245f8232b tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1540 microversion: 2.1 time: 0.030717 Nov 02 21:22:22.484015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 146/333] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors?marker=452 => generated 1540 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:22.499431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d313112-d6e5-48ac-8b45-aa140bba7f72 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.529584 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d313112-d6e5-48ac-8b45-aa140bba7f72 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.034640 Nov 02 21:22:22.551960 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 188/334] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:22.553138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d934ffd-cb0b-4502-aa6a-4d17e539c0b5 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.565782 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d934ffd-cb0b-4502-aa6a-4d17e539c0b5 tempest-FlavorsV2TestJSON-1225269093 tempest-FlavorsV2TestJSON-1225269093-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019847 Nov 02 21:22:22.573524 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 147/335] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:22.733012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:22.733777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:22.756892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:22.757771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:22.759245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:22.761882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:22.764218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:22.766519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:23.035651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:23.055951 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-709ed9f2-4ad4-4cdc-91a1-8982e0c7e977 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1319 microversion: 2.1 time: 0.328640 Nov 02 21:22:23.059629 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 189/336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:22 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:23.700459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-645e99cd-b83c-43a6-8065-c24b778bf182 req-8835f2aa-1c59-4f03-a21c-3f7f8268336c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d9874f-026b-40b2-9e0b-62c1df42e442", "name": "network-vif-plugged", "status": "completed", "tag": "97a6e697-5a70-4a94-b843-51643c580f80"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:23.711090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-645e99cd-b83c-43a6-8065-c24b778bf182 req-8835f2aa-1c59-4f03-a21c-3f7f8268336c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:23.711845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-645e99cd-b83c-43a6-8065-c24b778bf182 req-8835f2aa-1c59-4f03-a21c-3f7f8268336c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:23.712493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-645e99cd-b83c-43a6-8065-c24b778bf182 req-8835f2aa-1c59-4f03-a21c-3f7f8268336c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:23.724743 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-645e99cd-b83c-43a6-8065-c24b778bf182 req-8835f2aa-1c59-4f03-a21c-3f7f8268336c service nova] Creating event network-vif-plugged:97a6e697-5a70-4a94-b843-51643c580f80 for instance b9d9874f-026b-40b2-9e0b-62c1df42e442 on n-h2-860863-4 Nov 02 21:22:23.730007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-645e99cd-b83c-43a6-8065-c24b778bf182 req-8835f2aa-1c59-4f03-a21c-3f7f8268336c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033160 Nov 02 21:22:23.731988 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 148/337] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:24.094173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:24.095955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:24.112677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:24.113941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:24.114583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:24.116476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:24.119491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:24.120528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:24.297363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:24.308206 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82b2987c-c052-49a8-9050-c9375b2282ae tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1319 microversion: 2.1 time: 0.230295 Nov 02 21:22:24.312569 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 190/338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:24 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:25.340159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:25.341761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:25.360230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:25.360728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:25.361202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:25.361918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:25.362369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:25.362793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:25.552306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:25.561895 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-11f322d0-501c-49d8-a7cf-a34af216c990 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1468 microversion: 2.1 time: 0.229586 Nov 02 21:22:25.566689 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 149/339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:25 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:25.588736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:25.590003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:25.597867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:25.598359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:25.599038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:25.599921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:25.600542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:25.601163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:25.670212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lazy-loading 'flavor' on Instance uuid b9d9874f-026b-40b2-9e0b-62c1df42e442 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:22:26.036947 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a38fba06-ba5e-45d4-9643-87633eb562fd tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442/action" status: 202 len: 0 microversion: 2.1 time: 0.449318 Nov 02 21:22:26.036947 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 191/340] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:22:25 2022] POST /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:22:26.044788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:26.045508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:26.052271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:26.053595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:26.054310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:26.055987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:26.056697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:26.057726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:26.237330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:26.246656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a8f1677-d75d-4dcb-bf1b-5cde8616d43e tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1476 microversion: 2.1 time: 0.206000 Nov 02 21:22:26.247682 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 150/341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:26 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:27.272718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:27.277901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:27.280774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:27.281282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:27.281723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:27.282424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:27.283012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:27.283452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:27.549642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:27.558004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d37b4ab5-24f2-4374-89c2-73c64ec8bd84 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1459 microversion: 2.1 time: 0.291194 Nov 02 21:22:27.559278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 192/342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:27 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1459 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:27.580596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:27.581463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:27.588099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:27.594058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:27.594058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:27.594058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:27.594058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:27.594682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.081463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5716389e-5876-474b-b76c-07ae9d71e5f5 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1610 microversion: 2.1 time: 0.496276 Nov 02 21:22:28.081463 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 151/343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:27 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1610 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:28.102310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:28.117108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.117108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.117108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.117108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.117665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.117665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.155503 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6262998-7152-4fba-b4c8-57274d49722a tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057082 Nov 02 21:22:28.157283 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 193/344] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:22:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:28.170217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860863-4", "block_migration": true, "disk_over_commit": false}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:28.184563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:28.187561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.188181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.188865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.190527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.191175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.192025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.220690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Lazy-loading 'flavor' on Instance uuid b9d9874f-026b-40b2-9e0b-62c1df42e442 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:22:28.234906 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance b9d9874f-026b-40b2-9e0b-62c1df42e442 while it is in vm_state suspended Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Request method failure captured: Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442/action HTTP/1.1 Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 97 Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9iwot358xrrrZTBpVouZoStkqsnAVDymBuCmyWxd8G_8DFmYyLskWJKbtZdHTq9EASNlmCLTjGbCKYy_mAoUVMmW41JE-xrzse68F9_44cn2H_xSXcjKGu1Zos2AgXLKrUplBiqoIslScuvI7lNMmTNzSpIx7CAVJdi7HJUymC6Ww Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 2025e4ee38944f18a5672059dff69d74 Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-LiveMigrationNegativeTest-1328722909 Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:22:28.237300 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2025e4ee38944f18a5672059dff69d74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2025e4ee38944f18a5672059dff69d74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2025e4ee38944f18a5672059dff69d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2025e4ee38944f18a5672059dff69d74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-LiveMigrationNegativeTest-1328722909 Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 2025e4ee38944f18a5672059dff69d74 Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1328722909 Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-LiveMigrationNegativeTest-1328722909-project-admin Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7134058e68524d858e18d382699f0189 Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-LiveMigrationNegativeTest-1328722909-project-admin Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: {"os-migrateLive": {"host": "n-h1-860863-4", "block_migration": true, "disk_over_commit": false}} Nov 02 21:22:28.238661 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'os-migrateLive' instance b9d9874f-026b-40b2-9e0b-62c1df42e442 while it is in vm_state suspended Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b9d9874f-026b-40b2-9e0b-62c1df42e442', 'body': {'os-migrateLive': {'host': 'n-h1-860863-4', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 21:22:28.239335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b9d9874f-026b-40b2-9e0b-62c1df42e442 in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:28.240364 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance b9d9874f-026b-40b2-9e0b-62c1df42e442 while it is in vm_state suspended Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance b9d9874f-026b-40b2-9e0b-62c1df42e442 while it is in vm_state suspended Nov 02 21:22:28.244776 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:22:28.245891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance b9d9874f-026b-40b2-9e0b-62c1df42e442 while it is in vm_state suspended {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:28.251957 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41a9288b-c7b5-4018-9d7c-11e0486d5c29 tempest-LiveMigrationNegativeTest-1328722909 tempest-LiveMigrationNegativeTest-1328722909-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442/action" status: 409 len: 155 microversion: 2.1 time: 0.087604 Nov 02 21:22:28.260748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 152/345] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:22:28 2022] POST /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442/action => generated 155 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:22:28.264552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:28.265234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:28.275693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.276304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.276605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.277445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.283141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.283682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.327296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:22:28.745287 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a2ed73a4-2658-4c77-b7dc-c9701aa9082c tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 204 len: 0 microversion: 2.1 time: 0.484678 Nov 02 21:22:28.750754 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 194/346] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:22:28 2022] DELETE /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:22:28.758207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:28.758901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:28.765823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.766410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.766874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.767563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:28.768012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:28.768538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:28.969157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:28.971460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:28.977562 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b33561e6-85b7-4f91-8777-cde1762c4a7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1465 microversion: 2.1 time: 0.224545 Nov 02 21:22:28.978118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 195/347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:28 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1465 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:29.002364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-860627ce-be0e-4dc6-8fa2-e34ad911b559 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2118136318", "id": 1344769628, "os-flavor-access:is_public": "False"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:29.119735 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-860627ce-be0e-4dc6-8fa2-e34ad911b559 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.562371 Nov 02 21:22:29.120390 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 153/348] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:28 2022] POST /compute/v2.1/flavors => generated 431 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:29.133593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f14b5f19-cdfe-49a7-9928-de3c28def7df tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d74a8b9f829e40b39831bbc78335b611"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:29.633315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72e3bcb2-cec2-4988-b327-5386165452a5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:29.643166 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72e3bcb2-cec2-4988-b327-5386165452a5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.420732 Nov 02 21:22:29.643965 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 154/349] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:22:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:30.001256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:30.001876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:30.017761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:30.022521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:30.024448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:30.026635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:30.029009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:30.029461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:30.310625 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f14b5f19-cdfe-49a7-9928-de3c28def7df tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1344769628/action" status: 200 len: 97 microversion: 2.1 time: 1.180820 Nov 02 21:22:30.315902 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 196/350] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 21:22:29 2022] POST /compute/v2.1/flavors/1344769628/action => generated 97 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:22:30.401027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:30.409791 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1673be6-5967-4985-9b2f-0680b42c1aba tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1465 microversion: 2.1 time: 0.413456 Nov 02 21:22:30.412509 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 155/351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:29 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1465 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:30.604359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aea0b0b5-f310-4f91-992f-78378522ea17 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Action: 'create', calling method: .version_select at 0x7f9b697b2550>, body: {"keypair": {"name": "tempest-keypair-1719037404", "type": "ssh", "user_id": "e96f22b0b88e4bd9810fb99749d177e9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaraW1Cyx7sT9cn8o24bRKTxNL9g6j+vyNYTAZ27UhYEZ28YwrpO9Tlh74Z7KfLKYrbYb1rkBw9bsh5kYuFswGF20ic6i+KO1jnmL3qssJOMy+LhF2ADnYqp9Lqr1MOzw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:30.646598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-aea0b0b5-f310-4f91-992f-78378522ea17 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Getting quotas for project c659e39db9324fe7a3bdd8afd9229c05. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:30.663721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-aea0b0b5-f310-4f91-992f-78378522ea17 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Getting quotas for user 23f4a8bacaa74424a663e48c23e848c6 and project c659e39db9324fe7a3bdd8afd9229c05. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:30.773030 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aea0b0b5-f310-4f91-992f-78378522ea17 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.459575 Nov 02 21:22:30.774041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 197/352] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:22:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 462 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:22:30.788016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25cf2e21-821d-4e69-8a17-a548795d002e tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Action: 'create', calling method: .version_select at 0x7f9b696c8790>, body: {"keypair": {"name": "tempest-keypair-1993522498", "type": "ssh", "user_id": "e96f22b0b88e4bd9810fb99749d177e9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVXBiJ2GwUgN8U2l15LWVo7oXYuYf1XY3rYiaTBhStjA0NjIjbhrgoF4OCZrL2w91mlKK8gFf7j55/e6YAbZq7zuLz2dtnZg1YYFiNvXopHSUsqFx4ayxOURBd5QaFelQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:30.814058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-25cf2e21-821d-4e69-8a17-a548795d002e tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Getting quotas for project c659e39db9324fe7a3bdd8afd9229c05. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:30.818894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-25cf2e21-821d-4e69-8a17-a548795d002e tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Getting quotas for user 23f4a8bacaa74424a663e48c23e848c6 and project c659e39db9324fe7a3bdd8afd9229c05. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:30.921475 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25cf2e21-821d-4e69-8a17-a548795d002e tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.136997 Nov 02 21:22:30.922493 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 198/353] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:22:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:22:30.936245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ab3b2fc-b1b0-428d-95b9-ff1abc0f2581 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Calling method '.version_select at 0x7f9b69834670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:30.997680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1fedab05-0b31-4fc7-bbb0-1861533979ab tempest-FlavorsAccessTestJSON-2109343548 tempest-FlavorsAccessTestJSON-2109343548-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:31.012349 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ab3b2fc-b1b0-428d-95b9-ff1abc0f2581 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1719037404?user_id=e96f22b0b88e4bd9810fb99749d177e9" status: 200 len: 512 microversion: 2.10 time: 0.080094 Nov 02 21:22:31.025692 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 199/354] 10.222.0.25 () {60 vars in 1340 bytes} [Wed Nov 2 21:22:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1719037404?user_id=e96f22b0b88e4bd9810fb99749d177e9 => generated 512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:22:31.036859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6dd92136-ac6a-47ab-a7ed-c417c075ac77 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Action: 'create', calling method: .version_select at 0x7f9b696c8700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-928523214", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7DeUnIa8gsJC9UakLURa/s1EKhAB8KJGNwgL0ICK7+2JM0pzNix6NQ687JYZyEqje8ZgeREO9rB/UF3KXRMCbVTkcynjYi/M/sCHOgwchdulNdq29v0CXsRvSyan4Fg=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:31.059222 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1fedab05-0b31-4fc7-bbb0-1861533979ab tempest-FlavorsAccessTestJSON-2109343548 tempest-FlavorsAccessTestJSON-2109343548-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.645595 Nov 02 21:22:31.059815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 156/355] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:30 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:31.073337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6dd92136-ac6a-47ab-a7ed-c417c075ac77 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Getting quotas for project c659e39db9324fe7a3bdd8afd9229c05. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:31.080359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6dd92136-ac6a-47ab-a7ed-c417c075ac77 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Getting quotas for user 23f4a8bacaa74424a663e48c23e848c6 and project c659e39db9324fe7a3bdd8afd9229c05. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:31.085799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0113c12a-aedf-4222-af97-12025297da72 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d74a8b9f829e40b39831bbc78335b611"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:31.177937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:31.186369 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6dd92136-ac6a-47ab-a7ed-c417c075ac77 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.159248 Nov 02 21:22:31.188374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 200/356] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:22:31 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 21:22:31.198457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-374c2773-12d6-4c2f-b0ba-b82e6188290f tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Calling method '.version_select at 0x7f9b695e6af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:31.203796 n-d-860863-4 devstack@n-api.service[121040]: WARNING oslo_db.sqlalchemy.utils [None req-374c2773-12d6-4c2f-b0ba-b82e6188290f tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 21:22:31.225093 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-374c2773-12d6-4c2f-b0ba-b82e6188290f tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "GET /compute/v2.1/os-keypairs?user_id=e96f22b0b88e4bd9810fb99749d177e9" status: 200 len: 726 microversion: 2.10 time: 0.031028 Nov 02 21:22:31.227880 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 201/357] 10.222.0.25 () {60 vars in 1259 bytes} [Wed Nov 2 21:22:31 2022] GET /compute/v2.1/os-keypairs?user_id=e96f22b0b88e4bd9810fb99749d177e9 => generated 726 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:22:31.234821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=98 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:31.241549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b8afed6-f438-433e-b6f9-2ecfe947c218 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Calling method '.version_select at 0x7f9b697241f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:31.374108 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b8afed6-f438-433e-b6f9-2ecfe947c218 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-928523214" status: 204 len: 0 microversion: 2.10 time: 0.137245 Nov 02 21:22:31.375506 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 202/358] 10.222.0.25 () {60 vars in 1322 bytes} [Wed Nov 2 21:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-928523214 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:22:31.736562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Calling method '.version_select at 0x7f9b696be160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:31.742915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:31.744560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:31.745046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:31.783835 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0113c12a-aedf-4222-af97-12025297da72 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors/1344769628/action" status: 200 len: 21 microversion: 2.1 time: 0.702008 Nov 02 21:22:31.784436 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 157/359] 10.222.0.25 () {60 vars in 1200 bytes} [Wed Nov 2 21:22:31 2022] POST /compute/v2.1/flavors/1344769628/action => generated 21 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:22:31.788760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:31.797579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7b41b62-37f9-4b2c-855b-4e7e42e5e9cd tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Calling method '.version_select at 0x7f9b698fde50>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:31.803531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:31.804291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:31.805626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:31.842026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:31.844518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:31.848083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:31.867466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53e5b75d-b985-4eb6-ae2e-e5fe04a5e04d tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.487984 Nov 02 21:22:31.868597 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 203/360] 10.222.0.25 () {60 vars in 1208 bytes} [Wed Nov 2 21:22:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:22:31.877909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:31.883117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:31.904049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:31.904743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:31.905508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:31.906971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:31.908812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:31.909477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:31.911503 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d7b41b62-37f9-4b2c-855b-4e7e42e5e9cd tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993522498?user_id=e96f22b0b88e4bd9810fb99749d177e9" status: 204 len: 0 microversion: 2.10 time: 0.124914 Nov 02 21:22:31.912088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 158/361] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1993522498?user_id=e96f22b0b88e4bd9810fb99749d177e9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:22:31.916752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3251a309-070b-4cb3-bc19-8f34f9296be4 tempest-FlavorsAccessTestJSON-2109343548 tempest-FlavorsAccessTestJSON-2109343548-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:31.973547 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3251a309-070b-4cb3-bc19-8f34f9296be4 tempest-FlavorsAccessTestJSON-2109343548 tempest-FlavorsAccessTestJSON-2109343548-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.059914 Nov 02 21:22:31.974057 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 159/362] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:31.978493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3af57f76-98cf-4882-a286-97f1e55127a3 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1940357440"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:31.982441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.aggregate [None req-3af57f76-98cf-4882-a286-97f1e55127a3 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Generated uuid 9ee5a8e7-5ded-4cad-a260-02e39d0cfb6e for aggregate {{(pid=121039) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 21:22:32.017118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:32.033248 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc6177b2-14a7-4f5a-a08d-b4a7528eaf10 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1423 microversion: 2.1 time: 0.162993 Nov 02 21:22:32.034049 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 204/363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:31 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1423 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:32.044400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-75131aa3-32ac-4b55-a3d6-e7247f932121 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] Calling method '.version_select at 0x7f9b695e6b80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:32.101818 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3af57f76-98cf-4882-a286-97f1e55127a3 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.126698 Nov 02 21:22:32.103824 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 160/364] 10.222.0.25 () {62 vars in 1205 bytes} [Wed Nov 2 21:22:31 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:32.110528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ccac5b1a-b10a-4a2c-8529-f5a1049af134 req-57e9af4b-1f8c-4927-9211-025b28e4faf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d9874f-026b-40b2-9e0b-62c1df42e442", "name": "network-vif-deleted", "tag": "97a6e697-5a70-4a94-b843-51643c580f80"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:32.128113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ccac5b1a-b10a-4a2c-8529-f5a1049af134 req-57e9af4b-1f8c-4927-9211-025b28e4faf7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:32.128702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ccac5b1a-b10a-4a2c-8529-f5a1049af134 req-57e9af4b-1f8c-4927-9211-025b28e4faf7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:32.129051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ccac5b1a-b10a-4a2c-8529-f5a1049af134 req-57e9af4b-1f8c-4927-9211-025b28e4faf7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:32.135158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-75131aa3-32ac-4b55-a3d6-e7247f932121 tempest-KeyPairsV210TestJSON-201577055 tempest-KeyPairsV210TestJSON-201577055-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719037404?user_id=e96f22b0b88e4bd9810fb99749d177e9" status: 204 len: 0 microversion: 2.10 time: 0.097035 Nov 02 21:22:32.137081 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 205/365] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719037404?user_id=e96f22b0b88e4bd9810fb99749d177e9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:22:32.155671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e493b2c-5d6d-4bda-a813-5131b188dbd5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-226757127", "imageRef": "0110fdbc-7a95-4789-b05e-2b03158a5222", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:32.185628 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ccac5b1a-b10a-4a2c-8529-f5a1049af134 req-57e9af4b-1f8c-4927-9211-025b28e4faf7 service nova] Creating event network-vif-deleted:97a6e697-5a70-4a94-b843-51643c580f80 for instance b9d9874f-026b-40b2-9e0b-62c1df42e442 on n-h2-860863-4 Nov 02 21:22:32.196422 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ccac5b1a-b10a-4a2c-8529-f5a1049af134 req-57e9af4b-1f8c-4927-9211-025b28e4faf7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090467 Nov 02 21:22:32.198674 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 161/366] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:32.221099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bbbba130-1e7e-4479-95db-eaf2b297997f tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:32.231524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-3e493b2c-5d6d-4bda-a813-5131b188dbd5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:32.344191 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bbbba130-1e7e-4479-95db-eaf2b297997f tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1344769628" status: 202 len: 0 microversion: 2.1 time: 0.142466 Nov 02 21:22:32.348977 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 162/367] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:22:32 2022] DELETE /compute/v2.1/flavors/1344769628 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:22:32.359145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5dab1fc-c2e5-4d0b-8994-15b391dc578b tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-41338067"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:32.465930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:32.546648 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5dab1fc-c2e5-4d0b-8994-15b391dc578b tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 298 microversion: 2.41 time: 0.195841 Nov 02 21:22:32.561959 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 163/368] 10.222.0.25 () {62 vars in 1213 bytes} [Wed Nov 2 21:22:32 2022] PUT /compute/v2.1/os-aggregates/18 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:32.570067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9c8f8e9-b5fa-4317-8616-c6caabc4fc4f tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:32.598987 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9c8f8e9-b5fa-4317-8616-c6caabc4fc4f tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035624 Nov 02 21:22:32.605918 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 164/369] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:32.611760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9485e1e3-781e-4d26-a477-6d4641d0f460 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:32.644008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9485e1e3-781e-4d26-a477-6d4641d0f460 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 298 microversion: 2.41 time: 0.034387 Nov 02 21:22:32.646183 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 165/370] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 21:22:32 2022] GET /compute/v2.1/os-aggregates/18 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:32.658576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f426c445-30b1-40b1-91b2-c74efa3b406e tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1716579452", "id": 1639687055, "os-flavor-access:is_public": "False"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:32.772406 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3e493b2c-5d6d-4bda-a813-5131b188dbd5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e493b2c-5d6d-4bda-a813-5131b188dbd5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] Request method failure captured: Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 142 Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-VgHew11YzVkFOnQgh3z17fECB8HBGvkdnSgiKoYG-mqFC00huZt8_tK-aoDMnT5DyOQf0uQyuGUjPCnosxlVNR18Rj5CiG3ZeJqG10CA7FB5KI6z3lR2K3haJEvP63IJzmsUWjgjGy8yjHWy7mj0u4CzVOp1K6oFPUrR4ZuRXPIY Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 01e3e837e6fd492f8c8bdc9f5aca86a3 Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsV2NegativeTest-545646036 Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:32.774373 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_01e3e837e6fd492f8c8bdc9f5aca86a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e3e837e6fd492f8c8bdc9f5aca86a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/01e3e837e6fd492f8c8bdc9f5aca86a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/01e3e837e6fd492f8c8bdc9f5aca86a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsV2NegativeTest-545646036 Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 01e3e837e6fd492f8c8bdc9f5aca86a3 Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-545646036 Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsV2NegativeTest-545646036-project Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9dd61b95f4cf4ebc86fde24c42cc6d65 Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsV2NegativeTest-545646036-project Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-226757127", "imageRef": "0110fdbc-7a95-4789-b05e-2b03158a5222", "flavorRef": "452"}} Nov 02 21:22:32.775785 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: exception: Flavor's memory is too small for requested image. Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-226757127', 'imageRef': '0110fdbc-7a95-4789-b05e-2b03158a5222', 'flavorRef': '452'}}} Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:32.776494 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:32.777938 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e493b2c-5d6d-4bda-a813-5131b188dbd5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e493b2c-5d6d-4bda-a813-5131b188dbd5 tempest-FlavorsV2NegativeTest-545646036 tempest-FlavorsV2NegativeTest-545646036-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.638633 Nov 02 21:22:32.779050 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 206/371] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:32 2022] POST /compute/v2.1/servers => generated 93 bytes in 640 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:22:32.782164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55a15745-1b52-4cfc-891e-7b54aff54339 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:32.805250 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f426c445-30b1-40b1-91b2-c74efa3b406e tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.155963 Nov 02 21:22:32.814584 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 166/372] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:32 2022] POST /compute/v2.1/flavors => generated 431 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:32.820184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55a15745-1b52-4cfc-891e-7b54aff54339 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:32.820683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55a15745-1b52-4cfc-891e-7b54aff54339 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:32.827746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55a15745-1b52-4cfc-891e-7b54aff54339 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:32.828079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0f5359f-4785-4e95-bffd-457e0ba3d2a1 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:32.841008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0f5359f-4785-4e95-bffd-457e0ba3d2a1 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/1639687055/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.025196 Nov 02 21:22:32.842788 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 167/373] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 21:22:32 2022] GET /compute/v2.1/flavors/1639687055/os-flavor-access => generated 21 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 21:22:32.856161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-58b9e619-f4ce-4aa3-b182-16b1406208af tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:32.967780 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-58b9e619-f4ce-4aa3-b182-16b1406208af tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1639687055" status: 202 len: 0 microversion: 2.1 time: 0.117546 Nov 02 21:22:32.969171 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 168/374] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:22:32 2022] DELETE /compute/v2.1/flavors/1639687055 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:22:32.980191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba32df6c-e68e-4dd4-83d0-dc5739240345 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:33.060166 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ba32df6c-e68e-4dd4-83d0-dc5739240345 tempest-FlavorsAccessTestJSON-1912286907 tempest-FlavorsAccessTestJSON-1912286907-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.086602 Nov 02 21:22:33.062390 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 169/375] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:22:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:22:33.073329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:33.075120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:33.124398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:33.125194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:33.126929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:33.127702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:33.133865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:33.135415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:33.240907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:33.241442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:33.248108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:33.248845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lazy-loading 'fault' on Instance uuid b9d9874f-026b-40b2-9e0b-62c1df42e442 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:22:33.265181 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55a15745-1b52-4cfc-891e-7b54aff54339 tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 313 microversion: 2.41 time: 0.487803 Nov 02 21:22:33.266049 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 207/376] 10.222.0.25 () {62 vars in 1235 bytes} [Wed Nov 2 21:22:32 2022] POST /compute/v2.1/os-aggregates/18/action => generated 313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:33.279782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ec069d7-1e0a-48ae-a082-000179e3d44b tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:33.293430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ec069d7-1e0a-48ae-a082-000179e3d44b tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:33.294213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ec069d7-1e0a-48ae-a082-000179e3d44b tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:33.295437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ec069d7-1e0a-48ae-a082-000179e3d44b tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:33.381175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:33.397852 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-43fab5c3-4d2f-48da-abaf-2699f0acfff6 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 200 len: 1309 microversion: 2.1 time: 0.332808 Nov 02 21:22:33.398870 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 170/377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:33 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:33.620439 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ec069d7-1e0a-48ae-a082-000179e3d44b tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 298 microversion: 2.41 time: 0.345733 Nov 02 21:22:33.628329 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 208/378] 10.222.0.25 () {62 vars in 1235 bytes} [Wed Nov 2 21:22:33 2022] POST /compute/v2.1/os-aggregates/18/action => generated 298 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:22:33.633265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db4d6851-d97e-4c97-a335-f886d81c42bc tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:33.731167 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db4d6851-d97e-4c97-a335-f886d81c42bc tempest-AggregatesAdminTestV241-145513665 tempest-AggregatesAdminTestV241-145513665-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.101505 Nov 02 21:22:33.733470 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 171/379] 10.222.0.25 () {60 vars in 1196 bytes} [Wed Nov 2 21:22:33 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:34.424789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:34.426249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: b9d9874f-026b-40b2-9e0b-62c1df42e442] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:34.434898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:34.435743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:34.436713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:34.437780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:34.444487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:34.444487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:34.453522 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] HTTP exception thrown: Instance b9d9874f-026b-40b2-9e0b-62c1df42e442 could not be found. Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Request method failure captured: Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 HTTP/1.1 Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9fRAFPnjCixWaUNQDldl4v_cD2wCGRJXsMtFbKjNEFpi04uQVsE4KJ5qgyt8zHoySFgic-7CvjWGsCvccg790AjHv_BhrnQ97GP8U4Tu-3f_weGFeok1ShJBbkct3tMSFjEFwMsdskXGBL9TdklLUzeFXgpNHSNmSVnt4sZbPHBcM Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: afa6d9c601754827a8f2df9b9f544b10 Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-LiveMigrationNegativeTest-1978124008 Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:34.455392 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-LiveMigrationNegativeTest-1978124008 Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: afa6d9c601754827a8f2df9b9f544b10 Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1978124008 Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-LiveMigrationNegativeTest-1978124008-project Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c27e33aa9a564bf3a7036e79125205e1 Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-LiveMigrationNegativeTest-1978124008-project Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance b9d9874f-026b-40b2-9e0b-62c1df42e442 could not be found. Nov 02 21:22:34.456904 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'b9d9874f-026b-40b2-9e0b-62c1df42e442'} Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d9874f-026b-40b2-9e0b-62c1df42e442 could not be found. Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:34.457652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d9874f-026b-40b2-9e0b-62c1df42e442 could not be found. Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d9874f-026b-40b2-9e0b-62c1df42e442 could not be found. Nov 02 21:22:34.458716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:34.459753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Returning 404 to user: Instance b9d9874f-026b-40b2-9e0b-62c1df42e442 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:34.459753 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad43b68e-b63c-4d22-a30b-3b44482dc82f tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442" status: 404 len: 111 microversion: 2.1 time: 0.036923 Nov 02 21:22:34.459753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 209/380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:34 2022] GET /compute/v2.1/servers/b9d9874f-026b-40b2-9e0b-62c1df42e442 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:34.467170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:34.468396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:34.476695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:34.477612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:34.478442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:34.479298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:34.479899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:34.480535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:34.513459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:22:34.900338 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bdd3a6c0-1aaf-4ef0-87c9-d446f70e2d7a tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 204 len: 0 microversion: 2.1 time: 0.437480 Nov 02 21:22:34.904290 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 172/381] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:22:34 2022] DELETE /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:22:34.914961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:34.915979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:34.924942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:34.926740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:34.927520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:34.929399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:34.929861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:34.932898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:35.263447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:35.275775 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f792bdd2-dfe5-4101-bf98-368d095ecc68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1475 microversion: 2.1 time: 0.362800 Nov 02 21:22:35.277873 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 210/382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:34 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:36.303251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:36.304593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:36.312278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:36.313520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:36.314149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:36.314924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:36.315385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:36.315816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:36.741185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:36.751985 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-602ac140-e05b-4c13-8765-eeaee2b42b9d tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1475 microversion: 2.1 time: 0.453085 Nov 02 21:22:36.752582 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 173/383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:36 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:37.753633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-66ce054e-b561-461c-af12-a618c36db314 req-df2c4144-c51c-4fce-808f-2bb1dce3564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9483dc5b-212f-45a2-beef-3e5c3cd8e10f", "name": "network-vif-deleted", "tag": "2c33e0dd-385e-4ab6-bae0-a27e621c2b6f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:37.779552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:37.780141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:37.792202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66ce054e-b561-461c-af12-a618c36db314 req-df2c4144-c51c-4fce-808f-2bb1dce3564d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:37.795427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66ce054e-b561-461c-af12-a618c36db314 req-df2c4144-c51c-4fce-808f-2bb1dce3564d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:37.796836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66ce054e-b561-461c-af12-a618c36db314 req-df2c4144-c51c-4fce-808f-2bb1dce3564d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:37.805487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:37.805487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:37.811839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:37.817704 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-66ce054e-b561-461c-af12-a618c36db314 req-df2c4144-c51c-4fce-808f-2bb1dce3564d service nova] Creating event network-vif-deleted:2c33e0dd-385e-4ab6-bae0-a27e621c2b6f for instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f on n-h1-860863-4 Nov 02 21:22:37.818192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:37.819917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:37.820596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:37.830073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-66ce054e-b561-461c-af12-a618c36db314 req-df2c4144-c51c-4fce-808f-2bb1dce3564d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081264 Nov 02 21:22:37.838232 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 211/384] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:38.098094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c27e33aa9a564bf3a7036e79125205e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa6d9c601754827a8f2df9b9f544b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:38.111304 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a0140cbf-9cc1-4946-b121-9b3e9dcaca62 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 200 len: 1433 microversion: 2.1 time: 0.336174 Nov 02 21:22:38.118316 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 174/385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:37 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 1433 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:39.144082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:39.144773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] [instance: 9483dc5b-212f-45a2-beef-3e5c3cd8e10f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:39.150702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=27 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:39.153963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:39.154615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:39.155206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:39.157386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:39.157799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:39.160493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:39.179064 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] HTTP exception thrown: Instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f could not be found. Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Request method failure captured: Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f HTTP/1.1 Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9fRAFPnjCixWaUNQDldl4v_cD2wCGRJXsMtFbKjNEFpi04uQVsE4KJ5qgyt8zHoySFgic-7CvjWGsCvccg790AjHv_BhrnQ97GP8U4Tu-3f_weGFeok1ShJBbkct3tMSFjEFwMsdskXGBL9TdklLUzeFXgpNHSNmSVnt4sZbPHBcM Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: afa6d9c601754827a8f2df9b9f544b10 Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-LiveMigrationNegativeTest-1978124008 Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:22:39.181198 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/afa6d9c601754827a8f2df9b9f544b10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-LiveMigrationNegativeTest-1978124008 Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: afa6d9c601754827a8f2df9b9f544b10 Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1978124008 Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-LiveMigrationNegativeTest-1978124008-project Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c27e33aa9a564bf3a7036e79125205e1 Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-LiveMigrationNegativeTest-1978124008-project Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f could not be found. Nov 02 21:22:39.182381 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9483dc5b-212f-45a2-beef-3e5c3cd8e10f'} Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f could not be found. Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:22:39.183033 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f could not be found. Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f could not be found. Nov 02 21:22:39.184671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:22:39.187358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] Returning 404 to user: Instance 9483dc5b-212f-45a2-beef-3e5c3cd8e10f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:22:39.188424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e66f2cdd-3c49-48b5-adb2-9822208fbf68 tempest-LiveMigrationNegativeTest-1978124008 tempest-LiveMigrationNegativeTest-1978124008-project] 10.222.0.25 "GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f" status: 404 len: 111 microversion: 2.1 time: 0.048623 Nov 02 21:22:39.203332 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 212/386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:39 2022] GET /compute/v2.1/servers/9483dc5b-212f-45a2-beef-3e5c3cd8e10f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:22:44.129042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecb842f3-1b82-43bb-95ba-30b96e4fe4c3 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] Action: 'create', calling method: .version_select at 0x7f9b697b2ca0>, body: {"security_group": {"name": "tempest-securitygroup-1222149236", "description": "tempest-description-1875386413"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:44.622811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=19 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:44.882109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-886763343", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:44.967717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:45.701798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:45.702646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:45.702646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:45.702996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:45.703409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:45.745629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:45.746297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:45.747478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:45.748264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:45.753770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:45.756833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:45.780565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Getting quotas for project ad41afe8a2f04aee958c00322937c074. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:45.789424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Getting quotas for user d1038966c4b6489ebafefb73c748e957 and project ad41afe8a2f04aee958c00322937c074. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:45.846133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:22:45.857395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:22:46.097825 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9853a8d1-2056-496c-b9e5-796ba58ded7f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486298 Nov 02 21:22:46.104450 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 213/387] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:22:46.544674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ecb842f3-1b82-43bb-95ba-30b96e4fe4c3 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.793728 Nov 02 21:22:46.549381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 175/388] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:22:43 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:46.563184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ee67292-7591-4626-825e-3b5adcc2d7a1 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] Action: 'create', calling method: .version_select at 0x7f9b697b2b80>, body: {"security_group": {"name": "tempest-securitygroup-861069060", "description": "tempest-description-1481304122"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:46.600874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-694436394", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:46.707201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:47.626666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:47.627279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:47.627645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:47.629612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:47.630095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:47.651051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:47.651051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:47.651051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:47.655797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:47.656305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:47.656771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:47.657521 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ee67292-7591-4626-825e-3b5adcc2d7a1 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.098694 Nov 02 21:22:47.667029 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 214/389] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:22:46 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:47.728609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Getting quotas for project ad41afe8a2f04aee958c00322937c074. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:47.741753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Getting quotas for user d1038966c4b6489ebafefb73c748e957 and project ad41afe8a2f04aee958c00322937c074. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:47.768442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:22:47.772960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:22:47.992447 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-014299a2-c496-4695-86f5-7c1a19ab99bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395360 Nov 02 21:22:48.003052 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 176/390] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:22:48.038678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Action: 'update', calling method: .version_select at 0x7f9b696c8820>, body: {"quota_set": {"ram": "5120"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:48.274887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a61f7a88-c218-4859-8ee7-14a3e708db0b tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Action: 'create', calling method: .version_select at 0x7f9b69a31160>, body: {"security_group": {"name": "tempest-securitygroup-561290777", "description": "tempest-description-1272940012"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:48.481659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:48.482603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:48.483549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:48.484428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:48.485167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:48.485738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:48.715224 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c9d21b8-57ac-4d3b-ae37-c9f00422876f tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48" status: 200 len: 240 microversion: 2.36 time: 1.045457 Nov 02 21:22:48.717784 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 215/391] 10.222.0.25 () {62 vars in 1303 bytes} [Wed Nov 2 21:22:47 2022] PUT /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48 => generated 240 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:48.729875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-109a3666-3cb3-49c3-a039-ec10759ea92f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:48.730662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-109a3666-3cb3-49c3-a039-ec10759ea92f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:49.154647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-109a3666-3cb3-49c3-a039-ec10759ea92f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:49.164887 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-109a3666-3cb3-49c3-a039-ec10759ea92f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1213 microversion: 2.1 time: 0.445481 Nov 02 21:22:49.170460 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 216/392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:48 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1213 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:49.178149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Calling method '.version_select at 0x7f9b696e6f70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:49.770677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:49.771353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:49.773652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:49.775173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:49.779692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:49.781921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:49.879799 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a708b545-9de3-4bb6-aba1-d09f14ebb710 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48/detail" status: 200 len: 672 microversion: 2.36 time: 0.699713 Nov 02 21:22:49.880873 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 217/393] 10.222.0.25 () {60 vars in 1304 bytes} [Wed Nov 2 21:22:49 2022] GET /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48/detail => generated 672 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:50.005806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-674536344", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:50.099070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:51.220271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:51.220900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:51.223632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:51.224407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:51.224640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:51.242254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.242739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.243335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.250327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.251168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.258568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.289402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Getting quotas for project 026cb55f30604c5a84c5a0de753c1a58. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:51.293909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Getting quotas for user da7dbeb2292d4ed2bb9e0bab2eed84f5 and project 026cb55f30604c5a84c5a0de753c1a58. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:51.306918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:22:51.317235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:22:51.449969 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a61f7a88-c218-4859-8ee7-14a3e708db0b tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 3.444641 Nov 02 21:22:51.451374 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 177/394] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:22:48 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 3448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:51.465466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:51.466633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:51.474699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.475508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.476338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.477888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.478545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.479340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.515156 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb5f9acf-dae3-4bd5-9308-640e8af4ed27 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631829 Nov 02 21:22:51.522836 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 218/395] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:22:51.530325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Action: 'update', calling method: .version_select at 0x7f9b695c3820>, body: {"quota_set": {"ram": "2048"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:51.692773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.693295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.693731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.694456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.694909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.695336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.760201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:51.778323 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ea6fdce4-ca69-4596-ba51-80c29e41215d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1265 microversion: 2.1 time: 0.324535 Nov 02 21:22:51.779700 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 178/396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:51 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:51.820288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:51.830011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:51.851670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.852539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.853313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.854275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.856892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.857664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.858316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.859459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.859815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:51.861405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.861640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:51.865459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:51.910115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:51.968638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:22:52.100026 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ccd9d17-9a77-4d34-be9f-ffee0cd96026 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48?user_id=bbf772644cbd4a4c84bdd8c2f8498f6e" status: 200 len: 240 microversion: 2.36 time: 0.575992 Nov 02 21:22:52.102041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 219/397] 10.222.0.25 () {62 vars in 1384 bytes} [Wed Nov 2 21:22:51 2022] PUT /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48?user_id=bbf772644cbd4a4c84bdd8c2f8498f6e => generated 240 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:52.114249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b905b244-73a3-499b-aa5c-2c8de0e2dd79 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Action: 'create', calling method: .version_select at 0x7f9b695c3e50>, body: {"security_group": {"name": "tempest-securitygroup-1131259273", "description": "tempest-description-1218456738"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:52.140775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:52.377057 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3614e039-c215-48d4-9840-d2417621f155 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 204 len: 0 microversion: 2.1 time: 0.593550 Nov 02 21:22:52.389595 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 179/398] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:22:51 2022] DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:22:52.396044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b69e937-ed22-47d9-b0b4-aaf14130694e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:52.401185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b69e937-ed22-47d9-b0b4-aaf14130694e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:52.540043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b69e937-ed22-47d9-b0b4-aaf14130694e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:52.550517 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b69e937-ed22-47d9-b0b4-aaf14130694e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1219 microversion: 2.1 time: 0.162854 Nov 02 21:22:52.551713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 180/399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:52 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:52.559012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21434d64-b42b-442a-a348-e2d0effc9eb5 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] Calling method '.version_select at 0x7f9b698ba700>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:52.710065 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-21434d64-b42b-442a-a348-e2d0effc9eb5 tempest-QuotasAdminTestV236-1700008087 tempest-QuotasAdminTestV236-1700008087-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48?user_id=bbf772644cbd4a4c84bdd8c2f8498f6e" status: 200 len: 282 microversion: 2.36 time: 0.157039 Nov 02 21:22:52.717498 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 181/400] 10.222.0.25 () {60 vars in 1364 bytes} [Wed Nov 2 21:22:52 2022] GET /compute/v2.1/os-quota-sets/b2204b037a7649ed9dcda3a026382a48?user_id=bbf772644cbd4a4c84bdd8c2f8498f6e => generated 282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:22:52.724447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-916839785", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "176203017", "adminPass": "***", "networks": [{"uuid": "151be214-a7c0-4f14-a002-4d9a3290d39f"}], "security_groups": [{"name": "tempest-securitygroup--1564118783"}], "key_name": "tempest-keypair-1112162530", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:53.247608 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b905b244-73a3-499b-aa5c-2c8de0e2dd79 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.142912 Nov 02 21:22:53.248665 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 220/401] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:22:52 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:22:53.254966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:53.256953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:22:53.279779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:53.283690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:53.288445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:53.289796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:53.294922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:53.295513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:53.351836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] validate_networks() for [('151be214-a7c0-4f14-a002-4d9a3290d39f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:53.955854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:22:53.970604 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33d06572-1f4e-4b7e-a106-58352de716bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1271 microversion: 2.1 time: 0.716183 Nov 02 21:22:53.975684 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 221/402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:22:53 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1271 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:22:53.992574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Calling method '.version_select at 0x7f9b695c1040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:22:56.149115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:22:56.149115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:22:56.149115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:22:56.149115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:22:56.149115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:22:56.153200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:56.153200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:56.153200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:56.153200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:22:56.153654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:22:56.153654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:22:56.185496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Getting quotas for project fd4894dee76f4b36a22065bbc923b04a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:22:56.195063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Getting quotas for user 7e5759f947464db980b4dc96a5cd984d and project fd4894dee76f4b36a22065bbc923b04a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:22:56.229317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:22:56.234390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:22:56.504962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6662f3e5-af49-4a0c-b485-a29e5ccb718f tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.780429 Nov 02 21:22:56.512876 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 182/403] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:22:57.393392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-219816210", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fbb32731-3286-4309-9c0c-b898bc17a336"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:22:57.471401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:22:57.534741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] validate_networks() for [('fbb32731-3286-4309-9c0c-b898bc17a336', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:22:59.881031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e15395e-cfb6-4b51-bd0a-3f35eb8e2ba5 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:22:59.882295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Neutron security group 7e15395e-cfb6-4b51-bd0a-3f35eb8e2ba5 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:22:59.884335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.security_groups [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Security Group ID 7e15395e-cfb6-4b51-bd0a-3f35eb8e2ba5 does not exist {{(pid=121040) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Nov 02 21:23:00.241132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7e15395e-cfb6-4b51-bd0a-3f35eb8e2ba5 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:23:00.242784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Neutron security group 7e15395e-cfb6-4b51-bd0a-3f35eb8e2ba5 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:23:00.243464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.security_groups [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Security Group ID 7e15395e-cfb6-4b51-bd0a-3f35eb8e2ba5 does not exist {{(pid=121040) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Nov 02 21:23:00.250421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:00.250917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:00.251573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:00.251693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:00.252137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:00.272003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:00.274264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:00.274730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:00.275708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:00.276168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:00.279257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:00.325165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:00.333180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for user 9ab2a1f2b5b74571b08c97e9493d568d and project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:00.365851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:00.370652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:00.564220 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db921c21-b994-4ca4-8eb8-fa15c30e7852 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.047579 Nov 02 21:23:00.572300 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 183/404] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:22:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:23:00.579612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:00.580823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:00.588811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:00.589711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:00.590397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:00.591349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:00.592016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:00.592776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:01.162881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:01.173102 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7ac26dfa-75d3-4592-b4f0-89788a2ef93e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 0.598249 Nov 02 21:23:01.174447 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 184/405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:00 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:01.188551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:01.190838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:01.213765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:01.215466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:01.216222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:01.216987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:01.221792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:01.222250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:01.822622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:01.830687 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f4b3eff7-b674-40d6-8225-e00fb664c9f2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.651968 Nov 02 21:23:01.845519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 185/406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:01 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:01.859547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:01.865823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:01.879585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:01.880150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:01.880731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:01.882863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:01.883323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:01.904665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=13 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:01.919058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:02.021877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2911f04-7316-42c9-a5e5-0a41a89fad6c does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:23:02.023205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Neutron security group b2911f04-7316-42c9-a5e5-0a41a89fad6c not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:23:02.024260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.security_groups [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Security Group ID b2911f04-7316-42c9-a5e5-0a41a89fad6c does not exist {{(pid=121040) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Nov 02 21:23:02.098386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=36 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:02.179522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2911f04-7316-42c9-a5e5-0a41a89fad6c does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:23:02.181235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Neutron security group b2911f04-7316-42c9-a5e5-0a41a89fad6c not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:23:02.181733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.security_groups [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Security Group ID b2911f04-7316-42c9-a5e5-0a41a89fad6c does not exist {{(pid=121040) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Nov 02 21:23:02.658868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:02.669689 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c449c866-02a7-41da-8c50-c8763b8945e7 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.820441 Nov 02 21:23:02.673503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 186/407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:01 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:02.685300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d855bbd8-f819-4907-bd59-39fdb1229ed5 req-5aa91463-220f-4ca2-a22f-89fcd8c285a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0ab77c-58ce-40d3-9df9-4658e23b6940", "name": "network-vif-deleted", "tag": "e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:02.712399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d855bbd8-f819-4907-bd59-39fdb1229ed5 req-5aa91463-220f-4ca2-a22f-89fcd8c285a9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:02.718460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d855bbd8-f819-4907-bd59-39fdb1229ed5 req-5aa91463-220f-4ca2-a22f-89fcd8c285a9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:02.718460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d855bbd8-f819-4907-bd59-39fdb1229ed5 req-5aa91463-220f-4ca2-a22f-89fcd8c285a9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:02.734278 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d855bbd8-f819-4907-bd59-39fdb1229ed5 req-5aa91463-220f-4ca2-a22f-89fcd8c285a9 service nova] Creating event network-vif-deleted:e1b6bb8a-a2ff-4ea1-a6f4-6cc543e49302 for instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 on n-h1-860863-4 Nov 02 21:23:02.741688 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d855bbd8-f819-4907-bd59-39fdb1229ed5 req-5aa91463-220f-4ca2-a22f-89fcd8c285a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065386 Nov 02 21:23:02.743381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 187/408] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:02.751405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:02.752198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:02.760073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:02.760814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:02.762008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:02.763099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:02.763703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:02.764591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:02.902459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:02.915621 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31d6acfd-8450-4077-8b3c-35729f1bc249 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1203 microversion: 2.1 time: 0.168607 Nov 02 21:23:02.945954 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 188/409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:02 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:03.286670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fc211476-a6d9-4f3b-ac23-fa36a5a68de2 tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] Calling method '.version_select at 0x7f9b696ed9d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:03.302008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fc211476-a6d9-4f3b-ac23-fa36a5a68de2 tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.353595 Nov 02 21:23:03.302943 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 189/410] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 21:23:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:03.307928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:03.309629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:03.316791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:03.317530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:03.318393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:03.319255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:03.319851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:03.320420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:03.965849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=52 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:04.122099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:04.135607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:04.181496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54d816fc-7e95-4069-ba13-b2ad07cc96a1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 0.877102 Nov 02 21:23:04.184038 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 190/411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:03 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:04.201859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-69996bbb-f275-4549-8eb6-4cc3f4547886 req-5e69f158-39b6-4baa-b56a-9e408e3cd25d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb432d5-49aa-4904-b943-057c7a56255d", "tag": "da0e6b65-f828-4734-a7d4-18f69f3c54d3"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:04.217126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-69996bbb-f275-4549-8eb6-4cc3f4547886 req-5e69f158-39b6-4baa-b56a-9e408e3cd25d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:04.218445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-69996bbb-f275-4549-8eb6-4cc3f4547886 req-5e69f158-39b6-4baa-b56a-9e408e3cd25d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:04.219211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-69996bbb-f275-4549-8eb6-4cc3f4547886 req-5e69f158-39b6-4baa-b56a-9e408e3cd25d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:04.238968 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-69996bbb-f275-4549-8eb6-4cc3f4547886 req-5e69f158-39b6-4baa-b56a-9e408e3cd25d service nova] Creating event network-changed:da0e6b65-f828-4734-a7d4-18f69f3c54d3 for instance 6eb432d5-49aa-4904-b943-057c7a56255d on n-h1-860863-4 Nov 02 21:23:04.246400 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-69996bbb-f275-4549-8eb6-4cc3f4547886 req-5e69f158-39b6-4baa-b56a-9e408e3cd25d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059008 Nov 02 21:23:04.247812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 191/412] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:04.254035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:04.254740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:04.262740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:04.263519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:04.264124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:04.265036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:04.265641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:04.267469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:04.395564 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-785a41d9-3f3a-4d9a-a8c3-834de42db694 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8652 microversion: 2.1 time: 10.416126 Nov 02 21:23:04.396222 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 222/413] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 21:22:53 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8652 bytes in 10420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:04.402634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5edeb3bd-b8b6-414d-8452-b4936164de92 tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] Action: 'update', calling method: .version_select at 0x7f9b695c30d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:04.713718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:04.724185 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-321a7e51-5686-48df-9e64-0bccd47904fa tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.474289 Nov 02 21:23:04.726508 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 192/414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:04 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:04.735399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:04.736234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:04.744462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:04.746010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:04.746796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:04.749340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:04.750164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:04.751661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:05.010082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:05.024828 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7bc6db45-1fca-44bd-b164-2f55b9ace8ff tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.295574 Nov 02 21:23:05.025661 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 193/415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:04 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:05.031702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:05.032744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:05.062104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:05.063254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:05.069213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:05.070165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:05.075359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:05.079916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:05.407333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:05.415656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7735b59-8977-4927-a0c2-10b3afdc8fc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.388358 Nov 02 21:23:05.420240 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 194/416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:05 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:05.438416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bc24dd5-74e0-4216-9b12-929e89d9ce50 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] Calling method '.version_select at 0x7f9b698ba9d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:05.847866 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5edeb3bd-b8b6-414d-8452-b4936164de92 tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.450279 Nov 02 21:23:05.850381 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 223/417] 10.222.0.25 () {60 vars in 1206 bytes} [Wed Nov 2 21:23:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:05.855872 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bc24dd5-74e0-4216-9b12-929e89d9ce50 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.433564 Nov 02 21:23:05.861509 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 195/418] 10.222.0.25 () {58 vars in 1191 bytes} [Wed Nov 2 21:23:05 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:05.863645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:05.865358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:05.875168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f097b367-5d41-4734-a455-18fd71cd6508 req-859235ac-30c9-4855-9cee-f483894cf004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e", "tag": "959e5aa8-19e8-427e-86c3-a667021fcc01"}, {"name": "network-changed", "server_uuid": "b0a412bb-8df5-445f-8543-5e4b52e60115", "tag": "20768c6b-0c87-424a-9ac4-1d628f7ae7f7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:05.884784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:05.886004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:05.888463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:05.888646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f097b367-5d41-4734-a455-18fd71cd6508 req-859235ac-30c9-4855-9cee-f483894cf004 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:05.889363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f097b367-5d41-4734-a455-18fd71cd6508 req-859235ac-30c9-4855-9cee-f483894cf004 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:05.889920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f097b367-5d41-4734-a455-18fd71cd6508 req-859235ac-30c9-4855-9cee-f483894cf004 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:05.890312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:05.891859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:05.893195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:05.920740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f097b367-5d41-4734-a455-18fd71cd6508 req-859235ac-30c9-4855-9cee-f483894cf004 service nova] Creating event network-changed:959e5aa8-19e8-427e-86c3-a667021fcc01 for instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e on n-h2-860863-4 Nov 02 21:23:05.921322 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f097b367-5d41-4734-a455-18fd71cd6508 req-859235ac-30c9-4855-9cee-f483894cf004 service nova] Creating event network-changed:20768c6b-0c87-424a-9ac4-1d628f7ae7f7 for instance b0a412bb-8df5-445f-8543-5e4b52e60115 on n-h2-860863-4 Nov 02 21:23:05.935377 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f097b367-5d41-4734-a455-18fd71cd6508 req-859235ac-30c9-4855-9cee-f483894cf004 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072173 Nov 02 21:23:05.938649 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 224/419] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:05.944043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:05.944756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:05.970209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:05.970686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:05.971208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:05.972119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:05.972593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:05.973047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:06.206311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:06.218824 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-80ea0323-2263-49a5-bb6f-5439be4bf694 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 0.360032 Nov 02 21:23:06.220369 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 196/420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:05 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:06.238224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a39de739-5332-4bd0-bcd6-cbb71e28937e tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] Calling method '.version_select at 0x7f9b698ba160>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:06.240131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:06.252502 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-941ae007-423f-4e8f-be5d-b10d0e6c1b69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.312661 Nov 02 21:23:06.253423 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 225/421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:05 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:06.270116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30e73b6c-6825-43c6-83ee-5c60e23e3f60 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Calling method '.version_select at 0x7f9b69597af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:06.276007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a39de739-5332-4bd0-bcd6-cbb71e28937e tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.054204 Nov 02 21:23:06.289867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 197/422] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 21:23:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:06.304344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:06.309071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:06.320972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:06.322200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:06.323104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:06.324790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:06.325854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:06.327018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:06.625721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:06.642490 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9dab8b04-5727-4de0-8324-a7d053eb028c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.351030 Nov 02 21:23:06.644772 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 198/423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:06 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:06.651586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f685051-9346-4118-8538-538cc3646264 tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] Action: 'update', calling method: .version_select at 0x7f9b697cf3a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:06.705461 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-30e73b6c-6825-43c6-83ee-5c60e23e3f60 tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/d30803fa-41d1-4744-acde-f7706b4e2787" status: 202 len: 0 microversion: 2.1 time: 0.446267 Nov 02 21:23:06.705461 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 226/424] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:23:06 2022] DELETE /compute/v2.1/os-security-groups/d30803fa-41d1-4744-acde-f7706b4e2787 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:06.719048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d946c9a0-19ae-4be2-8543-3cc8b2727fb3 req-6e5d36d8-ea98-4a25-8524-f6b98b7595b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f34a0e-b047-45c7-a82c-fbab7419d3d5", "tag": "9c70901d-a948-4e16-b493-f688d27c0b9a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:06.761980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d946c9a0-19ae-4be2-8543-3cc8b2727fb3 req-6e5d36d8-ea98-4a25-8524-f6b98b7595b4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:06.762754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d946c9a0-19ae-4be2-8543-3cc8b2727fb3 req-6e5d36d8-ea98-4a25-8524-f6b98b7595b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:06.762856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d946c9a0-19ae-4be2-8543-3cc8b2727fb3 req-6e5d36d8-ea98-4a25-8524-f6b98b7595b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:06.784802 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d946c9a0-19ae-4be2-8543-3cc8b2727fb3 req-6e5d36d8-ea98-4a25-8524-f6b98b7595b4 service nova] Creating event network-changed:9c70901d-a948-4e16-b493-f688d27c0b9a for instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 on n-h1-860863-4 Nov 02 21:23:06.795159 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d946c9a0-19ae-4be2-8543-3cc8b2727fb3 req-6e5d36d8-ea98-4a25-8524-f6b98b7595b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088433 Nov 02 21:23:06.795757 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 227/425] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:06.802022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:06.802903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:06.824103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:06.824103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:06.824103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:06.824103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:06.824517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:06.824517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:07.310212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:07.353208 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-437649f3-208b-4462-a113-c5e505f668c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.554870 Nov 02 21:23:07.355029 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 228/426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:06 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:07.360302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bc8f831-5d1f-48cf-a467-6994aa88c09d tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] Calling method '.version_select at 0x7f9b696ef790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:07.757830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f685051-9346-4118-8538-538cc3646264 tempest-QuotaClassesAdminTestJSON-1491717194 tempest-QuotaClassesAdminTestJSON-1491717194-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.111693 Nov 02 21:23:07.760424 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 199/427] 10.222.0.25 () {60 vars in 1206 bytes} [Wed Nov 2 21:23:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:07.798306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:07.800623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:07.826182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:07.829022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:07.844230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:07.848174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:07.851085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:07.852465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:08.093882 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1bc8f831-5d1f-48cf-a467-6994aa88c09d tempest-SecurityGroupsTestAdminJSON-1147924659 tempest-SecurityGroupsTestAdminJSON-1147924659-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/87947e3d-758d-46c8-a230-95d3891d49be" status: 202 len: 0 microversion: 2.1 time: 0.737522 Nov 02 21:23:08.095187 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 229/428] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:23:07 2022] DELETE /compute/v2.1/os-security-groups/87947e3d-758d-46c8-a230-95d3891d49be => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:08.100023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:08.100922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:08.111086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:08.117754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:08.118519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:08.119504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:08.121488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:08.122179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:09.076197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:09.090651 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe959d8a-a1de-44e3-9c0d-249c963bdef6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.989315 Nov 02 21:23:09.096324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:09.098917 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 230/429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:08 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:09.108016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:09.125771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:09.127614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ceaa614-c887-4f98-b20c-7d0be50aa58e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 1.365023 Nov 02 21:23:09.128368 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 200/430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:07 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:09.139925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:09.146086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5a3e79d-111e-4c5d-8bcb-ead4e4ebdab1 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] Calling method '.version_select at 0x7f9b698ba160>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:09.146978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:09.153582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:09.154534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:09.155371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:09.155966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:09.580963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:09.594374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d401401e-addc-4437-ba23-a62c747d8362 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.493868 Nov 02 21:23:09.595225 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 231/431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:09 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:09.606906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:09.607815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:09.617558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:09.624868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:09.627417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:09.627417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:09.627417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:09.627417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:09.908612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:09.920615 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b308b0e2-6deb-4d0f-859e-27340a964f1b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.320724 Nov 02 21:23:09.938607 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 232/432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:09 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:09.951340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8b26371a-96b9-4664-8bde-8e63e9e86537 req-49e67ba2-d215-4932-9980-2c64396a2723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b0cb2f-8ffb-43e2-bd68-446bc4b05289", "tag": "7478b817-f107-4757-9d0e-e2c158d60d08"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:09.974822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8b26371a-96b9-4664-8bde-8e63e9e86537 req-49e67ba2-d215-4932-9980-2c64396a2723 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:09.975769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8b26371a-96b9-4664-8bde-8e63e9e86537 req-49e67ba2-d215-4932-9980-2c64396a2723 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:09.976691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8b26371a-96b9-4664-8bde-8e63e9e86537 req-49e67ba2-d215-4932-9980-2c64396a2723 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:10.004287 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8b26371a-96b9-4664-8bde-8e63e9e86537 req-49e67ba2-d215-4932-9980-2c64396a2723 service nova] Creating event network-changed:7478b817-f107-4757-9d0e-e2c158d60d08 for instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 on n-h2-860863-4 Nov 02 21:23:10.009227 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8b26371a-96b9-4664-8bde-8e63e9e86537 req-49e67ba2-d215-4932-9980-2c64396a2723 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068773 Nov 02 21:23:10.010367 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 233/433] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:10.118643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:10.121787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:10.130152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:10.131841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:10.132443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:10.134066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:10.134855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:10.135474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:10.300424 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5a3e79d-111e-4c5d-8bcb-ead4e4ebdab1 tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/929c106f-63b9-4e6c-8e1c-508c154fa103" status: 202 len: 0 microversion: 2.1 time: 1.167865 Nov 02 21:23:10.302625 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 201/434] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:23:09 2022] DELETE /compute/v2.1/os-security-groups/929c106f-63b9-4e6c-8e1c-508c154fa103 => generated 0 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:10.307084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:10.312967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:10.320123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:10.348139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:10.349885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:10.350523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:10.352191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:10.353052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:10.358530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:10.475770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:10.490951 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26fb0a9b-9c16-41fd-b342-02a193f02f12 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.381300 Nov 02 21:23:10.507141 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 234/435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:10 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:10.510823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50c20bfa-9ecf-42a7-a084-3da8af21801d tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] Calling method '.version_select at 0x7f9b6957d790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:10.896477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:10.909604 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-23b50ea7-74ef-49ab-8991-5f4a22536b4f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 0.605109 Nov 02 21:23:10.913812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 202/436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:10 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:10.928139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:10.931278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:10.947289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:10.948225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:10.949790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:10.952200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:10.952876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:10.955944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:11.543274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:11.553700 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50c20bfa-9ecf-42a7-a084-3da8af21801d tempest-SecurityGroupsTestAdminJSON-905623226 tempest-SecurityGroupsTestAdminJSON-905623226-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a727684f-e853-4e2b-9f6a-0c3beecba511" status: 202 len: 0 microversion: 2.1 time: 1.056968 Nov 02 21:23:11.559999 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 235/437] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:23:10 2022] DELETE /compute/v2.1/os-security-groups/a727684f-e853-4e2b-9f6a-0c3beecba511 => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:11.560679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d8a947d5-dc30-442d-b095-395763c39c26 req-a1cf92fb-7cd4-4e4c-8339-4adaa048382c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e", "name": "network-vif-plugged", "status": "completed", "tag": "959e5aa8-19e8-427e-86c3-a667021fcc01"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:11.566260 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-07028ad6-1f40-4c57-9462-96095bf9fa82 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.651074 Nov 02 21:23:11.567502 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 203/438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:10 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:11.584422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:11.585577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:11.596619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d8a947d5-dc30-442d-b095-395763c39c26 req-a1cf92fb-7cd4-4e4c-8339-4adaa048382c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:11.597532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:11.605498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d8a947d5-dc30-442d-b095-395763c39c26 req-a1cf92fb-7cd4-4e4c-8339-4adaa048382c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:11.606460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d8a947d5-dc30-442d-b095-395763c39c26 req-a1cf92fb-7cd4-4e4c-8339-4adaa048382c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:11.607280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:11.610954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:11.615808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:11.616326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:11.616950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:11.636667 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d8a947d5-dc30-442d-b095-395763c39c26 req-a1cf92fb-7cd4-4e4c-8339-4adaa048382c service nova] Creating event network-vif-plugged:959e5aa8-19e8-427e-86c3-a667021fcc01 for instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e on n-h2-860863-4 Nov 02 21:23:11.650279 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d8a947d5-dc30-442d-b095-395763c39c26 req-a1cf92fb-7cd4-4e4c-8339-4adaa048382c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094627 Nov 02 21:23:11.653405 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 236/439] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:11.710519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:11.711619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:11.719808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:11.720172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:11.721990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:11.724432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:11.725549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:11.726185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:12.063173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:12.074981 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-50912891-2bf2-44a2-946f-924a239be31d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.506105 Nov 02 21:23:12.076455 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 204/440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:11 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:12.084207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:12.085876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:12.097231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:12.097901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:12.099268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:12.101458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:12.103128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:12.103740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:12.187233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:12.202158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0be5dffa-8198-47f8-a227-8b582c50ceb0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.547249 Nov 02 21:23:12.206797 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 237/441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:11 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:12.590482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:12.591105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:12.611228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:12.611558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:12.612199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:12.613027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:12.613491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:12.613923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:12.838314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:12.841342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:12.855723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab39dcc5-dd04-476d-9465-dbeb18e549fa tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 0.777024 Nov 02 21:23:12.856316 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 205/442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:12 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:13.077643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:13.099643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4303a8e-d4d6-4efe-9a9f-0c7f1094b894 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.510827 Nov 02 21:23:13.100277 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 238/443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:12 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:13.102079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:13.102709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:13.110352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:13.110859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:13.111295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:13.111991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:13.113103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:13.121992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:13.233109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:13.234508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:13.256225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:13.256737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:13.271051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:13.271926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:13.278562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:13.283265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:13.356837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:13.365900 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2643e8cb-89a5-4d09-9502-a663a0ca8e09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.267703 Nov 02 21:23:13.366846 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 206/444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:13 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:13.769717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-017b6109-6d21-4426-9b49-a9f8f641e5eb req-e09c81df-c914-4e4c-a0e0-43ba4859b815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb432d5-49aa-4904-b943-057c7a56255d", "name": "network-vif-plugged", "status": "completed", "tag": "da0e6b65-f828-4734-a7d4-18f69f3c54d3"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:13.792959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-017b6109-6d21-4426-9b49-a9f8f641e5eb req-e09c81df-c914-4e4c-a0e0-43ba4859b815 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:13.794356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-017b6109-6d21-4426-9b49-a9f8f641e5eb req-e09c81df-c914-4e4c-a0e0-43ba4859b815 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:13.795342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-017b6109-6d21-4426-9b49-a9f8f641e5eb req-e09c81df-c914-4e4c-a0e0-43ba4859b815 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:13.823096 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-017b6109-6d21-4426-9b49-a9f8f641e5eb req-e09c81df-c914-4e4c-a0e0-43ba4859b815 service nova] Creating event network-vif-plugged:da0e6b65-f828-4734-a7d4-18f69f3c54d3 for instance 6eb432d5-49aa-4904-b943-057c7a56255d on n-h1-860863-4 Nov 02 21:23:13.842158 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-017b6109-6d21-4426-9b49-a9f8f641e5eb req-e09c81df-c914-4e4c-a0e0-43ba4859b815 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074687 Nov 02 21:23:13.842158 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 207/445] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:23:13.884803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:13.885900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:13.905293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:13.906160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:13.908360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:13.909605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:13.911574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:13.913435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:14.130347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:14.161558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-baf5db31-4050-4222-994f-bc35001e6fb2 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.919220 Nov 02 21:23:14.162897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 239/446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:13 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:14.169176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:14.170848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:14.193010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:14.193681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:14.194249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:14.199154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:14.200204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:14.201596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:14.567964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:14.584710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69f1bae6-c555-48ca-95c4-df649525f987 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 0.701707 Nov 02 21:23:14.585586 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 208/447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:13 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:14.593393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:14.607412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc3bd095-3094-45ab-8ce8-4d8e9e4b46fd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.443073 Nov 02 21:23:14.615943 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 240/448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:14 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:14.622965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:14.623883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:14.645564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:14.650353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:14.650353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:14.650353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:14.650353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:14.650664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:14.912001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:14.921180 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1433bcfe-41cd-4b4e-8296-6504d471804e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.334635 Nov 02 21:23:14.921771 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 209/449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:14 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:15.200853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:15.203499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:15.217052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:15.217930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:15.218528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:15.219401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:15.220010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:15.220735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:15.490660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:15.505266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4f2e8fa6-05e7-42f6-955d-6d180c7cebab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.317740 Nov 02 21:23:15.509056 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 241/450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:15 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:15.620731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:15.621745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:15.634412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:15.636799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:15.645596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:15.646514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:15.653804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:15.655827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:15.659272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:15.660895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:15.661689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:15.662963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:15.668304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:15.674538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:15.674538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:15.674538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:15.847521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:16.152176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:16.170944 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4bce00c4-8edd-42c4-b24d-d26fde5f839c tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.531425 Nov 02 21:23:16.171544 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 242/451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:15 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:16.196818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fa81fe7d-4760-4966-8935-66d4db1cda10 req-0713ac1b-28f5-4be0-ad65-cf94c14c5960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f34a0e-b047-45c7-a82c-fbab7419d3d5", "name": "network-vif-plugged", "status": "completed", "tag": "9c70901d-a948-4e16-b493-f688d27c0b9a"}, {"server_uuid": "b0a412bb-8df5-445f-8543-5e4b52e60115", "name": "network-vif-plugged", "status": "completed", "tag": "20768c6b-0c87-424a-9ac4-1d628f7ae7f7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:16.241382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fa81fe7d-4760-4966-8935-66d4db1cda10 req-0713ac1b-28f5-4be0-ad65-cf94c14c5960 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:16.242066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fa81fe7d-4760-4966-8935-66d4db1cda10 req-0713ac1b-28f5-4be0-ad65-cf94c14c5960 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:16.242277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fa81fe7d-4760-4966-8935-66d4db1cda10 req-0713ac1b-28f5-4be0-ad65-cf94c14c5960 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:16.273026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:16.286494 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b18a45ef-cb3f-48cb-91e6-6c00392315f8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1319 microversion: 2.1 time: 0.674088 Nov 02 21:23:16.290847 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 210/452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:15 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:16.292919 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fa81fe7d-4760-4966-8935-66d4db1cda10 req-0713ac1b-28f5-4be0-ad65-cf94c14c5960 service nova] Creating event network-vif-plugged:9c70901d-a948-4e16-b493-f688d27c0b9a for instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 on n-h1-860863-4 Nov 02 21:23:16.293464 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fa81fe7d-4760-4966-8935-66d4db1cda10 req-0713ac1b-28f5-4be0-ad65-cf94c14c5960 service nova] Creating event network-vif-plugged:20768c6b-0c87-424a-9ac4-1d628f7ae7f7 for instance b0a412bb-8df5-445f-8543-5e4b52e60115 on n-h2-860863-4 Nov 02 21:23:16.298494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:16.305505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:16.315832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:16.316819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:16.318579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:16.318579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:16.319518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:16.320315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:16.320614 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fa81fe7d-4760-4966-8935-66d4db1cda10 req-0713ac1b-28f5-4be0-ad65-cf94c14c5960 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.147635 Nov 02 21:23:16.324882 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 243/453] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:16.754042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:16.762554 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-57d4e87d-c4be-4f0d-b64e-99b2f0a37ed7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.469958 Nov 02 21:23:16.767775 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 211/454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:16 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:16.777577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:16.778618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:16.786100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-460933893", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "2e122478-3983-4b35-aafd-de2f1ae7dd60"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:16.794093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:16.794627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:16.795067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:16.795783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:16.796236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:16.796661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:16.871850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] validate_networks() for [('2e122478-3983-4b35-aafd-de2f1ae7dd60', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:17.148659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:17.161899 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bcdc52c9-959b-4da1-b8ca-4cf18366ebdf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1313 microversion: 2.1 time: 0.391418 Nov 02 21:23:17.173098 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 212/455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:16 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:17.501796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1469524295", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": "none"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:17.617785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:17.618215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:17.618692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:17.619104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:17.620601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:17.636661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=31 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:17.643749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:17.648142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:17.648608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:17.649431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:17.651113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:17.656650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:17.707297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Getting quotas for project 531e75ec3b8f44bfa3caeb3d09ab1f83. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:17.721501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:17.726002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Getting quotas for user 379afd7e565f45c3b3a7ea6489df9309 and project 531e75ec3b8f44bfa3caeb3d09ab1f83. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:17.763930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:17.771705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:18.035996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0afad6b8-26d9-4e24-a251-caff4b7940a2 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.861124 Nov 02 21:23:18.037334 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 213/456] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:23:18.044260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:18.045924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:18.055148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:18.056428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:18.057104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:18.058735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:18.059625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:18.060289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:18.726185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:18.737161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10ee9f1e-ace5-419a-8be0-1d9beee16c46 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1388 microversion: 2.1 time: 0.698384 Nov 02 21:23:18.737983 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 214/457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:18 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1388 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:18.743155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:18.743970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:18.752245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:18.753292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:18.754429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:18.755176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:18.755741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:18.759396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=12,nova_api:INSERT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:18.769762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:18.772254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:18.772765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:18.773232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:18.775478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:18.775478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:18.775663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:18.776124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:18.777124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:18.780369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:18.781224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:18.781849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:18.813621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Getting quotas for project 474e60f37a8d4b8694acb88ffc736368. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:18.820769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Getting quotas for user 00fce7be56a04270b9d8adf4285bb85f and project 474e60f37a8d4b8694acb88ffc736368. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:18.847916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:18.855735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:19.067639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:19.081325 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a0973ce-a765-4740-9d9d-34d95321eed0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.754886 Nov 02 21:23:19.084456 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 244/458] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:23:19.091050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:19.091881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:19.094175 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-603d6a9e-7861-4ba9-b5c6-9e0fd199a5bf tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1468 microversion: 2.1 time: 0.352977 Nov 02 21:23:19.095961 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 215/459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:18 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1468 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:19.098736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:19.099424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:19.100021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:19.100884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:19.101555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:19.102139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:19.113324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-25093ae3-32b2-464f-a25f-c92a7dfcb7e0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:19.115751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-25093ae3-32b2-464f-a25f-c92a7dfcb7e0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:19.216088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25093ae3-32b2-464f-a25f-c92a7dfcb7e0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:19.231569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25093ae3-32b2-464f-a25f-c92a7dfcb7e0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:19.235483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25093ae3-32b2-464f-a25f-c92a7dfcb7e0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:19.254209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-25093ae3-32b2-464f-a25f-c92a7dfcb7e0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1454 microversion: 2.91 time: 0.156893 Nov 02 21:23:19.255512 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 216/460] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:19 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:19.275734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:19.276728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:19.295498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:19.297799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:19.299822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:19.302685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:19.303756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:19.304677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:19.442827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:19.453561 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b58d4f3e-c01c-4525-aa63-78782f749950 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1307 microversion: 2.1 time: 0.367651 Nov 02 21:23:19.460548 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 245/461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:19 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:19.467630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7cb9011b-e6a7-4683-ae04-4e2f3ccbb0e4 req-17e58906-eb58-4455-b167-7880d70e3f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b0cb2f-8ffb-43e2-bd68-446bc4b05289", "name": "network-vif-plugged", "status": "completed", "tag": "7478b817-f107-4757-9d0e-e2c158d60d08"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:19.503685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7cb9011b-e6a7-4683-ae04-4e2f3ccbb0e4 req-17e58906-eb58-4455-b167-7880d70e3f7d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:19.503922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7cb9011b-e6a7-4683-ae04-4e2f3ccbb0e4 req-17e58906-eb58-4455-b167-7880d70e3f7d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:19.504535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7cb9011b-e6a7-4683-ae04-4e2f3ccbb0e4 req-17e58906-eb58-4455-b167-7880d70e3f7d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:19.517556 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7cb9011b-e6a7-4683-ae04-4e2f3ccbb0e4 req-17e58906-eb58-4455-b167-7880d70e3f7d service nova] Creating event network-vif-plugged:7478b817-f107-4757-9d0e-e2c158d60d08 for instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 on n-h2-860863-4 Nov 02 21:23:19.524794 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7cb9011b-e6a7-4683-ae04-4e2f3ccbb0e4 req-17e58906-eb58-4455-b167-7880d70e3f7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062973 Nov 02 21:23:19.526062 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 246/462] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:19.532798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-956114e6-57a6-44bd-9972-1e76499ff0f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:19.534957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-956114e6-57a6-44bd-9972-1e76499ff0f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:19.623162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-956114e6-57a6-44bd-9972-1e76499ff0f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:19.639406 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-956114e6-57a6-44bd-9972-1e76499ff0f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1223 microversion: 2.1 time: 0.108990 Nov 02 21:23:19.641177 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 247/463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:19 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:19.668649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:19.681564 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7cd26da6-7f62-4e55-886e-38d9d1a3a4b1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1463 microversion: 2.1 time: 0.422432 Nov 02 21:23:19.682563 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 217/464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:19 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1463 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:19.920520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1885326515", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fce733bb-4d9b-4a3f-8666-2b353f0ca65b"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:19.989986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:19.991094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:20.000047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.000047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.000800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.001731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.002387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.003036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.038043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] validate_networks() for [('fce733bb-4d9b-4a3f-8666-2b353f0ca65b', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:20.088101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:23:20.103270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:20.503481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-079aeabe-6f58-4c58-b0f7-42e9e29ad77e tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 204 len: 0 microversion: 2.1 time: 0.860075 Nov 02 21:23:20.509627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:20.509627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:20.510533 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 248/465] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:23:19 2022] DELETE /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 0 bytes in 863 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:23:20.510630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:20.510630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:20.510630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:20.528921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.529631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.530673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.531640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.532676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.533612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.556676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:20.564567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for user 979116d5dca74e6d90abe23e9033107e and project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:20.571549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1532779873", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:20.578432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:20.587388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:20.630223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:20.757266 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a123a09c-550a-4713-9f82-96c49a3189a1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.072983 Nov 02 21:23:20.758476 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 218/466] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:23:20.764335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:20.769122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:20.775149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.778448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.779202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.780156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.780785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.781430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.891823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:20.892364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:20.892969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:20.893482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:20.896057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:20.907692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.908749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.909797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.918145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:20.927753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:20.927753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:20.942816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Getting quotas for project e67258fa3a5247389ddb9ceeedba9076. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:20.952756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Getting quotas for user 93744d04892f4736b9458281d1c5ca2a and project e67258fa3a5247389ddb9ceeedba9076. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:20.966112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:20.968505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:20.983769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:20.990672 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-772c1223-fc00-4f4c-ac5c-d3f0088f9a96 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1462 microversion: 2.1 time: 0.230844 Nov 02 21:23:20.991375 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 219/467] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:20 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1462 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:20.999391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.000041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.006385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.007057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.011412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.011412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.011412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.011845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.140790 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fef675d-08a6-4c88-a9eb-a31ddf32d93f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631066 Nov 02 21:23:21.142085 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 249/468] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:23:21.162038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.163057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.164203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.172348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.172894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.173441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.173546 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e5a9c8d-69c9-492f-96c6-9ab9fbe0a460 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1588 microversion: 2.1 time: 0.178718 Nov 02 21:23:21.174029 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 220/469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:20 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1588 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:21.174312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.174910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.175603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.178511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.179446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.204750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.204750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.204750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.204750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.205291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.205710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.339880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.349782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.351385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.360347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e72c4d8b-6ea3-49b2-9c4a-ee6107797388 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1506 microversion: 2.91 time: 0.210377 Nov 02 21:23:21.360917 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 250/470] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:21 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:21.366608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.367497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.374045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.374777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.375417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.376475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.377222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.381072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.387725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.391274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd98fbfb-ef03-4324-a4b3-6c1c58e7dcc7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1487 microversion: 2.1 time: 0.216161 Nov 02 21:23:21.391916 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 221/471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:21 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1487 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:21.396577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.397489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.403777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.404573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.405261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.406156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.406849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.407470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.496235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.506622 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9db827c3-af9e-422c-bbb5-811fc69f8812 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1227 microversion: 2.1 time: 0.113659 Nov 02 21:23:21.507373 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 222/472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:21 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1227 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:21.514194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc94741b-cd3e-443a-b620-0adbd8c8ccd8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.515201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc94741b-cd3e-443a-b620-0adbd8c8ccd8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.585854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc94741b-cd3e-443a-b620-0adbd8c8ccd8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.592458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.595072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc94741b-cd3e-443a-b620-0adbd8c8ccd8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.597089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc94741b-cd3e-443a-b620-0adbd8c8ccd8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.600415 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc94741b-cd3e-443a-b620-0adbd8c8ccd8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1262 microversion: 2.25 time: 0.089561 Nov 02 21:23:21.600415 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 223/473] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:21 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:21.605194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1176984682", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:21.614549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be7c9c8f-b4d0-42e1-bc00-6ce1dd1fa756 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1474 microversion: 2.1 time: 0.246053 Nov 02 21:23:21.623512 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 251/474] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:21 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1474 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:21.628544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-57a41dd4-00d4-4207-b312-65809202f468 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.629216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-57a41dd4-00d4-4207-b312-65809202f468 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.679822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:21.696335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57a41dd4-00d4-4207-b312-65809202f468 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:21.704318 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-57a41dd4-00d4-4207-b312-65809202f468 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1222 microversion: 2.1 time: 0.079498 Nov 02 21:23:21.704912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 252/475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:21 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:21.709553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:21.710048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.715973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.716464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.716905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.717661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.721777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.722479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.852769 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f38a4d0d-9d24-4d78-bcab-54ee673242cd tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146748 Nov 02 21:23:21.853425 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 253/476] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:23:21 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:21.880788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:21.881493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:21.893021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.893021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.893229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.894096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:21.897560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:21.898273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:21.994778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:21.996416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:21.997260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:21.997772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:21.998257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:22.009861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.010588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.012146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.013494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.014076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.015343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.055019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Getting quotas for project ad41afe8a2f04aee958c00322937c074. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:22.067225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Getting quotas for user d1038966c4b6489ebafefb73c748e957 and project ad41afe8a2f04aee958c00322937c074. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:22.083737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:22.094704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:22.240582 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b9c8da17-a9b7-4074-a8c4-9a474b8eb499 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289/action" status: 202 len: 0 microversion: 2.1 time: 0.365998 Nov 02 21:23:22.250395 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 254/477] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:21 2022] POST /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:22.272923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:22.277760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:22.301661 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1375d3a9-3442-421a-ba1a-dff2a5f05c69 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700228 Nov 02 21:23:22.315521 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 224/478] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:23:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:23:22.318439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.328808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.329435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.332220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.332570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc701765-a066-46cc-8ab7-3bb67606d7b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:22.333226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc701765-a066-46cc-8ab7-3bb67606d7b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:22.333769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.336028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.462373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc701765-a066-46cc-8ab7-3bb67606d7b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:22.471936 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc701765-a066-46cc-8ab7-3bb67606d7b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1214 microversion: 2.1 time: 0.149251 Nov 02 21:23:22.485201 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 225/479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:22 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:22.485201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:22.485201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:22.520658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.521184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.528218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.528630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.530877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.531497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.790705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:22.804711 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41fb79d1-825c-4c57-b8e9-fb04ee117f16 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1492 microversion: 2.1 time: 0.553236 Nov 02 21:23:22.805348 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 255/480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:22 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1492 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:22.825257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:22.827733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:22.851646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.852449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.853103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.857808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.857808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.857808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.860498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:22.875898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:22.880727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:22.912884 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7cb362d7-46d4-4e30-99bb-343c4c67b7fe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1524 microversion: 2.91 time: 0.438432 Nov 02 21:23:22.914839 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 226/481] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:22 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1524 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:22.928547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:22.930572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:22.942452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.946221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.946944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:22.948225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:22.952615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:22.953348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.044706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:23.050848 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b8fafe2-5fd3-4e04-a747-2ef6c80e2075 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1275 microversion: 2.1 time: 0.244450 Nov 02 21:23:23.079397 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 256/482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:22 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1275 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:23.091660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:23.093973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:23.102614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.103925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.104584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.106059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.106886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.107700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.113425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:23.126468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:23.128473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:23.129832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-29fd69f2-3b13-4164-b2cc-4522774c1476 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1258 microversion: 2.25 time: 0.213656 Nov 02 21:23:23.130873 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 227/483] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:22 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1258 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:23.135695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:23.136537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:23.144022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.145052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.145723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.146642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.147307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.147949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.184533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:23.186538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:23.198959 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-800c700b-29e8-480c-86b8-d3ca7ddc833f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1432 microversion: 2.1 time: 0.114979 Nov 02 21:23:23.199528 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 257/484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:23 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1432 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:23.239863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:23.249166 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eccfdae4-6ed4-4f4a-a3db-bdf4b15d3e6d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1218 microversion: 2.1 time: 0.116698 Nov 02 21:23:23.249738 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 228/485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:23 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:23.366686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-04d4a135-2c0f-404b-bf11-23a19c97c28c req-1fc11fa0-d9dc-4629-ab97-0a10249dc0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb432d5-49aa-4904-b943-057c7a56255d", "name": "network-vif-deleted", "tag": "da0e6b65-f828-4734-a7d4-18f69f3c54d3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:23.382452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-04d4a135-2c0f-404b-bf11-23a19c97c28c req-1fc11fa0-d9dc-4629-ab97-0a10249dc0ab service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.382941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-04d4a135-2c0f-404b-bf11-23a19c97c28c req-1fc11fa0-d9dc-4629-ab97-0a10249dc0ab service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.383380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-04d4a135-2c0f-404b-bf11-23a19c97c28c req-1fc11fa0-d9dc-4629-ab97-0a10249dc0ab service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.399393 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-04d4a135-2c0f-404b-bf11-23a19c97c28c req-1fc11fa0-d9dc-4629-ab97-0a10249dc0ab service nova] Creating event network-vif-deleted:da0e6b65-f828-4734-a7d4-18f69f3c54d3 for instance 6eb432d5-49aa-4904-b943-057c7a56255d on n-h1-860863-4 Nov 02 21:23:23.406375 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-04d4a135-2c0f-404b-bf11-23a19c97c28c req-1fc11fa0-d9dc-4629-ab97-0a10249dc0ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046118 Nov 02 21:23:23.408336 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 258/486] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:23.494079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:23.496685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:23.501255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.501665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.502102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.503147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.503232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.503670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.565991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:23.577549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d9a84b0-9c09-48d9-b210-b978a3355699 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1218 microversion: 2.1 time: 0.087481 Nov 02 21:23:23.581963 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 229/487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:23 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:23.758442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:23.759287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:23.766049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.766775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.767377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.768071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.768698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.769819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.834772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:23.835688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:23.843456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.844350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.844895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:23.845818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:23.847012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:23.847513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.068191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.080888 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd769530-26c9-4cd5-955c-379261beb476 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1588 microversion: 2.1 time: 0.326132 Nov 02 21:23:24.094565 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 259/488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:23 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1588 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:24.108422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:24.108682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.110209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:24.118032 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a83cccb-c632-4528-aa77-d72bf50ccd5e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 200 len: 1472 microversion: 2.1 time: 0.289036 Nov 02 21:23:24.118548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.118895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.119938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.120118 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 230/489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:23 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:24.121818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.122639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.123459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.126332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:24.126949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:24.132993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.137038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.137038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.137038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.137038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.137351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.275504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.293647 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d7f44849-45f2-4971-bb9b-614d44a968f7 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1275 microversion: 2.1 time: 0.171013 Nov 02 21:23:24.317431 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 231/490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:24 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:24.330346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1259641595"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:24.333742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:24.344669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.345846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.348270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.349808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.350505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.350874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.351633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.366560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.377925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.394625 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83170969-3a56-4452-8744-06c67d1ce9e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1512 microversion: 2.91 time: 0.298656 Nov 02 21:23:24.395210 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 260/491] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:24 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:24.421575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:24.422628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:24.430250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.431269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.432055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.433235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.433903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.434729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.532147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.540538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.543048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.544456 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8abdc5b1-4357-47b3-81de-ee4a11391cf8 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1258 microversion: 2.25 time: 0.142405 Nov 02 21:23:24.545669 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 261/492] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:24 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:24.552225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:24.553062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:24.562636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.563358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.564674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.565588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.566237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.566812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.652992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.661538 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b920ff90-177f-4ab7-9f25-696bf7d450ed tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1304 microversion: 2.1 time: 0.114578 Nov 02 21:23:24.677969 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 262/493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:24 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:24.684004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:24.684660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:24.691537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.692035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.692480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.707049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.707916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.708441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.804144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.814108 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7b01015-d33c-431e-8076-a5a51dd0b238 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1218 microversion: 2.1 time: 0.134893 Nov 02 21:23:24.815789 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 263/494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:24 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:24.820771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:24.821719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:24.828735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.829389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.829908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.830800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:24.831479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:24.832163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:24.922066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:24.926962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1343e0dd-5120-4d06-8733-bc1d3c2ac554 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289/action" status: 202 len: 0 microversion: 2.1 time: 0.599696 Nov 02 21:23:24.926962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 232/495] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:24 2022] POST /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:23:24.941112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34194d3e-d314-492c-a71f-6dadce0faa09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b69894c10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:24.943406 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cdb55f0c-021d-49d0-8935-0c12a52d6a08 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1266 microversion: 2.1 time: 0.126187 Nov 02 21:23:24.956808 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 264/496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:24 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:25.031795 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34194d3e-d314-492c-a71f-6dadce0faa09 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.101183 Nov 02 21:23:25.032854 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 233/497] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:24 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:25.321520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:25.322710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:25.332895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.333773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.334491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.335410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.337660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.338463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.431834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0972d36b-f974-499a-aed7-11739faf1ac3 req-3aaa96f0-ab1b-408c-a659-56843b5600a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f34a0e-b047-45c7-a82c-fbab7419d3d5", "tag": "9c70901d-a948-4e16-b493-f688d27c0b9a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:25.448268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0972d36b-f974-499a-aed7-11739faf1ac3 req-3aaa96f0-ab1b-408c-a659-56843b5600a7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.449617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0972d36b-f974-499a-aed7-11739faf1ac3 req-3aaa96f0-ab1b-408c-a659-56843b5600a7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.450156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0972d36b-f974-499a-aed7-11739faf1ac3 req-3aaa96f0-ab1b-408c-a659-56843b5600a7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.462494 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0972d36b-f974-499a-aed7-11739faf1ac3 req-3aaa96f0-ab1b-408c-a659-56843b5600a7 service nova] Creating event network-changed:9c70901d-a948-4e16-b493-f688d27c0b9a for instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 on n-h1-860863-4 Nov 02 21:23:25.468557 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0972d36b-f974-499a-aed7-11739faf1ac3 req-3aaa96f0-ab1b-408c-a659-56843b5600a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041259 Nov 02 21:23:25.470024 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 234/498] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:23:25.475814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:25.476734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:25.496969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.497493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.497945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.498667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.499225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.501180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.516665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.522647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:25.530484 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-01addee7-a7b3-4acf-975f-5030d7e83b6b tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1293 microversion: 2.1 time: 0.213495 Nov 02 21:23:25.545740 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 265/499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:25 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1293 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:25.577442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:25.578086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:25.585950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.586734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.587962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.591793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.592603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.593204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.654337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.662709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.664574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.670400 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0fcf5af9-5ed1-4a17-8b80-15dc5b20ab21 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1533 microversion: 2.91 time: 0.198942 Nov 02 21:23:25.671480 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 235/500] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:25 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1533 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:25.689613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:25.690426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:25.703374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.705612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.706246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.707448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.708069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.710959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.720748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.729393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.738623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.739929 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-204a8f3b-bef8-4fc7-8524-9e01f274f928 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1314 microversion: 2.25 time: 0.168018 Nov 02 21:23:25.740613 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 266/501] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:25 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:23:25.781787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.782498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.783089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.784243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lazy-loading 'fault' on Instance uuid 6eb432d5-49aa-4904-b943-057c7a56255d {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:25.867251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:25.883134 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f156840-4fdb-4e1d-8c0a-8a17eecfe3ca tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1309 microversion: 2.1 time: 0.197942 Nov 02 21:23:25.883726 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 236/502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:25 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1309 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:25.910126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:25.910696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:25.925315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.927376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.928158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.929885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.931590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.933837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.966104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:25.967040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:25.982221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.984835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.986036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:25.987730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:25.990049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:25.991501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.039939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:26.051436 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cfe93c2-0efe-48cd-9a20-383271c63792 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1218 microversion: 2.1 time: 0.164208 Nov 02 21:23:26.055734 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 237/503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:25 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:26.063691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:26.064652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:26.083340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.083957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.084472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.085286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.085944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.086619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.264324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lazy-loading 'services' on Instance uuid e97f5885-4d7e-4cda-a26a-9fe0358fd787 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:26.326510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:26.342741 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8908aec5-9670-46bf-a5fb-3a52acf8353a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1272 microversion: 2.1 time: 0.281295 Nov 02 21:23:26.343685 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 238/504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:26 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:26.382710 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f56354fb-e23a-4b57-a473-ed11e8767e2a tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1938 microversion: 2.91 time: 0.638340 Nov 02 21:23:26.382710 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 267/505] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:25 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1938 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:26.386056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3c4b81ca-9bd9-469d-ba72-1053edc5414f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b696ddf70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:26.417904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:26.421754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:26.439517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.456492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.463263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.467076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.473013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.474600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.508890 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3c4b81ca-9bd9-469d-ba72-1053edc5414f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.140450 Nov 02 21:23:26.513211 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 239/506] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:26 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:26.556326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:26.557223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:26.563315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:26.572217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.572982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.574429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.575758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.576451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.577087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.707631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lazy-loading 'services' on Instance uuid e97f5885-4d7e-4cda-a26a-9fe0358fd787 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:26.726691 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-350f2213-9470-40d5-8a6f-47db8bf1a92c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1938 microversion: 2.91 time: 0.312783 Nov 02 21:23:26.738837 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 268/507] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:26 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1938 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:26.754361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:26.758654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.759010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.759528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.760337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.761473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.762654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.790572 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60b89594-a464-466e-bedd-e8efa72f9b8d tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.039776 Nov 02 21:23:26.791588 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 269/508] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 21:23:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:23:26.800705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:26.805730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:26.812349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.812918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.813663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.814448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.815002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.815503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.815852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:26.827028 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-843343bf-f317-446d-baa8-614aabb496f5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1323 microversion: 2.1 time: 0.274716 Nov 02 21:23:26.827621 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 240/509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:26 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:26.832642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:26.833404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:26.840082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.840784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.841413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.842293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:26.843073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:26.843665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:26.872002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lazy-loading 'flavor' on Instance uuid e97f5885-4d7e-4cda-a26a-9fe0358fd787 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:26.900905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:27.222765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:27.222765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:27.222765 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf9455d9-d4a7-4db5-bcb8-07c503497f50 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1320 microversion: 2.25 time: 0.136327 Nov 02 21:23:27.224835 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 270/510] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:26 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1320 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:27.224835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:27.224835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:27.224835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:27.224835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.225607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.225607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.225607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.225607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.226080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.226080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.226080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.226080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.226567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lazy-loading 'fault' on Instance uuid 6eb432d5-49aa-4904-b943-057c7a56255d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:27.226567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:27.226567 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e56eee7-4183-45cc-8666-91d422b4886c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 200 len: 1309 microversion: 2.1 time: 0.117759 Nov 02 21:23:27.226567 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 271/511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:26 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:27.227975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:27.227975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:27.227975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.227975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.229045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.229045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.229045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.229045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.229515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:27.229515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd3b0b9e-e055-4e62-a114-81e104e770ec tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1274 microversion: 2.1 time: 0.137171 Nov 02 21:23:27.229515 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 272/512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:27 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:27.374275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:27.375370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:27.401622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.402503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.406070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.407026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.407648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.408237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.853395 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-952d1fd9-f7df-4cdc-8758-c65e966fdb99 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action" status: 202 len: 0 microversion: 2.91 time: 1.023953 Nov 02 21:23:27.853935 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 241/513] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:23:26 2022] POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action => generated 0 bytes in 1025 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:23:27.864731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-891971cb-6ec5-4d47-97e0-02dd1a2e7445 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b697b2c10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:27.911938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:27.919855 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90b2e0c6-f6bc-4f68-b470-d25046b2d3ca tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.552933 Nov 02 21:23:27.934732 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 273/514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:27 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:27.958437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:27.959340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:27.967055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.969532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.971911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.981790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-891971cb-6ec5-4d47-97e0-02dd1a2e7445 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.121526 Nov 02 21:23:27.982379 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 242/515] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:27 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:27.982927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:27.983623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:27.984229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:27.996420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:27.997702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:28.016289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.017145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.017777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.019867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.022623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.024457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.275708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:28.294822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:28.298787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:28.307585 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bc02368-a2b4-4c67-bc55-fd67361b184e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.318911 Nov 02 21:23:28.307585 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 243/516] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:27 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:28.316808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:28.317351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:28.325451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.328396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.329526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.346203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.348841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.348841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.768266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:28.772492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:28.779944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:28.781519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:28.782642 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ffc5b9b-3d91-4dfd-9a1e-259c3c06ef57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1320 microversion: 2.25 time: 0.475429 Nov 02 21:23:28.783228 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 244/517] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:28 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1320 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:28.788137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d3fe6490-209e-4b07-9dd4-70ba2e915930 req-641c84fa-489c-4d54-a477-593c3794850d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527718c-baf8-4607-a25c-3cf3d6d4a540", "tag": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:28.798562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d3fe6490-209e-4b07-9dd4-70ba2e915930 req-641c84fa-489c-4d54-a477-593c3794850d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.798969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d3fe6490-209e-4b07-9dd4-70ba2e915930 req-641c84fa-489c-4d54-a477-593c3794850d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.799466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d3fe6490-209e-4b07-9dd4-70ba2e915930 req-641c84fa-489c-4d54-a477-593c3794850d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.811414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d3fe6490-209e-4b07-9dd4-70ba2e915930 req-641c84fa-489c-4d54-a477-593c3794850d service nova] Creating event network-changed:0bb6edec-16b6-4bc9-93e6-f0f2955f0528 for instance d527718c-baf8-4607-a25c-3cf3d6d4a540 on n-h1-860863-4 Nov 02 21:23:28.816605 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d3fe6490-209e-4b07-9dd4-70ba2e915930 req-641c84fa-489c-4d54-a477-593c3794850d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032282 Nov 02 21:23:28.817579 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 245/518] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:28.822816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:28.824503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:28.842230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.842230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.842230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.842230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.842681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.842681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.859341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:28.885559 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-629e647d-52c8-41e3-8136-72e4b0c6886d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1323 microversion: 2.1 time: 0.942669 Nov 02 21:23:28.902843 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 274/519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:27 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1323 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:28.910706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:28.911621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:28.918186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.919464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.920337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.921336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.922101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.922894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.938193 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] HTTP exception thrown: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Request method failure captured: Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d HTTP/1.1 Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-nocwVCmTelM1DsJoQ9ZD-EuzSipsFk_XS0zi1t6HxJP2Eh7RNXaciONAYLU0ElMO_SscFmKwct-EhzelsZH6vnUGdsQaFcSeDImtJNW4ZQGna3aIGBhbUspHoMBM_p2qQkqAOpnWhRe416hYusszZNIji1XlZ5Iwcl6Uco8GT06U Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:23:28.940474 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: da7dbeb2292d4ed2bb9e0bab2eed84f5 Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:23:28.941910 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '6eb432d5-49aa-4904-b943-057c7a56255d'} Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:23:28.942741 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:23:28.943985 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:23:28.951351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Returning 404 to user: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:23:28.952597 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdddc991-9fde-463a-bb7c-0c016f54f357 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 404 len: 111 microversion: 2.1 time: 0.048234 Nov 02 21:23:28.953717 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 275/520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:28 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:23:28.959574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:28.967007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:28.978952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.981098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.981765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.983915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:28.983915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:28.986753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:28.989700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:29.002974 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-120df3db-7e2f-4340-a9d1-3b6757b0f6fb tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1280 microversion: 2.1 time: 0.184299 Nov 02 21:23:29.016968 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 246/521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:28 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:29.023140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df9ef25e-995d-435f-946c-1062850baf6f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b696888b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:29.088745 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df9ef25e-995d-435f-946c-1062850baf6f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.083640 Nov 02 21:23:29.094749 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 247/522] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:29 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:29.142642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-841847478", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:29.221530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:29.564351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:29.573045 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4844574a-9c94-4090-9234-8f0a0705e209 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.617864 Nov 02 21:23:29.581403 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 276/523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:28 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:29.586873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:29.591526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:29.601919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:29.602428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:29.607051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:29.608506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:29.609341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:29.609860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:29.751802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:29.764780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:29.769142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:29.774284 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-77df22de-c53f-46bf-835d-d063be69368a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.191537 Nov 02 21:23:29.775197 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 277/524] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:29 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:29.812748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:29.813824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:29.836054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:29.837416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:29.838135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:29.839412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:29.840220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:29.840885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:29.904867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:29.905330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:29.905831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:29.908478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:29.908613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:29.924511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:29.925698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:29.926191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:29.926929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:29.927381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:29.927804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:29.955631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Getting quotas for project 026cb55f30604c5a84c5a0de753c1a58. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:29.963790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Getting quotas for user da7dbeb2292d4ed2bb9e0bab2eed84f5 and project 026cb55f30604c5a84c5a0de753c1a58. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:29.980049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:29.982527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:30.176856 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-26ab4c4d-8ee8-41de-964e-57eaf99d80a8 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038216 Nov 02 21:23:30.186852 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 248/525] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:23:30.212285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:30.213724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:30.230487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:30.231919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:30.232725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:30.233769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:30.234559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:30.235209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:30.616152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:30.626000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:30.628002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:30.629854 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fbbc2e53-b2c4-45b8-888d-6d71ec3ef5f9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.821568 Nov 02 21:23:30.631619 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 278/526] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:29 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:23:30.638699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:30.639649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:30.646093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:30.647009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:30.647677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:30.648618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:30.649723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:30.650338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:30.827451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:30.859906 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-300acd31-dcb7-4dc6-af3a-4b6a04cf8ed0 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1280 microversion: 2.1 time: 0.225414 Nov 02 21:23:30.876105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 279/527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:30 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:30.884270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd7c17fa-ea59-4068-b7e1-56c2e88e551a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b695c3040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:30.944112 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd7c17fa-ea59-4068-b7e1-56c2e88e551a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.063575 Nov 02 21:23:30.946215 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 280/528] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:30 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:30.952435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86d6172b-1654-402e-a9d3-cee5875a96ce tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:30.953465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86d6172b-1654-402e-a9d3-cee5875a96ce tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:31.114253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-86d6172b-1654-402e-a9d3-cee5875a96ce tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:31.127828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:31.153132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86d6172b-1654-402e-a9d3-cee5875a96ce tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1219 microversion: 2.1 time: 0.205178 Nov 02 21:23:31.155678 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81d094c1-68b7-4361-97c6-2e1b768f4a00 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1323 microversion: 2.1 time: 0.967368 Nov 02 21:23:31.169141 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 249/529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:30 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1323 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:31.174967 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 281/530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:30 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:31.180052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:31.184163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:31.185451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:31.186502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:31.198310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.200778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.201473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.202238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.203129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.203905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.204898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.205257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.206059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.206632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.207902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.208403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.437450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:31.447967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:31.451315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:31.461886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f190323a-fcbb-493c-8911-e804a62f5fd6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.284461 Nov 02 21:23:31.463146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 282/531] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:31 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:31.485034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a4bd5fce-32e9-4d82-aa6e-5b5db2560153 req-a28e7515-a751-440c-9216-3f9a5e61e58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c", "tag": "36a0c8c0-c3de-4d14-b2dd-eae7a6b9caeb"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:31.494659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a4bd5fce-32e9-4d82-aa6e-5b5db2560153 req-a28e7515-a751-440c-9216-3f9a5e61e58d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.496137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a4bd5fce-32e9-4d82-aa6e-5b5db2560153 req-a28e7515-a751-440c-9216-3f9a5e61e58d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.497011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a4bd5fce-32e9-4d82-aa6e-5b5db2560153 req-a28e7515-a751-440c-9216-3f9a5e61e58d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.511416 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a4bd5fce-32e9-4d82-aa6e-5b5db2560153 req-a28e7515-a751-440c-9216-3f9a5e61e58d service nova] Creating event network-changed:36a0c8c0-c3de-4d14-b2dd-eae7a6b9caeb for instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c on n-h2-860863-4 Nov 02 21:23:31.517415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a4bd5fce-32e9-4d82-aa6e-5b5db2560153 req-a28e7515-a751-440c-9216-3f9a5e61e58d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052646 Nov 02 21:23:31.518560 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 283/532] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:31.666391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:31.669197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:31.677477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.678586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.679626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.680964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.681568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.682410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.714757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:31.723223 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-785c8943-74ae-481f-be97-766f50cb1ff1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.552187 Nov 02 21:23:31.726334 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 250/533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:31 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:31.886702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:31.887821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:31.910533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.911035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.911470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:31.918817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:31.920063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:31.920533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:32.319505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:32.331843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:32.338502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:32.343233 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-256a8eec-1a58-4c3c-8329-976174630082 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.685531 Nov 02 21:23:32.363451 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 284/534] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:31 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:23:32.375930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2dfc9f7-b230-4e90-b736-665becd56e1d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6931e280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:32.387884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:32.397349 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c251d82-6e8e-4a84-8bb3-148418bc3146 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.515000 Nov 02 21:23:32.400764 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 251/535] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:31 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:32.408210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ea99d8dc-ab01-49c0-afdc-629c60224601 req-5079e3d4-2b69-42c8-b156-804bf980d9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b0cb2f-8ffb-43e2-bd68-446bc4b05289", "name": "network-vif-plugged", "status": "completed", "tag": "7478b817-f107-4757-9d0e-e2c158d60d08"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:32.444220 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2dfc9f7-b230-4e90-b736-665becd56e1d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.076694 Nov 02 21:23:32.444907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea99d8dc-ab01-49c0-afdc-629c60224601 req-5079e3d4-2b69-42c8-b156-804bf980d9df service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:32.446102 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 285/536] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:32 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:32.456660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea99d8dc-ab01-49c0-afdc-629c60224601 req-5079e3d4-2b69-42c8-b156-804bf980d9df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:32.457205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea99d8dc-ab01-49c0-afdc-629c60224601 req-5079e3d4-2b69-42c8-b156-804bf980d9df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:32.457885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:32.458513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:32.474700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:32.475192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:32.477872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:32.478609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:32.479074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:32.479531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:32.484646 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ea99d8dc-ab01-49c0-afdc-629c60224601 req-5079e3d4-2b69-42c8-b156-804bf980d9df service nova] Creating event network-vif-plugged:7478b817-f107-4757-9d0e-e2c158d60d08 for instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 on n-h2-860863-4 Nov 02 21:23:32.498656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ea99d8dc-ab01-49c0-afdc-629c60224601 req-5079e3d4-2b69-42c8-b156-804bf980d9df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095109 Nov 02 21:23:32.501855 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 252/537] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:32.510425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:32.513511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:32.521221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:32.521429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:32.522095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:32.522862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:32.524509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:32.525604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:32.526205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:32.711721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:32.727564 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72fbf5b6-baa8-438d-842d-83ab40b8081c tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1271 microversion: 2.1 time: 0.224262 Nov 02 21:23:32.732151 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 253/538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:32 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1271 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:32.743174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:32.750417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:32.755225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:32.757730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:32.759219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:32.763073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:32.764491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:32.765286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.156587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.170255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.172258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.177932 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7644cc64-2ada-45df-96eb-4cbd57ce2968 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.444126 Nov 02 21:23:33.187249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.205023 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 254/539] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:32 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:33.206633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:33.207281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:33.213756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.214298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.214854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.215578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.216234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.216714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.234949 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dcc6d53c-f66e-46dc-a7ee-f605796b2160 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1323 microversion: 2.1 time: 0.787117 Nov 02 21:23:33.246334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 286/540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:32 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1323 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:33.377539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:33.377539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:33.385746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.387049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.387506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.388234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.388689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.389342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.605899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.625691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f860742c-6cb0-4d8c-b89e-ee3a942d3989 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.430355 Nov 02 21:23:33.628196 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 255/541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:33 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:33.645067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:33.645762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:33.651956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.652759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.653791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.654644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.655103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.655600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.675077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.687574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.689090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.690556 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-468bf575-c177-4bca-b978-760db8eba9f4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.321538 Nov 02 21:23:33.691675 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 287/542] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:33 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:33.698426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31c3b32e-3613-473d-9f6a-115f34471a75 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b693731f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:33.748501 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31c3b32e-3613-473d-9f6a-115f34471a75 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.055569 Nov 02 21:23:33.755100 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 288/543] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:33 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:33.760191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:33.761081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:33.767546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.768034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.768548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.769291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.769747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.770173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.868463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.869246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:33.878810 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36ce1744-3afe-498f-a1ed-b8901e6ea0f4 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1279 microversion: 2.1 time: 0.123682 Nov 02 21:23:33.879569 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 289/544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:33 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1279 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:33.900993 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed02e6db-9368-4d1c-85f4-275a22e736d7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.264850 Nov 02 21:23:33.905304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c68567ed-d0b2-447b-a7ec-a2ff416c757b req-5199b72c-925b-4a7c-b67e-2c26238a401d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95785582-f8b6-4b0e-8939-cba2ddb6fe80", "tag": "6e1dd69a-dd9f-47e1-8de2-606043e416cd"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:33.905773 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 256/545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:33 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:33.933421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c68567ed-d0b2-447b-a7ec-a2ff416c757b req-5199b72c-925b-4a7c-b67e-2c26238a401d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:33.933902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c68567ed-d0b2-447b-a7ec-a2ff416c757b req-5199b72c-925b-4a7c-b67e-2c26238a401d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:33.934341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c68567ed-d0b2-447b-a7ec-a2ff416c757b req-5199b72c-925b-4a7c-b67e-2c26238a401d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:33.958095 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c68567ed-d0b2-447b-a7ec-a2ff416c757b req-5199b72c-925b-4a7c-b67e-2c26238a401d service nova] Creating event network-changed:6e1dd69a-dd9f-47e1-8de2-606043e416cd for instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 on n-h1-860863-4 Nov 02 21:23:33.975017 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c68567ed-d0b2-447b-a7ec-a2ff416c757b req-5199b72c-925b-4a7c-b67e-2c26238a401d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094120 Nov 02 21:23:33.977200 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 290/546] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:34.219281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:34.222643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:34.232041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.233329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.237820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:34.237820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.237820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.237820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:34.266424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:34.266424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:34.285671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.286154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.294142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:34.295162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.295860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.296640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:34.406665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:34.420318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:34.420318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:34.444131 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-26589db4-78f6-490c-a228-a05529958695 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.227602 Nov 02 21:23:34.444131 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 257/547] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:34 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:34.651783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:34.652677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:34.660018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.660515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.660970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:34.661677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.664218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.664218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:34.957832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:34.969594 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ded2de31-ec69-4efc-b1e3-b383d0d03e63 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1323 microversion: 2.1 time: 0.710758 Nov 02 21:23:34.971047 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 291/548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:34 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1323 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:34.977527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:34.978436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:34.986886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.987705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.992019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:34.993177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:34.994526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:34.995291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.161691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.170037 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d520c01-d900-4c61-a602-18013ce063d8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.522008 Nov 02 21:23:35.170848 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 258/549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:34 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:35.186321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dfdd87a1-8a7b-4fa0-802a-7d7097cc70fb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b69688c10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:35.257798 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dfdd87a1-8a7b-4fa0-802a-7d7097cc70fb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.086210 Nov 02 21:23:35.263375 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 259/550] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:35 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:35.276262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0830db15-37cb-45db-aaf3-da2a0e33e996 req-a8244e71-b8f3-4162-9299-ab737e427942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527718c-baf8-4607-a25c-3cf3d6d4a540", "name": "network-vif-plugged", "status": "completed", "tag": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:35.287850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0830db15-37cb-45db-aaf3-da2a0e33e996 req-a8244e71-b8f3-4162-9299-ab737e427942 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:35.291878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0830db15-37cb-45db-aaf3-da2a0e33e996 req-a8244e71-b8f3-4162-9299-ab737e427942 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:35.291878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0830db15-37cb-45db-aaf3-da2a0e33e996 req-a8244e71-b8f3-4162-9299-ab737e427942 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.306341 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0830db15-37cb-45db-aaf3-da2a0e33e996 req-a8244e71-b8f3-4162-9299-ab737e427942 service nova] Creating event network-vif-plugged:0bb6edec-16b6-4bc9-93e6-f0f2955f0528 for instance d527718c-baf8-4607-a25c-3cf3d6d4a540 on n-h1-860863-4 Nov 02 21:23:35.312510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0830db15-37cb-45db-aaf3-da2a0e33e996 req-a8244e71-b8f3-4162-9299-ab737e427942 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050597 Nov 02 21:23:35.315109 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 260/551] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:35.320412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:35.320412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:35.329532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:35.330307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:35.331258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.332336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:35.333027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:35.333674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.513211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.530596 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-282d4ca2-bb79-4b8f-ae22-edc631823837 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1277 microversion: 2.1 time: 0.214044 Nov 02 21:23:35.532368 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 261/552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:35 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:35.536840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:35.543066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:35.544542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:35.545402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:35.545545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.546204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:35.546660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:35.547094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.550375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.559935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.570860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.572371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e4603f4-c05b-4eff-951b-321f426d2651 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.600194 Nov 02 21:23:35.573155 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 292/553] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:34 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:35.589885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:35.590998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:35.597768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:35.598532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:35.599208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.600235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:35.600957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:35.601611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:35.706712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.720407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.724102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.750527 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-502a7bfa-e0ba-4d87-af2e-1c0541d117cc tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.175730 Nov 02 21:23:35.752304 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 293/554] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:35 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:35.850152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:35.862018 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9cf90f8e-0a3d-4d33-9c78-75e4619cf82d tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.328830 Nov 02 21:23:35.862895 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 262/555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:35 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:35.997931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:35.998940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:36.013500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.014692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.015603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.016577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.017281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.017984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.029257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-42ce42fc-8fc8-4baf-b021-57fc44d092d8 req-23289af4-1143-42dc-941f-f04170cf33bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f433e0da-82f2-4c39-8781-c6375f1935f7", "tag": "200a9aba-f221-4300-8c9f-084a2f912ab8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:36.037579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-42ce42fc-8fc8-4baf-b021-57fc44d092d8 req-23289af4-1143-42dc-941f-f04170cf33bf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.038337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-42ce42fc-8fc8-4baf-b021-57fc44d092d8 req-23289af4-1143-42dc-941f-f04170cf33bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.038974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-42ce42fc-8fc8-4baf-b021-57fc44d092d8 req-23289af4-1143-42dc-941f-f04170cf33bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.054525 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-42ce42fc-8fc8-4baf-b021-57fc44d092d8 req-23289af4-1143-42dc-941f-f04170cf33bf service nova] Creating event network-changed:200a9aba-f221-4300-8c9f-084a2f912ab8 for instance f433e0da-82f2-4c39-8781-c6375f1935f7 on n-h1-860863-4 Nov 02 21:23:36.064267 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-42ce42fc-8fc8-4baf-b021-57fc44d092d8 req-23289af4-1143-42dc-941f-f04170cf33bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041527 Nov 02 21:23:36.065826 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 263/556] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:36.196962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:36.204447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:36.210889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.211388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.211990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.212679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.213160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.213584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.224621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:36.237565 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3eae0305-dd82-4455-bea9-eca16ff8b5ac tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1323 microversion: 2.1 time: 0.246961 Nov 02 21:23:36.238706 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 294/557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:35 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:36.281653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8385d021-3518-4a20-ab86-ad7a46958279 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b693c7dc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:36.339229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8385d021-3518-4a20-ab86-ad7a46958279 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.065330 Nov 02 21:23:36.348526 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 295/558] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:36 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:36.525583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:36.537517 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31e5e8ec-b7a7-470a-8ecf-a9a1968ea8bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.343431 Nov 02 21:23:36.551311 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 264/559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:36 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:36.559740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:36.561047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:36.567789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.568465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.569208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.570301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.570908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.571579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.599423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:36.600185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:36.610663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.616420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.616420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.616420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.616420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.619507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.774938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:36.951718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:36.958623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:36.968388 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9124ed17-362a-456e-9c24-acc797adb984 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.412994 Nov 02 21:23:36.969363 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 296/560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:36 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:36.975963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:36.979162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:36.981645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:36.983323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:36.984620 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-310b61e0-5342-409f-a87d-eead4ab9ac2a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.390847 Nov 02 21:23:36.988202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.991390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.991390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.991390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:36.991390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:36.991765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:36.992858 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 265/561] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:36 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:23:36.998801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:36.999411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:37.022595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:37.023766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:37.023766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:37.025866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:37.025866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:37.025866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:37.138582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:37.153572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:37.155526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:37.172908 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85f69ccc-9388-4bff-a44d-3d31ee3560c5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.200860 Nov 02 21:23:37.175984 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 297/562] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:36 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:37.265560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:37.266419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:37.277754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:37.278481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:37.279095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:37.280008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:37.280638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:37.281334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:37.448385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:37.461125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:37.470411 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d380bb53-138d-47ff-9354-32d4c6a42466 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.476334 Nov 02 21:23:37.482508 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 266/563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:36 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:37.502985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2bdce777-8e91-4371-a94f-81975737be93 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b696ed1f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:37.555034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2bdce777-8e91-4371-a94f-81975737be93 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.070762 Nov 02 21:23:37.564801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 267/564] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:37 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:37.570777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:37.571789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:37.584282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:37.588493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:37.592122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:37.593618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:37.596653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:37.598594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.083252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.086294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.117673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-249f99a9-1be6-4585-a302-d20b196b91be tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.547305 Nov 02 21:23:38.118786 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b9556d6-0e38-4565-9c45-f41c97adeda5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1323 microversion: 2.1 time: 0.851063 Nov 02 21:23:38.119641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 298/565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:37 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1323 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:38.120132 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 268/566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:37 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:38.146413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:38.146553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:38.147237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:38.152904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:38.163068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.163881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.170593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.170593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.170593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.170593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.171011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.171011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.171011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.172192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.173838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.174366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.652465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.661838 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2b6d312e-cf5b-4ba9-9f9e-4e1d9ad4860b tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.536784 Nov 02 21:23:38.663388 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 269/567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:38 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:38.676552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.685828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.687537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:38.688261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:38.688533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.690130 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d99b5693-383c-4c0f-ba83-fcaa36efc58a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.560743 Nov 02 21:23:38.704955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 299/568] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:38 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:38.707928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.709180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.710297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.711551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-18bcde3c-4449-4753-adb4-064e422e3047 req-9c0be034-f136-47c3-b68c-f59780bd638a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c", "name": "network-vif-plugged", "status": "completed", "tag": "36a0c8c0-c3de-4d14-b2dd-eae7a6b9caeb"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:38.713159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.713866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.716508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.721696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-18bcde3c-4449-4753-adb4-064e422e3047 req-9c0be034-f136-47c3-b68c-f59780bd638a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.722177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-18bcde3c-4449-4753-adb4-064e422e3047 req-9c0be034-f136-47c3-b68c-f59780bd638a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.722607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-18bcde3c-4449-4753-adb4-064e422e3047 req-9c0be034-f136-47c3-b68c-f59780bd638a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.735641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-18bcde3c-4449-4753-adb4-064e422e3047 req-9c0be034-f136-47c3-b68c-f59780bd638a service nova] Creating event network-vif-plugged:36a0c8c0-c3de-4d14-b2dd-eae7a6b9caeb for instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c on n-h2-860863-4 Nov 02 21:23:38.740751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-18bcde3c-4449-4753-adb4-064e422e3047 req-9c0be034-f136-47c3-b68c-f59780bd638a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033853 Nov 02 21:23:38.744298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 300/569] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:38.747647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:38.748362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:38.754995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.755487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.755929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.756625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:38.757107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:38.757532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:38.800226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.826269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.828222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:38.835413 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2b1580b6-226f-4a0a-8660-991a7f4ecb3a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.158270 Nov 02 21:23:38.871274 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 270/570] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:38 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:38.888229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1abede54-aa65-4798-a601-bfbb330401ba tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b69589a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:38.986983 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1abede54-aa65-4798-a601-bfbb330401ba tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.113628 Nov 02 21:23:38.987580 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 271/571] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:38 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:39.075961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:39.103198 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1febec0b-f20f-4f35-9889-850064777312 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.360184 Nov 02 21:23:39.117270 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 301/572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:38 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:39.142316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:39.143427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:39.145867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:39.151993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:39.152126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:39.152126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:39.152126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:39.152522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:39.153422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:39.154051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:39.155785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:39.156450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:39.157138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:39.161410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:39.161837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:39.162275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:39.491756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:39.507043 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5dd6eb3a-7339-4d46-9237-5d4aea1126bd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1314 microversion: 2.1 time: 0.369222 Nov 02 21:23:39.520964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 272/573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:39 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:39.520964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-3faeb95f-cb4d-42cb-a342-1c1cb3f3596b req-bddb9b5b-66ce-4ccd-ae42-0d351e1d1ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa833686-7d75-43c2-bf17-b189332492a6", "tag": "d5b21e69-6648-467d-80d8-aeca79a25cd4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:39.532530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:39.533247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3faeb95f-cb4d-42cb-a342-1c1cb3f3596b req-bddb9b5b-66ce-4ccd-ae42-0d351e1d1ad4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:39.533735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3faeb95f-cb4d-42cb-a342-1c1cb3f3596b req-bddb9b5b-66ce-4ccd-ae42-0d351e1d1ad4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:39.534479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3faeb95f-cb4d-42cb-a342-1c1cb3f3596b req-bddb9b5b-66ce-4ccd-ae42-0d351e1d1ad4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:39.540303 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9da40fa7-d3b3-462f-9985-b18216205396 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1519 microversion: 2.1 time: 0.398406 Nov 02 21:23:39.549796 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-3faeb95f-cb4d-42cb-a342-1c1cb3f3596b req-bddb9b5b-66ce-4ccd-ae42-0d351e1d1ad4 service nova] Creating event network-changed:d5b21e69-6648-467d-80d8-aeca79a25cd4 for instance fa833686-7d75-43c2-bf17-b189332492a6 on n-h2-860863-4 Nov 02 21:23:39.555915 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-3faeb95f-cb4d-42cb-a342-1c1cb3f3596b req-bddb9b5b-66ce-4ccd-ae42-0d351e1d1ad4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044619 Nov 02 21:23:39.560885 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 273/574] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:39.562330 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 302/575] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:39 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1519 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:39.570322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-357b6dbf-adc3-4427-a353-3d2955016e8d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'create', calling method: .version_select at 0x7f9b69688ca0>, body: {"pool": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:39.687569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:39.688560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:39.695436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:39.696338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:39.697068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:39.698895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:39.699613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:39.700263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:39.942276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:39.973843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=29 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:40.146813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:40.155953 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f20c1b4-1203-4a29-bb60-3add6bed5a15 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.472437 Nov 02 21:23:40.157085 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 303/576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:39 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:40.162724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:40.163331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:40.170406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:40.171460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:40.172123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:40.173111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:40.173889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:40.174535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:40.581384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:40.604369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:40.611397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:40.613863 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc19d600-7058-495a-922f-b174dfd7c9d1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.454459 Nov 02 21:23:40.615501 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 304/577] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:40 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:40.622459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:40.623284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:40.630865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:40.632102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:40.632525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:40.633517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:40.634227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:40.634857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:40.810646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:40.825675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:40.828806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:40.835174 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f94d7f63-15fe-4119-9967-3b75f3c66c86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.217850 Nov 02 21:23:40.857454 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 305/578] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:40 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:40.865969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55f848a9-bece-49b2-8cde-4d8977f8996a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6954e790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:40.950996 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55f848a9-bece-49b2-8cde-4d8977f8996a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.096068 Nov 02 21:23:40.952990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 306/579] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:40 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:40.960336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:40.961869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:40.975862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:40.975862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:40.980265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:40.980265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:40.980265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:40.980265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:41.001078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:41.135182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=18 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:41.548166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:41.556423 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0b9194c-8d9f-492a-bdf3-9a1547550e01 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.600539 Nov 02 21:23:41.574092 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 307/580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:40 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:41.579304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:41.580011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:41.586794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:41.587572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:41.588104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:41.589535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:41.590731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:41.591184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:41.734375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:41.742631 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d810823-c05c-4feb-9ef0-d07ca9d9eb5c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1463 microversion: 2.1 time: 0.167195 Nov 02 21:23:41.743228 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 308/581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:41 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:41.747866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7643eff5-4e2c-48bc-a394-1147846a3f7e req-ff5eea7a-faf2-4bd8-9a20-aa2741891433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95785582-f8b6-4b0e-8939-cba2ddb6fe80", "name": "network-vif-plugged", "status": "completed", "tag": "6e1dd69a-dd9f-47e1-8de2-606043e416cd"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:41.756790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7643eff5-4e2c-48bc-a394-1147846a3f7e req-ff5eea7a-faf2-4bd8-9a20-aa2741891433 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:41.757327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7643eff5-4e2c-48bc-a394-1147846a3f7e req-ff5eea7a-faf2-4bd8-9a20-aa2741891433 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:41.757768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7643eff5-4e2c-48bc-a394-1147846a3f7e req-ff5eea7a-faf2-4bd8-9a20-aa2741891433 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:41.772804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7643eff5-4e2c-48bc-a394-1147846a3f7e req-ff5eea7a-faf2-4bd8-9a20-aa2741891433 service nova] Creating event network-vif-plugged:6e1dd69a-dd9f-47e1-8de2-606043e416cd for instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 on n-h1-860863-4 Nov 02 21:23:41.778515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7643eff5-4e2c-48bc-a394-1147846a3f7e req-ff5eea7a-faf2-4bd8-9a20-aa2741891433 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Nov 02 21:23:41.779668 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 309/582] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:41.784052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:41.784749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:41.791282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:41.791865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:41.792300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:41.793722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:41.793722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:41.794039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.036749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:42.046051 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c95ce6df-8dec-4b05-942d-d2431c9b08b1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.265574 Nov 02 21:23:42.057203 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 310/583] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:41 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:42.057203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:42.057203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:42.059193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.063919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.063919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.063919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.063919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.064559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.272011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:42.283968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:42.286080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:42.288481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8c903a0f-2b3c-4776-b751-774518626fdc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1362 microversion: 2.25 time: 0.239842 Nov 02 21:23:42.288481 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 311/584] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:42 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:42.450723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:42.457876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Searching by: {'deleted': False, 'project_id': '72c4934caf8e490ea42879f4810b2f5c'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:42.474746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.475238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.475678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.476590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.477078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.484006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.637298 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f8ffdc0-4da7-4b49-90a3-c5a87aded954 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.330850 Nov 02 21:23:42.637298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 312/585] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:23:42 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:23:42.644464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:42.648679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:42.655367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.656036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.657039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.657548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.658775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.658775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.780246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:42.783366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:42.784851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:42.789784 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ac78e68-e6a0-4aef-938b-5e349fb4110c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.158771 Nov 02 21:23:42.790341 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 313/586] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:42 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:42.802646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26a9ad3a-0835-422f-a4e8-a86b259b35eb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6931edc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:42.847574 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26a9ad3a-0835-422f-a4e8-a86b259b35eb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1414 microversion: 2.1 time: 0.056216 Nov 02 21:23:42.848149 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 314/587] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:42 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:42.852591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:42.853223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:42.859985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.860890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.861046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:42.861691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:42.862493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:42.862613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.239533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:43.248396 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b492c896-c968-4d45-ad75-4027bbc7d3b7 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.399235 Nov 02 21:23:43.261211 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 315/588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:42 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:43.261211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:43.261584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Searching by: {'deleted': False} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:43.266350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:43.266758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:43.267210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.267919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:43.268363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:43.268786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.383180 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-357b6dbf-adc3-4427-a353-3d2955016e8d tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.819837 Nov 02 21:23:43.385407 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 274/589] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:23:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:43.390598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:23:43.394202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:43.395220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:43.406721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:43.409464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:43.409464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.410153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:43.411139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:43.411668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.531314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:43.531963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:43.532417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.643585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:43.651286 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-334a4cbd-86aa-4fab-8856-2fd9342a04fd tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.263069 Nov 02 21:23:43.652294 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 275/590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:43 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:43.656661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:43.657284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:43.662954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:43.663432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:43.663863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.664916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:43.665060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:43.665900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:43.843330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:43.851934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:43.853393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:43.855193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b4532647-2a9d-48c1-b019-b4252dc52fdb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1557 microversion: 2.25 time: 0.201685 Nov 02 21:23:43.855812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 276/591] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:43 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:43.860338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-878576556", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "2e122478-3983-4b35-aafd-de2f1ae7dd60"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:43.913873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] validate_networks() for [('2e122478-3983-4b35-aafd-de2f1ae7dd60', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:44.133717 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2392207-8c71-4636-a8aa-992b15ed9ebb tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15794 microversion: 2.1 time: 0.883126 Nov 02 21:23:44.134339 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 316/592] 10.222.0.25 () {58 vars in 1171 bytes} [Wed Nov 2 21:23:43 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15794 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:23:44.139449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.140120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:44.143099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:44.146545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.147030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.147470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.148235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.148611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.149152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.229063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:44.237444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:44.238987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:44.244162 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03e4f62a-f582-4092-bcff-760a03df8908 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.108863 Nov 02 21:23:44.244733 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 317/593] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:44.250018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85c7838c-b882-41b4-a31d-f9a98bd7fd5f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6931e0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.295330 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85c7838c-b882-41b4-a31d-f9a98bd7fd5f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1423 microversion: 2.1 time: 0.049506 Nov 02 21:23:44.296036 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 318/594] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1423 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:44.399119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:44.400139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:44.400808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:44.401900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:44.402417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:44.404055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.404959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:44.410951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.411432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.411877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.412570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.416405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.416514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.416624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.416720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.416832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.416832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.416832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.416832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.433426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Getting quotas for project 474e60f37a8d4b8694acb88ffc736368. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:44.443095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Getting quotas for user 00fce7be56a04270b9d8adf4285bb85f and project 474e60f37a8d4b8694acb88ffc736368. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:44.455695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:44.458015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:44.552431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid 95785582-f8b6-4b0e-8939-cba2ddb6fe80 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:44.565816 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e18dbb10-8e66-483e-b9c9-219d8541c439 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 2050 microversion: 2.25 time: 0.268749 Nov 02 21:23:44.566432 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 319/595] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 2050 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:44.570815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.575810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Searching by: {'deleted': False, 'project_id': '72c4934caf8e490ea42879f4810b2f5c'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:44.587727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.587727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.587727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.587727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.588101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.588101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.616841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b338cf90-1939-4956-bc2e-a8bd42fd731a tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758284 Nov 02 21:23:44.624495 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 277/596] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:23:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:23:44.624495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.624495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:44.630565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:44.632523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.633301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.633857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.634690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.635291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.636361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.786900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c97dae84-b55d-4a6c-a0e9-62df9571221d tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?tenant_id=ad41afe8a2f04aee958c00322937c074" status: 200 len: 15 microversion: 2.1 time: 0.219413 Nov 02 21:23:44.787470 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 320/597] 10.222.0.25 () {58 vars in 1231 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/servers/detail?tenant_id=ad41afe8a2f04aee958c00322937c074 => generated 15 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:23:44.805238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab69ac39-4045-4d81-b2f7-fca7a88aee9d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b69aec670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.833147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:44.845100 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-926c3a64-ae68-4e19-a79f-f4bcea553b70 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.225854 Nov 02 21:23:44.845677 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 278/598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:44.851083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1cfd28d9-d234-46fb-afdd-5127ec93a666 req-728f1b0e-aa9c-48e2-bfcb-abb715920905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f433e0da-82f2-4c39-8781-c6375f1935f7", "name": "network-vif-plugged", "status": "completed", "tag": "200a9aba-f221-4300-8c9f-084a2f912ab8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:44.856234 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab69ac39-4045-4d81-b2f7-fca7a88aee9d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 200 len: 1423 microversion: 2.1 time: 0.067611 Nov 02 21:23:44.864985 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 321/599] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:44.864985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.864985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:44.870288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.871116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.871253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1cfd28d9-d234-46fb-afdd-5127ec93a666 req-728f1b0e-aa9c-48e2-bfcb-abb715920905 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.871592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.871725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1cfd28d9-d234-46fb-afdd-5127ec93a666 req-728f1b0e-aa9c-48e2-bfcb-abb715920905 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.872039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1cfd28d9-d234-46fb-afdd-5127ec93a666 req-728f1b0e-aa9c-48e2-bfcb-abb715920905 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.872287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:44.872744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:44.873200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:44.884805 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1cfd28d9-d234-46fb-afdd-5127ec93a666 req-728f1b0e-aa9c-48e2-bfcb-abb715920905 service nova] Creating event network-vif-plugged:200a9aba-f221-4300-8c9f-084a2f912ab8 for instance f433e0da-82f2-4c39-8781-c6375f1935f7 on n-h1-860863-4 Nov 02 21:23:44.890969 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1cfd28d9-d234-46fb-afdd-5127ec93a666 req-728f1b0e-aa9c-48e2-bfcb-abb715920905 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043916 Nov 02 21:23:44.892512 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 279/600] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:44.905664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff0af7d7-81f5-43a5-9f78-c3f751e5d323 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:44.905926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff0af7d7-81f5-43a5-9f78-c3f751e5d323 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:44.994025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff0af7d7-81f5-43a5-9f78-c3f751e5d323 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:45.002423 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff0af7d7-81f5-43a5-9f78-c3f751e5d323 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1223 microversion: 2.1 time: 0.108498 Nov 02 21:23:45.003241 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 280/601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:45.008162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:45.008766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:45.015836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.016571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.017190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.018098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.018769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.019347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.127624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid 95785582-f8b6-4b0e-8939-cba2ddb6fe80 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:45.143732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ebf87d7c-4280-47d4-ab5a-500cab27b34d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 2050 microversion: 2.25 time: 0.283930 Nov 02 21:23:45.153009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 322/602] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:44 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 2050 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:45.153009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:45.156884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Searching by: {'tenant_id': 'ad41afe8a2f04aee958c00322937c074', 'deleted': False} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:45.168032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.168734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.169285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.170121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.170653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.171081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.195192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:45.200867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:23:45.203842 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7ffd6265-f17d-4ad4-bff6-1a6a8e987d9f tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.199373 Nov 02 21:23:45.204555 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 281/603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:45 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:45.210410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15b1a906-36ac-4b32-9fd8-dd997e362e1e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b696ed040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:45.279347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.279827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.280259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.406104 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c6de5ed9-8963-4aab-9c3c-afdac6f3eb14 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ad41afe8a2f04aee958c00322937c074" status: 200 len: 4824 microversion: 2.1 time: 0.259965 Nov 02 21:23:45.407003 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 323/604] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 21:23:45 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ad41afe8a2f04aee958c00322937c074 => generated 4824 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:45.416364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:45.420186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.420675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.421148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.421941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.422401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.422836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.446808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-613b637f-0d7d-484f-9185-352b531095b6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033991 Nov 02 21:23:45.447486 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 324/605] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 21:23:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:23:45.453415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:45.458873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:45.465094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.466367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.469504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.470437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.470914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.471354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.540780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:45.550684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:45.550684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:45.555728 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-024e8fa6-27c4-4bbc-9530-cbbffaac306f tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.107208 Nov 02 21:23:45.556484 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 325/606] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:45 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:45.560726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:45.566542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Searching by: {'tenant_id': '72c4934caf8e490ea42879f4810b2f5c', 'deleted': False} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:45.571301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.572123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.572446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.573751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.574204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.574622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.604659 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-535c688d-98c1-4ae6-a95f-d6c11268d114 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72c4934caf8e490ea42879f4810b2f5c" status: 200 len: 15 microversion: 2.1 time: 0.046928 Nov 02 21:23:45.605582 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 326/607] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 21:23:45 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=72c4934caf8e490ea42879f4810b2f5c => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:23:45.610265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": "auto"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:45.612738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:45.619836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.621057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.623958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.623958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:45.623958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:45.623958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:45.699008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'flavor' on Instance uuid 95785582-f8b6-4b0e-8939-cba2ddb6fe80 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:45.712390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121040) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:23:45.737335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:46.244574 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15b1a906-36ac-4b32-9fd8-dd997e362e1e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 204 len: 0 microversion: 2.1 time: 1.038755 Nov 02 21:23:46.249222 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 282/608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:45 2022] DELETE /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:23:46.250608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc13518f-ef4f-455f-b7e4-869319d27300 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:46.256024 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc13518f-ef4f-455f-b7e4-869319d27300 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008730 Nov 02 21:23:46.256802 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 283/609] 10.222.0.25 () {58 vars in 1189 bytes} [Wed Nov 2 21:23:46 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:23:46.261326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:46.262181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:46.268771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.269470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.270215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.271072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.271847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.272284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.417762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:46.426298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36d05707-a349-465b-bad5-b9e8a8cf2ad1 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1322 microversion: 2.1 time: 0.168476 Nov 02 21:23:46.427045 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 284/610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:46 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:46.435677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:46.436470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:46.443534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.444827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.446380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.447217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.447882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.449329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.532744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:46.540385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4a9de450-fdaf-419c-bec0-a2bd4cb37a22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1275 microversion: 2.1 time: 0.110088 Nov 02 21:23:46.541724 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 285/611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:46 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:46.546717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:46.547506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:46.554709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.555200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.555634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.556326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.556806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.557261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.692973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:46.701345 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-17095712-b538-459d-a35c-71a3d56a241d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.158520 Nov 02 21:23:46.701922 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 286/612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:46 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:46.706331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:46.706837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:46.712540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.713060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.713501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.714703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:46.715161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:46.715605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:46.742383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:23:47.031552 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b34db5c4-7ebb-40c0-ad39-01edfc296e48 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 204 len: 0 microversion: 2.1 time: 0.322819 Nov 02 21:23:47.037591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 287/613] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:23:46 2022] DELETE /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:23:47.059352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:47.061851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:47.071095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:47.071817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:47.072257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:47.073279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:47.073739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:47.074157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:47.286321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:47.434572 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-daf63f69-2044-4455-a944-df207c717173 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action" status: 202 len: 0 microversion: 2.1 time: 0.395472 Nov 02 21:23:47.435215 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 288/614] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:47 2022] POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:47.443074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:47.443689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:47.450425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:47.450915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:47.451354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:47.452052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:47.453095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:47.453459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:47.561470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:47.571487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:47.573009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:47.580738 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3441e85-cfe1-41f1-a17d-eaea5619aed4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.141453 Nov 02 21:23:47.581378 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 289/615] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:47 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:47.587023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1890957734", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fbb32731-3286-4309-9c0c-b898bc17a336"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:47.670965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] validate_networks() for [('fbb32731-3286-4309-9c0c-b898bc17a336', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:48.465268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:48.465768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:48.466140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:48.466569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:48.466973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:48.476519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:48.477037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:48.477470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:48.478183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:48.478816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:48.479287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:48.497156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:48.502107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for user 9ab2a1f2b5b74571b08c97e9493d568d and project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:48.514842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:48.517167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:48.659156 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fceae52f-716e-4006-b431-17ea390b92d7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076483 Nov 02 21:23:48.660046 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 290/616] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:23:48.664947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:48.671529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:48.672350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ad41afe8a2f04aee958c00322937c074'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:48.695527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:48.696005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:48.696609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:48.697357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:48.697797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:48.699042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:48.809135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:23:48.921063 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-764a00fd-ab24-4542-b46a-6ebab016e9da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.259622 Nov 02 21:23:48.921647 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 291/617] 10.222.0.25 () {58 vars in 1150 bytes} [Wed Nov 2 21:23:48 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:48.926287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:48.926892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:48.933897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:48.934397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:48.935877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:48.935877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:48.936213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:48.937262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:49.158533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:49.167101 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb8bf145-4077-42d4-963f-19c0c5c595b6 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1472 microversion: 2.1 time: 0.243973 Nov 02 21:23:49.167897 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 292/618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:48 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:49.172648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:49.173277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:49.181596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:49.182101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:49.183101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:49.183785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:49.184235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:49.184735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:49.472101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:49.480286 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-394d3161-7375-4f20-ad67-4614c6fdb924 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.311046 Nov 02 21:23:49.493536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 293/619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:49 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:49.503887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:49.504796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:49.512605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:49.513409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:49.514497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:49.515902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:49.516543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:49.517213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:49.769728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:49.778701 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-001dd9b7-c9b2-4b6c-9776-62d5bde71ee7 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.283702 Nov 02 21:23:49.779211 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 294/620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:49 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:49.797467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f65d240d-b742-4ba1-a539-457b2fedfa03 req-d0411e75-615c-4cb0-a547-58336f23e009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa833686-7d75-43c2-bf17-b189332492a6", "name": "network-vif-plugged", "status": "completed", "tag": "d5b21e69-6648-467d-80d8-aeca79a25cd4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:49.809430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f65d240d-b742-4ba1-a539-457b2fedfa03 req-d0411e75-615c-4cb0-a547-58336f23e009 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:49.810165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f65d240d-b742-4ba1-a539-457b2fedfa03 req-d0411e75-615c-4cb0-a547-58336f23e009 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:49.810601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f65d240d-b742-4ba1-a539-457b2fedfa03 req-d0411e75-615c-4cb0-a547-58336f23e009 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:49.822887 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f65d240d-b742-4ba1-a539-457b2fedfa03 req-d0411e75-615c-4cb0-a547-58336f23e009 service nova] Creating event network-vif-plugged:d5b21e69-6648-467d-80d8-aeca79a25cd4 for instance fa833686-7d75-43c2-bf17-b189332492a6 on n-h2-860863-4 Nov 02 21:23:49.829510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f65d240d-b742-4ba1-a539-457b2fedfa03 req-d0411e75-615c-4cb0-a547-58336f23e009 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049002 Nov 02 21:23:49.830717 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 295/621] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:49.837030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:49.838525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:49.846607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:49.848186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:49.848186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:49.849117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:49.849735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:49.850328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.018836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:50.027484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:50.029518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:50.035199 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c4666764-ead8-4754-a81b-b22d0bdd9e8a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.203132 Nov 02 21:23:50.036353 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 296/622] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:49 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:50.053954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:50.054638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:50.063443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.064147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.064733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.065652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.066295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.067475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.164252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:50.175946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c975381-2106-4a9a-a979-3e422566a946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1204 microversion: 2.1 time: 0.138242 Nov 02 21:23:50.185024 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 297/623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:50 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1204 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:50.185024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:50.185304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:50.192000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.192589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.193217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.194308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.194785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.195237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.484854 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5070f157-389b-4a92-82ec-044c2596533a tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action" status: 202 len: 0 microversion: 2.1 time: 0.307019 Nov 02 21:23:50.485543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 298/624] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:50 2022] POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:50.550907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-68257e36-03aa-43b6-878f-3108ece7c6bc tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:50.551479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-68257e36-03aa-43b6-878f-3108ece7c6bc tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] [instance: b6c81f7b-09c0-4c29-b41d-b8929267ec06] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:50.556904 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-68257e36-03aa-43b6-878f-3108ece7c6bc tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] HTTP exception thrown: Instance b6c81f7b-09c0-4c29-b41d-b8929267ec06 could not be found. Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-68257e36-03aa-43b6-878f-3108ece7c6bc tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Request method failure captured: Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/b6c81f7b-09c0-4c29-b41d-b8929267ec06/action HTTP/1.1 Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 15 Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt_HP0_cWfWzsUUO-6lzwF95a788Psm82-eFpmLuNs_BflcyowuxM13a6xC3ORmrw1cJkb6EWXubL30Y5a0eWErnDykV5OB-OLQjeT89XGCXDih-0zs31pPuIoQ4ZOBfvDxf5YQiJaHA0i4CtqnNodZTj0bDD23nGjhZ0jUWudqY8G0 Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:23:50.558880 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 37a0b2c0d9954295b8aaca9406d66596 Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: {"migrate": {}} Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:23:50.560307 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b6c81f7b-09c0-4c29-b41d-b8929267ec06 could not be found. Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b6c81f7b-09c0-4c29-b41d-b8929267ec06', 'body': {'migrate': {}}} Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c81f7b-09c0-4c29-b41d-b8929267ec06 could not be found. Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:23:50.561163 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c81f7b-09c0-4c29-b41d-b8929267ec06 could not be found. Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c81f7b-09c0-4c29-b41d-b8929267ec06 could not be found. Nov 02 21:23:50.563406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:23:50.564472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-68257e36-03aa-43b6-878f-3108ece7c6bc tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Returning 404 to user: Instance b6c81f7b-09c0-4c29-b41d-b8929267ec06 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:23:50.564472 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-68257e36-03aa-43b6-878f-3108ece7c6bc tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/b6c81f7b-09c0-4c29-b41d-b8929267ec06/action" status: 404 len: 111 microversion: 2.1 time: 0.073750 Nov 02 21:23:50.564472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 299/625] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:50 2022] POST /compute/v2.1/servers/b6c81f7b-09c0-4c29-b41d-b8929267ec06/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:23:50.565581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a3b2926b-5ed2-4cb9-a0d6-5f698ed01221 req-eaa0957b-542f-4ffb-a9c0-137aa7b6ccd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b0cb2f-8ffb-43e2-bd68-446bc4b05289", "name": "network-vif-deleted", "tag": "7478b817-f107-4757-9d0e-e2c158d60d08"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:50.581743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a3b2926b-5ed2-4cb9-a0d6-5f698ed01221 req-eaa0957b-542f-4ffb-a9c0-137aa7b6ccd1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.582295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a3b2926b-5ed2-4cb9-a0d6-5f698ed01221 req-eaa0957b-542f-4ffb-a9c0-137aa7b6ccd1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.582736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a3b2926b-5ed2-4cb9-a0d6-5f698ed01221 req-eaa0957b-542f-4ffb-a9c0-137aa7b6ccd1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.613886 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a3b2926b-5ed2-4cb9-a0d6-5f698ed01221 req-eaa0957b-542f-4ffb-a9c0-137aa7b6ccd1 service nova] Creating event network-vif-deleted:7478b817-f107-4757-9d0e-e2c158d60d08 for instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 on n-h2-860863-4 Nov 02 21:23:50.619181 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a3b2926b-5ed2-4cb9-a0d6-5f698ed01221 req-eaa0957b-542f-4ffb-a9c0-137aa7b6ccd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057250 Nov 02 21:23:50.619786 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 300/626] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:50.626213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-4263cb0d-8511-42b9-bb22-694d267168ae req-4af03917-f856-4cfc-b454-487e9dea1752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbff37c-15d4-46f4-8eea-845f782b6591", "tag": "b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:50.635536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4263cb0d-8511-42b9-bb22-694d267168ae req-4af03917-f856-4cfc-b454-487e9dea1752 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.636010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4263cb0d-8511-42b9-bb22-694d267168ae req-4af03917-f856-4cfc-b454-487e9dea1752 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.636438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4263cb0d-8511-42b9-bb22-694d267168ae req-4af03917-f856-4cfc-b454-487e9dea1752 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.646741 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-4263cb0d-8511-42b9-bb22-694d267168ae req-4af03917-f856-4cfc-b454-487e9dea1752 service nova] Creating event network-changed:b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f for instance 8fbff37c-15d4-46f4-8eea-845f782b6591 on n-h2-860863-4 Nov 02 21:23:50.651942 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-4263cb0d-8511-42b9-bb22-694d267168ae req-4af03917-f856-4cfc-b454-487e9dea1752 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029139 Nov 02 21:23:50.652504 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 301/627] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:50.657422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:50.658107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:50.664039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.666029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.666029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.666029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.666386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.666528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.687955 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2ffadb7-24f5-46d9-bf0a-cf6cd6d71e0e tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80/action" status: 202 len: 0 microversion: 2.25 time: 5.081263 Nov 02 21:23:50.688888 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 327/628] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:23:45 2022] POST /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80/action => generated 0 bytes in 5083 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:23:50.693595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:50.694482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:50.701597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.702090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.708102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.708102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.708102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.708102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.845760 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d46faed7-52a2-4dae-bf61-77fa07d7708f tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1613 microversion: 2.1 time: 0.191982 Nov 02 21:23:50.846341 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 302/629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:50 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1613 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:50.857767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1114614824", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:50.868408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:50.880170 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e6a006c-de42-419a-8d93-66f94a5220f2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.189956 Nov 02 21:23:50.880745 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 328/630] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:50 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:50.904878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:50.906166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:50.914307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.914637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.915093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.915816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:50.916289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:50.916723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:50.926938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:23:51.364546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:51.373899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:51.375515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:51.377011 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11117944-40b4-4373-a1ee-403dc942b2a0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.494358 Nov 02 21:23:51.377664 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 329/631] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:50 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:51.389059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:51.389059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:51.393264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.393851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.394374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.395185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.395718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.396223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.546776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:51.547222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:51.547658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:51.551654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:51.551654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:51.559447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.560064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.560605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.561861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.562550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.563361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.592598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Getting quotas for project e67258fa3a5247389ddb9ceeedba9076. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:23:51.598765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Getting quotas for user 93744d04892f4736b9458281d1c5ca2a and project e67258fa3a5247389ddb9ceeedba9076. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:23:51.614254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:23:51.616824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:23:51.715977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:51.723935 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9d3a3a4-10e3-46a3-bf37-0d0388f4230e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1319 microversion: 2.1 time: 0.345138 Nov 02 21:23:51.724516 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 330/632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:51 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:51.735319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:51.735864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:51.742798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.743289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.743926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.744662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.746040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.746440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.775831 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-efd732ab-805e-411e-b98e-7f12c75a2ce9 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920811 Nov 02 21:23:51.777809 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 303/633] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:23:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:23:51.787598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:51.788343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:51.796886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.797638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.798358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.799254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.799866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.800492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.930790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:51.949103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:51.952497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:51.961171 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ed45b31-55e9-429d-93a5-f7e1d7daa1a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.181851 Nov 02 21:23:51.961809 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 304/634] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:51 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:51.967502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:51.968117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:51.975069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.976351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.976794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:51.980890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:51.980890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:51.980890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.075767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:52.084987 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-639680e9-b941-4977-bf91-ced69f3d12a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1266 microversion: 2.1 time: 0.122048 Nov 02 21:23:52.085575 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 305/635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:51 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:52.090277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56ef04ea-e99c-4b33-bb0a-208ea0a5ca6b tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:52.090916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-56ef04ea-e99c-4b33-bb0a-208ea0a5ca6b tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:52.189456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-56ef04ea-e99c-4b33-bb0a-208ea0a5ca6b tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:52.196506 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-56ef04ea-e99c-4b33-bb0a-208ea0a5ca6b tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1222 microversion: 2.1 time: 0.109920 Nov 02 21:23:52.197113 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 306/636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:52 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:52.201957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99b757fe-8320-4782-9abb-4d17ab0d6db3 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1613 microversion: 2.1 time: 0.476171 Nov 02 21:23:52.202648 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 331/637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:51 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1613 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:52.209824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-31cce953-34ed-46c1-a58f-a6dbc5794409 req-201a4650-74ec-47a9-83e7-ce26538012af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b0cb2f-8ffb-43e2-bd68-446bc4b05289", "name": "network-vif-unplugged", "status": "completed", "tag": "7478b817-f107-4757-9d0e-e2c158d60d08"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:52.213003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:52.214796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:52.221773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-31cce953-34ed-46c1-a58f-a6dbc5794409 req-201a4650-74ec-47a9-83e7-ce26538012af service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.222521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-31cce953-34ed-46c1-a58f-a6dbc5794409 req-201a4650-74ec-47a9-83e7-ce26538012af service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.222660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.223074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.223186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-31cce953-34ed-46c1-a58f-a6dbc5794409 req-201a4650-74ec-47a9-83e7-ce26538012af service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.223510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.224213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.224812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.225278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.235569 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-31cce953-34ed-46c1-a58f-a6dbc5794409 req-201a4650-74ec-47a9-83e7-ce26538012af service nova] Creating event network-vif-unplugged:7478b817-f107-4757-9d0e-e2c158d60d08 for instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 on n-h2-860863-4 Nov 02 21:23:52.243652 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-31cce953-34ed-46c1-a58f-a6dbc5794409 req-201a4650-74ec-47a9-83e7-ce26538012af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036694 Nov 02 21:23:52.249266 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 307/638] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:52.257135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:52.267117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Searching by: {'host': 'n-h2-860863-4', 'deleted': False} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:52.271330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:52.283452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.283452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.283452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.283452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.283925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.284679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.379252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:23:52.396621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:52.440715 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-672f7a7f-1518-4ecc-a38f-4af73fb91e48 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=n-h2-860863-4&all_tenants=1" status: 200 len: 1655 microversion: 2.1 time: 0.189371 Nov 02 21:23:52.444093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:52.445070 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 308/639] 10.222.0.25 () {58 vars in 1190 bytes} [Wed Nov 2 21:23:52 2022] GET /compute/v2.1/servers?host=n-h2-860863-4&all_tenants=1 => generated 1655 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:52.451704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:52.452439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:52.455276 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6f7ec61-de1b-4cac-aebd-2eb379098736 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.250395 Nov 02 21:23:52.455868 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 332/640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:52 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:52.460965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:52.462182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.463055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.464404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.465717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.466485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.466934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.469517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:23:52.480687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.481412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.481850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.482572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.483022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.483440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.566771 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2f537925-a746-42d5-9b44-e43295f834cd tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.109286 Nov 02 21:23:52.567363 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 333/641] 10.222.0.25 () {58 vars in 1196 bytes} [Wed Nov 2 21:23:52 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:23:52.580825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:52.583115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:52.589493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.589989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.590439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.591150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.591658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.592268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.639877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:52.648838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:52.650616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:52.652474 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ed89699-843e-4968-b722-e93151ea54ec tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.206287 Nov 02 21:23:52.653207 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 309/642] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:52 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:52.748332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:52.749496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:52.756277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.756862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.757471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.758262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.758961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.759492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.911990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2940ba9e-a5ba-4416-8baa-88c2405f01b8 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action" status: 202 len: 0 microversion: 2.1 time: 0.334639 Nov 02 21:23:52.912991 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 334/643] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:52 2022] POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:23:52.921774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:52.924514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:52.935030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.935783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.936284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.939315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:52.939315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:52.939315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:52.964121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:52.982297 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-482d0ba4-ac67-438b-9f57-d3f2838d8abb tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1468 microversion: 2.1 time: 0.238409 Nov 02 21:23:52.984134 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 310/644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:52 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1468 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:52.998208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:52.999107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:53.006299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.006972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.007606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.008442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.009032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.009686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.046972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:23:53.047394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:23:53.047931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:23:53.048581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:23:53.049174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:23:53.353755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:53.360989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.361721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.362326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.363198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.363803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.364383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.385351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:53.393832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b08c6c8f-3e22-4600-a1e6-8d4a02e91719 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action" status: 202 len: 1066 microversion: 2.1 time: 0.476700 Nov 02 21:23:53.394696 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 335/645] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:52 2022] POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action => generated 1066 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 21:23:53.409222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:53.409222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:53.409222 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-352278d7-46dc-4e09-8a3e-f9abf988ca07 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.421082 Nov 02 21:23:53.409490 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 311/646] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:52 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:53.412358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:53.414931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:53.421595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:53.422207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:53.425509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.428452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.428452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.428452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.428452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.428804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.436664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.437274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.437801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.438515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.438941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.439874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.787878 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61127359-e964-4af9-a1bf-f56fa384c537 tempest-DeleteServersAdminTestJSON-1335301120 tempest-DeleteServersAdminTestJSON-1335301120-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6/action" status: 202 len: 0 microversion: 2.1 time: 0.384984 Nov 02 21:23:53.791426 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 336/647] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:23:53 2022] POST /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:23:53.794146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:53.794770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:53.800786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.801476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.801914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.802612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.803349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.803732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.928299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:53.937732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc71df8d-5114-4190-b301-81c7f8d228c2 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1274 microversion: 2.1 time: 0.147936 Nov 02 21:23:53.938701 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 337/648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:53 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:53.943473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:53.944113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:53.950729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.953731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.953731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:53.953731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:53.953731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:53.954524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.165811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.175069 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-56531918-d896-4678-a1e4-788224090ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 0.767001 Nov 02 21:23:54.175812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 312/649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:53 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:54.180720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:54.181534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:54.197382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.199414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.199930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.200708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.201255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.201739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.245051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.250172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:54.255624 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27e6fdbf-f614-498e-8587-a1b5f415ae77 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1470 microversion: 2.1 time: 0.315831 Nov 02 21:23:54.256484 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 338/650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:53 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:54.263195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:54.264201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:54.274613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.275314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.277831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.278820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.279553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.280246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.608432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.616378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b72e2e27-0e70-4a48-97ab-d64a637830c2 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.439270 Nov 02 21:23:54.616975 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 313/651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:54 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:54.639385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:54.640459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:54.646544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.647040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.647483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.648184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.648869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.649512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.685600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.686110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.686560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.687792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lazy-loading 'fault' on Instance uuid fa833686-7d75-43c2-bf17-b189332492a6 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:54.767411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.779263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.798166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.798166 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d00ea160-d668-449c-8a0f-628760ccb1df tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.525741 Nov 02 21:23:54.798166 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 339/652] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:54 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:54.798166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:54.798582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:54.812418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.813288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.813739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.814513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.815176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.815614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.946574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.957237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.959378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:54.967390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-927e314d-6730-4444-8bf4-9906d9f141e4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.181350 Nov 02 21:23:54.967980 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 340/653] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:54 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:54.982799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:54.983636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:54.991394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.991988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.992595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:54.993466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:54.993994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:54.994527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.147285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:55.148188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:55.164691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54cccba3-a841-44be-a1a2-6c3814e5e6c6 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1451 microversion: 2.1 time: 0.533130 Nov 02 21:23:55.177105 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 314/654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:54 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1451 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:55.184172 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4e9eac7-649f-418c-b8a0-19b9415f4e66 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1280 microversion: 2.1 time: 0.194017 Nov 02 21:23:55.184172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 341/655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:54 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:55.190207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:55.190712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:55.196766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.197850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.198934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.200542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.201224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.201663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.204526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:55.205239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:55.212902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.213525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.214671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.215446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.215996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.216917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.230678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:23:55.268947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:55.498028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:55.506489 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-229e53b6-7113-476d-9f24-eac694861b2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 0.306158 Nov 02 21:23:55.507380 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 342/656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:55 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:55.512954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:55.513838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:55.520185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.525820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.526901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.527716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.528251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.528756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.617131 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d23b451-e89c-46bb-9980-3d6a347a4538 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 204 len: 0 microversion: 2.1 time: 0.430614 Nov 02 21:23:55.618552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 315/657] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:23:55 2022] DELETE /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:23:55.625214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0d7e28e6-b9ea-4750-8682-bdf8595652a6 req-20d90a47-a13c-45ba-8655-d8e62ef2b66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a3e5b8-5d0c-4307-960d-4da823a904a2", "tag": "a28dda6b-a1c2-4b33-90e0-80e0ecccf79c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:55.636001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0d7e28e6-b9ea-4750-8682-bdf8595652a6 req-20d90a47-a13c-45ba-8655-d8e62ef2b66b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.637050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0d7e28e6-b9ea-4750-8682-bdf8595652a6 req-20d90a47-a13c-45ba-8655-d8e62ef2b66b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.637297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0d7e28e6-b9ea-4750-8682-bdf8595652a6 req-20d90a47-a13c-45ba-8655-d8e62ef2b66b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.663159 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0d7e28e6-b9ea-4750-8682-bdf8595652a6 req-20d90a47-a13c-45ba-8655-d8e62ef2b66b service nova] Creating event network-changed:a28dda6b-a1c2-4b33-90e0-80e0ecccf79c for instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 on n-h1-860863-4 Nov 02 21:23:55.670686 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0d7e28e6-b9ea-4750-8682-bdf8595652a6 req-20d90a47-a13c-45ba-8655-d8e62ef2b66b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050563 Nov 02 21:23:55.671315 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 316/658] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:55.676408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:55.678592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:55.687154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.688024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.688798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.689683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.693594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.693594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.730326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.731112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.731711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.732381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lazy-loading 'fault' on Instance uuid fa833686-7d75-43c2-bf17-b189332492a6 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:55.787462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:55.796457 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-617ef591-43ca-45c0-9359-830891b6c71c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1470 microversion: 2.1 time: 0.287822 Nov 02 21:23:55.797251 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 343/659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:55 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:55.802578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:55.803573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:55.810223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.811008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.811663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:55.813425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:55.814096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:55.814732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.125848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.133945 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f5fe224-9c18-4992-a86b-4df5c5f4594a tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1457 microversion: 2.1 time: 0.461548 Nov 02 21:23:56.134725 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 317/660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:55 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1457 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:56.153533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:56.154174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:56.161982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.165717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.165717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.165717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.165717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.166126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.215414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.233550 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08061564-cad4-49ce-a86d-625076c68685 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.434940 Nov 02 21:23:56.235109 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 344/661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:55 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:56.240326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:56.241453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:56.249028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.249798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.250573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.251745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.252310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.252883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.657224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.665811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.668233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.674434 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-736c0ef4-fb73-4272-a2bd-02db29d20d16 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.438241 Nov 02 21:23:56.675402 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 345/662] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:56 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:56.684304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:56.685189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:56.691119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.692645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.692645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.692837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.693266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.693852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.796346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.805425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.807145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:56.809638 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f994264-1119-4a54-bf4b-404b4a677233 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.661108 Nov 02 21:23:56.810392 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 318/663] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:56 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:56.818940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:56.819561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:56.826435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.826928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.836681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:56.836681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:56.836681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:56.836681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.118160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.127347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee5c71d1-ef17-45f3-95a1-b500251e67ef tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1322 microversion: 2.1 time: 0.450160 Nov 02 21:23:57.128138 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 346/664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:56 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:57.153115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-00af4288-bb12-4fbc-a0e6-ced87574561f req-78218946-88da-4d0a-8c3b-b43b96e41753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47783fba-5ca0-4f25-a768-9e48565b5ba5", "tag": "1d8083c4-2d9f-45bb-a3fa-93c8cbca7ad8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:57.166740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-00af4288-bb12-4fbc-a0e6-ced87574561f req-78218946-88da-4d0a-8c3b-b43b96e41753 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.168219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-00af4288-bb12-4fbc-a0e6-ced87574561f req-78218946-88da-4d0a-8c3b-b43b96e41753 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.169494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-00af4288-bb12-4fbc-a0e6-ced87574561f req-78218946-88da-4d0a-8c3b-b43b96e41753 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.178610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.186202 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-00af4288-bb12-4fbc-a0e6-ced87574561f req-78218946-88da-4d0a-8c3b-b43b96e41753 service nova] Creating event network-changed:1d8083c4-2d9f-45bb-a3fa-93c8cbca7ad8 for instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 on n-h2-860863-4 Nov 02 21:23:57.189209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bbf0c9d5-6001-4079-9168-6e0e8b1d9cc2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 0.377088 Nov 02 21:23:57.192966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-00af4288-bb12-4fbc-a0e6-ced87574561f req-78218946-88da-4d0a-8c3b-b43b96e41753 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045875 Nov 02 21:23:57.193762 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 347/665] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:57.200766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:57.201839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:57.205598 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 319/666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:56 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:57.212103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:57.212958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.213447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:57.215915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.216951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.217956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.218723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.219317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.233184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.233766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.234721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.235567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.236021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.236493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.280568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.281136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.281681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.282209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lazy-loading 'fault' on Instance uuid fa833686-7d75-43c2-bf17-b189332492a6 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:57.548922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.562273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9364426-7745-48bd-aabb-36bfa7b59d3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1470 microversion: 2.1 time: 0.367092 Nov 02 21:23:57.563427 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 348/667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:57 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:57.568443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:57.571813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:57.582562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.583317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.583812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.587037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.587974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.589194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.589655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.597815 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-abd93e62-483d-4f36-a779-04727149c628 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1457 microversion: 2.1 time: 0.390170 Nov 02 21:23:57.598556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 320/668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:57 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1457 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:57.693567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-42e5f347-0384-4fef-9a6f-ce4ef45e3563 req-aa2155eb-1fbe-4fea-97a1-9be6ad7ae746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95785582-f8b6-4b0e-8939-cba2ddb6fe80", "name": "network-vif-unplugged", "status": "completed", "tag": "6e1dd69a-dd9f-47e1-8de2-606043e416cd"}, {"name": "network-changed", "server_uuid": "95785582-f8b6-4b0e-8939-cba2ddb6fe80", "tag": "6e1dd69a-dd9f-47e1-8de2-606043e416cd"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:57.716135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-42e5f347-0384-4fef-9a6f-ce4ef45e3563 req-aa2155eb-1fbe-4fea-97a1-9be6ad7ae746 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.716627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-42e5f347-0384-4fef-9a6f-ce4ef45e3563 req-aa2155eb-1fbe-4fea-97a1-9be6ad7ae746 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.717095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-42e5f347-0384-4fef-9a6f-ce4ef45e3563 req-aa2155eb-1fbe-4fea-97a1-9be6ad7ae746 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.740738 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-42e5f347-0384-4fef-9a6f-ce4ef45e3563 req-aa2155eb-1fbe-4fea-97a1-9be6ad7ae746 service nova] Creating event network-vif-unplugged:6e1dd69a-dd9f-47e1-8de2-606043e416cd for instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 on n-h1-860863-4 Nov 02 21:23:57.741267 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-42e5f347-0384-4fef-9a6f-ce4ef45e3563 req-aa2155eb-1fbe-4fea-97a1-9be6ad7ae746 service nova] Creating event network-changed:6e1dd69a-dd9f-47e1-8de2-606043e416cd for instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 on n-h1-860863-4 Nov 02 21:23:57.753887 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-42e5f347-0384-4fef-9a6f-ce4ef45e3563 req-aa2155eb-1fbe-4fea-97a1-9be6ad7ae746 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.064209 Nov 02 21:23:57.754690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 321/669] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:23:57.761481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:57.762138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:57.789903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.789903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.789903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.789903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.790256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.790256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.859364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.860427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.872027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.874682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:57.881604 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-170b16a5-21cf-4bb6-95c1-99debad57860 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.123767 Nov 02 21:23:57.882412 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 322/670] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:57 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:57.891390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:57.892689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:57.899950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.906346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.907484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.908655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:57.909314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:57.909903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:57.931211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41fbad22-d2cb-42fc-b9c0-fb520271d462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.366538 Nov 02 21:23:57.934595 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 349/671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:57 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:58.097635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:58.110641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:58.112418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:58.114746 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f75d9dce-33b2-49bb-8035-0db7bbdf3d22 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.230303 Nov 02 21:23:58.126328 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 323/672] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:57 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:58.153563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:58.153745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:58.175025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.175537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.175986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.176706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.177382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.177986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.191075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c17505c4-92a0-472c-abb4-cac915adea86 req-7cdac9bc-df37-44cd-9bfa-85b4709b2374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbff37c-15d4-46f4-8eea-845f782b6591", "name": "network-vif-plugged", "status": "completed", "tag": "b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:58.214320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c17505c4-92a0-472c-abb4-cac915adea86 req-7cdac9bc-df37-44cd-9bfa-85b4709b2374 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.214825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c17505c4-92a0-472c-abb4-cac915adea86 req-7cdac9bc-df37-44cd-9bfa-85b4709b2374 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.215274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c17505c4-92a0-472c-abb4-cac915adea86 req-7cdac9bc-df37-44cd-9bfa-85b4709b2374 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.218499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:23:58.239224 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c17505c4-92a0-472c-abb4-cac915adea86 req-7cdac9bc-df37-44cd-9bfa-85b4709b2374 service nova] Creating event network-vif-plugged:b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f for instance 8fbff37c-15d4-46f4-8eea-845f782b6591 on n-h2-860863-4 Nov 02 21:23:58.247852 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c17505c4-92a0-472c-abb4-cac915adea86 req-7cdac9bc-df37-44cd-9bfa-85b4709b2374 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060910 Nov 02 21:23:58.248523 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 324/673] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:58.254731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:58.255718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:58.263345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.263345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.263635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.264228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.264681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.265130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.409473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:58.417278 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-668ae0b7-c7ee-49ed-83c9-f4fa0680f15f tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1322 microversion: 2.1 time: 0.269024 Nov 02 21:23:58.417855 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 350/674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:58 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:58.457915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:58.466334 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4df7c92c-4e89-4074-a29f-c83acfde0beb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 0.216443 Nov 02 21:23:58.466994 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 325/675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:58 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:58.585708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:58.586321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:58.592814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.593320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.593759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.594442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.594892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.595312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.622133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:58.622745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:58.634798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.635385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.636317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.637206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.637775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.638201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.674969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.675450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.675884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.676323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lazy-loading 'fault' on Instance uuid fa833686-7d75-43c2-bf17-b189332492a6 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:58.731385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:58.738991 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69ca73f3-258d-466f-854a-9bf94366eb52 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1415 microversion: 2.1 time: 0.121191 Nov 02 21:23:58.753090 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 326/676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:58 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1415 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:58.805610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:58.814165 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-de8a38d3-2516-441f-ac09-ff5d8f17b9f1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1470 microversion: 2.1 time: 0.232330 Nov 02 21:23:58.814734 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 351/677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:58 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:58.914085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:58.914845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:58.922159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.922712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.923332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.924099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.924554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.925255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.957152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:58.957886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:58.979958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.980372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.980835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:58.981581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:58.982033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:58.982461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.024743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.034344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.036162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.041500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-884b0327-ae3b-44b9-b62c-cbf7f57ec15c tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1560 microversion: 2.91 time: 0.131209 Nov 02 21:23:59.042909 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 327/678] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:58 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1560 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:23:59.144537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:59.145168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:59.151908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.152379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.153274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.153791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.154347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.154663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.345100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.353313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5c90a439-7531-4fdb-93bd-fbafef807369 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.399980 Nov 02 21:23:59.353978 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 352/679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:58 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:59.443381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:59.445917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:59.454965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.455605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.456047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.456744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.457767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.458196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.472757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.481836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.483185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.484356 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a93c30e9-7262-49c8-ad76-39156741529b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.343938 Nov 02 21:23:59.484913 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 328/680] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:23:59 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:23:59.494938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:59.496408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:59.524985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.525482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.525914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.526761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.528017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.528459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.754266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.762440 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb5f64b9-8f87-4379-a91e-b2f5fc8434f8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1322 microversion: 2.1 time: 0.324828 Nov 02 21:23:59.763281 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 353/681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:59 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:23:59.767571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:59.768171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:59.774649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.775142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.775577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.776274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.777011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.777169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.805300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.811539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.812101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.812605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.813147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lazy-loading 'fault' on Instance uuid fa833686-7d75-43c2-bf17-b189332492a6 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:23:59.813911 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dd8afd5d-c811-4b1b-8ff1-7ebb2d16112d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 0.327995 Nov 02 21:23:59.814488 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 329/682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:59 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:23:59.825458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6bfb5476-5721-4057-94d8-4f615067621c req-d085776a-667b-44bd-b9f0-fe4e1da2e70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa833686-7d75-43c2-bf17-b189332492a6", "name": "network-vif-deleted", "tag": "d5b21e69-6648-467d-80d8-aeca79a25cd4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:23:59.829678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6bfb5476-5721-4057-94d8-4f615067621c req-d085776a-667b-44bd-b9f0-fe4e1da2e70d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.830189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6bfb5476-5721-4057-94d8-4f615067621c req-d085776a-667b-44bd-b9f0-fe4e1da2e70d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.830624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6bfb5476-5721-4057-94d8-4f615067621c req-d085776a-667b-44bd-b9f0-fe4e1da2e70d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.842161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6bfb5476-5721-4057-94d8-4f615067621c req-d085776a-667b-44bd-b9f0-fe4e1da2e70d service nova] Creating event network-vif-deleted:d5b21e69-6648-467d-80d8-aeca79a25cd4 for instance fa833686-7d75-43c2-bf17-b189332492a6 on n-h2-860863-4 Nov 02 21:23:59.846918 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6bfb5476-5721-4057-94d8-4f615067621c req-d085776a-667b-44bd-b9f0-fe4e1da2e70d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Nov 02 21:23:59.847510 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 330/683] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:23:59.852582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:23:59.853301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:23:59.859332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.859815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.860248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.860952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:23:59.861405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:23:59.861827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:23:59.876469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7dbeb2292d4ed2bb9e0bab2eed84f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026cb55f30604c5a84c5a0de753c1a58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:23:59.884449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16d972c9-b97e-4bf1-acc6-dfa1e306c0c3 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 200 len: 1309 microversion: 2.1 time: 0.120302 Nov 02 21:23:59.885254 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 354/684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:59 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:00.049820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.059189 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-596d275f-2031-4cb3-b1c6-c5cb7b51e831 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1470 microversion: 2.1 time: 0.210400 Nov 02 21:24:00.060130 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 331/685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:23:59 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:00.077839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:00.078602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:00.084803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.085320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.085797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.086495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.086946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.087423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.186732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.190423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:00.195844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.197394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.203392 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3c88978-6d99-4060-91b8-88f6c969df2b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1560 microversion: 2.91 time: 0.130617 Nov 02 21:24:00.204192 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 355/686] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:00 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1560 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:00.377515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:00.378134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:00.384558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.385105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.386100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.386950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.387433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.387934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.511199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:00.512357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:00.516794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:00.520969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.521484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.522016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.522846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.523554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.524087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.636920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.636920 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-885bf437-b56b-436e-afa3-6f92a9641c68 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1323 microversion: 2.1 time: 0.164804 Nov 02 21:24:00.636920 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 332/687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:00 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:00.667701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.676567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.678152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:00.679313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-494cb26e-cb44-4699-9fe1-84ecb4974fef tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.172968 Nov 02 21:24:00.680121 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 356/688] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:00 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:24:00.786942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:00.787825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:00.794914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.795408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.795842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.796535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.797082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.797806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.837864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:00.842337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:00.848244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.848734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.849195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:00.850532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:00.850984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:00.851409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.007861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.017549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38074c54-c5e3-4c34-bf92-cf79e570b87e tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1322 microversion: 2.1 time: 0.234592 Nov 02 21:24:01.018748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 333/689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:00 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:01.023643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.024258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.031105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.031605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.032049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.032745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.033298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.033739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.044548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.048216 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] HTTP exception thrown: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Request method failure captured: Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 HTTP/1.1 Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-nocwVCmTelM1DsJoQ9ZD-EuzSipsFk_XS0zi1t6HxJP2Eh7RNXaciONAYLU0ElMO_SscFmKwct-EhzelsZH6vnUGdsQaFcSeDImtJNW4ZQGna3aIGBhbUspHoMBM_p2qQkqAOpnWhRe416hYusszZNIji1XlZ5Iwcl6Uco8GT06U Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:01.050212 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: da7dbeb2292d4ed2bb9e0bab2eed84f5 Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.051973 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'fa833686-7d75-43c2-bf17-b189332492a6'} Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:01.052729 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.054267 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.055854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Returning 404 to user: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:01.055854 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c8d4023-c1b9-4ab5-aeee-4fab9d27d79d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 404 len: 111 microversion: 2.1 time: 0.031161 Nov 02 21:24:01.055854 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 334/690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:01 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:01.056111 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fc5d42d-e097-46f2-8c45-24fa5b828049 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 0.219076 Nov 02 21:24:01.064706 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 357/691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:00 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:01.065221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.066021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.071735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.079091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.079091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.079091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.079091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.079447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.088366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] HTTP exception thrown: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.089386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Request method failure captured: Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 HTTP/1.1 Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-nocwVCmTelM1DsJoQ9ZD-EuzSipsFk_XS0zi1t6HxJP2Eh7RNXaciONAYLU0ElMO_SscFmKwct-EhzelsZH6vnUGdsQaFcSeDImtJNW4ZQGna3aIGBhbUspHoMBM_p2qQkqAOpnWhRe416hYusszZNIji1XlZ5Iwcl6Uco8GT06U Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:01.090197 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: da7dbeb2292d4ed2bb9e0bab2eed84f5 Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.091536 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'fa833686-7d75-43c2-bf17-b189332492a6'} Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:01.093122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.095522 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.097163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Returning 404 to user: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:01.098506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.098670 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a2b42c7-1bf8-4c61-9a1a-9c37715a4696 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 404 len: 111 microversion: 2.1 time: 0.030117 Nov 02 21:24:01.098670 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 335/692] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:01 2022] DELETE /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:24:01.098965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.098965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.098965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.099375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.099830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.100048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.100262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.100556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: fa833686-7d75-43c2-bf17-b189332492a6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.107386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.107855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.108301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.109021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.109481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.109915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.124491 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] HTTP exception thrown: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Request method failure captured: Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 HTTP/1.1 Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-nocwVCmTelM1DsJoQ9ZD-EuzSipsFk_XS0zi1t6HxJP2Eh7RNXaciONAYLU0ElMO_SscFmKwct-EhzelsZH6vnUGdsQaFcSeDImtJNW4ZQGna3aIGBhbUspHoMBM_p2qQkqAOpnWhRe416hYusszZNIji1XlZ5Iwcl6Uco8GT06U Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:01.126044 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: da7dbeb2292d4ed2bb9e0bab2eed84f5 Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.127362 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'fa833686-7d75-43c2-bf17-b189332492a6'} Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:01.128095 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. Nov 02 21:24:01.129715 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.131299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Returning 404 to user: Instance fa833686-7d75-43c2-bf17-b189332492a6 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:01.131299 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-545cb937-185f-4fe6-b8b1-113e906ad37e tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6" status: 404 len: 111 microversion: 2.1 time: 0.031249 Nov 02 21:24:01.131299 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 336/693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:01 2022] GET /compute/v2.1/servers/fa833686-7d75-43c2-bf17-b189332492a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:01.136550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.137183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.144085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.144574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.145054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.145760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.146216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.146648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.161346 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] HTTP exception thrown: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Request method failure captured: Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d HTTP/1.1 Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-nocwVCmTelM1DsJoQ9ZD-EuzSipsFk_XS0zi1t6HxJP2Eh7RNXaciONAYLU0ElMO_SscFmKwct-EhzelsZH6vnUGdsQaFcSeDImtJNW4ZQGna3aIGBhbUspHoMBM_p2qQkqAOpnWhRe416hYusszZNIji1XlZ5Iwcl6Uco8GT06U Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:01.162995 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: da7dbeb2292d4ed2bb9e0bab2eed84f5 Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.164314 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '6eb432d5-49aa-4904-b943-057c7a56255d'} Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:01.165064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.166339 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.168136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Returning 404 to user: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:01.168136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-35c0bb6a-ecdf-430f-8911-32e142ad2fa1 tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 404 len: 111 microversion: 2.1 time: 0.032279 Nov 02 21:24:01.168328 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 337/694] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:01 2022] DELETE /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:24:01.173775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.174383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] [instance: 6eb432d5-49aa-4904-b943-057c7a56255d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.180663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.181184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.181625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.183138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.183769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.184199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.201168 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] HTTP exception thrown: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Request method failure captured: Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d HTTP/1.1 Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-nocwVCmTelM1DsJoQ9ZD-EuzSipsFk_XS0zi1t6HxJP2Eh7RNXaciONAYLU0ElMO_SscFmKwct-EhzelsZH6vnUGdsQaFcSeDImtJNW4ZQGna3aIGBhbUspHoMBM_p2qQkqAOpnWhRe416hYusszZNIji1XlZ5Iwcl6Uco8GT06U Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:01.203090 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/026cb55f30604c5a84c5a0de753c1a58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 026cb55f30604c5a84c5a0de753c1a58 Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1627182934 Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: da7dbeb2292d4ed2bb9e0bab2eed84f5 Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersAdminTestJSON-1627182934-project Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.204410 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '6eb432d5-49aa-4904-b943-057c7a56255d'} Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:01.205140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. Nov 02 21:24:01.206280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:01.210105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] Returning 404 to user: Instance 6eb432d5-49aa-4904-b943-057c7a56255d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:01.211198 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f86f2c94-6c30-40e0-83d1-70401cf4f71d tempest-DeleteServersAdminTestJSON-1627182934 tempest-DeleteServersAdminTestJSON-1627182934-project] 10.222.0.25 "GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d" status: 404 len: 111 microversion: 2.1 time: 0.041886 Nov 02 21:24:01.215619 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 338/695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:01 2022] GET /compute/v2.1/servers/6eb432d5-49aa-4904-b943-057c7a56255d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:01.233920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.234536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.242522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.243185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.243675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.244372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.245687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.246562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.279154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.287645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-037c32ff-f356-424e-905e-0456bfa1e0e0 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1470 microversion: 2.1 time: 0.203104 Nov 02 21:24:01.288641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 358/696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:01 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:01.335980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.345448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.346879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.351632 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f972222-a3b0-41de-8116-a076248358d0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1560 microversion: 2.91 time: 0.123745 Nov 02 21:24:01.352184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 339/697] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:01 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1560 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:01.653532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.654281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.660377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.660806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.661272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.661956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.662404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.662826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.705092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.705092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.715894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.716684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.717390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.718349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.719073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.719719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.850290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.860134 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1c54e5f-9f4c-4ac9-a2dc-1a34ed6273b0 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 200 len: 1518 microversion: 2.1 time: 0.211039 Nov 02 21:24:01.865040 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 359/698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:01 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:01.867224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:01.867933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.874934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.875440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.875889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.876682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.877362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.877801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.893990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.910370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:24:01.931901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.938406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:01.939668 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f11e7930-acc5-4929-80f8-55065f83841b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.239767 Nov 02 21:24:01.943365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 340/699] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:01 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:01.965416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'action', calling method: .version_select at 0x7f9b6ac60af0>, body: {"addFloatingIp": {"address": "172.25.1.250"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:01.968176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:01.975017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.979578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.979578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:01.979578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:01.979578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:01.979996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:02.059678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:24:02.061543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquired lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:24:02.193999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=22 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:02.217188 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0a95a9b-7e8f-4d55-9613-a3df2b46882d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 204 len: 0 microversion: 2.1 time: 0.354790 Nov 02 21:24:02.217779 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 360/700] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:01 2022] DELETE /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:02.223393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:02.232376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:02.233408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:02.234102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:02.234544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:02.235250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:02.235700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:02.236127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:02.313334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:02.511040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:02.847517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:02.860012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfa65fd0-7f9f-4af5-a120-a1f771445242 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1322 microversion: 2.1 time: 0.640704 Nov 02 21:24:02.882434 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 361/701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:02 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:02.898188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:02.899149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:02.915225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:02.918242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:02.918242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:02.918242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:02.925096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:02.926665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:03.353281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:03.362006 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf1ab1b9-28de-4f5f-a127-6df8c54b920d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 0.478085 Nov 02 21:24:03.377964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 362/702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:02 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:03.388407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:03.389387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:03.395868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:03.397275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:03.397275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:03.398097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:03.398714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:03.399309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:03.685858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:03.699603 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65c5b435-3136-4562-a554-b8d916c1312d tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1713 microversion: 2.1 time: 0.320062 Nov 02 21:24:03.700695 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 363/703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:03 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1713 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:03.717608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:03.718533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:03.736004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:03.736004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:03.736004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:03.736004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:03.736427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:03.736427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:03.973668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:03.983608 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d516acf-ce3f-435e-a7bf-8c1dffdde8fd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1470 microversion: 2.1 time: 0.281009 Nov 02 21:24:03.984231 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 364/704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:03 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:03.992893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:03.998431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:04.017365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:04.018063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:04.018680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:04.019551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:04.020171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:04.020757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:04.099404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:04.109833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:04.111711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:04.117515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b294b0aa-1c34-4c38-8f44-0aa9006d0430 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.128567 Nov 02 21:24:04.118319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 365/705] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:03 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:04.123345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e11f3ec5-44e4-4169-9114-5212bc3a3dbb req-e08dc955-8258-4d8e-97f2-07c85dea0896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a3e5b8-5d0c-4307-960d-4da823a904a2", "name": "network-vif-plugged", "status": "completed", "tag": "a28dda6b-a1c2-4b33-90e0-80e0ecccf79c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:04.133257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e11f3ec5-44e4-4169-9114-5212bc3a3dbb req-e08dc955-8258-4d8e-97f2-07c85dea0896 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:04.134041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e11f3ec5-44e4-4169-9114-5212bc3a3dbb req-e08dc955-8258-4d8e-97f2-07c85dea0896 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:04.134660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e11f3ec5-44e4-4169-9114-5212bc3a3dbb req-e08dc955-8258-4d8e-97f2-07c85dea0896 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:04.147229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e11f3ec5-44e4-4169-9114-5212bc3a3dbb req-e08dc955-8258-4d8e-97f2-07c85dea0896 service nova] Creating event network-vif-plugged:a28dda6b-a1c2-4b33-90e0-80e0ecccf79c for instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 on n-h1-860863-4 Nov 02 21:24:04.157072 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e11f3ec5-44e4-4169-9114-5212bc3a3dbb req-e08dc955-8258-4d8e-97f2-07c85dea0896 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033759 Nov 02 21:24:04.157072 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 366/706] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:04.168671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:04.172403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:04.188822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:04.199706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:04.202984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:04.202984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:04.202984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:04.202984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:04.619819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:04.630325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:04.643042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:04.645824 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a213ff8-26be-41dc-b85f-cdc582382281 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.490316 Nov 02 21:24:04.646846 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 367/707] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:04 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:04.653949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:04.654741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:04.662703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:04.663494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:04.664096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:04.664988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:04.665783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:04.666501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:04.995572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Building network info cache for instance {{(pid=121039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:24:05.039850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:05.053998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11158c22-f1ec-498c-b3f1-0dad3d6433f3 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1322 microversion: 2.1 time: 0.401536 Nov 02 21:24:05.054762 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 368/708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:04 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:05.073073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:05.085143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:05.110458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:05.115404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:05.116024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:05.120358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:05.123307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:05.126226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:06.328858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:06.339643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6fb376d6-0179-4783-91cd-74be6c2eea8d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1308 microversion: 2.1 time: 1.280380 Nov 02 21:24:06.344339 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 369/709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:05 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1308 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:06.345999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:06.346846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:06.353380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:06.354636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:06.355288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:06.356243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:06.356975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:06.358074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:06.510698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:06.521239 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32372bdd-1b68-4b66-9b9a-f220f4ff5459 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1645 microversion: 2.1 time: 0.179454 Nov 02 21:24:06.524919 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 370/710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:06 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1645 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:06.539630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a2ed3e37-dd2f-417e-8c78-13ff563fc10c req-94f6f489-aba8-4cb3-9d21-cb1e8842c19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527718c-baf8-4607-a25c-3cf3d6d4a540", "tag": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:06.563721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a2ed3e37-dd2f-417e-8c78-13ff563fc10c req-94f6f489-aba8-4cb3-9d21-cb1e8842c19f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:06.564873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a2ed3e37-dd2f-417e-8c78-13ff563fc10c req-94f6f489-aba8-4cb3-9d21-cb1e8842c19f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:06.565856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a2ed3e37-dd2f-417e-8c78-13ff563fc10c req-94f6f489-aba8-4cb3-9d21-cb1e8842c19f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:06.601226 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a2ed3e37-dd2f-417e-8c78-13ff563fc10c req-94f6f489-aba8-4cb3-9d21-cb1e8842c19f service nova] Creating event network-changed:0bb6edec-16b6-4bc9-93e6-f0f2955f0528 for instance d527718c-baf8-4607-a25c-3cf3d6d4a540 on n-h1-860863-4 Nov 02 21:24:06.614710 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a2ed3e37-dd2f-417e-8c78-13ff563fc10c req-94f6f489-aba8-4cb3-9d21-cb1e8842c19f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085327 Nov 02 21:24:06.614710 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 371/711] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:06.618598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:06.621881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:06.629237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:06.629952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:06.630567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:06.631819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:06.632438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:06.633384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:06.663049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:07.210611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:07.219155 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08744518-977a-439f-bca0-0767ec4591d9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1476 microversion: 2.1 time: 0.605532 Nov 02 21:24:07.236082 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 372/712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:06 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1476 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:07.241828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:07.242653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:07.250525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.254474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.254474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.254474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.254474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.256143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.400474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:07.414907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:07.422126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:07.435008 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5427ecb-20f5-4f4f-b142-b2e2108d34a9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.197312 Nov 02 21:24:07.435968 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 373/713] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:07 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:07.440519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:07.441152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:07.468544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.469106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.469543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.470454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.471068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.471647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.562385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Updating instance_info_cache with network_info: [{"id": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528", "address": "fa:16:3e:68:72:e7", "network": {"id": "2e122478-3983-4b35-aafd-de2f1ae7dd60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424755741-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "474e60f37a8d4b8694acb88ffc736368", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0bb6edec-16", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:24:07.574086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Releasing lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:24:07.575977 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-99872023-8f88-45ce-8839-45848146c166 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action" status: 202 len: 0 microversion: 2.1 time: 5.631311 Nov 02 21:24:07.577281 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 341/714] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:01 2022] POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action => generated 0 bytes in 5633 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:24:07.583138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:07.583777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:07.592675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.593533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.594353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.602530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.603434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.605012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.712200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:07.726240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:07.727684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:07.728859 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bed7c60c-0604-4f88-9783-bd56f0dd0471 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.291940 Nov 02 21:24:07.732586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 374/715] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:07 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:07.746304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47783fba-5ca0-4f25-a768-9e48565b5ba5", "name": "network-vif-plugged", "status": "completed", "tag": "1d8083c4-2d9f-45bb-a3fa-93c8cbca7ad8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:07.762649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.763413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.764009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.780669 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] Creating event network-vif-plugged:1d8083c4-2d9f-45bb-a3fa-93c8cbca7ad8 for instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 on n-h2-860863-4 Nov 02 21:24:07.786560 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044410 Nov 02 21:24:07.787667 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 375/716] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:07.792161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:07.793506 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c61487c8-d306-49b9-889e-9f9b16e0df9b req-39e2ce44-8c2c-49fd-a5d9-f3256132e535 service nova] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004687 Nov 02 21:24:07.794313 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 376/717] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 21:24:07 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 21:24:07.799380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:07.802095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:07.806938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.807799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.808433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:07.809745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:07.810421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:07.811780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.115309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:08.130623 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47c788a6-3e01-4628-8eca-d31a66c3a389 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1322 microversion: 2.1 time: 0.552007 Nov 02 21:24:08.131565 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 342/718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:07 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:08.154753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:08.156435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:08.164704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:08.165520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:08.166552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.167811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:08.168427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:08.169057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.203209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:08.210080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:08.210801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:08.211404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.212460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lazy-loading 'fault' on Instance uuid 63f34a0e-b047-45c7-a82c-fbab7419d3d5 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:08.217833 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f8d5bbf-95db-4b9a-8a92-1879235bc9f6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1488 microversion: 2.1 time: 0.421998 Nov 02 21:24:08.223602 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 377/719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:07 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1488 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:08.236346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'action', calling method: .version_select at 0x7f9b6ac61af0>, body: {"addFloatingIp": {"address": "172.25.1.250"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:08.246306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:08.267891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:08.269082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:08.275352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.275352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:08.275352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:08.279716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.311907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5759f947464db980b4dc96a5cd984d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4894dee76f4b36a22065bbc923b04a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:08.325701 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86408560-bf6d-4749-8681-d58a0a7fe715 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 200 len: 1352 microversion: 2.1 time: 0.177755 Nov 02 21:24:08.357182 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 343/720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:08 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 1352 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:08.363900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:08.367366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:08.383019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:08.384787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:08.389216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.390543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:08.394635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:08.395748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:08.404202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:08.450482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "refresh_cache-8fbff37c-15d4-46f4-8eea-845f782b6591" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:24:08.451101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquired lock "refresh_cache-8fbff37c-15d4-46f4-8eea-845f782b6591" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:24:09.133003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:09.141803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e7224b15-4a2a-48bc-9e7b-bccdf7023aab tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1476 microversion: 2.1 time: 0.783171 Nov 02 21:24:09.152954 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 344/721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:08 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1476 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:09.152954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81de42cc-f851-4513-ad9c-e15e56d83e5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:09.158300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81de42cc-f851-4513-ad9c-e15e56d83e5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:09.158300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81de42cc-f851-4513-ad9c-e15e56d83e5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:09.158300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81de42cc-f851-4513-ad9c-e15e56d83e5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:09.286437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81de42cc-f851-4513-ad9c-e15e56d83e5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Going to try to stop instance {{(pid=121039) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:24:09.501383 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81de42cc-f851-4513-ad9c-e15e56d83e5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2/action" status: 202 len: 0 microversion: 2.1 time: 0.357165 Nov 02 21:24:09.503924 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 345/722] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:09 2022] POST /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:09.513149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:09.519369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:09.529461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:09.536237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:09.536423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:09.537135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:09.538553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:09.539390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:09.540840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:10.057512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:10.070261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:10.071831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:10.083256 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9edd824-7068-4c4f-b5f0-70be36ce3bc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.579504 Nov 02 21:24:10.098018 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 346/723] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:09 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:10.111529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-49d97cb9-d2f4-44af-ac63-456912c0f915 req-d22e05fa-03de-4343-a78a-4f70c60d4324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f34a0e-b047-45c7-a82c-fbab7419d3d5", "name": "network-vif-deleted", "tag": "9c70901d-a948-4e16-b493-f688d27c0b9a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:10.123353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-49d97cb9-d2f4-44af-ac63-456912c0f915 req-d22e05fa-03de-4343-a78a-4f70c60d4324 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:10.124117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-49d97cb9-d2f4-44af-ac63-456912c0f915 req-d22e05fa-03de-4343-a78a-4f70c60d4324 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:10.124789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-49d97cb9-d2f4-44af-ac63-456912c0f915 req-d22e05fa-03de-4343-a78a-4f70c60d4324 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:10.141130 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-49d97cb9-d2f4-44af-ac63-456912c0f915 req-d22e05fa-03de-4343-a78a-4f70c60d4324 service nova] Creating event network-vif-deleted:9c70901d-a948-4e16-b493-f688d27c0b9a for instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 on n-h1-860863-4 Nov 02 21:24:10.147466 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-49d97cb9-d2f4-44af-ac63-456912c0f915 req-d22e05fa-03de-4343-a78a-4f70c60d4324 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048064 Nov 02 21:24:10.148647 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 347/724] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:10.155255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:10.156385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:10.165887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:10.166646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:10.167552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:10.168524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:10.169231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:10.169933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:10.616242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:10.624951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:10.626404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:10.627572 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8e296f0-a9f7-4bff-a323-46f04cfde80b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1567 microversion: 2.25 time: 0.477458 Nov 02 21:24:10.628355 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 348/725] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:10 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1567 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:10.646168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:10.646791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:10.665237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:10.668265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:10.669961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:10.672721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:10.675553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:10.676053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:10.949733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:10.962871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cfebe09e-1e44-4c09-bca0-bbaf9ed8bfd5 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1471 microversion: 2.1 time: 0.333688 Nov 02 21:24:10.969706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 349/726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:10 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:10.982197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:10.984079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:11.019767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:11.024577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:11.025179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:11.026633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:11.029459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:11.029993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:11.080209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] HTTP exception thrown: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Request method failure captured: Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 HTTP/1.1 Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9WpbiEZzpMnPxs59g3mToHjocDc3n8baKLetOPkM_KK_Z5lYusHAWBEOduSZ57SQsfmxavACKcJ0ndVAU0EzlKF9VaXkgDH2uRsUF28Lb-Isaq7FosAVBaE7fIpNbTC2r0P_x8K5d5IDb3su0kjjWAR1TOXjQOH-u0IG0Nx3jQB3A Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:11.083851 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7e5759f947464db980b4dc96a5cd984d Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:11.090630 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '63f34a0e-b047-45c7-a82c-fbab7419d3d5'} Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:11.091809 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:11.093054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:11.094389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Returning 404 to user: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:11.094389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2bdc8a8-3ea7-42be-9185-f04f47425431 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 404 len: 111 microversion: 2.1 time: 0.114855 Nov 02 21:24:11.094389 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 350/727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:10 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:11.097233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:11.102087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:11.115774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:11.121686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:11.122171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:11.125333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:11.126277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:11.126602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:11.515924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:11.525378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8397502c-3331-4180-8873-4b390056bf73 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.436854 Nov 02 21:24:11.526040 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 351/728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:11 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:11.535245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:11.542286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:11.558963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:11.560092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:11.560787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:11.561825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:11.562354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:11.565965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:11.899607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:11.925712 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c24293ac-87ff-4e7b-97f3-d0cec9e9173b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1476 microversion: 2.1 time: 0.395591 Nov 02 21:24:11.926485 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 352/729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:11 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:11.938088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-3a20e9b4-6f03-4f5d-8bcc-8ca848eed763 req-ebf1a2ce-cf6c-4d80-8002-8f3cadeefaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e", "name": "network-vif-unplugged", "status": "completed", "tag": "959e5aa8-19e8-427e-86c3-a667021fcc01"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:11.959006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3a20e9b4-6f03-4f5d-8bcc-8ca848eed763 req-ebf1a2ce-cf6c-4d80-8002-8f3cadeefaa6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:11.959908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3a20e9b4-6f03-4f5d-8bcc-8ca848eed763 req-ebf1a2ce-cf6c-4d80-8002-8f3cadeefaa6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:11.967756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3a20e9b4-6f03-4f5d-8bcc-8ca848eed763 req-ebf1a2ce-cf6c-4d80-8002-8f3cadeefaa6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:11.988253 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-3a20e9b4-6f03-4f5d-8bcc-8ca848eed763 req-ebf1a2ce-cf6c-4d80-8002-8f3cadeefaa6 service nova] Creating event network-vif-unplugged:959e5aa8-19e8-427e-86c3-a667021fcc01 for instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e on n-h2-860863-4 Nov 02 21:24:11.997330 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-3a20e9b4-6f03-4f5d-8bcc-8ca848eed763 req-ebf1a2ce-cf6c-4d80-8002-8f3cadeefaa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069762 Nov 02 21:24:12.001982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 353/730] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:12.013376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:12.014298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:12.026631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:12.026631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:12.026631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:12.026631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:12.027353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:12.027353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:12.053034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lazy-loading 'flavor' on Instance uuid 47783fba-5ca0-4f25-a768-9e48565b5ba5 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:12.777509 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-79b727d1-34a6-44cc-b9cb-b87464d5d1a4 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5/action" status: 202 len: 0 microversion: 2.1 time: 0.773537 Nov 02 21:24:12.779887 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 354/731] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:12 2022] POST /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:12.789680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:12.790491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:12.804449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:12.810051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:12.810712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:12.811642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:12.812570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:12.813192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:12.845030 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] HTTP exception thrown: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Request method failure captured: Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 HTTP/1.1 Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9WpbiEZzpMnPxs59g3mToHjocDc3n8baKLetOPkM_KK_Z5lYusHAWBEOduSZ57SQsfmxavACKcJ0ndVAU0EzlKF9VaXkgDH2uRsUF28Lb-Isaq7FosAVBaE7fIpNbTC2r0P_x8K5d5IDb3su0kjjWAR1TOXjQOH-u0IG0Nx3jQB3A Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:12.848556 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7e5759f947464db980b4dc96a5cd984d Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:12.850177 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9c0ab77c-58ce-40d3-9df9-4658e23b6940'} Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:12.851034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:12.852281 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:12.861337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Returning 404 to user: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:12.863657 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a451458b-ec6b-41eb-bc04-fbce11c7a2e2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 404 len: 111 microversion: 2.1 time: 0.082824 Nov 02 21:24:12.864497 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 355/732] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:12 2022] DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:12.880383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:12.884448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:12.898060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:12.898558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:12.901896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:12.912311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:12.913098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:12.914492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:13.075871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:13.086650 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.neutron [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] re-assign floating IP 172.25.1.250 from instance d527718c-baf8-4607-a25c-3cf3d6d4a540 Nov 02 21:24:13.100172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:13.103239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:13.121748 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cccb0bf9-421a-4425-9279-7bc5bd12419b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.253595 Nov 02 21:24:13.139130 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 356/733] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:12 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:13.150227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:13.152289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:13.154294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Building network info cache for instance {{(pid=121040) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:24:13.158728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:13.159680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:13.160423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:13.161344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:13.161948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:13.163768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:13.503199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:13.518019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:13.519643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:13.522200 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e67640a-f329-424c-8c7d-3e8f1f2f8236 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1557 microversion: 2.25 time: 0.381441 Nov 02 21:24:13.525596 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 357/734] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:13 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1557 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:13.541854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:13.542797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:13.569963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:13.575206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:13.575206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:13.575206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:13.575600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:13.576380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:13.912068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:13.934130 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7fee833d-d06f-4930-b429-32553ef2f7d8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.405993 Nov 02 21:24:13.935219 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 358/735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:13 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:13.961109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d200c075-200a-45f7-b89c-c63ebef88c63 req-1f2e4389-a675-4ea4-8677-17fea0aa7aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527718c-baf8-4607-a25c-3cf3d6d4a540", "tag": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:13.969546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d200c075-200a-45f7-b89c-c63ebef88c63 req-1f2e4389-a675-4ea4-8677-17fea0aa7aa7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:13.970026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d200c075-200a-45f7-b89c-c63ebef88c63 req-1f2e4389-a675-4ea4-8677-17fea0aa7aa7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:13.970638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d200c075-200a-45f7-b89c-c63ebef88c63 req-1f2e4389-a675-4ea4-8677-17fea0aa7aa7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:13.987222 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d200c075-200a-45f7-b89c-c63ebef88c63 req-1f2e4389-a675-4ea4-8677-17fea0aa7aa7 service nova] Creating event network-changed:0bb6edec-16b6-4bc9-93e6-f0f2955f0528 for instance d527718c-baf8-4607-a25c-3cf3d6d4a540 on n-h1-860863-4 Nov 02 21:24:14.020609 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d200c075-200a-45f7-b89c-c63ebef88c63 req-1f2e4389-a675-4ea4-8677-17fea0aa7aa7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074950 Nov 02 21:24:14.023172 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 359/736] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:14.034766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:14.038348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:14.058073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:14.059137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:14.060043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:14.061981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:14.064431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:14.064431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:15.040179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Updating instance_info_cache with network_info: [{"id": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528", "address": "fa:16:3e:68:72:e7", "network": {"id": "2e122478-3983-4b35-aafd-de2f1ae7dd60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424755741-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "474e60f37a8d4b8694acb88ffc736368", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0bb6edec-16", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121040) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:24:15.159253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Building network info cache for instance {{(pid=121040) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:24:15.379775 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d752bf5a-a385-4d0c-9b2c-ca4c279cb438 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1613 microversion: 2.1 time: 1.354591 Nov 02 21:24:15.381487 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 360/737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:14 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1613 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:15.403509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:15.404217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:15.410860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:15.411579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:15.412336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:15.413828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:15.414490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:15.415169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:15.440201 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] HTTP exception thrown: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Request method failure captured: Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 HTTP/1.1 Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt9WpbiEZzpMnPxs59g3mToHjocDc3n8baKLetOPkM_KK_Z5lYusHAWBEOduSZ57SQsfmxavACKcJ0ndVAU0EzlKF9VaXkgDH2uRsUF28Lb-Isaq7FosAVBaE7fIpNbTC2r0P_x8K5d5IDb3su0kjjWAR1TOXjQOH-u0IG0Nx3jQB3A Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:15.442234 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7e5759f947464db980b4dc96a5cd984d Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:15.443727 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9c0ab77c-58ce-40d3-9df9-4658e23b6940'} Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:15.444533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:15.445702 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:15.448477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Returning 404 to user: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:15.449922 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1640fec3-b6f8-4b56-946c-34f744efcbb8 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 404 len: 111 microversion: 2.1 time: 0.055696 Nov 02 21:24:15.451008 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 361/738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:15 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:15.458150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:15.459048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:15.466000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:15.466786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:15.467419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:15.468320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:15.469028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:15.469647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:15.474937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:15.808493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:15.818955 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-25d20d1a-f3a6-4e89-b657-75d04e889790 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1476 microversion: 2.1 time: 0.366383 Nov 02 21:24:15.834116 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 362/739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:15 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:15.840527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8241eb91-0130-4158-ab10-788c505976b9 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '.version_select at 0x7f9b693ce670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:15.844182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8241eb91-0130-4158-ab10-788c505976b9 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:15.844652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8241eb91-0130-4158-ab10-788c505976b9 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:15.845130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8241eb91-0130-4158-ab10-788c505976b9 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:15.861717 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8241eb91-0130-4158-ab10-788c505976b9 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.026320 Nov 02 21:24:15.871417 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 363/740] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 21:24:15 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:24:15.871417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:15.871417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:15.877370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:15.877877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:15.878325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:15.879134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:15.879588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:15.880534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.008098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:16.018696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:16.020852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:16.027021 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d4a6d07d-d423-4d08-a376-4af6f93d9fb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.163147 Nov 02 21:24:16.033624 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 364/741] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:15 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:16.033624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a8aaf11d-5df7-48f4-afd1-c8be8f46b8f2 req-69c4e5cf-9594-4b3e-9803-96adae029491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e", "name": "network-vif-plugged", "status": "completed", "tag": "959e5aa8-19e8-427e-86c3-a667021fcc01"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:16.043096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a8aaf11d-5df7-48f4-afd1-c8be8f46b8f2 req-69c4e5cf-9594-4b3e-9803-96adae029491 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.043838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a8aaf11d-5df7-48f4-afd1-c8be8f46b8f2 req-69c4e5cf-9594-4b3e-9803-96adae029491 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.046665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a8aaf11d-5df7-48f4-afd1-c8be8f46b8f2 req-69c4e5cf-9594-4b3e-9803-96adae029491 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.063089 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a8aaf11d-5df7-48f4-afd1-c8be8f46b8f2 req-69c4e5cf-9594-4b3e-9803-96adae029491 service nova] Creating event network-vif-plugged:959e5aa8-19e8-427e-86c3-a667021fcc01 for instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e on n-h2-860863-4 Nov 02 21:24:16.068769 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a8aaf11d-5df7-48f4-afd1-c8be8f46b8f2 req-69c4e5cf-9594-4b3e-9803-96adae029491 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039723 Nov 02 21:24:16.069632 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 365/742] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:16.164159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Updating instance_info_cache with network_info: [{"id": "b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f", "address": "fa:16:3e:a8:ac:44", "network": {"id": "2e122478-3983-4b35-aafd-de2f1ae7dd60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424755741-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "474e60f37a8d4b8694acb88ffc736368", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb6662d05-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121040) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:24:16.227711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Calling method '.version_select at 0x7f9b6929d700>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:16.229589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.230103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.230621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.250495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.251011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.251499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.266827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.267476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.268494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.273359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Releasing lock "refresh_cache-8fbff37c-15d4-46f4-8eea-845f782b6591" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:24:16.280402 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d9b3d3d-7265-4094-b654-369d10a72462 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591/action" status: 202 len: 0 microversion: 2.1 time: 8.053222 Nov 02 21:24:16.280402 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 378/743] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:08 2022] POST /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591/action => generated 0 bytes in 8054 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:24:16.282335 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8cb2db8-9e21-41ba-ab9a-5545bd753e5e tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.210860 Nov 02 21:24:16.288748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 366/744] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:24:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:24:16.290627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:16.290921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:16.291907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:16.293077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:16.300313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.301209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.301757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.302571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.303135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.303278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.303760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.304082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.304758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.305764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.306392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.306957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.394461 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] HTTP exception thrown: Cannot 'migrate' instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 while it is in vm_state suspended Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Request method failure captured: Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5/action HTTP/1.1 Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 15 Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt_HP0_cWfWzsUUO-6lzwF95a788Psm82-eFpmLuNs_BflcyowuxM13a6xC3ORmrw1cJkb6EWXubL30Y5a0eWErnDykV5OB-OLQjeT89XGCXDih-0zs31pPuIoQ4ZOBfvDxf5YQiJaHA0i4CtqnNodZTj0bDD23nGjhZ0jUWudqY8G0 Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:24:16.396118 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 37a0b2c0d9954295b8aaca9406d66596 Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: {"migrate": {}} Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:16.397694 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'migrate' instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 while it is in vm_state suspended Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '47783fba-5ca0-4f25-a768-9e48565b5ba5', 'body': {'migrate': {}}} Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 in vm_state suspended. Cannot resize while the instance is in this state. Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.398619 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 while it is in vm_state suspended Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:16.399991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:16.402310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:16.402310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:16.402310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 while it is in vm_state suspended Nov 02 21:24:16.402310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.403413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Returning 409 to user: Cannot 'migrate' instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 while it is in vm_state suspended {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:16.404284 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7af988e4-3b5a-4835-8d18-db6fc87f2085 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5/action" status: 409 len: 148 microversion: 2.1 time: 0.119843 Nov 02 21:24:16.410011 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 367/745] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:16 2022] POST /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5/action => generated 148 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:24:16.415140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31c6c393-8445-4f8d-9835-97b54cb262b2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '.version_select at 0x7f9b6969f040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:16.486650 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31c6c393-8445-4f8d-9835-97b54cb262b2 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112162530" status: 202 len: 0 microversion: 2.1 time: 0.075505 Nov 02 21:24:16.487236 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 368/746] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112162530 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:16.494133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:16.495404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:16.506225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.506729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.507178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.507898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.508353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.508796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.517463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:16.529290 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05ecaa28-ab79-4416-a444-933440f26960 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.251187 Nov 02 21:24:16.536335 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 379/747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:16 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:16.541542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0da8857f-c199-4ed6-a009-0f1c05282dde req-64bb940f-27e4-44f9-8522-f15e660893b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbff37c-15d4-46f4-8eea-845f782b6591", "tag": "b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:16.569240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0da8857f-c199-4ed6-a009-0f1c05282dde req-64bb940f-27e4-44f9-8522-f15e660893b7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.569960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0da8857f-c199-4ed6-a009-0f1c05282dde req-64bb940f-27e4-44f9-8522-f15e660893b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.570700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0da8857f-c199-4ed6-a009-0f1c05282dde req-64bb940f-27e4-44f9-8522-f15e660893b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.595949 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0da8857f-c199-4ed6-a009-0f1c05282dde req-64bb940f-27e4-44f9-8522-f15e660893b7 service nova] Creating event network-changed:b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f for instance 8fbff37c-15d4-46f4-8eea-845f782b6591 on n-h2-860863-4 Nov 02 21:24:16.611702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0da8857f-c199-4ed6-a009-0f1c05282dde req-64bb940f-27e4-44f9-8522-f15e660893b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073607 Nov 02 21:24:16.613135 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 380/748] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:16.627750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'action', calling method: .version_select at 0x7f9b6ac61c10>, body: {"removeFloatingIp": {"address": "172.25.1.250"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:16.672488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid 95785582-f8b6-4b0e-8939-cba2ddb6fe80 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:16.747750 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22422361-9d0f-440e-80eb-c20974455eff tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 2050 microversion: 2.25 time: 0.259430 Nov 02 21:24:16.753091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 369/749] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:16 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 2050 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:16.763018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Calling method '.version_select at 0x7f9b6952f1f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:16.767071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.767916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.768597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.797600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.798408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.799122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.811906 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-874b297c-6d6c-4d08-8b79-b51c90025da3 tempest-HypervisorAdminV228Test-1698981499 tempest-HypervisorAdminV228Test-1698981499-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.057079 Nov 02 21:24:16.813780 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 370/750] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 21:24:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:24:16.848441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ffb9fa6-7ac4-4aa7-9b72-7a01d181ac26 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ffb9fa6-7ac4-4aa7-9b72-7a01d181ac26 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Request method failure captured: Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7/action HTTP/1.1 Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 39 Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt_HP0_cWfWzsUUO-6lzwF95a788Psm82-eFpmLuNs_BflcyowuxM13a6xC3ORmrw1cJkb6EWXubL30Y5a0eWErnDykV5OB-OLQjeT89XGCXDih-0zs31pPuIoQ4ZOBfvDxf5YQiJaHA0i4CtqnNodZTj0bDD23nGjhZ0jUWudqY8G0 Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:24:16.861642 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 37a0b2c0d9954295b8aaca9406d66596 Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: {"os-resetState": {"state": "invalid"}} Nov 02 21:24:16.862966 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f433e0da-82f2-4c39-8781-c6375f1935f7', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:16.863660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:24:16.864948 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 21:24:16.867873 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:16.914659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ffb9fa6-7ac4-4aa7-9b72-7a01d181ac26 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:16.915964 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ffb9fa6-7ac4-4aa7-9b72-7a01d181ac26 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7/action" status: 400 len: 144 microversion: 2.1 time: 0.100171 Nov 02 21:24:16.920115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 371/751] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:16 2022] POST /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7/action => generated 144 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:24:16.934981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:16.935737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:16.950654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.951234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.951745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.952605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.953174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.953669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.968304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:16.976472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.976984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.977429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:16.978137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:16.981060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:16.981500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:17.509702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:17.529673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2606ad1-3564-49c1-b428-c214e398dc02 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1476 microversion: 2.1 time: 0.600470 Nov 02 21:24:17.529967 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 372/752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:16 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1476 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:17.547929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30b5d07e-4246-4909-b04a-3f4c9f4acac5 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30b5d07e-4246-4909-b04a-3f4c9f4acac5 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Request method failure captured: Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7/action HTTP/1.1 Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 31 Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt_HP0_cWfWzsUUO-6lzwF95a788Psm82-eFpmLuNs_BflcyowuxM13a6xC3ORmrw1cJkb6EWXubL30Y5a0eWErnDykV5OB-OLQjeT89XGCXDih-0zs31pPuIoQ4ZOBfvDxf5YQiJaHA0i4CtqnNodZTj0bDD23nGjhZ0jUWudqY8G0 Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:24:17.552820 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 37a0b2c0d9954295b8aaca9406d66596 Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: {"os-resetState": {"state": 1}} Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:17.554681 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f433e0da-82f2-4c39-8781-c6375f1935f7', 'body': {'os-resetState': {'state': 1}}} Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 1 Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:17.556063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 21:24:17.558291 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.561021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30b5d07e-4246-4909-b04a-3f4c9f4acac5 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:17.561021 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30b5d07e-4246-4909-b04a-3f4c9f4acac5 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7/action" status: 400 len: 120 microversion: 2.1 time: 0.023469 Nov 02 21:24:17.561021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 373/753] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:17 2022] POST /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7/action => generated 120 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:24:17.564046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-142970717", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fce733bb-4d9b-4a3f-8666-2b353f0ca65b"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:17.646841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] validate_networks() for [('fce733bb-4d9b-4a3f-8666-2b353f0ca65b', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:24:17.649786 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] HTTP exception thrown: Floating IP 172.25.1.250 is not associated with instance d527718c-baf8-4607-a25c-3cf3d6d4a540. Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Request method failure captured: Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action HTTP/1.1 Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 49 Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt_DXSCPHpSX1pzJPeTwr5qSAqOys5BDgqRFgOM86WDLJRdvTQSLEZqttzfNa-g0llC12geR0CPN88s4qbVcnkSII766KxvjeRn9qA39cfd8YhfCyFOPv9nnw6sg3VR8Krmxy2JCxz3gMNczeFMwpvToL5yNj7Uhz5jt72cFxZ__jsE Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:17.657279 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 00fce7be56a04270b9d8adf4285bb85f Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: {"removeFloatingIp": {"address": "172.25.1.250"}} Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:24:17.658596 n-d-860863-4 devstack@n-api.service[121040]: exception: Floating IP 172.25.1.250 is not associated with instance d527718c-baf8-4607-a25c-3cf3d6d4a540. Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd527718c-baf8-4607-a25c-3cf3d6d4a540', 'body': {'removeFloatingIp': {'address': '172.25.1.250'}}} Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.250 is not associated with instance d527718c-baf8-4607-a25c-3cf3d6d4a540. Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.659390 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.250 is not associated with instance d527718c-baf8-4607-a25c-3cf3d6d4a540. Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Returning 409 to user: Floating IP 172.25.1.250 is not associated with instance d527718c-baf8-4607-a25c-3cf3d6d4a540. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:17.660554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1a85430-a599-4e3b-99ee-efbc1e7513a5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action" status: 409 len: 146 microversion: 2.1 time: 1.045103 Nov 02 21:24:17.666137 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 381/754] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:16 2022] POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action => generated 146 bytes in 1052 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:24:17.674414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:17.675801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:17.688074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:17.688916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:17.690011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:17.691651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:17.692680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:17.693741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:17.855276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:17.865092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:17.866844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:17.873689 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a37f3da-1cf5-4c65-96b2-bce17ff63981 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.205877 Nov 02 21:24:17.874265 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 382/755] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:17 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:17.889930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:17.891768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:17.904652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:17.905389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:17.906023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:17.907105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:17.907714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:17.908286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:18.761327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:18.770196 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f293455-38eb-4608-968f-014ebb638bb8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.893932 Nov 02 21:24:18.778077 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 383/756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:17 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d2cc436-2cdf-4389-86d3-dfa1df7880f6 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d2cc436-2cdf-4389-86d3-dfa1df7880f6 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Failed to fetch instance by id 999 {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9d2cc436-2cdf-4389-86d3-dfa1df7880f6 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d2cc436-2cdf-4389-86d3-dfa1df7880f6 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Request method failure captured: Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 37 Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt_HP0_cWfWzsUUO-6lzwF95a788Psm82-eFpmLuNs_BflcyowuxM13a6xC3ORmrw1cJkb6EWXubL30Y5a0eWErnDykV5OB-OLQjeT89XGCXDih-0zs31pPuIoQ4ZOBfvDxf5YQiJaHA0i4CtqnNodZTj0bDD23nGjhZ0jUWudqY8G0 Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:18.798400 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b2831d27b014aefb4e31978dd2fd0c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 7b2831d27b014aefb4e31978dd2fd0c9 Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417521863 Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 37a0b2c0d9954295b8aaca9406d66596 Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417521863-project-admin Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:24:18.799682 n-d-860863-4 devstack@n-api.service[121040]: {"os-resetState": {"state": "error"}} Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 999 could not be found. Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:18.800687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:18.801922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d2cc436-2cdf-4389-86d3-dfa1df7880f6 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:18.802985 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d2cc436-2cdf-4389-86d3-dfa1df7880f6 tempest-ServersAdminNegativeTestJSON-1417521863 tempest-ServersAdminNegativeTestJSON-1417521863-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.017560 Nov 02 21:24:18.805990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 384/757] 10.222.0.25 () {60 vars in 1179 bytes} [Wed Nov 2 21:24:18 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:24:18.814049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.250"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:19.070813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:19.078874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.079746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.080267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.081241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.082010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.083022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.087832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:24:19.093016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:24:19.093016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:24:19.093016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:24:19.093016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:24:19.098167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.098646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.099073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.099809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.100253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.100670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.119136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:24:19.125258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for user 979116d5dca74e6d90abe23e9033107e and project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:24:19.138060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:24:19.140396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:24:19.305893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "refresh_cache-8fbff37c-15d4-46f4-8eea-845f782b6591" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:24:19.306501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquired lock "refresh_cache-8fbff37c-15d4-46f4-8eea-845f782b6591" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:24:19.321679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1413b125-828a-43c9-aade-3e8cae274b91 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.765349 Nov 02 21:24:19.322320 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 374/758] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:24:19.327701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:19.328581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:19.335184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.335678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.336123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.336818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.337332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.337767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.629041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:19.636843 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5dea0c1a-9a52-42f3-aa57-70717d60d83a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1462 microversion: 2.1 time: 0.312707 Nov 02 21:24:19.637444 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 375/759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:19 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1462 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:19.641946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:19.642454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:19.648627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.653586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.653586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.653586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:19.653586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:19.653986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:19.682023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:24:19.976762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8be4cfd-cca2-4efc-9311-4281175892fc tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 204 len: 0 microversion: 2.1 time: 0.338044 Nov 02 21:24:19.977951 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 376/760] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:19 2022] DELETE /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:19.989222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c8c0489-c731-4e29-83a7-cef8544b539d tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:20.058006 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c8c0489-c731-4e29-83a7-cef8544b539d tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/464443597" status: 202 len: 0 microversion: 2.1 time: 0.075270 Nov 02 21:24:20.062156 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 377/761] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:24:19 2022] DELETE /compute/v2.1/flavors/464443597 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:20.067668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:20.068447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:20.074727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.075223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.075664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.076366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.076829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.077354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.204037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.214325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.215976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.221980 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bcfafe18-adbd-4052-a7a3-7764c052ca65 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1537 microversion: 2.91 time: 0.158774 Nov 02 21:24:20.222548 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 378/762] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:20 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:20.243165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:20.244011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:20.253470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.253958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.254574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.255208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.255618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.256046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.361741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Building network info cache for instance {{(pid=121040) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:24:20.364269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.376772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.390165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.391747 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-966ed5bd-75d0-4bcd-8670-1590dd71d073 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1265 microversion: 2.25 time: 0.153157 Nov 02 21:24:20.401654 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 379/763] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:20 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:20.412955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:20.413769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:20.421233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.421820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.422500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.423463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.424514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.425166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.651047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.659031 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-02008257-e76e-4af3-9db3-e9f1b9231225 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1462 microversion: 2.1 time: 0.255260 Nov 02 21:24:20.659835 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 380/764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:20 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1462 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:20.664391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:20.665014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:20.669941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:20.678324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.679046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.679735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.681531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.682555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.683021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.921230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:20.928942 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c73a935-c29a-43f6-bd70-a18125ac599d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.267932 Nov 02 21:24:20.930015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 381/765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:20 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:20.944185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:20.944709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:20.953505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.954257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.954854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:20.955761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:20.956221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:20.956654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.129696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Updating instance_info_cache with network_info: [{"id": "b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f", "address": "fa:16:3e:a8:ac:44", "network": {"id": "2e122478-3983-4b35-aafd-de2f1ae7dd60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424755741-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "474e60f37a8d4b8694acb88ffc736368", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb6662d05-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121040) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:24:21.169402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.177654 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-52f0627a-d120-4e1e-b29f-8901902283ce tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1468 microversion: 2.1 time: 0.246558 Nov 02 21:24:21.178239 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 382/766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:20 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:21.183317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-858ffe4c-5ac9-447e-8f99-df806a824d00 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:21.186634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Releasing lock "refresh_cache-8fbff37c-15d4-46f4-8eea-845f782b6591" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:24:21.186634 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c81a398b-45f4-49c9-8f04-3ecfc63d0a89 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591/action" status: 202 len: 0 microversion: 2.1 time: 2.374300 Nov 02 21:24:21.186634 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 385/767] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:18 2022] POST /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591/action => generated 0 bytes in 2379 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:24:21.190726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-cd54b55f-c9e9-4e63-bdad-6963e84caa6a req-4ea3a292-b9e7-4373-ac00-d6e017fd16a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fbff37c-15d4-46f4-8eea-845f782b6591", "tag": "b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:21.201251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd54b55f-c9e9-4e63-bdad-6963e84caa6a req-4ea3a292-b9e7-4373-ac00-d6e017fd16a2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.201829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd54b55f-c9e9-4e63-bdad-6963e84caa6a req-4ea3a292-b9e7-4373-ac00-d6e017fd16a2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.202358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd54b55f-c9e9-4e63-bdad-6963e84caa6a req-4ea3a292-b9e7-4373-ac00-d6e017fd16a2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.205714 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-858ffe4c-5ac9-447e-8f99-df806a824d00 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.026403 Nov 02 21:24:21.206304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 383/768] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:21 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:21.211153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:21.215299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:21.216841 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-cd54b55f-c9e9-4e63-bdad-6963e84caa6a req-4ea3a292-b9e7-4373-ac00-d6e017fd16a2 service nova] Creating event network-changed:b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f for instance 8fbff37c-15d4-46f4-8eea-845f782b6591 on n-h2-860863-4 Nov 02 21:24:21.222705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.223055 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-cd54b55f-c9e9-4e63-bdad-6963e84caa6a req-4ea3a292-b9e7-4373-ac00-d6e017fd16a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036635 Nov 02 21:24:21.223274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.223722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.223919 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 386/769] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:21.224456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.224913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.225419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.231125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:21.231808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:21.238155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.238830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.239276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.239984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.240443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.240978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.246891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:21.272075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:24:21.335017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:24:21.335225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:24:21.336533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:24:21.336978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:24:21.337500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:24:21.491570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:21.500303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.501277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.502017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.502885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.503631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.505683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.533436 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61510ab0-c31e-4b53-95aa-8a860c0c5dec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action" status: 202 len: 1066 microversion: 2.1 time: 0.325856 Nov 02 21:24:21.534075 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 384/770] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:21 2022] POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action => generated 1066 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 21:24:21.538926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb551e30-f07d-4768-b926-6c7d5119e950 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:21.548261 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d0eaad5-60ca-45bf-8673-a5f4e81a83ea tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 204 len: 0 microversion: 2.1 time: 0.322549 Nov 02 21:24:21.549574 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 387/771] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:21 2022] DELETE /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:21.560718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:21.561443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:21.568027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.569783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.574580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.574580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.574580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.574580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.624448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:21.656769 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb551e30-f07d-4768-b926-6c7d5119e950 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/176203017" status: 202 len: 0 microversion: 2.1 time: 0.121437 Nov 02 21:24:21.660643 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 385/772] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:24:21 2022] DELETE /compute/v2.1/flavors/176203017 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:21.664684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:21.665417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:21.672907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.674141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.674685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.675389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.675840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.676296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.691205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.704647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.706045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.722390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d03e6e9-4ed3-485d-b3c6-e768af960dfe tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1537 microversion: 2.91 time: 0.171417 Nov 02 21:24:21.722986 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 388/773] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:21 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:21.734476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:21.735096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:21.759909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.760473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.761120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.761649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.763008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.763443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.812722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.822474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.824800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.826165 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b558326f-595f-417f-a054-55ebc5ebb34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1265 microversion: 2.25 time: 0.167309 Nov 02 21:24:21.827083 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 386/774] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:21 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:21.832846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.250"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:21.835777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:21.842361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.842874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.843304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.844025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:21.844471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:21.844888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:21.873537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:24:21.874047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquired lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:24:21.977360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:21.985974 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-137fcff1-9d7e-40f8-8c21-854c0b3321c5 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.260123 Nov 02 21:24:21.986559 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 389/775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:21 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:22.007079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1655128c-ecda-43ba-a26a-ed23bcc34540 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.029157 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1655128c-ecda-43ba-a26a-ed23bcc34540 tempest-ServersWithSpecificFlavorTestJSON-1603401697 tempest-ServersWithSpecificFlavorTestJSON-1603401697-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027030 Nov 02 21:24:22.029753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 390/776] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:22.168663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Calling method '.version_select at 0x7f9b68ffdb80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.170445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.170932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.171365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.185389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.185878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.187369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.196434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.196955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.197372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.203235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a69b7070-899a-4172-9cd9-b1afb10b6c97 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.172213 Nov 02 21:24:22.203805 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 391/777] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:22.215914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.215914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:22.215914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.215914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.216365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.216894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.217367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.217792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.470547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:22.479649 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b172d0bb-3263-4d11-8606-799f8b7c0a49 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.274841 Nov 02 21:24:22.490407 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 392/778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:22 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:22.497153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.497922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:22.504406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.504983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.506783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.506783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.506783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.507128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.521444 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] HTTP exception thrown: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Request method failure captured: Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 HTTP/1.1 Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9WpbiEZzpMnPxs59g3mToHjocDc3n8baKLetOPkM_KK_Z5lYusHAWBEOduSZ57SQsfmxavACKcJ0ndVAU0EzlKF9VaXkgDH2uRsUF28Lb-Isaq7FosAVBaE7fIpNbTC2r0P_x8K5d5IDb3su0kjjWAR1TOXjQOH-u0IG0Nx3jQB3A Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:22.523275 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7e5759f947464db980b4dc96a5cd984d Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.524821 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '63f34a0e-b047-45c7-a82c-fbab7419d3d5'} Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:22.525643 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.527093 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.528475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Returning 404 to user: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:22.528475 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-676713f0-59f4-4d63-98c4-fcf0773559e6 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 404 len: 111 microversion: 2.1 time: 0.033108 Nov 02 21:24:22.528475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 393/779] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:22 2022] DELETE /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:22.530225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.530838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:22.536578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.537102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.537544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.538238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.538694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.539121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.715969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:22.723641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3deba96-3d49-43e9-b822-8fb8d2f95ab8 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 200 len: 1468 microversion: 2.1 time: 0.197172 Nov 02 21:24:22.724128 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 394/780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:22 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:22.844124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d27c7bdd-7a40-49e9-b878-28a9e2601b68 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Calling method '.version_select at 0x7f9b69153790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.846176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d27c7bdd-7a40-49e9-b878-28a9e2601b68 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3404e001ecb1412197c9502bf505fba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdae7a1c1cc4051a64d5deb35645eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d27c7bdd-7a40-49e9-b878-28a9e2601b68 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Request method failure captured: Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hypervisors/n-h2-860863-4/search HTTP/1.1 Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAEvBvPeDVZWmZ-4sVcNn1UjRFcpA4OBymOu-R0QAR0A5BzqxlUACTF8pbBEvn23lFoKgctqZ9vfPxHXpVHZkvCBuPSKCzBb9kxiaPydtgA4czNXu84MZiC6B2RrLajCnCPr4bHhITBPnjlhs4LumosxmtO5Vtrrpqp_CpKtHxH8VI Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: cfdae7a1c1cc4051a64d5deb35645eb4 Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-33665403 Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:22.847833 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-33665403 Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: cfdae7a1c1cc4051a64d5deb35645eb4 Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-33665403 Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-33665403-project Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 3404e001ecb1412197c9502bf505fba2 Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-33665403-project Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 21:24:22.849337 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'n-h2-860863-4'} Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:24:22.850197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 21:24:22.851581 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.852827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d27c7bdd-7a40-49e9-b878-28a9e2601b68 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:22.852827 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d27c7bdd-7a40-49e9-b878-28a9e2601b68 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/n-h2-860863-4/search" status: 403 len: 117 microversion: 2.1 time: 0.124169 Nov 02 21:24:22.855712 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 395/781] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 21:24:22 2022] GET /compute/v2.1/os-hypervisors/n-h2-860863-4/search => generated 117 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:22.860704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.861367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 63f34a0e-b047-45c7-a82c-fbab7419d3d5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:22.868449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.868973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.869749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.870173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.870740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.871179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.886900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] HTTP exception thrown: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Request method failure captured: Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 HTTP/1.1 Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9WpbiEZzpMnPxs59g3mToHjocDc3n8baKLetOPkM_KK_Z5lYusHAWBEOduSZ57SQsfmxavACKcJ0ndVAU0EzlKF9VaXkgDH2uRsUF28Lb-Isaq7FosAVBaE7fIpNbTC2r0P_x8K5d5IDb3su0kjjWAR1TOXjQOH-u0IG0Nx3jQB3A Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:22.888491 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7e5759f947464db980b4dc96a5cd984d Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.889885 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '63f34a0e-b047-45c7-a82c-fbab7419d3d5'} Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:22.890639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. Nov 02 21:24:22.891790 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:22.892823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Returning 404 to user: Instance 63f34a0e-b047-45c7-a82c-fbab7419d3d5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:22.892823 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-765cce6f-dea9-43bd-93d7-9b94bd36a340 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5" status: 404 len: 111 microversion: 2.1 time: 0.033198 Nov 02 21:24:22.892823 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 396/782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:22 2022] GET /compute/v2.1/servers/63f34a0e-b047-45c7-a82c-fbab7419d3d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:22.910813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:22.911677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:22.926755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.927520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.927961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:22.928711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:22.929363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:22.929953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:23.272006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:23.286163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:23.288022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:23.293384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:23.295298 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df46e398-deaa-4dcc-ae3e-ec6259b63b98 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1540 microversion: 2.91 time: 0.403526 Nov 02 21:24:23.296416 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 397/783] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:22 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1540 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:23.301199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:23.306219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:23.308267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:23.309008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:23.309671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:23.310587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:23.311310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:23.311954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:23.453070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:23.470393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:23.473215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:23.477253 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dca2fed3-6728-4d5b-842c-0a420357106c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1331 microversion: 2.25 time: 0.179028 Nov 02 21:24:23.489842 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 398/784] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:23 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1331 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:23.489842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Calling method '.version_select at 0x7f9b69038c10>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:23.490740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:23.491234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:23.491864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:23.509554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Request method failure captured: Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAFGET4X0XMJNlahC78LNJhQSNJTewORg5aH4qwjjXFsOLQnc44pBMEzNfb5F6fA8IIios3TUvUs3F8qH6PpJLaSoFZe5NTSP4Jk60iZHWcw5ZIYXzhTIi5VTanLyTEdhFPmLuqJBneo4X5WE2lnwUfkCt3UMANPso5JVID0qorr-w Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 3b8cda31e8914e5ba342eae555c9f4d3 Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-992444939 Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:24:23.512983 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-992444939 Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 3b8cda31e8914e5ba342eae555c9f4d3 Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-992444939 Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: fecf17be4ee240239924dc1b545b3d19 Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 21:24:23.514466 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:23.515192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b72faaf6-0923-428b-b7e3-d9c23e91f092 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.030329 Nov 02 21:24:23.522618 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 399/785] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:24:23 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:23.526974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:23.527164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:23.534243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:23.534948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:23.535438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:23.536208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:23.536654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:23.537414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:23.553716 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] HTTP exception thrown: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Request method failure captured: Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 HTTP/1.1 Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9WpbiEZzpMnPxs59g3mToHjocDc3n8baKLetOPkM_KK_Z5lYusHAWBEOduSZ57SQsfmxavACKcJ0ndVAU0EzlKF9VaXkgDH2uRsUF28Lb-Isaq7FosAVBaE7fIpNbTC2r0P_x8K5d5IDb3su0kjjWAR1TOXjQOH-u0IG0Nx3jQB3A Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:23.555313 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7e5759f947464db980b4dc96a5cd984d Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:23.556710 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9c0ab77c-58ce-40d3-9df9-4658e23b6940'} Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:23.557729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:23.558865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:23.562518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Returning 404 to user: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:23.563410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-81f69df0-3ffe-4f6b-b140-ffac977c19db tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 404 len: 111 microversion: 2.1 time: 0.044562 Nov 02 21:24:23.564198 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 400/786] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:23 2022] DELETE /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:23.572533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:23.574237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:23.581471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:23.583885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:23.583885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:23.583885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:23.584262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:23.585131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:24.141663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:24.150789 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3b85585-3eb6-41e0-9984-2f0f110d58bb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.582289 Nov 02 21:24:24.165009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 401/787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:23 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:24.165009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860863-4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:24.165009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:24.165009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:24.165613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:24.165839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:24.167062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:24.167517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:24.167940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:24.247937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860863-4". {{(pid=121040) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 21:24:24.526968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Building network info cache for instance {{(pid=121039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:24:24.539328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52e2d074-6c74-45ee-9638-66b7b99af12e tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action" status: 202 len: 0 microversion: 2.91 time: 0.386313 Nov 02 21:24:24.540642 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 402/788] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:24:24 2022] POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:24.547644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:24.548634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:24.563665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:24.563665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:24.563665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:24.563665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:24.564052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:24.564052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:24.991892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:25.005212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85a92254-94cf-4bbd-beda-c14030077027 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.461304 Nov 02 21:24:25.026145 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 403/789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:24 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:25.037907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Calling method '.version_select at 0x7f9b6940b670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:25.040124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.040678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.041092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.058783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.059963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.060660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.073512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.074068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.075117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.084515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b729e2b-58f7-40a4-8bcc-883c671409c4 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050516 Nov 02 21:24:25.098860 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 404/790] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:25.115736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:25.115736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] [instance: 9c0ab77c-58ce-40d3-9df9-4658e23b6940] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:25.136859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.137389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.137838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.138563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.139024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.139476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.159717 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] HTTP exception thrown: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Request method failure captured: Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 HTTP/1.1 Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt9WpbiEZzpMnPxs59g3mToHjocDc3n8baKLetOPkM_KK_Z5lYusHAWBEOduSZ57SQsfmxavACKcJ0ndVAU0EzlKF9VaXkgDH2uRsUF28Lb-Isaq7FosAVBaE7fIpNbTC2r0P_x8K5d5IDb3su0kjjWAR1TOXjQOH-u0IG0Nx3jQB3A Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:25.161499 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fd4894dee76f4b36a22065bbc923b04a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: fd4894dee76f4b36a22065bbc923b04a Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213 Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7e5759f947464db980b4dc96a5cd984d Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1933034213-project Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:25.163019 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9c0ab77c-58ce-40d3-9df9-4658e23b6940'} Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:25.163759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. Nov 02 21:24:25.164942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.167682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] Returning 404 to user: Instance 9c0ab77c-58ce-40d3-9df9-4658e23b6940 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:25.167682 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea103ee2-a056-46b7-9d2c-23c3dfaa8386 tempest-ServersWithSpecificFlavorTestJSON-1933034213 tempest-ServersWithSpecificFlavorTestJSON-1933034213-project] 10.222.0.25 "GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940" status: 404 len: 111 microversion: 2.1 time: 0.063988 Nov 02 21:24:25.167682 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 405/791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:25 2022] GET /compute/v2.1/servers/9c0ab77c-58ce-40d3-9df9-4658e23b6940 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:25.176307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:25.177104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: 47783fba-5ca0-4f25-a768-9e48565b5ba5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:25.187196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.189258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.189782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.195682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.195682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.195682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.227735 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] HTTP exception thrown: Instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 could not be found. Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Request method failure captured: Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 HTTP/1.1 Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt_FnUp5n06pQat48XT3cTXMR3KYTcvBhkmEdWsu8x2xklNfooI8ftAieF527-y2js1NZ8Jq2PMr4zl3aezqmoWpBN-GS0ugRTVnP-3COpImuvFZtYtwmxYJ1DzlTPlOQ_cEcrbAAQ0muEkb8C5pNbQ7AM__GtMgtVBiVc1JlqFZHvY Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e67258fa3a5247389ddb9ceeedba9076 Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-116464497 Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:25.229374 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersAdminNegativeTestJSON-116464497 Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e67258fa3a5247389ddb9ceeedba9076 Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-116464497 Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersAdminNegativeTestJSON-116464497-project Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 93744d04892f4736b9458281d1c5ca2a Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersAdminNegativeTestJSON-116464497-project Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 could not be found. Nov 02 21:24:25.230731 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '47783fba-5ca0-4f25-a768-9e48565b5ba5'} Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 could not be found. Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:25.231640 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 could not be found. Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 could not be found. Nov 02 21:24:25.233442 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:25.234494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Returning 404 to user: Instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:25.234494 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0eadf0af-fe67-4a5c-a617-b8001c66a062 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5" status: 404 len: 111 microversion: 2.1 time: 0.059919 Nov 02 21:24:25.243276 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 406/792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:25 2022] GET /compute/v2.1/servers/47783fba-5ca0-4f25-a768-9e48565b5ba5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:25.255132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2b350c40-dfb2-4e76-9b60-7c85cc174ed1 req-a078df1f-b2aa-4fcf-a69b-011e0da3cc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47783fba-5ca0-4f25-a768-9e48565b5ba5", "name": "network-vif-deleted", "tag": "1d8083c4-2d9f-45bb-a3fa-93c8cbca7ad8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:25.267999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2b350c40-dfb2-4e76-9b60-7c85cc174ed1 req-a078df1f-b2aa-4fcf-a69b-011e0da3cc45 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.268476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2b350c40-dfb2-4e76-9b60-7c85cc174ed1 req-a078df1f-b2aa-4fcf-a69b-011e0da3cc45 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.268907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2b350c40-dfb2-4e76-9b60-7c85cc174ed1 req-a078df1f-b2aa-4fcf-a69b-011e0da3cc45 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.284826 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2b350c40-dfb2-4e76-9b60-7c85cc174ed1 req-a078df1f-b2aa-4fcf-a69b-011e0da3cc45 service nova] Creating event network-vif-deleted:1d8083c4-2d9f-45bb-a3fa-93c8cbca7ad8 for instance 47783fba-5ca0-4f25-a768-9e48565b5ba5 on n-h2-860863-4 Nov 02 21:24:25.290314 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2b350c40-dfb2-4e76-9b60-7c85cc174ed1 req-a078df1f-b2aa-4fcf-a69b-011e0da3cc45 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040064 Nov 02 21:24:25.291365 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 407/793] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:25.296997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:25.298132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:25.305852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.306356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.306784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:25.309164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:25.309295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:25.312759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.093699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.109223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Updating instance_info_cache with network_info: [{"id": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528", "address": "fa:16:3e:68:72:e7", "network": {"id": "2e122478-3983-4b35-aafd-de2f1ae7dd60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424755741-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "474e60f37a8d4b8694acb88ffc736368", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0bb6edec-16", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:24:26.120219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.141056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.141056 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4809560a-a420-4cf3-8d5a-74816740b031 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1361 microversion: 2.25 time: 0.845453 Nov 02 21:24:26.143023 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 408/794] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:25 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1361 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:26.148296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-eebd6353-4ae2-430b-b3bb-89d2de07467a req-948fa387-d555-413d-b3c4-58f61966ebf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527718c-baf8-4607-a25c-3cf3d6d4a540", "tag": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:26.161569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eebd6353-4ae2-430b-b3bb-89d2de07467a req-948fa387-d555-413d-b3c4-58f61966ebf5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.162732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eebd6353-4ae2-430b-b3bb-89d2de07467a req-948fa387-d555-413d-b3c4-58f61966ebf5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.163330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eebd6353-4ae2-430b-b3bb-89d2de07467a req-948fa387-d555-413d-b3c4-58f61966ebf5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.177111 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-eebd6353-4ae2-430b-b3bb-89d2de07467a req-948fa387-d555-413d-b3c4-58f61966ebf5 service nova] Creating event network-changed:0bb6edec-16b6-4bc9-93e6-f0f2955f0528 for instance d527718c-baf8-4607-a25c-3cf3d6d4a540 on n-h1-860863-4 Nov 02 21:24:26.185831 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-eebd6353-4ae2-430b-b3bb-89d2de07467a req-948fa387-d555-413d-b3c4-58f61966ebf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041240 Nov 02 21:24:26.187167 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 409/795] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:26.197075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.201844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:26.220329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.221747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.221747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.222707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.223331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.223949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.233521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Releasing lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:24:26.234410 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-744165b7-cd14-4b39-adbe-8887b30dd538 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action" status: 202 len: 0 microversion: 2.1 time: 4.406148 Nov 02 21:24:26.235030 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 387/796] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:21 2022] POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action => generated 0 bytes in 4407 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:24:26.245616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31aad856-cdf8-4e14-b1b1-9e6840c37bb3 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Calling method '.version_select at 0x7f9b6929d0d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.247076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31aad856-cdf8-4e14-b1b1-9e6840c37bb3 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3404e001ecb1412197c9502bf505fba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfdae7a1c1cc4051a64d5deb35645eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31aad856-cdf8-4e14-b1b1-9e6840c37bb3 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Request method failure captured: Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAEvBvPeDVZWmZ-4sVcNn1UjRFcpA4OBymOu-R0QAR0A5BzqxlUACTF8pbBEvn23lFoKgctqZ9vfPxHXpVHZkvCBuPSKCzBb9kxiaPydtgA4czNXu84MZiC6B2RrLajCnCPr4bHhITBPnjlhs4LumosxmtO5Vtrrpqp_CpKtHxH8VI Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: cfdae7a1c1cc4051a64d5deb35645eb4 Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-33665403 Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:26.253692 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cfdae7a1c1cc4051a64d5deb35645eb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-33665403 Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: cfdae7a1c1cc4051a64d5deb35645eb4 Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-33665403 Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-33665403-project Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 3404e001ecb1412197c9502bf505fba2 Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-33665403-project Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 21:24:26.255045 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '1'} Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:24:26.255769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 21:24:26.257127 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:26.260718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31aad856-cdf8-4e14-b1b1-9e6840c37bb3 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:26.260718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31aad856-cdf8-4e14-b1b1-9e6840c37bb3 tempest-HypervisorAdminNegativeUnderV252Test-33665403 tempest-HypervisorAdminNegativeUnderV252Test-33665403-project] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019302 Nov 02 21:24:26.260718 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 388/797] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:24:26 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:26.282878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.284422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:26.320743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.325330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.326241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.327232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.329709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.330538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.384303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.395536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.397464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.403980 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28f759c0-35f1-4099-a872-b43a1e27a04e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1488 microversion: 2.91 time: 0.214786 Nov 02 21:24:26.418134 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 410/798] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:26 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1488 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:26.435860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.436702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:26.446401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.447081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.448278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.452825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.452825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.452825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.459491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:26.491409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:24:26.622630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.634225 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d5b7441d-a3c7-44f6-823b-782a7662094e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.374708 Nov 02 21:24:26.634896 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 389/799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:26 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:26.645401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.646375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:26.654195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.654856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.659856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.659856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.659856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.659856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.843006 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47082066-fea0-4627-899d-183e54cdfc29 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 204 len: 0 microversion: 2.1 time: 0.422157 Nov 02 21:24:26.844965 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 411/800] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:26 2022] DELETE /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:26.852886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6da4db18-be72-45fb-901d-adb373a73298 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '.version_select at 0x7f9b68ffdf70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.915463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:26.925662 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d4bc347-5ecb-422e-9b8e-d8b04f2cbc90 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.288715 Nov 02 21:24:26.926560 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 390/801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:26 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:26.931266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Calling method '.version_select at 0x7f9b69335160>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.934080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.934292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.934739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.940818 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] HTTP exception thrown: No hypervisor matching '14c4e4f8-626e-40de-866f-c24d88a86739' could be found. Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Request method failure captured: Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-hypervisors/14c4e4f8-626e-40de-866f-c24d88a86739/servers HTTP/1.1 Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAFGET4X0XMJNlahC78LNJhQSNJTewORg5aH4qwjjXFsOLQnc44pBMEzNfb5F6fA8IIios3TUvUs3F8qH6PpJLaSoFZe5NTSP4Jk60iZHWcw5ZIYXzhTIi5VTanLyTEdhFPmLuqJBneo4X5WE2lnwUfkCt3UMANPso5JVID0qorr-w Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 3b8cda31e8914e5ba342eae555c9f4d3 Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-992444939 Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:24:26.942132 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b8cda31e8914e5ba342eae555c9f4d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-992444939 Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 3b8cda31e8914e5ba342eae555c9f4d3 Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-992444939 Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: fecf17be4ee240239924dc1b545b3d19 Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: exception: No hypervisor matching '14c4e4f8-626e-40de-866f-c24d88a86739' could be found. Nov 02 21:24:26.944113 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '14c4e4f8-626e-40de-866f-c24d88a86739'} Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '14c4e4f8-626e-40de-866f-c24d88a86739' could be found. Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:26.945175 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '14c4e4f8-626e-40de-866f-c24d88a86739' could be found. Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] Returning 404 to user: No hypervisor matching '14c4e4f8-626e-40de-866f-c24d88a86739' could be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:26.946533 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c97600ca-7c79-4b08-a58d-5f3a43d9bc88 tempest-HypervisorAdminNegativeUnderV252Test-992444939 tempest-HypervisorAdminNegativeUnderV252Test-992444939-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/14c4e4f8-626e-40de-866f-c24d88a86739/servers" status: 404 len: 123 microversion: 2.1 time: 0.016366 Nov 02 21:24:26.950365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 391/802] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 21:24:26 2022] GET /compute/v2.1/os-hypervisors/14c4e4f8-626e-40de-866f-c24d88a86739/servers => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:26.955473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:26.956086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:26.963772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.964534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.964902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:26.966555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:26.967014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:26.967622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.326540 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6da4db18-be72-45fb-901d-adb373a73298 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/4d555de7-7b27-42ad-8d2e-5fb59f5f7e44" status: 200 len: 185 microversion: 2.1 time: 0.478070 Nov 02 21:24:27.333540 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 412/803] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:24:26 2022] GET /compute/v2.1/os-floating-ips/4d555de7-7b27-42ad-8d2e-5fb59f5f7e44 => generated 185 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:27.340794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:27.344031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:27.344983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:27.349105 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da6364e2-e745-476f-b4a1-33bc7f480590 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1478 microversion: 2.1 time: 0.397491 Nov 02 21:24:27.350219 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 392/804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:26 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1478 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:27.355878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Action: 'action', calling method: .version_select at 0x7f9b6ac60c10>, body: {"removeFloatingIp": {"address": "172.25.1.250"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:27.363363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.363984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.364522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.365432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.372603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.374588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.641361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:27.659215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.659945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.660640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.661654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.663144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.663991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.699209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:27.710291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:27.712188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:27.714590 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfad0343-1e23-4ed3-8c1d-716e67f404ed tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1361 microversion: 2.25 time: 0.378686 Nov 02 21:24:27.729580 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 413/805] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:27 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1361 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:27.729930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:27.730784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:27.737948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.738450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.738898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.739616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.740076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.740515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.850715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:27.860448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:27.862213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:27.868519 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-62f2b859-1a93-422d-8b64-705334a07204 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.142986 Nov 02 21:24:27.890875 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 414/806] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:27 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:27.905092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:27.908982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:27.933753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.934501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.935106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:27.935983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:27.941998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:27.941998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:28.058691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:24:28.059092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquired lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:24:28.371683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:28.383546 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38978eb9-6ae2-4a57-92d2-7bae17916180 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.491450 Nov 02 21:24:28.394782 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 415/807] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:27 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:28.399863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:28.403558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:28.424071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:28.424278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:28.424897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:28.425807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:28.426422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:28.426999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:28.934470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:28.949409 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c971b53d-788e-48b9-85c7-b07b973b5933 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.553205 Nov 02 21:24:28.950579 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 416/808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:28 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:28.958254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9bfc8a0b-0cb2-42ce-8bc9-7b7d580471e5 req-f294a9a4-6b5a-433f-a033-2adeae030972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fbff37c-15d4-46f4-8eea-845f782b6591", "name": "network-vif-deleted", "tag": "b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f"}, {"name": "network-changed", "server_uuid": "c0a35e18-355f-4fc3-ab55-c9546c8bfb42", "tag": "97b6314e-b34f-4ab8-93c1-efdbbe8346b3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:28.977809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9bfc8a0b-0cb2-42ce-8bc9-7b7d580471e5 req-f294a9a4-6b5a-433f-a033-2adeae030972 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:28.984989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9bfc8a0b-0cb2-42ce-8bc9-7b7d580471e5 req-f294a9a4-6b5a-433f-a033-2adeae030972 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:28.985588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9bfc8a0b-0cb2-42ce-8bc9-7b7d580471e5 req-f294a9a4-6b5a-433f-a033-2adeae030972 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:29.043412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9bfc8a0b-0cb2-42ce-8bc9-7b7d580471e5 req-f294a9a4-6b5a-433f-a033-2adeae030972 service nova] Creating event network-vif-deleted:b6662d05-37ea-4f3f-8c1c-7a8f7a9c946f for instance 8fbff37c-15d4-46f4-8eea-845f782b6591 on n-h2-860863-4 Nov 02 21:24:29.045597 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9bfc8a0b-0cb2-42ce-8bc9-7b7d580471e5 req-f294a9a4-6b5a-433f-a033-2adeae030972 service nova] Creating event network-changed:97b6314e-b34f-4ab8-93c1-efdbbe8346b3 for instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 on n-h1-860863-4 Nov 02 21:24:29.069308 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9bfc8a0b-0cb2-42ce-8bc9-7b7d580471e5 req-f294a9a4-6b5a-433f-a033-2adeae030972 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.117099 Nov 02 21:24:29.070475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 417/809] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:29.076974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:29.077924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:29.085882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:29.086413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:29.086864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:29.087949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:29.089077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:29.090071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:29.109107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:29.131880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:29.662111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:29.683665 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-59426965-4002-4be5-8327-9d3fdc56cc23 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1478 microversion: 2.1 time: 0.611507 Nov 02 21:24:29.684569 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 418/810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:29 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1478 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:29.702849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:29.705046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:29.716128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:29.717649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:29.719054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:29.722466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:29.723177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:29.723774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:30.359204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Building network info cache for instance {{(pid=121039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:24:30.493844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:30.503250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:30.511784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:30.521539 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1836bd00-1d1b-4141-be99-d4f284070396 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1361 microversion: 2.25 time: 0.826442 Nov 02 21:24:30.522865 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 419/811] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:29 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1361 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:30.529939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:30.533694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:30.547693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:30.547693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:30.548334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:30.549645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:30.550996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:30.552412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:30.733100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:30.758504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:30.762873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:30.802699 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0059bccf-ef0e-482d-90f3-bc662bebb66b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.278375 Nov 02 21:24:30.803318 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 420/812] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:30 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:30.842500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:30.842500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:30.842500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:30.842500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:30.842999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:30.842999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:30.842999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:30.842999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:31.616067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:31.625155 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd103329-b03b-49c6-8654-cc37b1cbae01 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.801839 Nov 02 21:24:31.637312 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 421/813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:30 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:31.647148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:31.648347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:31.655088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:31.657329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:31.657329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:31.657329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:31.658662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:31.659328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:31.919115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Updating instance_info_cache with network_info: [{"id": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528", "address": "fa:16:3e:68:72:e7", "network": {"id": "2e122478-3983-4b35-aafd-de2f1ae7dd60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424755741-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "474e60f37a8d4b8694acb88ffc736368", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0bb6edec-16", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:24:32.038977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Releasing lock "refresh_cache-d527718c-baf8-4607-a25c-3cf3d6d4a540" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:24:32.040675 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72557e17-ba83-446c-b04b-d2fe0f38bfa1 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action" status: 202 len: 0 microversion: 2.1 time: 4.689359 Nov 02 21:24:32.056422 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 393/814] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:27 2022] POST /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540/action => generated 0 bytes in 4691 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:24:32.056422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:32.056422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:32.080253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.086995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.087634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.089896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.094551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.095178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.137540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.149536 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93b35ea3-1ea3-4398-b7da-558d2acd218c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.507304 Nov 02 21:24:32.151767 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 422/815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:31 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:32.159402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8c3aa5d0-1875-45ac-9c0e-476f65b1b965 req-80cbee0f-4264-4b1a-ada1-e37b546b124d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527718c-baf8-4607-a25c-3cf3d6d4a540", "tag": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528"}, {"server_uuid": "f433e0da-82f2-4c39-8781-c6375f1935f7", "name": "network-vif-deleted", "tag": "200a9aba-f221-4300-8c9f-084a2f912ab8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:32.228506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8c3aa5d0-1875-45ac-9c0e-476f65b1b965 req-80cbee0f-4264-4b1a-ada1-e37b546b124d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.234812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.234812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.234812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.234812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lazy-loading 'fault' on Instance uuid f433e0da-82f2-4c39-8781-c6375f1935f7 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:32.236011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8c3aa5d0-1875-45ac-9c0e-476f65b1b965 req-80cbee0f-4264-4b1a-ada1-e37b546b124d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.236622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8c3aa5d0-1875-45ac-9c0e-476f65b1b965 req-80cbee0f-4264-4b1a-ada1-e37b546b124d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.267221 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8c3aa5d0-1875-45ac-9c0e-476f65b1b965 req-80cbee0f-4264-4b1a-ada1-e37b546b124d service nova] Creating event network-changed:0bb6edec-16b6-4bc9-93e6-f0f2955f0528 for instance d527718c-baf8-4607-a25c-3cf3d6d4a540 on n-h1-860863-4 Nov 02 21:24:32.267743 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8c3aa5d0-1875-45ac-9c0e-476f65b1b965 req-80cbee0f-4264-4b1a-ada1-e37b546b124d service nova] Creating event network-vif-deleted:200a9aba-f221-4300-8c9f-084a2f912ab8 for instance f433e0da-82f2-4c39-8781-c6375f1935f7 on n-h1-860863-4 Nov 02 21:24:32.282098 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8c3aa5d0-1875-45ac-9c0e-476f65b1b965 req-80cbee0f-4264-4b1a-ada1-e37b546b124d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.126183 Nov 02 21:24:32.283281 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 423/816] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:32.288676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:32.289635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:32.298012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.303580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.303580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.303580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.303580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.303969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.316856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93744d04892f4736b9458281d1c5ca2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67258fa3a5247389ddb9ceeedba9076', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.329308 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dbc67d07-447d-477c-a055-7f4af0ce8323 tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 200 len: 1312 microversion: 2.1 time: 0.283432 Nov 02 21:24:32.329971 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 394/817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:32 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:32.343457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:32.345423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:32.361998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.362878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.364382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.365379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.366063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.366733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.551598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.561183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.566081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.566749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.567801 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70675b7b-ef40-4262-a163-87c73bbe8258 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1361 microversion: 2.25 time: 0.283204 Nov 02 21:24:32.569129 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 424/818] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:32 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:32.576187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:32.577001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:32.580059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.581744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:32.585806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.586396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.586899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.601095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.601095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.601095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.601414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e0f3927-7d53-48e4-87fd-df54b7e562c0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.260404 Nov 02 21:24:32.601414 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 395/819] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:32 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:32.604601 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] HTTP exception thrown: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Request method failure captured: Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 HTTP/1.1 Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt_DXSCPHpSX1pzJPeTwr5qSAqOys5BDgqRFgOM86WDLJRdvTQSLEZqttzfNa-g0llC12geR0CPN88s4qbVcnkSII766KxvjeRn9qA39cfd8YhfCyFOPv9nnw6sg3VR8Krmxy2JCxz3gMNczeFMwpvToL5yNj7Uhz5jt72cFxZ__jsE Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:32.606437 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 00fce7be56a04270b9d8adf4285bb85f Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.608027 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '8fbff37c-15d4-46f4-8eea-845f782b6591'} Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:32.608945 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.613791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.615740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Returning 404 to user: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:32.615740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba65e403-5baf-4019-990e-badeea802799 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 404 len: 111 microversion: 2.1 time: 0.039365 Nov 02 21:24:32.615740 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 425/820] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:32 2022] DELETE /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:32.634061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:32.634828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: 8fbff37c-15d4-46f4-8eea-845f782b6591] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:32.662058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:32.663019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:32.665419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.666513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.667268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.668164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.668636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.669308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.675637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.676411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.677056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.679017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:32.679017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:32.687240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:32.709790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] HTTP exception thrown: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Request method failure captured: Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 HTTP/1.1 Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt_DXSCPHpSX1pzJPeTwr5qSAqOys5BDgqRFgOM86WDLJRdvTQSLEZqttzfNa-g0llC12geR0CPN88s4qbVcnkSII766KxvjeRn9qA39cfd8YhfCyFOPv9nnw6sg3VR8Krmxy2JCxz3gMNczeFMwpvToL5yNj7Uhz5jt72cFxZ__jsE Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:24:32.717271 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 00fce7be56a04270b9d8adf4285bb85f Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.718632 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '8fbff37c-15d4-46f4-8eea-845f782b6591'} Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:32.719504 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. Nov 02 21:24:32.720628 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:24:32.723314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Returning 404 to user: Instance 8fbff37c-15d4-46f4-8eea-845f782b6591 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:32.723314 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ea9186e-a54e-4ef2-b380-61fd7bcedb8c tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591" status: 404 len: 111 microversion: 2.1 time: 0.096989 Nov 02 21:24:32.728049 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 396/821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:32 2022] GET /compute/v2.1/servers/8fbff37c-15d4-46f4-8eea-845f782b6591 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:32.737324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-37daae56-eeca-4414-ba5e-fdc302d0f674 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '.version_select at 0x7f9b698ba940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:33.594934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:33.615554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19fa1426-b51b-40bd-9ee5-4d401f066b13 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.964258 Nov 02 21:24:33.620497 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 426/822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:32 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:33.638586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:33.641356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:33.661412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:33.662393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:33.663119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:33.664112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:33.665260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:33.671315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:34.336258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:34.363499 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b9d5e40-0ede-4c79-a098-d36adcbf5dd5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.739389 Nov 02 21:24:34.367932 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 427/823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:33 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:34.392343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:34.393347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] [instance: f433e0da-82f2-4c39-8781-c6375f1935f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:34.412683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:34.415509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:34.416243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:34.419994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:34.421081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:34.422760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:34.481843 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] HTTP exception thrown: Instance f433e0da-82f2-4c39-8781-c6375f1935f7 could not be found. Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Request method failure captured: Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 HTTP/1.1 Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt_FnUp5n06pQat48XT3cTXMR3KYTcvBhkmEdWsu8x2xklNfooI8ftAieF527-y2js1NZ8Jq2PMr4zl3aezqmoWpBN-GS0ugRTVnP-3COpImuvFZtYtwmxYJ1DzlTPlOQ_cEcrbAAQ0muEkb8C5pNbQ7AM__GtMgtVBiVc1JlqFZHvY Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e67258fa3a5247389ddb9ceeedba9076 Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-116464497 Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:34.483800 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e67258fa3a5247389ddb9ceeedba9076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersAdminNegativeTestJSON-116464497 Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e67258fa3a5247389ddb9ceeedba9076 Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-116464497 Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersAdminNegativeTestJSON-116464497-project Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 93744d04892f4736b9458281d1c5ca2a Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersAdminNegativeTestJSON-116464497-project Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f433e0da-82f2-4c39-8781-c6375f1935f7 could not be found. Nov 02 21:24:34.485196 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f433e0da-82f2-4c39-8781-c6375f1935f7'} Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f433e0da-82f2-4c39-8781-c6375f1935f7 could not be found. Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:34.486040 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f433e0da-82f2-4c39-8781-c6375f1935f7 could not be found. Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f433e0da-82f2-4c39-8781-c6375f1935f7 could not be found. Nov 02 21:24:34.487852 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:34.490908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] Returning 404 to user: Instance f433e0da-82f2-4c39-8781-c6375f1935f7 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:34.492085 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35027786-efaf-48a9-85b9-8e29f9925ddf tempest-ServersAdminNegativeTestJSON-116464497 tempest-ServersAdminNegativeTestJSON-116464497-project] 10.222.0.25 "GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7" status: 404 len: 111 microversion: 2.1 time: 0.119247 Nov 02 21:24:34.493569 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 428/824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:34 2022] GET /compute/v2.1/servers/f433e0da-82f2-4c39-8781-c6375f1935f7 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:34.534328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:34.557668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:34.563024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:34.566227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:34.567025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:34.568380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:34.571475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:34.572191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:35.109579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:35.113380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:35.125149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:35.132505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:35.141197 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-726ab427-6668-4015-bc98-8626894aad8d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1361 microversion: 2.25 time: 0.638571 Nov 02 21:24:35.141197 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 429/825] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:34 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1361 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:35.143279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:35.144301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:35.169825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:35.169825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:35.169825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:35.171558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:35.172568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:35.175368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:35.788527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:35.810639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:35.815840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:35.830311 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-637e59a3-e783-4a74-942d-3fc8b58e2b83 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.691856 Nov 02 21:24:35.850004 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 430/826] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:35 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:35.868592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:35.875508 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-37daae56-eeca-4414-ba5e-fdc302d0f674 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/4d555de7-7b27-42ad-8d2e-5fb59f5f7e44" status: 202 len: 0 microversion: 2.1 time: 3.141779 Nov 02 21:24:35.875508 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 397/827] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:24:32 2022] DELETE /compute/v2.1/os-floating-ips/4d555de7-7b27-42ad-8d2e-5fb59f5f7e44 => generated 0 bytes in 3145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:35.882060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:35.883053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:35.886206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:35.909277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:35.910001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:35.910620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:35.911051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:35.911739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:35.912758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:35.913393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:35.915119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:35.915951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:35.917439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:35.917759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:35.919823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:36.718789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:36.732360 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51969e76-dc25-4a3a-9d64-449cfa25c359 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.872746 Nov 02 21:24:36.748623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 431/828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:35 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:36.748623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3f3975a2-7f67-4cd7-adf9-0651ac955485 req-a2f25921-8ceb-4097-8a10-2a31410bf6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a35e18-355f-4fc3-ab55-c9546c8bfb42", "name": "network-vif-plugged", "status": "completed", "tag": "97b6314e-b34f-4ab8-93c1-efdbbe8346b3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:36.769051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3f3975a2-7f67-4cd7-adf9-0651ac955485 req-a2f25921-8ceb-4097-8a10-2a31410bf6fc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:36.769698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3f3975a2-7f67-4cd7-adf9-0651ac955485 req-a2f25921-8ceb-4097-8a10-2a31410bf6fc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:36.770316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3f3975a2-7f67-4cd7-adf9-0651ac955485 req-a2f25921-8ceb-4097-8a10-2a31410bf6fc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:36.782369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:36.783744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3f3975a2-7f67-4cd7-adf9-0651ac955485 req-a2f25921-8ceb-4097-8a10-2a31410bf6fc service nova] Creating event network-vif-plugged:97b6314e-b34f-4ab8-93c1-efdbbe8346b3 for instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 on n-h1-860863-4 Nov 02 21:24:36.792798 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03559e9b-8b78-461b-a82b-fe97828bca06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.916308 Nov 02 21:24:36.795013 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 398/829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:35 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:36.799798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:36.800390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:36.810517 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3f3975a2-7f67-4cd7-adf9-0651ac955485 req-a2f25921-8ceb-4097-8a10-2a31410bf6fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076254 Nov 02 21:24:36.811717 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 432/830] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:36.817722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:36.818461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:36.819089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:36.820004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:36.820628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:36.821282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:36.841865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:36.844670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:36.852702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:36.853416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:36.855084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:36.855787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:36.856329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:36.857048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:36.861652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:24:37.108093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:37.150007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:37.167874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:37.170176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:37.172241 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c19131cf-9d49-47c7-87e2-9b318c1a7743 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1361 microversion: 2.25 time: 0.358297 Nov 02 21:24:37.174313 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 433/831] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:36 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1361 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:37.179802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:37.180679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:37.199160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.201111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.202358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:37.203660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.204669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.206119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:37.309144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0d487393-783d-4da3-a8b8-de8472dcb8c6 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 204 len: 0 microversion: 2.1 time: 0.512621 Nov 02 21:24:37.309879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 399/832] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:36 2022] DELETE /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:37.314572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:37.324216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:37.325519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:37.327498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:37.328494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:37.334991 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb5b45f9-bad7-4564-99f0-b656035ec51a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.158499 Nov 02 21:24:37.345051 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 434/833] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:37 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:37.353101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.353101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.353101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:37.353101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.355643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.355643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:37.579547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:37.589767 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ddd5e03d-2eaf-4c74-926d-d186adc9fef3 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1525 microversion: 2.1 time: 0.270286 Nov 02 21:24:37.590535 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 400/834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:37 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1525 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:37.757125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:37.760068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:37.774501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.777637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.784389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:37.787810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.789714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.790946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:37.822473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:37.823381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:37.842940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.843453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.848744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:37.849837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:37.856485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:37.862361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:38.154209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.166603 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89490de5-7d71-4c1e-88f3-b83e040f61bc tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.414410 Nov 02 21:24:38.177206 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 435/835] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:37 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:38.202274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:38.203014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:38.212369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:38.214230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:38.214845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:38.219168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:38.219863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:38.229095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:38.296554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.307208 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-943c22cd-4654-4c41-bd58-2e2fe86d6713 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.487085 Nov 02 21:24:38.311628 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 401/836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:37 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:38.374764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:38.375835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:38.386295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:38.388990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:38.389796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:38.393781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:38.395226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:38.397075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:38.615511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.630154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.633173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.651888 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b09aae1a-b0ee-423f-b535-6806e6159e72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.287931 Nov 02 21:24:38.653369 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 402/837] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:38 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:24:38.663875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:38.665991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:38.677147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:38.680549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:38.681338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:38.683735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:38.684451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:38.686882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:38.725514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.756312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.763645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:38.766498 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd623881-1409-4911-9583-eba7d6aa82f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1361 microversion: 2.25 time: 0.568171 Nov 02 21:24:38.785352 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 436/838] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:38 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1361 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:39.131619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:39.141202 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e4d7b79-ca7e-4b77-8344-4fa14ada0dc5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1525 microversion: 2.1 time: 0.486347 Nov 02 21:24:39.142893 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 403/839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:38 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1525 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:39.199882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:39.200797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:39.208343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.209356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.209986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.211159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.211957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.212553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.347535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:39.348085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:39.356285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.364234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.364234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.364234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.364234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.364962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.499665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:39.514704 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70a972db-cb38-451a-a3e7-a27995e34b3e tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.321495 Nov 02 21:24:39.515295 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 437/840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:39 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:39.699022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:39.701590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:39.714795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:39.733462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-609fa57c-4593-4214-b7a7-239ff8161a06 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1498 microversion: 2.1 time: 0.390102 Nov 02 21:24:39.735336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:39.737333 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 404/841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:39 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1498 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:39.741802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.746594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.748857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.755426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.756230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.757543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.812845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:39.813913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:39.837057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.838757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.840824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.848792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:39.849651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:39.851056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:39.858467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:39.886903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:39.896689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:39.930802 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e5ba3c4-78e0-418a-9a9b-c92cf111591d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.240588 Nov 02 21:24:39.937528 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 438/842] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:39 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:24:40.172688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:40.176248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:40.228193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:40.228193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:40.228193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:40.228193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:40.228723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:40.228723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:40.228908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:40.261247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:40.264620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:40.266019 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4eb8382a-4728-420f-ab55-d7ef0722e34e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1556 microversion: 2.25 time: 0.466986 Nov 02 21:24:40.266891 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 405/843] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:39 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1556 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:40.307290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:40.316275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:40.349400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:40.351701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:40.352158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:40.353103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:40.353598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:40.359214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:40.968440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:40.979732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0db11716-fd00-4eab-b86c-e8a4fab30d99 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1525 microversion: 2.1 time: 0.816743 Nov 02 21:24:40.999565 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 439/844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:40 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1525 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:41.006891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:41.007876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:41.017127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid c0a35e18-355f-4fc3-ab55-c9546c8bfb42 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:41.017748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.018545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.032148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.036808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.037596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.039492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.046305 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a0189b1-6a50-4768-88f8-440228aad1ae tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 2048 microversion: 2.25 time: 0.755854 Nov 02 21:24:41.046905 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 406/845] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:40 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 2048 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:24:41.060329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:41.062308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:41.081117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.081753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.082311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.084435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.085007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.089181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.584341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:41.600364 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d9db852-c857-4192-9a96-9326e716fefd tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.599255 Nov 02 21:24:41.601282 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 440/846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:40 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:41.606578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:41.607191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:41.610188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:41.620550 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae7730f7-b80b-4cb3-9361-b78ae9c411fe tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 200 len: 1475 microversion: 2.1 time: 0.564581 Nov 02 21:24:41.639376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.639376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.639376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.639376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.639913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.639913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.640134 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 407/847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:41 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 1475 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:41.640134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:41.640134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:41.656648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.656648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.656648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.656648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.657184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.657184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.828205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:41.850209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:41.853712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:41.865606 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad5db0c6-5a3c-44ca-aa23-979f44542032 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.263195 Nov 02 21:24:41.867250 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 441/848] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:41 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:41.882938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1004711144"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:41.888724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:41.910112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.912494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.914268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:41.915551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:41.919104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:41.920422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.247870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid c0a35e18-355f-4fc3-ab55-c9546c8bfb42 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:42.270642 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1971ca69-9fb9-4a90-b794-1d51742b0880 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 2048 microversion: 2.25 time: 0.636128 Nov 02 21:24:42.280458 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 408/849] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:41 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 2048 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:42.295864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:42.296419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:42.332967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.333800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.335816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.340178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.340920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.341752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.661614 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9bdac9b-dd1b-4cb8-aabc-a4afdb1f4844 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2/action" status: 202 len: 0 microversion: 2.1 time: 0.792315 Nov 02 21:24:42.675465 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 442/850] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:24:41 2022] POST /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2/action => generated 0 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:24:42.688281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:42.694324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.694324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.694324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.694324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.695159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.695938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.723702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b71c70e3-70dc-455e-b467-a52bc0371990 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044704 Nov 02 21:24:42.725566 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 443/851] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 21:24:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:24:42.730403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:42.731403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:42.738273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.738766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.739209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.739914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.740541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.741176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.793895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:42.806584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2dddc7ef-90ba-4426-be77-e3612cc0aab5 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1525 microversion: 2.1 time: 0.522326 Nov 02 21:24:42.807426 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 409/852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:42 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1525 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:42.826819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1181c06-1065-4125-9a28-0d0cd0ce2a4a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691af940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:42.910227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1181c06-1065-4125-9a28-0d0cd0ce2a4a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.086844 Nov 02 21:24:42.911217 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 410/853] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:42 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:42.936334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:42.936334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:42.956966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.957457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.957908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:42.969165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:42.969671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:42.970329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:43.092561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:43.115788 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-64b4bec1-1be9-43d1-ae8f-8178542ef4d4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.390016 Nov 02 21:24:43.122591 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 444/854] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:42 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:43.140533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:43.141485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:43.166093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:43.167586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:43.168401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:43.169349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:43.169970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:43.170583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:43.334806 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-505c7d7f-fbee-4a55-8e7c-7eab2cb8b8bd tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42/action" status: 202 len: 0 microversion: 2.25 time: 0.409537 Nov 02 21:24:43.342559 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 411/855] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:24:42 2022] POST /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:43.346808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:43.364317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:43.364317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:43.368892 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84579216-b17f-442f-b25e-406caac3dd5d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.244834 Nov 02 21:24:43.370812 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 445/856] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:43 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:43.397931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:43.398833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:43.406214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:43.406962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:43.407538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:43.409758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:43.410411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:43.411017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:43.460266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:43.877932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:43.881555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:43.882020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:43.882455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:43.892166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:43.892166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:43.892166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.002709 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-37277636-b499-47cd-82df-c0607d012ff5 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.654938 Nov 02 21:24:44.005893 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 412/857] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:24:43 2022] GET /compute/v2.1/os-services => generated 944 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:44.016637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.018675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:44.025046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.026427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.027136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.027874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.028341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.028874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.154506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:44.169775 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-887f5df4-f648-464d-a3ee-f90527bf4eaf tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1308 microversion: 2.1 time: 0.162407 Nov 02 21:24:44.170402 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 413/858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:44.183415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-120f524f-44db-479d-8345-a5247885fa20 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691b94c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.230948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid c0a35e18-355f-4fc3-ab55-c9546c8bfb42 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:44.286182 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-120f524f-44db-479d-8345-a5247885fa20 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.114844 Nov 02 21:24:44.287613 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 414/859] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:44.294014 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ff061e4-82b4-4e3c-a6e2-058850641e2b tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 2053 microversion: 2.25 time: 0.903101 Nov 02 21:24:44.294814 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 446/860] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:43 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 2053 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:44.302198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.305294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b3b3f04b-7d51-4039-af14-48a8e587543f req-dd3810dd-a813-4aac-89a5-56850291c62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527718c-baf8-4607-a25c-3cf3d6d4a540", "name": "network-vif-deleted", "tag": "0bb6edec-16b6-4bc9-93e6-f0f2955f0528"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:44.305854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.321663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.336030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3b3f04b-7d51-4039-af14-48a8e587543f req-dd3810dd-a813-4aac-89a5-56850291c62e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.339877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3b3f04b-7d51-4039-af14-48a8e587543f req-dd3810dd-a813-4aac-89a5-56850291c62e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.345184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3b3f04b-7d51-4039-af14-48a8e587543f req-dd3810dd-a813-4aac-89a5-56850291c62e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.347659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.359484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.360049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.373465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.379894 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b3b3f04b-7d51-4039-af14-48a8e587543f req-dd3810dd-a813-4aac-89a5-56850291c62e service nova] Creating event network-vif-deleted:0bb6edec-16b6-4bc9-93e6-f0f2955f0528 for instance d527718c-baf8-4607-a25c-3cf3d6d4a540 on n-h1-860863-4 Nov 02 21:24:44.395007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b3b3f04b-7d51-4039-af14-48a8e587543f req-dd3810dd-a813-4aac-89a5-56850291c62e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105747 Nov 02 21:24:44.397285 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 415/861] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:44.412575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.414656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:44.425841 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f44fa74-1648-47c8-aae3-2296e26dc6e8 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.130106 Nov 02 21:24:44.426788 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 447/862] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:44.439503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.440005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.440907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.442297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:44.443183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.443920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.444387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.445821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.467953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.468784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.469885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.472399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.473181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.473908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.646982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:44.656472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:44.665091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:44.670926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d109768-d9e1-4b2a-a5fc-8e263ea31062 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.242937 Nov 02 21:24:44.672014 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 448/863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:44.675797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:44.676966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.680756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.681455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.682610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.683509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.684118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.684722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.685386 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7f74c558-e3cc-4809-995d-2a27ffba53c6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.285408 Nov 02 21:24:44.686609 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 416/864] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:44.714271 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e89388f-0fde-40b3-b842-bf1473afa0f2 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.041040 Nov 02 21:24:44.714895 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 449/865] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:44.727206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.731258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.731931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.732570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.733504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.734110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.734717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.761242 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7df93792-db64-4300-8f7d-19f320a1c18e tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-860863-4&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037641 Nov 02 21:24:44.761850 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 417/866] 10.222.0.25 () {58 vars in 1194 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/os-services?host=n-d-860863-4&binary=xxx => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:24:44.776005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.780257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.780776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.781508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.782402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.783034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.783522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.828576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd882d94-9929-4d41-bc9b-40662e94ef6c tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.057349 Nov 02 21:24:44.829694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 450/867] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:44.843325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:44.848046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.848592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.849211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.849992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:44.850631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:44.851117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:44.890106 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6329555b-ca5f-432d-adad-69f6e7a3a2a0 tempest-ServicesAdminNegativeTestJSON-572385882 tempest-ServicesAdminNegativeTestJSON-572385882-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.051946 Nov 02 21:24:44.891095 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 418/868] 10.222.0.25 () {58 vars in 1198 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 21:24:45.142815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6285044-2d36-4d5b-bba8-ec6016aba1c5 tempest-ServicesAdminNegativeTestJSON-1366584299 tempest-ServicesAdminNegativeTestJSON-1366584299-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:45.147102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6285044-2d36-4d5b-bba8-ec6016aba1c5 tempest-ServicesAdminNegativeTestJSON-1366584299 tempest-ServicesAdminNegativeTestJSON-1366584299-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3bfde00606ee4128a7af8f5e9e9a2fe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152cd2c6021b47f284198313b2994511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6285044-2d36-4d5b-bba8-ec6016aba1c5 tempest-ServicesAdminNegativeTestJSON-1366584299 tempest-ServicesAdminNegativeTestJSON-1366584299-project] Request method failure captured: Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAY3_JRsmuVkuvosLDCfiI0dLitiR-HnaLndzMC05oJAgUU2lmSzV7lX11t1DmGg71wPaE6WzJACAjLYO-XhrknHZ4aoCMhTzjWBcJ8_aBJ0KEXenwA6wa19r6XmWjPQIuxFCernV5YX97fXrSGSk7454BrDun2HNmcVrypyInXon4 Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 152cd2c6021b47f284198313b2994511 Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1366584299 Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:45.149283 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_152cd2c6021b47f284198313b2994511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/152cd2c6021b47f284198313b2994511"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/152cd2c6021b47f284198313b2994511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/152cd2c6021b47f284198313b2994511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1366584299 Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 152cd2c6021b47f284198313b2994511 Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1366584299 Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServicesAdminNegativeTestJSON-1366584299-project Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 3bfde00606ee4128a7af8f5e9e9a2fe8 Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1366584299-project Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 21:24:45.151229 n-d-860863-4 devstack@n-api.service[121040]: action_args: {} Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:24:45.152176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 21:24:45.153651 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:45.155133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6285044-2d36-4d5b-bba8-ec6016aba1c5 tempest-ServicesAdminNegativeTestJSON-1366584299 tempest-ServicesAdminNegativeTestJSON-1366584299-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:45.155133 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6285044-2d36-4d5b-bba8-ec6016aba1c5 tempest-ServicesAdminNegativeTestJSON-1366584299 tempest-ServicesAdminNegativeTestJSON-1366584299-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.252673 Nov 02 21:24:45.155133 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 451/869] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:24:44 2022] GET /compute/v2.1/os-services => generated 112 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:45.201968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:45.204354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:45.227975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.231599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.234415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.235435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.237668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.238374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.262732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:45.283227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.284035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.285220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.285220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lazy-loading 'fault' on Instance uuid d527718c-baf8-4607-a25c-3cf3d6d4a540 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:45.332583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fce7be56a04270b9d8adf4285bb85f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e60f37a8d4b8694acb88ffc736368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:45.336905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:45.337557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:45.341193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b7659bbf-d166-4824-9545-988105fe7e22 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 200 len: 1313 microversion: 2.1 time: 0.150884 Nov 02 21:24:45.341785 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 419/870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:45 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:45.349466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.358370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.358969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.362844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.362844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.362844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.418510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f956b731-6bf6-41d7-9437-d43b07b7a601 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691b90d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:45.499801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f956b731-6bf6-41d7-9437-d43b07b7a601 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.075806 Nov 02 21:24:45.499801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 420/871] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:45 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:45.549242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid c0a35e18-355f-4fc3-ab55-c9546c8bfb42 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:45.586547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f1a0c74-77e4-4b29-80d6-feffe088a63a tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 2033 microversion: 2.25 time: 0.250034 Nov 02 21:24:45.588769 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 452/872] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:45 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 2033 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:45.616865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": "auto"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:45.619960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:45.627983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.628770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.629405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.630436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.631144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.631729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.667182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'flavor' on Instance uuid c0a35e18-355f-4fc3-ab55-c9546c8bfb42 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:45.683833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121039) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:24:45.696978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:45.711460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:45.712113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:45.729993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.730979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.731618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.732503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.733531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.734224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.863221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:45.876460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:45.879542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:45.887723 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee4d4e89-bb61-43bb-8277-9da5aa511da5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.183857 Nov 02 21:24:45.909224 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 453/873] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:45 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:24:45.923106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:45.923726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:45.936203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.937170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.940720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:45.953549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:45.953549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:45.953549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:46.208836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:46.216554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0e17784-31cf-4f12-aca9-bf954a8cea97 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.306227 Nov 02 21:24:46.217238 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 454/874] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:45 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:46.556829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25be0de0-bb97-417c-a774-2981b6e59b83 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1817373415", "id": 1902801597, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:46.642063 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25be0de0-bb97-417c-a774-2981b6e59b83 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.423840 Nov 02 21:24:46.643747 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 455/875] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:46 2022] POST /compute/v2.1/flavors => generated 430 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:46.649295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:46.649974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] [instance: d527718c-baf8-4607-a25c-3cf3d6d4a540] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:46.659103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:46.659804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:46.660350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:46.661144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:46.661831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:46.662368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:46.685477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] HTTP exception thrown: Instance d527718c-baf8-4607-a25c-3cf3d6d4a540 could not be found. Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Request method failure captured: Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 HTTP/1.1 Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt_DXSCPHpSX1pzJPeTwr5qSAqOys5BDgqRFgOM86WDLJRdvTQSLEZqttzfNa-g0llC12geR0CPN88s4qbVcnkSII766KxvjeRn9qA39cfd8YhfCyFOPv9nnw6sg3VR8Krmxy2JCxz3gMNczeFMwpvToL5yNj7Uhz5jt72cFxZ__jsE Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:46.687504 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/474e60f37a8d4b8694acb88ffc736368"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 474e60f37a8d4b8694acb88ffc736368 Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-126973032 Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 00fce7be56a04270b9d8adf4285bb85f Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-126973032-project Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance d527718c-baf8-4607-a25c-3cf3d6d4a540 could not be found. Nov 02 21:24:46.688867 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd527718c-baf8-4607-a25c-3cf3d6d4a540'} Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d527718c-baf8-4607-a25c-3cf3d6d4a540 could not be found. Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:46.689686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d527718c-baf8-4607-a25c-3cf3d6d4a540 could not be found. Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d527718c-baf8-4607-a25c-3cf3d6d4a540 could not be found. Nov 02 21:24:46.690854 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:46.692074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] Returning 404 to user: Instance d527718c-baf8-4607-a25c-3cf3d6d4a540 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:46.692074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a15c430-9b0c-486d-ab95-d3670eb42254 tempest-FloatingIPsAssociationTestJSON-126973032 tempest-FloatingIPsAssociationTestJSON-126973032-project] 10.222.0.25 "GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540" status: 404 len: 111 microversion: 2.1 time: 0.043955 Nov 02 21:24:46.692074 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 456/876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:46 2022] GET /compute/v2.1/servers/d527718c-baf8-4607-a25c-3cf3d6d4a540 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:24:46.698648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f7e4b1a2-9aca-45b1-b1a5-c487ca8c10f4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68ffd550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:46.793671 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f7e4b1a2-9aca-45b1-b1a5-c487ca8c10f4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.096658 Nov 02 21:24:46.795484 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 457/877] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:46 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:46.804657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84596db5-9870-436d-b764-4951ff05f39f tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:46.994603 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84596db5-9870-436d-b764-4951ff05f39f tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1902801597" status: 202 len: 0 microversion: 2.1 time: 0.196953 Nov 02 21:24:46.995291 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 458/878] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:24:46 2022] DELETE /compute/v2.1/flavors/1902801597 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:47.019359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:47.019929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:47.037846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:47.038349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:47.038789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:47.039489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:47.040121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:47.043334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:47.133734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:47.143661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:47.145417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:47.153725 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa562a61-1e25-4e92-918b-f60fed9acf8d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.157464 Nov 02 21:24:47.154696 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 459/879] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:46 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:47.159172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e8e8f58-3179-4463-818a-89baec92c466 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:47.211458 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e8e8f58-3179-4463-818a-89baec92c466 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055598 Nov 02 21:24:47.213718 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 460/880] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:47.238209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3fb05b3c-88ad-4ab5-b930-61d75fad65af req-731ec563-201a-4338-bd56-d9c881e9f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a3e5b8-5d0c-4307-960d-4da823a904a2", "name": "network-vif-plugged", "status": "completed", "tag": "a28dda6b-a1c2-4b33-90e0-80e0ecccf79c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:47.255091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3fb05b3c-88ad-4ab5-b930-61d75fad65af req-731ec563-201a-4338-bd56-d9c881e9f1bd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:47.255506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3fb05b3c-88ad-4ab5-b930-61d75fad65af req-731ec563-201a-4338-bd56-d9c881e9f1bd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:47.255927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3fb05b3c-88ad-4ab5-b930-61d75fad65af req-731ec563-201a-4338-bd56-d9c881e9f1bd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:47.281114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3fb05b3c-88ad-4ab5-b930-61d75fad65af req-731ec563-201a-4338-bd56-d9c881e9f1bd service nova] Creating event network-vif-plugged:a28dda6b-a1c2-4b33-90e0-80e0ecccf79c for instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 on n-h1-860863-4 Nov 02 21:24:47.287100 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3fb05b3c-88ad-4ab5-b930-61d75fad65af req-731ec563-201a-4338-bd56-d9c881e9f1bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067131 Nov 02 21:24:47.288013 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 461/881] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:47.294820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3499cce4-b7f8-4a55-8267-0373e2b149cb tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-373758050", "id": 1492583649, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:47.420423 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3499cce4-b7f8-4a55-8267-0373e2b149cb tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.131150 Nov 02 21:24:47.421522 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 462/882] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:47 2022] POST /compute/v2.1/flavors => generated 416 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:47.429005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:47.430509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:47.438383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:47.439132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:47.439575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:47.440281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:47.440736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:47.441275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:47.744790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:47.769144 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2dcfcace-d110-4fda-8000-30e2a6c52049 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1471 microversion: 2.1 time: 0.341689 Nov 02 21:24:47.776303 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 463/883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:47 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:47.780799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8dacf1be-7ef7-450c-a09d-68b45644104b tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:47.870021 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8dacf1be-7ef7-450c-a09d-68b45644104b tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.094594 Nov 02 21:24:47.871070 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 464/884] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:47 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:47.881104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72a661ba-57ae-473e-89dd-be63a346fd8b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f388b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:50.295461 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72a661ba-57ae-473e-89dd-be63a346fd8b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 2.420558 Nov 02 21:24:50.296359 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 465/885] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:47 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:50.329715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-013bda6d-6e6b-49bb-98af-b6f13f6dfeef tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:50.500411 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-013bda6d-6e6b-49bb-98af-b6f13f6dfeef tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1492583649" status: 202 len: 0 microversion: 2.1 time: 0.202466 Nov 02 21:24:50.505299 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 466/886] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:24:50 2022] DELETE /compute/v2.1/flavors/1492583649 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:50.512135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:50.513299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:50.550242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:50.550715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:50.551167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:50.551886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:50.552581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:50.570516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:50.725061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:50.739343 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92174e2b-4468-4718-af83-4a35984159ca tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42/action" status: 202 len: 0 microversion: 2.25 time: 5.128773 Nov 02 21:24:50.742177 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 421/887] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:24:45 2022] POST /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42/action => generated 0 bytes in 5132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:50.748725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:50.748880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:50.749600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:50.749745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:50.785886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:50.785886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:50.785886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:50.786251 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f60c8cd0-e883-4ff9-96eb-6f66ebe13221 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1533 microversion: 2.91 time: 0.266164 Nov 02 21:24:50.786349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:50.786442 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 467/888] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:50 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1533 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:50.786529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:50.786529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:50.786687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8913cea6-32cf-48b7-bbd1-d6e310aed6d9 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:50.837022 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8913cea6-32cf-48b7-bbd1-d6e310aed6d9 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062018 Nov 02 21:24:50.840761 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 468/889] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:50.846515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:50.847333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:50.887982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:50.891083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:50.891881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:50.894491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:50.894972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:50.910313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:51.232231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:51.248776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-be1d0deb-2a6b-4a11-a294-9749f0a1e3c1 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 0.504649 Nov 02 21:24:51.267401 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 422/890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:50 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:51.278419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:51.278762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:51.286400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:51.288538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:51.288538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:51.288538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:51.289575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:51.290261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:51.397204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:51.409631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:51.414398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:51.415622 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a86a7784-d821-4dc2-b9db-71ddb7fe76ee tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 0.573570 Nov 02 21:24:51.417932 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 469/891] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:50 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:51.426511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-202eef2d-f823-451f-a358-d480096880bc tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-339795808", "id": 383583712, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:51.470724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lazy-loading 'services' on Instance uuid e97f5885-4d7e-4cda-a26a-9fe0358fd787 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:51.493187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb049a1e-8842-4797-89aa-538fbb84eb0c tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1938 microversion: 2.91 time: 0.224526 Nov 02 21:24:51.498955 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 423/892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:51 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1938 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:51.505898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-64063020-6ace-412d-a0ff-283f0375652b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691fe430>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:51.519668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-202eef2d-f823-451f-a358-d480096880bc tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.096957 Nov 02 21:24:51.521485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 470/893] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:51 2022] POST /compute/v2.1/flavors => generated 425 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:51.539522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf33fbe7-b9f0-4d36-9106-aa0b713aabcf tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:51.569455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=7 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:51.599674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-64063020-6ace-412d-a0ff-283f0375652b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.099417 Nov 02 21:24:51.600338 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 424/894] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:51 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:51.642450 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf33fbe7-b9f0-4d36-9106-aa0b713aabcf tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/383583712" status: 202 len: 0 microversion: 2.1 time: 0.107803 Nov 02 21:24:51.643693 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 471/895] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:24:51 2022] DELETE /compute/v2.1/flavors/383583712 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:51.652899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-733412a0-4c9e-41d9-82da-9e5cff6cd103 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:51.664154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:51.664702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:51.685701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:51.690996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:51.691583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:51.693229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:51.693712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:51.694158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:51.712270 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-733412a0-4c9e-41d9-82da-9e5cff6cd103 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064168 Nov 02 21:24:51.714581 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 472/896] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:51.746416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a97b6386-6b87-4501-a2b6-08b603ffe63b tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1014311144", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:51.779236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lazy-loading 'flavor' on Instance uuid e97f5885-4d7e-4cda-a26a-9fe0358fd787 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:24:51.845169 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a97b6386-6b87-4501-a2b6-08b603ffe63b tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.105621 Nov 02 21:24:51.846463 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 473/897] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:51 2022] POST /compute/v2.1/flavors => generated 507 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:51.860390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89fa074d-b290-451f-816f-e593350e9da1 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:51.949429 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89fa074d-b290-451f-816f-e593350e9da1 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/917b2483-8236-47c0-b895-f63a22cc37cc" status: 202 len: 0 microversion: 2.1 time: 0.093259 Nov 02 21:24:51.953859 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 474/898] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:51 2022] DELETE /compute/v2.1/flavors/917b2483-8236-47c0-b895-f63a22cc37cc => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:51.959523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4242d81-d475-4098-bf44-2f7171c1c5bf tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:52.024161 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4242d81-d475-4098-bf44-2f7171c1c5bf tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069113 Nov 02 21:24:52.031240 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 475/899] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:52.049301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b271c520-2b6d-44cb-99a7-b49783bd4c90 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-730428301", "id": "d9d4aa0e-4ceb-4516-b682-b1d836c95a4c", "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:52.156731 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b271c520-2b6d-44cb-99a7-b49783bd4c90 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.112633 Nov 02 21:24:52.157505 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 476/900] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:52 2022] POST /compute/v2.1/flavors => generated 506 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:52.200922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cedca7de-990b-4b00-9b75-eb444095a7f3 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:52.325319 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cedca7de-990b-4b00-9b75-eb444095a7f3 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/d9d4aa0e-4ceb-4516-b682-b1d836c95a4c" status: 202 len: 0 microversion: 2.1 time: 0.153526 Nov 02 21:24:52.326515 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 477/901] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:24:52 2022] DELETE /compute/v2.1/flavors/d9d4aa0e-4ceb-4516-b682-b1d836c95a4c => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:52.331545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:52.335951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:52.349283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:52.355864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:52.356454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:52.357311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:52.357841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:52.358832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:52.543573 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a2db93d-24a5-4706-9d1f-37f05933e95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action" status: 202 len: 0 microversion: 2.91 time: 0.894885 Nov 02 21:24:52.545226 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 425/902] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:24:51 2022] POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:24:52.559742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-152d1d1c-5def-4020-9060-603c6e274271 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:52.596905 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-152d1d1c-5def-4020-9060-603c6e274271 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048547 Nov 02 21:24:52.598151 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 426/903] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:52.604852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:52.611786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:52.617575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:52.618542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:52.619271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:52.620184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:52.621088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:52.621677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:52.973760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:52.984168 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6daf50a6-2bb8-4ff9-a329-a0a24ebb215b tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 0.656281 Nov 02 21:24:52.989574 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 478/904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:52 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:52.996058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:53.000789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:53.014286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:53.019424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:53.023467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:53.024549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:53.025861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:53.031865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:53.043375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:53.049273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:53.053494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:53.058246 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-20dc214e-bbb5-4ee2-b9a5-16789fcd28da tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 0.457675 Nov 02 21:24:53.060483 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 427/905] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:52 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:53.072845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55603d3a-1481-4a16-af87-e49053f52dcc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691a6d30>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:53.153090 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55603d3a-1481-4a16-af87-e49053f52dcc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.090241 Nov 02 21:24:53.154458 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 428/906] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:53 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:53.167569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c8c57c2-4e1b-419a-a159-d2f1509dc8e6 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-352111132", "id": 596676180, "os-flavor-access:is_public": "True"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:53.208306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:53.220614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:53.234516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:53.248051 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b9165a72-12af-41db-99e5-55385bd1ca81 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.257102 Nov 02 21:24:53.261196 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 479/907] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:52 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:53.273241 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c8c57c2-4e1b-419a-a159-d2f1509dc8e6 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.104070 Nov 02 21:24:53.276604 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 429/908] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:53 2022] POST /compute/v2.1/flavors => generated 410 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:53.296829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e76111f9-268e-45a3-bd17-9acdda0d8180 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:53.306157 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e76111f9-268e-45a3-bd17-9acdda0d8180 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/596676180" status: 200 len: 410 microversion: 2.1 time: 0.014384 Nov 02 21:24:53.307479 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 480/909] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:24:53 2022] GET /compute/v2.1/flavors/596676180 => generated 410 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:53.673032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fe543e3d-41c4-468c-9cb4-c56ca5cdb0f2 req-f3861c54-6f69-4ff3-9f00-d29f90bcdc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a35e18-355f-4fc3-ab55-c9546c8bfb42", "name": "network-vif-unplugged", "status": "completed", "tag": "97b6314e-b34f-4ab8-93c1-efdbbe8346b3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:53.717417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fe543e3d-41c4-468c-9cb4-c56ca5cdb0f2 req-f3861c54-6f69-4ff3-9f00-d29f90bcdc29 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:53.719975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fe543e3d-41c4-468c-9cb4-c56ca5cdb0f2 req-f3861c54-6f69-4ff3-9f00-d29f90bcdc29 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:53.721324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fe543e3d-41c4-468c-9cb4-c56ca5cdb0f2 req-f3861c54-6f69-4ff3-9f00-d29f90bcdc29 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:53.740165 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fe543e3d-41c4-468c-9cb4-c56ca5cdb0f2 req-f3861c54-6f69-4ff3-9f00-d29f90bcdc29 service nova] Creating event network-vif-unplugged:97b6314e-b34f-4ab8-93c1-efdbbe8346b3 for instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 on n-h1-860863-4 Nov 02 21:24:53.755808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fe543e3d-41c4-468c-9cb4-c56ca5cdb0f2 req-f3861c54-6f69-4ff3-9f00-d29f90bcdc29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092938 Nov 02 21:24:53.759833 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 481/910] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:24:53.779255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ddcb314-cb5f-4514-9dcc-392b50c68618 tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:53.807924 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ddcb314-cb5f-4514-9dcc-392b50c68618 tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.491866 Nov 02 21:24:53.821015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 430/911] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:53 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:53.828366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45e7a147-3565-4c4a-b005-3118fad17116 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:53.959807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-45e7a147-3565-4c4a-b005-3118fad17116 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/596676180" status: 202 len: 0 microversion: 2.1 time: 0.135288 Nov 02 21:24:53.961108 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 482/912] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:24:53 2022] DELETE /compute/v2.1/flavors/596676180 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:53.970899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e4b6e95-728e-4644-b0ac-5c8585a86893 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:54.013986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:54.015487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:54.020321 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e4b6e95-728e-4644-b0ac-5c8585a86893 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053923 Nov 02 21:24:54.022598 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 431/913] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:54.030410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:54.032434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:54.033456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:54.044167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:54.045106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:54.046700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:54.053367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-787b0e10-b220-4222-a53d-4005d7a1e51c tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1527649321", "id": 1103662833, "os-flavor-access:is_public": "False"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:54.154474 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-787b0e10-b220-4222-a53d-4005d7a1e51c tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.110852 Nov 02 21:24:54.163422 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 432/914] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:54 2022] POST /compute/v2.1/flavors => generated 430 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:54.170821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:54.174860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:54.189609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:54.192717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:54.193400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:54.195119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:54.198804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:54.201896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:54.599581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:54.613893 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3806d9be-5c98-4e81-a46a-60c692ef6cfb tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 0.602834 Nov 02 21:24:54.616739 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 483/915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:54 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:54.631366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0d20836-d55d-45c3-87bc-f4d1b5cccb1f tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "1103662833"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:54.643862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:54.664796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:54.670908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:54.678216 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df4751a0-d14a-4f14-b7f8-a01aaac455ba tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 0.512983 Nov 02 21:24:54.680079 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 433/916] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:54 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:54.702130 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a0d20836-d55d-45c3-87bc-f4d1b5cccb1f tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] HTTP exception thrown: Flavor 1103662833 could not be found. Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0d20836-d55d-45c3-87bc-f4d1b5cccb1f tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] Request method failure captured: Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 107 Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAc5XVk8O61Gwb2ghggdx7Ay3jOou9gyAU0AM7TwqvSymCHYJq11RWDiFkJaUXQYnDDRcv_DQCy2GIhIjoHAjjzpZjJhTVCz-wkLM5QV0xkJ7GPWSVZfMtROHuJth6SNOjrDPjHGJk2e0dmUMuDgB-nQCGLK5wW5zveHzqLVtdsmGE Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8dbc0dbed77746f7a2db6bbbdd9ad639 Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FlavorsAdminTestJSON-214528829 Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:24:54.709020 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8dbc0dbed77746f7a2db6bbbdd9ad639"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dbc0dbed77746f7a2db6bbbdd9ad639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8dbc0dbed77746f7a2db6bbbdd9ad639"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8dbc0dbed77746f7a2db6bbbdd9ad639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FlavorsAdminTestJSON-214528829 Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8dbc0dbed77746f7a2db6bbbdd9ad639 Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-214528829 Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FlavorsAdminTestJSON-214528829-project Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e22878e955ae4facb83d527fa15bf13b Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FlavorsAdminTestJSON-214528829-project Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "test", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "1103662833"}} Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:24:54.713312 n-d-860863-4 devstack@n-api.service[121040]: exception: Flavor 1103662833 could not be found. Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '1103662833'}}} Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1103662833 could not be found. Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:54.715599 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1103662833 could not be found. Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:24:54.717363 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:24:54.718931 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:24:54.718931 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:24:54.718931 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:24:54.718931 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1103662833 could not be found. Nov 02 21:24:54.718931 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:24:54.718931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0d20836-d55d-45c3-87bc-f4d1b5cccb1f tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] Returning 400 to user: Flavor 1103662833 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:24:54.718931 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0d20836-d55d-45c3-87bc-f4d1b5cccb1f tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.091961 Nov 02 21:24:54.723086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90801af2-585a-4c04-ae3f-fbe1574c97aa tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691a64c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:54.728093 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 484/917] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:54 2022] POST /compute/v2.1/servers => generated 81 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:24:54.765315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:54.765838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:54.787389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:54.790075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:54.790740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:54.793885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:54.795773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:54.797027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:54.800311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:54.830629 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-90801af2-585a-4c04-ae3f-fbe1574c97aa tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.126133 Nov 02 21:24:54.836204 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 434/918] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:54 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:54.859883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eabf6a69-f4e5-4f34-8f1e-9d03cb8ce9af tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:54.868176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:55.006969 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eabf6a69-f4e5-4f34-8f1e-9d03cb8ce9af tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1103662833" status: 202 len: 0 microversion: 2.1 time: 0.168817 Nov 02 21:24:55.008958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:55.014054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 435/919] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:24:54 2022] DELETE /compute/v2.1/flavors/1103662833 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:55.029146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6d97e93b-2b32-4f8e-8045-4d0d1b6fb49c req-a108a211-9a82-41d3-a12a-10a87041e175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e", "name": "network-vif-unplugged", "status": "completed", "tag": "959e5aa8-19e8-427e-86c3-a667021fcc01"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:55.045716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:55.048296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:55.067496 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-603c5cda-b4dd-4ba4-b8c5-87ed6f4e4b7a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.322728 Nov 02 21:24:55.068319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 485/920] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:54 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:55.095336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6d97e93b-2b32-4f8e-8045-4d0d1b6fb49c req-a108a211-9a82-41d3-a12a-10a87041e175 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:55.097693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6d97e93b-2b32-4f8e-8045-4d0d1b6fb49c req-a108a211-9a82-41d3-a12a-10a87041e175 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:55.102205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6d97e93b-2b32-4f8e-8045-4d0d1b6fb49c req-a108a211-9a82-41d3-a12a-10a87041e175 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:55.108583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c1fb6b0-b5d2-48d7-87a4-b6fdf545b18e tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.130762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6d97e93b-2b32-4f8e-8045-4d0d1b6fb49c req-a108a211-9a82-41d3-a12a-10a87041e175 service nova] Creating event network-vif-unplugged:959e5aa8-19e8-427e-86c3-a667021fcc01 for instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e on n-h2-860863-4 Nov 02 21:24:55.138127 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6d97e93b-2b32-4f8e-8045-4d0d1b6fb49c req-a108a211-9a82-41d3-a12a-10a87041e175 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122388 Nov 02 21:24:55.138735 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 436/921] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:55.155438 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c1fb6b0-b5d2-48d7-87a4-b6fdf545b18e tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058055 Nov 02 21:24:55.171579 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 486/922] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:55.180175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-27b59fa0-077e-4fd8-888e-dbd55f360a13 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1978528402", "id": 1520130465, "os-flavor-access:is_public": "False"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:55.299553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-27b59fa0-077e-4fd8-888e-dbd55f360a13 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.123735 Nov 02 21:24:55.301251 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 437/923] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:55 2022] POST /compute/v2.1/flavors => generated 415 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:55.315908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a76f4f32-d95a-4545-a3d5-f4e32ff03a7c tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-353394204", "id": 2056010325, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:55.444920 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a76f4f32-d95a-4545-a3d5-f4e32ff03a7c tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.134525 Nov 02 21:24:55.445964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 487/924] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:55 2022] POST /compute/v2.1/flavors => generated 413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:55.458053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad272ede-c658-4fd2-88e1-be17c53bb6ba tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.501969 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad272ede-c658-4fd2-88e1-be17c53bb6ba tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.047842 Nov 02 21:24:55.505838 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 438/925] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:55.517394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ff03041-b50c-4560-ac5a-a79841de1bff tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.552414 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ff03041-b50c-4560-ac5a-a79841de1bff tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.040606 Nov 02 21:24:55.563428 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 488/926] 10.222.0.25 () {58 vars in 1177 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:55.577087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8996999-2c29-4576-891a-80275babc815 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.599389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8996999-2c29-4576-891a-80275babc815 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.023847 Nov 02 21:24:55.601395 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 439/927] 10.222.0.25 () {58 vars in 1171 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:55.615660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b01587f-036e-4046-807e-78bc85fe78c6 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.632729 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b01587f-036e-4046-807e-78bc85fe78c6 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.022215 Nov 02 21:24:55.640229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.641218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:55.645585 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 489/928] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:55.656388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e3d66c0-1fc7-4726-8e9d-716c1e955c9f tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.666491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:55.667007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:55.667457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:55.668369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:55.668833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:55.669293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:55.740122 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e3d66c0-1fc7-4726-8e9d-716c1e955c9f tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.090697 Nov 02 21:24:55.740732 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 490/929] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:55.763342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:55.763972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:55.783658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:55.784599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:55.785432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:55.787467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:55.788843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:55.789618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:56.302848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:56.313622 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eed49359-b612-4f4f-bdaf-905526fc4dc3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 0.677296 Nov 02 21:24:56.333393 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 440/930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:56.342378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b793d9c9-c7b3-45b6-b57f-87f0b11fee17 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.355795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:56.379732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:56.387894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:56.389915 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55366d08-206b-4eca-81e4-21231098c90a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 0.635961 Nov 02 21:24:56.400965 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 491/931] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:55 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:56.401207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b793d9c9-c7b3-45b6-b57f-87f0b11fee17 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.056099 Nov 02 21:24:56.409196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c57f1d3a-93bb-4208-bddb-840b3226f7a5 req-df55fe0d-5b48-43f5-9eea-0cac16c8a89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a35e18-355f-4fc3-ab55-c9546c8bfb42", "tag": "97b6314e-b34f-4ab8-93c1-efdbbe8346b3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:56.409552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 441/932] 10.222.0.25 () {58 vars in 1175 bytes} [Wed Nov 2 21:24:56 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:56.414373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e81e01f5-571c-4bc7-9dc7-df928836e471 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691a6310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.443199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c57f1d3a-93bb-4208-bddb-840b3226f7a5 req-df55fe0d-5b48-43f5-9eea-0cac16c8a89f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:56.443684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c57f1d3a-93bb-4208-bddb-840b3226f7a5 req-df55fe0d-5b48-43f5-9eea-0cac16c8a89f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:56.446619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c57f1d3a-93bb-4208-bddb-840b3226f7a5 req-df55fe0d-5b48-43f5-9eea-0cac16c8a89f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:56.463668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c57f1d3a-93bb-4208-bddb-840b3226f7a5 req-df55fe0d-5b48-43f5-9eea-0cac16c8a89f service nova] Creating event network-changed:97b6314e-b34f-4ab8-93c1-efdbbe8346b3 for instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 on n-h1-860863-4 Nov 02 21:24:56.473412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c57f1d3a-93bb-4208-bddb-840b3226f7a5 req-df55fe0d-5b48-43f5-9eea-0cac16c8a89f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080032 Nov 02 21:24:56.474165 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 492/933] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:56.495030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.496005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:56.502299 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e81e01f5-571c-4bc7-9dc7-df928836e471 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.091417 Nov 02 21:24:56.502937 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 442/934] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:56 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:56.509430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:56.510961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:56.511255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:56.512491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:56.512711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:56.513668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:56.517979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1adfea76-16d1-4453-95ab-a2b4b1d28197 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.545483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:56.566443 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1adfea76-16d1-4453-95ab-a2b4b1d28197 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.061300 Nov 02 21:24:56.567948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 443/935] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 21:24:56 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:56.596658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-28d1bf18-0b8b-443a-9cdc-8b07948724c7 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.623825 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-28d1bf18-0b8b-443a-9cdc-8b07948724c7 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.037157 Nov 02 21:24:56.625078 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 444/936] 10.222.0.25 () {58 vars in 1169 bytes} [Wed Nov 2 21:24:56 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:56.653560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c700d68f-67c8-4fd9-ab44-a2eaa34e100a tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.691902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:56.706521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:56.710097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:56.717918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e6fe87f9-9f90-4648-9359-4a73043fe0b9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.242501 Nov 02 21:24:56.719918 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 493/937] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:56 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:56.851249 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c700d68f-67c8-4fd9-ab44-a2eaa34e100a tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/2056010325" status: 202 len: 0 microversion: 2.1 time: 0.204302 Nov 02 21:24:56.853213 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 445/938] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:24:56 2022] DELETE /compute/v2.1/flavors/2056010325 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:24:56.861154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94791de4-d5f4-4d40-9954-42efe0cc2219 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.894096 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94791de4-d5f4-4d40-9954-42efe0cc2219 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036759 Nov 02 21:24:56.929354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a04ed16-0709-4787-9bd4-734993d8b2cb tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:56.948025 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 494/939] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:57.045332 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a04ed16-0709-4787-9bd4-734993d8b2cb tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1520130465" status: 202 len: 0 microversion: 2.1 time: 0.123964 Nov 02 21:24:57.054590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3da5552-38fa-4c57-be68-cbb44d730829 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:57.054870 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 446/940] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:24:56 2022] DELETE /compute/v2.1/flavors/1520130465 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:57.095304 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3da5552-38fa-4c57-be68-cbb44d730829 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044538 Nov 02 21:24:57.096087 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 495/941] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:57.125897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b545b83f-cb4a-4dda-94ee-a2a8845c620c tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1152373816", "id": 1133910242, "os-flavor-access:is_public": "False"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:57.228742 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b545b83f-cb4a-4dda-94ee-a2a8845c620c tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.106673 Nov 02 21:24:57.241203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b25c2b3e-6129-4c88-b5d1-cbbb6f006e0f tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:57.245220 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 447/942] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:57 2022] POST /compute/v2.1/flavors => generated 415 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:57.276353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b25c2b3e-6129-4c88-b5d1-cbbb6f006e0f tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038683 Nov 02 21:24:57.282732 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 496/943] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:57.301355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69c86413-d1e2-40c1-b803-eac157fe7326 tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:57.337992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:57.338909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:57.348029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69c86413-d1e2-40c1-b803-eac157fe7326 tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050370 Nov 02 21:24:57.350392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:57.357670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:57.373137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:57.373712 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 448/944] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:57.374954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:57.376877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:57.380647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9da5b353-9563-4cf4-a213-64b66ac0ab41 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:57.381442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:57.508421 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9da5b353-9563-4cf4-a213-64b66ac0ab41 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1133910242" status: 202 len: 0 microversion: 2.1 time: 0.132174 Nov 02 21:24:57.512917 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 449/945] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:24:57 2022] DELETE /compute/v2.1/flavors/1133910242 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:57.519469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:57.521173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:57.538658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:57.539550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:57.540248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:57.541569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:57.542289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:57.545558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:57.913888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:57.925149 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5882c4e5-60df-4c2d-a52c-1198d0d044ac tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 0.589395 Nov 02 21:24:57.936966 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 497/946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:57 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:24:57.936966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77bd3dc2-f383-40e1-a73c-3430029fc296 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:57.984793 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-77bd3dc2-f383-40e1-a73c-3430029fc296 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056041 Nov 02 21:24:57.985787 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 498/947] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:57.995987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d47da199-18dd-4e7e-963f-12e0ba2c8b4f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68ec83a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:58.071253 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d47da199-18dd-4e7e-963f-12e0ba2c8b4f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.083553 Nov 02 21:24:58.071990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 499/948] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:57 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:58.086024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:58.086647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:58.102867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:58.104274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:58.105029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:58.105925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:58.106544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:58.109534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:58.532720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:58.549082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:58.553318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:58.567292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fe9e3f1-4b51-4aa9-81da-664778ae4ff4 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.493138 Nov 02 21:24:58.570033 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 500/949] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:58 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:58.588394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91b86366-59e0-4314-9c56-d68ceaaf5990 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1650383753", "id": 1377283787, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:24:58.603276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:58.616264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:58.624194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:24:58.626918 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dce734f2-39c0-40f4-929d-0aecbbeb5dfa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 1.111271 Nov 02 21:24:58.635753 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 450/950] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:57 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:24:58.707093 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-91b86366-59e0-4314-9c56-d68ceaaf5990 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.134810 Nov 02 21:24:58.714736 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 501/951] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:24:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:24:58.720159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-57c3aa93-0abc-4dc0-9e32-938976fc5873 tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:58.762705 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-57c3aa93-0abc-4dc0-9e32-938976fc5873 tempest-FlavorsAdminTestJSON-214528829 tempest-FlavorsAdminTestJSON-214528829-project] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.041124 Nov 02 21:24:58.765174 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 451/952] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:58 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:58.783705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6b8731e-2615-4259-9927-19c044aa5831 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:58.803344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:DELETE=14,nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:24:58.874100 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6b8731e-2615-4259-9927-19c044aa5831 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1377283787" status: 202 len: 0 microversion: 2.1 time: 0.096003 Nov 02 21:24:58.875399 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 502/953] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:24:58 2022] DELETE /compute/v2.1/flavors/1377283787 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:24:58.883643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44589e5c-e278-4eb5-b48b-091fafa63880 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:58.934611 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44589e5c-e278-4eb5-b48b-091fafa63880 tempest-FlavorsAdminTestJSON-1892630634 tempest-FlavorsAdminTestJSON-1892630634-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055053 Nov 02 21:24:58.939254 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 452/954] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:24:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:58.964685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:58.964685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:58.975654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:58.977313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:58.982296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:58.987415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:58.987415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:58.987415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:59.088564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a88bd37-c685-4c51-a947-8daf40f78bc9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6944a280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:59.190869 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a88bd37-c685-4c51-a947-8daf40f78bc9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.106680 Nov 02 21:24:59.200528 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 453/955] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:24:59 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:24:59.612904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:24:59.614433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:24:59.622576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:59.623305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:59.625580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:24:59.626480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:24:59.627099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:24:59.629725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:00.230921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:00.257920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:00.261748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:00.284276 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a968fab1-82fc-4728-8a94-9046128255c7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.684171 Nov 02 21:25:00.293763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 454/956] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:24:59 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:25:00.315326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:00.316277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:00.342728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:00.344968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:00.345469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:00.348022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:00.350307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:00.351044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:00.601502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:00.630286 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-80e19f93-dc4b-43cc-bcf2-01bfa7afc5bf tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 1.681708 Nov 02 21:25:00.631842 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 503/957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:24:58 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:00.644427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-326a2c9b-cdc2-44b6-aa8f-ed93de446c42 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f705e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:00.738384 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-326a2c9b-cdc2-44b6-aa8f-ed93de446c42 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.099302 Nov 02 21:25:00.741341 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 504/958] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:00 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:01.326130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:01.326913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:01.364513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:01.365037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:01.375439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:01.375439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:01.375439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:01.392164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:01.704272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:01.724630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:01.735862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:01.749263 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5ac9ba5-100c-4c2a-b752-2703f1b1d2f0 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.429938 Nov 02 21:25:01.761764 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 505/959] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:01 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:25:01.801416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:01.803846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:01.841900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:01.842401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:01.842847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:01.843989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:01.857542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:01.859022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:01.859613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:01.859748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:01.860103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:01.860837 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bac6e551-c859-4951-ac47-c15e6b9e1a4a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 1.565365 Nov 02 21:25:01.877564 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 455/960] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:00 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:01.924988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9a865124-b867-40a7-b2bf-b6adbb246a08 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691a6af0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:02.022423 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9a865124-b867-40a7-b2bf-b6adbb246a08 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.143868 Nov 02 21:25:02.033756 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 456/961] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:01 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:02.312854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-9a7280ac-30d5-4a3d-9d34-c02149c56f5c req-9f566774-74dd-49c4-8561-f0f04f2a5be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e", "name": "network-vif-plugged", "status": "completed", "tag": "959e5aa8-19e8-427e-86c3-a667021fcc01"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:02.332774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9a7280ac-30d5-4a3d-9d34-c02149c56f5c req-9f566774-74dd-49c4-8561-f0f04f2a5be0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:02.334987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9a7280ac-30d5-4a3d-9d34-c02149c56f5c req-9f566774-74dd-49c4-8561-f0f04f2a5be0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:02.335674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9a7280ac-30d5-4a3d-9d34-c02149c56f5c req-9f566774-74dd-49c4-8561-f0f04f2a5be0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:02.357085 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-9a7280ac-30d5-4a3d-9d34-c02149c56f5c req-9f566774-74dd-49c4-8561-f0f04f2a5be0 service nova] Creating event network-vif-plugged:959e5aa8-19e8-427e-86c3-a667021fcc01 for instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e on n-h2-860863-4 Nov 02 21:25:02.365838 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-9a7280ac-30d5-4a3d-9d34-c02149c56f5c req-9f566774-74dd-49c4-8561-f0f04f2a5be0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057163 Nov 02 21:25:02.367197 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 457/962] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:25:02.791964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:02.792667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:02.823026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:02.823751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:02.826342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:02.830398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:02.833396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:02.834285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:03.084872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:03.108606 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83aabcab-c703-4dcc-ae5c-e3204c180253 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 1.343240 Nov 02 21:25:03.120527 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 506/963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:01 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:03.140097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:03.141179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:03.177380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:03.182462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:03.186044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:03.186735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:03.187208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:03.187644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:03.201690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:03.204077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:03.222081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:03.223663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:03.238787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-49ecf2c1-4cf1-4f4d-8aed-335ce531b469 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.451901 Nov 02 21:25:03.245000 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 458/964] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:02 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:03.269033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-219f704a-ef28-4016-8821-4e5c83fdacd7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b69175790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:03.351943 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-219f704a-ef28-4016-8821-4e5c83fdacd7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.102906 Nov 02 21:25:03.352853 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 459/965] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:03 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:03.651178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5036ea70-6f72-4f17-a17c-43ca6854d7ee tempest-ListImageFiltersNegativeTestJSON-701631003 tempest-ListImageFiltersNegativeTestJSON-701631003-project] Calling method '.version_select at 0x7f9b6916c040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:03.688891 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-5036ea70-6f72-4f17-a17c-43ca6854d7ee tempest-ListImageFiltersNegativeTestJSON-701631003 tempest-ListImageFiltersNegativeTestJSON-701631003-project] HTTP exception thrown: Image not found. Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5036ea70-6f72-4f17-a17c-43ca6854d7ee tempest-ListImageFiltersNegativeTestJSON-701631003 tempest-ListImageFiltersNegativeTestJSON-701631003-project] Request method failure captured: Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/images/22cde8a8-f483-496c-a870-d75821301189 HTTP/1.1 Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAunbsZw1w6nWQnDci9nwqCOEuaRYmd5chnVlGt4kaWAurv0LZ6aEGYJp0_eh7CUvbfwVjFkzW6NxzDM5SXAeMFlYPO6VPLpfz5WdXY8xn-6hDF7dwZBlcBEvUAL5uYAaUGgi0vNGLfbgfxDF6d3vrD3IurVNmDn_eqDDOuxXTq9Rs Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a03129e7a5894e39959a44421f4e54b6 Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-701631003 Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:25:03.703520 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a03129e7a5894e39959a44421f4e54b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a03129e7a5894e39959a44421f4e54b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a03129e7a5894e39959a44421f4e54b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a03129e7a5894e39959a44421f4e54b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-701631003 Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a03129e7a5894e39959a44421f4e54b6 Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-701631003 Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListImageFiltersNegativeTestJSON-701631003-project Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: be002652a28b4095ba3af0618c22335f Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-701631003-project Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '22cde8a8-f483-496c-a870-d75821301189'} Nov 02 21:25:03.704843 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:25:03.705720 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22cde8a8-f483-496c-a870-d75821301189 Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:25:03.706781 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22cde8a8-f483-496c-a870-d75821301189 could not be found. Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:25:03.707918 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:03.713484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5036ea70-6f72-4f17-a17c-43ca6854d7ee tempest-ListImageFiltersNegativeTestJSON-701631003 tempest-ListImageFiltersNegativeTestJSON-701631003-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:03.714706 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5036ea70-6f72-4f17-a17c-43ca6854d7ee tempest-ListImageFiltersNegativeTestJSON-701631003 tempest-ListImageFiltersNegativeTestJSON-701631003-project] 10.222.0.25 "GET /compute/v2.1/images/22cde8a8-f483-496c-a870-d75821301189" status: 404 len: 62 microversion: 2.1 time: 0.351631 Nov 02 21:25:03.714706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 460/966] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:03 2022] GET /compute/v2.1/images/22cde8a8-f483-496c-a870-d75821301189 => generated 62 bytes in 353 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:25:04.092745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:04.110847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:04.116369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:04.124114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f8a22a4-9130-40df-9310-8badd2684bc1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 1.002322 Nov 02 21:25:04.126718 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 507/967] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:03 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:04.141692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:04.142530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:04.160913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:04.164202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:04.164923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:04.165585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:04.172767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:04.173430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:04.295306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:04.295969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:04.319081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:04.332155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:04.334220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:04.346096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:04.346913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:04.349329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:04.547464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:04.561991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:04.566720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:04.587357 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-337db5ee-65bb-40dc-8e1f-239076195f13 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.296293 Nov 02 21:25:04.591458 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 508/968] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:04 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:04.617705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-036e6eda-dfa9-408c-b8f1-06cfb5013e7b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f70e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:04.742576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-036e6eda-dfa9-408c-b8f1-06cfb5013e7b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.148248 Nov 02 21:25:04.744519 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 509/969] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:04 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:05.183853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:05.185598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:05.228811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:05.229527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:05.229982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:05.230711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:05.231166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:05.231596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:05.511226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:05.525114 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e93bfd5-fa26-4bec-9585-8930e27449b6 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1477 microversion: 2.1 time: 1.390650 Nov 02 21:25:05.531230 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 461/970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:04 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1477 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:05.624907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:05.625443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:05.630395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:05.653656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:05.654511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:05.657840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:05.662330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:05.663206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:05.675012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:05.985109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:06.001757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:06.008484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:06.016850 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-927f8a7b-7450-43d2-9548-1e751d1c31be tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 0.859893 Nov 02 21:25:06.022449 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 510/971] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:05 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:06.035509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:06.041516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e94d5553-0503-4511-ad55-34c565ce7487 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f68b80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:06.050326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:06.057703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:06.087959 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e746d50-4b30-4271-925b-f94dd1aa4db6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.467824 Nov 02 21:25:06.120830 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 462/972] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:05 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:25:06.141754 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e94d5553-0503-4511-ad55-34c565ce7487 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.114290 Nov 02 21:25:06.144021 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 511/973] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:06 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:06.520992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1294820747", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "322e1fd6-7639-465c-a6f3-6aaae3e95954"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:06.558376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:06.559215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:06.573330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:06.576575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:06.577010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:06.585573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:06.585573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:06.585573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:06.658035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] validate_networks() for [('322e1fd6-7639-465c-a6f3-6aaae3e95954', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:25:07.596289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:07.615439 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb30186b-5ebb-4481-9946-fc5f5b564ead tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1462 microversion: 2.1 time: 1.063411 Nov 02 21:25:07.632413 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 512/974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:06 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1462 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:07.660134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:07.660134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:07.667120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:07.667618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:07.668059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:07.669226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:07.669682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:07.672885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:08.130287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:08.146957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:08.151757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:08.153240 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0dd99b7-faf0-4689-8d83-24514be7aa5f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1566 microversion: 2.25 time: 0.519246 Nov 02 21:25:08.156583 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 513/975] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:07 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1566 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:08.169457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:08.170355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:08.194309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:08.199303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:08.201598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:08.204337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:08.204578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:08.205065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:08.500427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:08.518166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:08.524960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:08.538489 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-07c308f7-913c-44e4-8247-2d1fdfbe0e3d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.378851 Nov 02 21:25:08.539107 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 514/976] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:08 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:08.557296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-474aa007-d4df-46e4-8af8-fec5a0130ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68ec8e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:08.628599 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-474aa007-d4df-46e4-8af8-fec5a0130ccc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.085917 Nov 02 21:25:08.630165 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 515/977] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:08 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:08.639465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:08.649720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:08.651499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:08.652055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:08.652643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:08.653199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:08.653712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:08.671384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:08.676765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:08.685536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:08.689405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:08.689994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:08.693654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:08.693790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:08.697236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:08.699145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:08.701011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:08.704429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:08.707130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:08.775856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:08.796705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for user 044e9aa5874a48b490b83c184aa470cc and project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:08.838487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:25:08.841191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:25:08.984864 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0843b3d9-a4a9-4f0c-89ec-e26860a1c6c2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.713758 Nov 02 21:25:08.995085 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 463/978] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:25:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:25:09.188156 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc41ca81-d49b-412f-b607-8f523f7a3a2e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action" status: 202 len: 0 microversion: 2.1 time: 0.554874 Nov 02 21:25:09.197702 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 516/979] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:25:08 2022] POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:09.197702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04778d8b-47ae-4ada-ac44-283be9d2b3f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:09.197702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04778d8b-47ae-4ada-ac44-283be9d2b3f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:09.219832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5aef01bc-39df-44e4-887c-e3aa704bf62c tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Action: 'create', calling method: .version_select at 0x7f9b6d2fc3a0>, body: {"keypair": {"name": "tempest-keypair-1409701875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG70Ye7NaO7duBZ2VLDSDWJuBkYu4byQXwrRMtNni7s//PYL/Ydt0JnTWkm/DsA1ZjY3Ajq8qAx6bc3O6AHIt81XEL+CmhSEI4QjCkxfE8uqur680gQVXACAJafbw3dZ4A=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:09.274120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-5aef01bc-39df-44e4-887c-e3aa704bf62c tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:09.294728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-5aef01bc-39df-44e4-887c-e3aa704bf62c tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for user 98f201e8142a421caf48bb67989a2b4a and project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:09.433632 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5aef01bc-39df-44e4-887c-e3aa704bf62c tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.437059 Nov 02 21:25:09.434332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 464/980] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:25:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:09.454073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04778d8b-47ae-4ada-ac44-283be9d2b3f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:09.486333 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04778d8b-47ae-4ada-ac44-283be9d2b3f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1225 microversion: 2.1 time: 0.295579 Nov 02 21:25:09.486919 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 517/981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:09 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1225 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:09.491976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:09.495211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:09.529643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:09.535251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:09.536520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:09.537047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:09.537497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:09.538219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:09.540966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:09.541691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:09.551235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:09.599277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:09.599849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:09.600594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:09.601093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:09.601521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:09.759502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:09.761298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:09.762435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:09.764341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lazy-loading 'fault' on Instance uuid 0a638e0a-0e2f-44b4-a1f9-702c78a5495e {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:25:10.120023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:10.134342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:10.152273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:10.158135 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f3af86b5-6404-4897-93da-036dabdd5574 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1541 microversion: 2.25 time: 0.719800 Nov 02 21:25:10.160431 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 465/982] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:09 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1541 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:10.220197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6f6efb4-1244-4889-b5a3-d8177a8036c1 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b6929df70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:10.263324 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a6f6efb4-1244-4889-b5a3-d8177a8036c1 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1409701875" status: 200 len: 497 microversion: 2.1 time: 0.075231 Nov 02 21:25:10.263942 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 466/983] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:25:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1409701875 => generated 497 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:10.294574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:10.296157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:10.303722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:10.307269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:10.308021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:10.308170 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4f6ef1d-25e4-40bd-9ed1-9d973c000826 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1596 microversion: 2.1 time: 0.785501 Nov 02 21:25:10.308784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:10.309289 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 518/984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:09 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1596 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:10.310988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:10.311442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:10.327989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88449d20-e44c-4761-970a-5ce992909d47 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68e87a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:10.451813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88449d20-e44c-4761-970a-5ce992909d47 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.141125 Nov 02 21:25:10.452404 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 519/985] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:10 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:10.465801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c843627-6609-482a-ae04-addfe9e72598 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '.version_select at 0x7f9b68f70e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:10.486334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c843627-6609-482a-ae04-addfe9e72598 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:10.487106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c843627-6609-482a-ae04-addfe9e72598 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:10.487883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c843627-6609-482a-ae04-addfe9e72598 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:10.501205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:10.521763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:10.536432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:10.557357 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8057e29f-dba7-4251-87c0-2caee16777af tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.285283 Nov 02 21:25:10.561730 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 467/986] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:10 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:10.566662 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c843627-6609-482a-ae04-addfe9e72598 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.099553 Nov 02 21:25:10.567518 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 520/987] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 21:25:10 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:10.583074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:10.585386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d5931b11-c781-47ce-b5c6-f485975c03e8 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b691b9f70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:10.597653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:10.629558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:10.631503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:10.632150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:10.633148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:10.633825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:10.636045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:10.704376 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d5931b11-c781-47ce-b5c6-f485975c03e8 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409701875" status: 202 len: 0 microversion: 2.1 time: 0.138571 Nov 02 21:25:10.706830 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 468/988] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:25:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409701875 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:10.713690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:10.719302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0dbb4c7d-d6eb-4e86-8b5f-711c2a19db42 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:10.720456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0dbb4c7d-d6eb-4e86-8b5f-711c2a19db42 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:10.941435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0dbb4c7d-d6eb-4e86-8b5f-711c2a19db42 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:11.005961 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0dbb4c7d-d6eb-4e86-8b5f-711c2a19db42 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1225 microversion: 2.1 time: 0.296037 Nov 02 21:25:11.006626 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 469/989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:10 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1225 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:11.038739 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ece0bb9d-d4db-4985-a598-b01b0d21b218 tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action" status: 202 len: 0 microversion: 2.1 time: 0.461977 Nov 02 21:25:11.039369 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 521/990] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:25:10 2022] POST /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:11.047415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:11.048163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:11.066602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.067453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.068777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.069797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.070455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.071143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.250273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Calling method '.version_select at 0x7f9b6a776af0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:11.260047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.260880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.261537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.298694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.305169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.305169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.362762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.363633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.364226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.383364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.384194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.385361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.415148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid c0a35e18-355f-4fc3-ab55-c9546c8bfb42 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:25:11.421771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.427095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.427857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.437586 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7dbb1d9a-8f0e-43b4-9849-f53a1474af98 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2152 microversion: 2.53 time: 0.429734 Nov 02 21:25:11.439977 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 470/991] 10.222.0.25 () {60 vars in 1243 bytes} [Wed Nov 2 21:25:11 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2152 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:11.448556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b96ab423-f74f-486b-bd43-6776d1d6c641 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Action: 'create', calling method: .version_select at 0x7f9b6929d0d0>, body: {"keypair": {"name": "tempest-keypair-967553328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cX9BFJz68XWHz4Yz/8JWKQgoDBpOjQL7zxVvS+qzfDS6jngdaPomRKaLScwbTW1d0D+MJbVJnBR2e1gQRxoawyEhZbeDnz+fykkMm8fTJJ9lO098+pmzHyjg0UJzLHg=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:11.468297 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ddf0208-fda5-4d63-a76e-222c2cbabf1d tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 2033 microversion: 2.25 time: 0.426044 Nov 02 21:25:11.468493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b96ab423-f74f-486b-bd43-6776d1d6c641 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:11.475932 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 522/992] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:11 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 2033 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:11.489207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b96ab423-f74f-486b-bd43-6776d1d6c641 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for user 98f201e8142a421caf48bb67989a2b4a and project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:11.493102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:11.499844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:11.522814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.523072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.523445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.529086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.531651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.532514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.663995 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b96ab423-f74f-486b-bd43-6776d1d6c641 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.222752 Nov 02 21:25:11.664907 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 471/993] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:25:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:11.669633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Calling method '.version_select at 0x7f9b696eda60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:11.673581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.680408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.682000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.749145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.750733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.750733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.820960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.826970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.827790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.848817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.854341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.854805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.877071 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60ca3e71-4e0f-4acf-bf92-8c0efde7343e tempest-ServersAdminTestJSON-579764322 tempest-ServersAdminTestJSON-579764322-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1613 microversion: 2.1 time: 0.399059 Nov 02 21:25:11.877071 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 523/994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:11 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1613 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:11.891025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-164debb8-98fd-48e6-9259-c911076043ba tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68ef93a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:11.979982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:11.982988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:11.983751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:11.996660 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-43d19ce3-52cd-4168-9cd8-df41e41ae796 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 923 microversion: 2.53 time: 0.330721 Nov 02 21:25:12.002196 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 472/995] 10.222.0.25 () {60 vars in 1222 bytes} [Wed Nov 2 21:25:11 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 923 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:25:12.016458 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-164debb8-98fd-48e6-9259-c911076043ba tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.138380 Nov 02 21:25:12.017159 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 524/996] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:11 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:12.024328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c7b0e79-2e61-4464-810d-482d618add6d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Action: 'create', calling method: .version_select at 0x7f9b6916cf70>, body: {"keypair": {"name": "tempest-keypair-1492343248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWvBa1IfF4cqpYNWtLQ//ROFrGKvtM7Fn2YdHguf1LCnRBpRAxOOH7aYCjopAGG38zq36LJEkoYRW7AEV++t7a6ZaFQHqfkWeUrrlEc786L7RUJY5ET67EbStQVDliIKw=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:12.031856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:12.037707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:12.059535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.061514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.063325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:12.065608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.067300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.069630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:12.085846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-5c7b0e79-2e61-4464-810d-482d618add6d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for project bd27a33cdee44680b69336170f3739fe. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:12.105282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-5c7b0e79-2e61-4464-810d-482d618add6d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for user 979116d5dca74e6d90abe23e9033107e and project bd27a33cdee44680b69336170f3739fe. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:12.237213 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c7b0e79-2e61-4464-810d-482d618add6d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.232988 Nov 02 21:25:12.238307 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 473/997] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:25:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:25:12.245427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:12.252694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1cccb284-099c-4804-bcc0-5793be291f11 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b69175310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:12.274152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:12.283688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:12.312343 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-57c7125c-2188-4c88-ab92-994565bde8e8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.291857 Nov 02 21:25:12.318239 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 525/998] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:12 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:12.352777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:12.354534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:12.362657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.363527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.364172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:12.365487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.366237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.367516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:12.461587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:25:12.691923 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1cccb284-099c-4804-bcc0-5793be291f11 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-967553328" status: 202 len: 0 microversion: 2.1 time: 0.448838 Nov 02 21:25:12.691923 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 474/999] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:25:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-967553328 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:12.713521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Calling method '.version_select at 0x7f9b6d29dee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:12.726675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.727832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.728435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:12.764736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.765275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.768570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:12.785052 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-faee7cb1-ff9b-4e73-8d40-522a157a7549 tempest-HypervisorAdminV253TestBase-47900954 tempest-HypervisorAdminV253TestBase-47900954-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors/2cb40280-be9b-48bc-ad7f-6971f21c4518" status: 200 len: 792 microversion: 2.53 time: 0.082324 Nov 02 21:25:12.789185 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 475/1000] 10.222.0.25 () {60 vars in 1298 bytes} [Wed Nov 2 21:25:12 2022] GET /compute/v2.1/os-hypervisors/2cb40280-be9b-48bc-ad7f-6971f21c4518 => generated 792 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:25:12.837518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:12.838185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:12.870211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.872857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.873389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:12.874123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:12.874579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:12.875010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:13.092148 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f7655cf-7803-450c-8f3a-3a858b2d517f tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 204 len: 0 microversion: 2.1 time: 0.760046 Nov 02 21:25:13.096078 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 526/1001] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:25:12 2022] DELETE /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 0 bytes in 776 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:13.111435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39531bf1-c77a-4348-93b1-d8c4cd1e1a65 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Action: 'create', calling method: .version_select at 0x7f9b68f68a60>, body: {"keypair": {"name": "tempest-keypair-1788545179", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:13.159962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-39531bf1-c77a-4348-93b1-d8c4cd1e1a65 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:13.167496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-39531bf1-c77a-4348-93b1-d8c4cd1e1a65 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for user 98f201e8142a421caf48bb67989a2b4a and project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:13.197755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:13.210412 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a361487-a6c4-4755-b688-1110707c330a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1277 microversion: 2.1 time: 0.420034 Nov 02 21:25:13.213467 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 476/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:12 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1277 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:13.223901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6498aea3-d53a-4e7a-8fda-946940e4c5cb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d29dd30>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:13.287813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39531bf1-c77a-4348-93b1-d8c4cd1e1a65 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.188846 Nov 02 21:25:13.293146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 527/1003] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:25:13 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:13.303358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:13.304351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:13.308250 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6498aea3-d53a-4e7a-8fda-946940e4c5cb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.092702 Nov 02 21:25:13.316446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:13.316593 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 477/1004] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:13 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:13.316717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:13.316717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:13.325069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:13.325942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:13.326638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:13.328565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e6626335-a771-4d8e-b266-bb321a273212 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b6926fc10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:13.479114 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e6626335-a771-4d8e-b266-bb321a273212 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788545179" status: 202 len: 0 microversion: 2.1 time: 0.156626 Nov 02 21:25:13.482210 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 478/1005] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1788545179 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:13.485495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:13.490391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:13.495984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:13.504855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:13.506726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:13.508874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:13.511061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:13.512709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:13.513605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:13.664312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:13.685135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:13.688712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:13.695954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:13.703000 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2238aa3e-e724-4c5f-8f2e-a60eef9c11a3 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1469 microversion: 2.1 time: 0.408495 Nov 02 21:25:13.704175 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 528/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:13 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:13.704445 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-73a42579-3218-447e-b76d-1ba47fccebc9 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.222937 Nov 02 21:25:13.705809 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 479/1007] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:13 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:13.709600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0479860-44f1-4f27-a366-10ebb0b4f51b tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Action: 'create', calling method: .version_select at 0x7f9b68e9be50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1272574483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU7RsVTrAIt43T/hekWsK6471SIjMkmSTQpzCkfINl5j9Mry47gWmo9hGzAw6axdb/nmrLotTvex/0epgAN4YU+YLlLSv5F4iGbXxt6kaWkQl0fvctOZM+huVwhyv9EHQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:13.742823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f0479860-44f1-4f27-a366-10ebb0b4f51b tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:13.760367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f0479860-44f1-4f27-a366-10ebb0b4f51b tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for user 98f201e8142a421caf48bb67989a2b4a and project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:13.881173 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0479860-44f1-4f27-a366-10ebb0b4f51b tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.175350 Nov 02 21:25:13.882055 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 529/1008] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:25:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:13.896910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fed3928e-3a65-4abb-9a3d-38a0b31c9cf0 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Action: 'create', calling method: .version_select at 0x7f9b68efa4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2050910900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG6rI6Mfer3YGxsftFAa1GvUSrdghggCXoykBc7F09BWYXXWAP/xekE1pKfqSMOymPEsF7M45+j70zgYiG/veADUZUPGKHkLPYZ1RP44YQnzWnsIx2HlqkD7VwYvz1h1g=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:13.940733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-fed3928e-3a65-4abb-9a3d-38a0b31c9cf0 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:13.957109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-fed3928e-3a65-4abb-9a3d-38a0b31c9cf0 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for user 98f201e8142a421caf48bb67989a2b4a and project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:14.084479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-644305447", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "f1a27830-c4e6-4f86-894e-5e8eaac191b0"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:14.092693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fed3928e-3a65-4abb-9a3d-38a0b31c9cf0 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.200239 Nov 02 21:25:14.093328 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 530/1009] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:25:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:25:14.107021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a0487e0-ee62-4dbd-aca1-60f6b2ec06d3 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Action: 'create', calling method: .version_select at 0x7f9b68efa0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-352630871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRiPETdXqpEUTFDge893mdIPab5uG3X9TnABi057LF0v2dhBEbdSmuJVlsoxAJFxxK3I+/kne0HkqltMyIE7I/1aAtQN0IZd8sVALdYGCoyEv4LmiV6gTcv7l+ND9MLfA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:14.147573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5a0487e0-ee62-4dbd-aca1-60f6b2ec06d3 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:14.178109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5a0487e0-ee62-4dbd-aca1-60f6b2ec06d3 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Getting quotas for user 98f201e8142a421caf48bb67989a2b4a and project a2bf277b37714d5fa257c5705646485b. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:14.191361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] validate_networks() for [('f1a27830-c4e6-4f86-894e-5e8eaac191b0', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:25:14.198980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:14.323302 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a0487e0-ee62-4dbd-aca1-60f6b2ec06d3 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.220627 Nov 02 21:25:14.326282 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 531/1010] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:25:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:25:14.350737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:14.354027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:14.373123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:14.377657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:14.378846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:14.379209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:14.379745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:14.380248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:14.672751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:14.685458 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-859eeb48-51f7-4cee-8736-40c966a0366d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1285 microversion: 2.1 time: 0.358002 Nov 02 21:25:14.689248 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 532/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:14 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1285 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:14.694127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8d71c96-11c5-42fd-9330-e959f8f96c76 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68ee63a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:14.780744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8d71c96-11c5-42fd-9330-e959f8f96c76 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.090189 Nov 02 21:25:14.789311 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 533/1012] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:14 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:14.802864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99467832-c75f-43a8-9721-e67598369f92 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b68f27820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:14.811862 n-d-860863-4 devstack@n-api.service[121040]: WARNING oslo_db.sqlalchemy.utils [None req-99467832-c75f-43a8-9721-e67598369f92 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 21:25:14.821385 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99467832-c75f-43a8-9721-e67598369f92 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.038335 Nov 02 21:25:14.822376 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 534/1013] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:25:14 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:14.827783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:14.832919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:14.836313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:14.838619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:14.839016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:14.839737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:14.840194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:14.840619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:15.331688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:15.358735 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b955a786-c85a-4596-8a1b-68ebe9d0c34c tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1469 microversion: 2.1 time: 0.534493 Nov 02 21:25:15.359841 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 535/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:14 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:15.366078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:15.380038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:15.395123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:15.395123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:15.395123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:15.395123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:15.395731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:15.395731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.300639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:16.318769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:16.321520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:16.333239 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc7c4808-e495-41ec-b770-b64e21f40663 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.971969 Nov 02 21:25:16.335987 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 536/1015] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:15 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:16.348118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14bff03f-f036-40f6-bd3a-875d54a8e7ea tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b68f709d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:16.486876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14bff03f-f036-40f6-bd3a-875d54a8e7ea tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-352630871" status: 202 len: 0 microversion: 2.1 time: 0.147729 Nov 02 21:25:16.492525 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 537/1016] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-352630871 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:16.499241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:16.501777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:16.521963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:16.522836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:16.523472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.524371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:16.525548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:16.526152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.540387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:16.542641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:16.544157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:16.544791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:16.545709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:16.577563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:16.579267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:16.584629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.588270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:16.590311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:16.591301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.620658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:16.626495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for user 9f705bbaa94a4a7d8e5bba79214bb359 and project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:16.647347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:25:16.653517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:25:16.749701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:16.758370 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-931c8676-1429-41e7-80b8-7648c6c9e8fb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1283 microversion: 2.1 time: 0.264439 Nov 02 21:25:16.769310 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 538/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:16 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1283 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:16.769310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-186560f4-d7e8-4c73-8aa6-d7d5c737d0d5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f0c5e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:16.813978 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-186560f4-d7e8-4c73-8aa6-d7d5c737d0d5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.053858 Nov 02 21:25:16.814945 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 539/1018] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:16 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:16.825390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-584ef242-b97a-46fb-9d8a-14a68ff089d1 req-d809ba20-a772-4b8c-bb3f-0e9bac17ed36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c", "name": "network-vif-deleted", "tag": "36a0c8c0-c3de-4d14-b2dd-eae7a6b9caeb"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:16.835943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-584ef242-b97a-46fb-9d8a-14a68ff089d1 req-d809ba20-a772-4b8c-bb3f-0e9bac17ed36 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:16.836425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-584ef242-b97a-46fb-9d8a-14a68ff089d1 req-d809ba20-a772-4b8c-bb3f-0e9bac17ed36 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:16.836856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-584ef242-b97a-46fb-9d8a-14a68ff089d1 req-d809ba20-a772-4b8c-bb3f-0e9bac17ed36 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.850027 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-584ef242-b97a-46fb-9d8a-14a68ff089d1 req-d809ba20-a772-4b8c-bb3f-0e9bac17ed36 service nova] Creating event network-vif-deleted:36a0c8c0-c3de-4d14-b2dd-eae7a6b9caeb for instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c on n-h2-860863-4 Nov 02 21:25:16.857021 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-584ef242-b97a-46fb-9d8a-14a68ff089d1 req-d809ba20-a772-4b8c-bb3f-0e9bac17ed36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040234 Nov 02 21:25:16.858396 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 540/1019] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:16.864830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:16.865776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:16.877606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:16.878138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:16.881325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.882217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:16.882725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:16.883124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:16.919264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e65aae58-4e4e-412f-adac-30e63febbe7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.209315 Nov 02 21:25:16.921904 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 480/1020] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:25:16.937806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-425f7534-e9c9-4ca0-b074-6cd65da32c4c tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b69175790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:17.011129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:17.014969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:17.018102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:17.024362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lazy-loading 'fault' on Instance uuid e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:25:17.088127 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-425f7534-e9c9-4ca0-b074-6cd65da32c4c tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2050910900" status: 202 len: 0 microversion: 2.1 time: 0.163497 Nov 02 21:25:17.092592 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 481/1021] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 21:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2050910900 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:17.098595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-94eaa509-ef4a-453e-8750-c879b16fb593 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:17.107356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-94eaa509-ef4a-453e-8750-c879b16fb593 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:17.141299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:17.152785 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d2d8459-e561-402e-a8e0-9071095a3f98 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 200 len: 1304 microversion: 2.1 time: 0.293114 Nov 02 21:25:17.164076 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 541/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:16 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 1304 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:17.185236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-198bce5e-14f8-4f74-97a6-b23078fe8939 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] Calling method '.version_select at 0x7f9b68ed1f70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:17.273903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-94eaa509-ef4a-453e-8750-c879b16fb593 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:17.292043 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-198bce5e-14f8-4f74-97a6-b23078fe8939 tempest-KeyPairsV2TestJSON-1971344884 tempest-KeyPairsV2TestJSON-1971344884-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1272574483" status: 202 len: 0 microversion: 2.1 time: 0.114695 Nov 02 21:25:17.292807 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 542/1023] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 21:25:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1272574483 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:17.297268 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-94eaa509-ef4a-453e-8750-c879b16fb593 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1210 microversion: 2.1 time: 0.193461 Nov 02 21:25:17.301435 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 482/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:17 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1210 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:17.365440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:17.366657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:17.384154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:17.387457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:17.388590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:17.397190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:17.397956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:17.400084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:17.696520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:17.708956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:17.713181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:17.728633 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b2df93a-a761-451e-a0b4-6bb2f024a00b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.367302 Nov 02 21:25:17.729578 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 543/1025] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:17 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:17.732239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1089078268", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fce733bb-4d9b-4a3f-8666-2b353f0ca65b"}], "security_groups": [{"name": "tempest-securitygroup--52258783"}], "key_name": "tempest-keypair-1492343248", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:17.784643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:17.785311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:17.797967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:17.798479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:17.798925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:17.799645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:17.800102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:17.800532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:18.532292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] validate_networks() for [('fce733bb-4d9b-4a3f-8666-2b353f0ca65b', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:25:18.628697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:18.640835 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3dec686e-b5bb-439e-bc61-ecf812b8c0e4 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1325 microversion: 2.1 time: 0.860615 Nov 02 21:25:18.651759 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 544/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:17 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1325 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:18.656259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22c617fb-e1c2-4173-88d3-1a7a37101c50 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68e93160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:18.710562 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22c617fb-e1c2-4173-88d3-1a7a37101c50 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1414 microversion: 2.1 time: 0.067686 Nov 02 21:25:18.711698 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 545/1027] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:18 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1414 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:18.721551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:18.722293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:18.742068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:18.745928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:18.746863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:18.749285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:18.749827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:18.751612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:18.762058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:18.773758 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] HTTP exception thrown: Instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c could not be found. Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Request method failure captured: Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c HTTP/1.1 Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-iFBFvdm6bpFSpNcqMqAVwk7nzzxZspSYcHn-jwKwxXvbtf0HUnfsXGLDmpOHjau4SGLfAFLJz62997JC0Se7Hoo_fCX_xZh6bHYX4skprrF-A8FLZX9W2z_vrmo42TN35_JRMVXrslCU6OfYPIPTAfHhQ2ZFw0EnSJ19FSEmVkKw Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ad41afe8a2f04aee958c00322937c074 Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:25:18.776359 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad41afe8a2f04aee958c00322937c074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ad41afe8a2f04aee958c00322937c074 Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersAdminTestJSON-351926994-project Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: d1038966c4b6489ebafefb73c748e957 Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersAdminTestJSON-351926994-project Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c could not be found. Nov 02 21:25:18.778046 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c'} Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c could not be found. Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:18.778939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c could not be found. Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c could not be found. Nov 02 21:25:18.780347 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:18.782627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Returning 404 to user: Instance e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:18.784065 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-daf5d4ef-a7fd-4fb9-b0ba-5213852b6e3d tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c" status: 404 len: 111 microversion: 2.1 time: 0.069386 Nov 02 21:25:18.785170 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 546/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:18 2022] GET /compute/v2.1/servers/e32e0b4e-177f-4acc-a0d4-5c8d01b8b78c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:25:18.803631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:18.808464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:18.826540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:18.826540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:18.827286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:18.828192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:18.828837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:18.830022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:18.999771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:19.010653 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1737ffb4-d6b6-4239-99b0-bcb207babb35 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1214 microversion: 2.1 time: 0.223364 Nov 02 21:25:19.011853 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 547/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:18 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:19.017818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:19.018780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:19.031499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.034198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.035178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.036434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.037531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.038169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.167480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:19.188495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:19.190200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:19.198273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7278f948-ed8b-4ed9-a7b6-d28c57848954 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1560 microversion: 2.91 time: 0.184958 Nov 02 21:25:19.198859 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 548/1030] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:19 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:19.206336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:19.207098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:19.220764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.221466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.222006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.222810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.223341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.223853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.256865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:25:19.585619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:19.587599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:19.587599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:19.587599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:19.588080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:19.599146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.600014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.600723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.601831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.602836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.605544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.635466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-81b95b6f-6611-4ac1-b6d1-9eaf9e1febc8 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 204 len: 0 microversion: 2.1 time: 0.434417 Nov 02 21:25:19.636369 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 549/1031] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:25:19 2022] DELETE /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:19.638425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:19.645544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:19.646409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:19.648821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for user 979116d5dca74e6d90abe23e9033107e and project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:19.654670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.655281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.656055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.656838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.657437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.657901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.673800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:25:19.677785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:25:19.827607 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-43d67fa9-69f1-42be-bd90-60a36123fe40 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 2.099514 Nov 02 21:25:19.836860 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 483/1032] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:25:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 2109 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 02 21:25:19.848283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:19.848283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:19.856836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.857637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.858321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.860572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:19.861547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:19.862247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:19.916392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:19.925304 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7bb4308-1908-42d6-9991-5900c79786da tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1469 microversion: 2.1 time: 0.284617 Nov 02 21:25:19.926649 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 550/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:19 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:19.933511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-788a6a22-c075-4f83-bdaf-ce24bc12ad5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f7c430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:20.035895 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-788a6a22-c075-4f83-bdaf-ce24bc12ad5b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1423 microversion: 2.1 time: 0.107593 Nov 02 21:25:20.037849 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 551/1034] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:19 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:20.048813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0cb923d-70b2-4240-80b5-3a5047bad1cd tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:20.048813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0cb923d-70b2-4240-80b5-3a5047bad1cd tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:20.144278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0cb923d-70b2-4240-80b5-3a5047bad1cd tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.162075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0cb923d-70b2-4240-80b5-3a5047bad1cd tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.163737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0cb923d-70b2-4240-80b5-3a5047bad1cd tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.165012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0cb923d-70b2-4240-80b5-3a5047bad1cd tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1286 microversion: 2.25 time: 0.125645 Nov 02 21:25:20.165743 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 552/1035] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:20 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:20.171444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:20.172068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:20.178563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:20.179239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:20.179975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:20.180830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:20.182599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:20.183302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:20.209184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.219992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb82af8c-b13d-4da2-8f11-6256850725f1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1325 microversion: 2.1 time: 0.381737 Nov 02 21:25:20.220591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 484/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:19 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:20.231996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31478876-52bc-481c-8015-7b80730880a9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b691b9160>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:20.299631 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31478876-52bc-481c-8015-7b80730880a9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 200 len: 1423 microversion: 2.1 time: 0.077826 Nov 02 21:25:20.300409 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 485/1037] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:20 2022] GET /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 1423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:20.315672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:20.316452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:20.332212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:20.332885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:20.333532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:20.334424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:20.335036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:20.335673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:20.338466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.350174 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fcad55f4-2778-4f11-b717-49ab5171bf06 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1262 microversion: 2.1 time: 0.182852 Nov 02 21:25:20.352736 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 553/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:20 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1262 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:20.365080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96662fa7-efd0-4306-811a-ab71e0c8001c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f27280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:20.482543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.495177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.498575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:20.506973 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38f4fdd1-dac0-47f0-bc61-01e02d84bbae tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.195468 Nov 02 21:25:20.507733 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 486/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:20 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:20.651091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-61d3a8b4-7ccf-490c-9e7e-f2e97df7f46c req-f7fa7891-02a9-4f18-a10e-6d5d94ed8b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c23781-8473-464f-8e15-febb6b169596", "tag": "24bbba71-3312-4add-9f2b-5bb5c51bc724"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:20.666770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-61d3a8b4-7ccf-490c-9e7e-f2e97df7f46c req-f7fa7891-02a9-4f18-a10e-6d5d94ed8b3d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:20.668534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-61d3a8b4-7ccf-490c-9e7e-f2e97df7f46c req-f7fa7891-02a9-4f18-a10e-6d5d94ed8b3d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:20.669009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-61d3a8b4-7ccf-490c-9e7e-f2e97df7f46c req-f7fa7891-02a9-4f18-a10e-6d5d94ed8b3d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:20.700482 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-61d3a8b4-7ccf-490c-9e7e-f2e97df7f46c req-f7fa7891-02a9-4f18-a10e-6d5d94ed8b3d service nova] Creating event network-changed:24bbba71-3312-4add-9f2b-5bb5c51bc724 for instance 88c23781-8473-464f-8e15-febb6b169596 on n-h2-860863-4 Nov 02 21:25:20.719364 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-61d3a8b4-7ccf-490c-9e7e-f2e97df7f46c req-f7fa7891-02a9-4f18-a10e-6d5d94ed8b3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064700 Nov 02 21:25:20.720221 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 487/1040] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:21.047591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-283567608", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": "none"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:22.227390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96662fa7-efd0-4306-811a-ab71e0c8001c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 204 len: 0 microversion: 2.1 time: 1.866952 Nov 02 21:25:22.227390 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 554/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:20 2022] DELETE /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 0 bytes in 1871 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:22.239663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:22.240303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:22.263133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.263641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.267970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.268747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.273306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.274043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.312735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:22.315004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:22.316287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:22.317649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:22.319718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:22.331999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.332861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.333568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.334682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.335377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.336311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.362228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Getting quotas for project e3943269757d42c0b1906f78b6a59b11. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:22.375099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Getting quotas for user de1744ab32064ac183d7910dd73ea80a and project e3943269757d42c0b1906f78b6a59b11. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:22.399037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:25:22.404045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:25:22.630904 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c90703a9-7a59-4613-8a2a-dea5fbc632a2 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.775257 Nov 02 21:25:22.635796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 488/1042] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:25:22.642800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:22.643659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:22.653354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.654051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.656089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.657097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.657819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.658415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.863144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:22.881999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:22.883608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:22.885614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe919af4-910c-4e9b-a386-d311387a5b7d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1346 microversion: 2.25 time: 0.251116 Nov 02 21:25:22.886488 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 489/1043] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:22 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1346 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:22.891381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:22.894566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:22.914930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.915721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.916306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.917278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:22.917878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:22.918457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:22.935972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:22.948612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:22.953679 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2f517c2-2ea4-42a0-8354-c3ae98ec3172 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1469 microversion: 2.1 time: 0.721905 Nov 02 21:25:22.961804 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 555/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:22 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1469 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:23.235295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] Calling method '.version_select at 0x7f9b68e9b0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:23.262165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.262977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.266095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.266095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.266095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.266095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.310778 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70cd3289-88e1-4441-b5cf-f76ee2ba1ec2 tempest-AbsoluteLimitsTestJSON-2007332268 tempest-AbsoluteLimitsTestJSON-2007332268-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.344557 Nov 02 21:25:23.315128 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 556/1045] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Nov 2 21:25:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:23.319674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:23.320496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:23.355516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.362173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.362714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.363479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.363960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.364384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.524595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.532963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef771eda-b58d-4a63-8bb2-d598f2449518 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1268 microversion: 2.1 time: 0.219648 Nov 02 21:25:23.548418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.550018 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 557/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:23 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1268 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:23.552528 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5965be59-adf2-47a5-816b-3e6303ead82e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1325 microversion: 2.1 time: 0.664805 Nov 02 21:25:23.556450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:23.557313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:23.564661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.565262 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 490/1047] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:22 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1325 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:23.565659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.566200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.567001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.567550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.568173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.603654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:23.603654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:23.608379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.608867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.609384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.610081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:23.610529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:23.610945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:23.660812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:25:23.708171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.729416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.730968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.757618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e521431c-24be-4766-858b-4fdf1bf17eb7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.206264 Nov 02 21:25:23.762921 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 558/1048] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:23 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:23.780703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f6211c3-ee93-42c4-90f6-66991736a846 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:23.783648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f6211c3-ee93-42c4-90f6-66991736a846 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:23.959252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f6211c3-ee93-42c4-90f6-66991736a846 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.974497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f6211c3-ee93-42c4-90f6-66991736a846 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.976092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f6211c3-ee93-42c4-90f6-66991736a846 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:23.997680 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f6211c3-ee93-42c4-90f6-66991736a846 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "PUT /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1358 microversion: 2.75 time: 0.225412 Nov 02 21:25:24.032193 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 559/1049] 10.222.0.25 () {62 vars in 1297 bytes} [Wed Nov 2 21:25:23 2022] PUT /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:24.046167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-309de707-d4d8-4470-a806-ceb589d95d17 req-79c768d7-448d-425c-95e4-bea67d3f23ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a412bb-8df5-445f-8543-5e4b52e60115", "name": "network-vif-deleted", "tag": "20768c6b-0c87-424a-9ac4-1d628f7ae7f7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:24.078537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-309de707-d4d8-4470-a806-ceb589d95d17 req-79c768d7-448d-425c-95e4-bea67d3f23ad service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.079114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-309de707-d4d8-4470-a806-ceb589d95d17 req-79c768d7-448d-425c-95e4-bea67d3f23ad service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.081206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-309de707-d4d8-4470-a806-ceb589d95d17 req-79c768d7-448d-425c-95e4-bea67d3f23ad service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.101413 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-309de707-d4d8-4470-a806-ceb589d95d17 req-79c768d7-448d-425c-95e4-bea67d3f23ad service nova] Creating event network-vif-deleted:20768c6b-0c87-424a-9ac4-1d628f7ae7f7 for instance b0a412bb-8df5-445f-8543-5e4b52e60115 on n-h2-860863-4 Nov 02 21:25:24.107976 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-309de707-d4d8-4470-a806-ceb589d95d17 req-79c768d7-448d-425c-95e4-bea67d3f23ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074596 Nov 02 21:25:24.108599 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 560/1050] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:24.114522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a60fce80-507d-40d6-b1e9-8fb85857a92b req-033b4ceb-6809-48a9-81f5-8c9e68be3437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a3e5b8-5d0c-4307-960d-4da823a904a2", "name": "network-vif-unplugged", "status": "completed", "tag": "a28dda6b-a1c2-4b33-90e0-80e0ecccf79c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:24.126992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a60fce80-507d-40d6-b1e9-8fb85857a92b req-033b4ceb-6809-48a9-81f5-8c9e68be3437 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.128470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a60fce80-507d-40d6-b1e9-8fb85857a92b req-033b4ceb-6809-48a9-81f5-8c9e68be3437 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.129468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a60fce80-507d-40d6-b1e9-8fb85857a92b req-033b4ceb-6809-48a9-81f5-8c9e68be3437 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.154292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a60fce80-507d-40d6-b1e9-8fb85857a92b req-033b4ceb-6809-48a9-81f5-8c9e68be3437 service nova] Creating event network-vif-unplugged:a28dda6b-a1c2-4b33-90e0-80e0ecccf79c for instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 on n-h1-860863-4 Nov 02 21:25:24.166074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a60fce80-507d-40d6-b1e9-8fb85857a92b req-033b4ceb-6809-48a9-81f5-8c9e68be3437 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052453 Nov 02 21:25:24.168196 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 561/1051] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:24.180976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:24.182467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:24.190610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.191566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.192000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.192849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.193408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.194404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.214702 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-694709cd-2148-4566-9b38-16f36c19ac00 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 204 len: 0 microversion: 2.1 time: 0.639958 Nov 02 21:25:24.218659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 491/1052] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:25:23 2022] DELETE /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:24.256224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:24.257066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:24.276181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.291354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.291996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.293040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.297047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.298319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.404352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.405147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.406013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.408448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lazy-loading 'fault' on Instance uuid b0a412bb-8df5-445f-8543-5e4b52e60115 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:25:24.471201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:24.494975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:24.496583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:24.498060 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-962080fa-5fdf-4fab-b4ac-6e8b60ea0eca tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1344 microversion: 2.25 time: 0.325874 Nov 02 21:25:24.509420 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 562/1053] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:24 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1344 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:24.520750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:24.533397 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d4cbc7eb-7010-4455-8309-bed870759aec tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 200 len: 1303 microversion: 2.1 time: 0.316256 Nov 02 21:25:24.534597 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 492/1054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:24 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 1303 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:24.539645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-273680583", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fbb32731-3286-4309-9c0c-b898bc17a336"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:24.544361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:24.545948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:24.568190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.571624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.572338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.576101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.579834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.579834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.609931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] validate_networks() for [('fbb32731-3286-4309-9c0c-b898bc17a336', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:25:24.828418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:24.854630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:24.860570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:24.874505 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-450e4229-6063-42cc-97b5-dc2ab0059700 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1362 microversion: 2.75 time: 0.335620 Nov 02 21:25:24.885508 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 563/1055] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:24 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:24.899492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:24.900323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:24.929387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.929387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.929387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:24.929387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:24.929854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:24.930169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:26.063539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:26.082083 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bef865c7-0847-4800-8ca0-60e36efcb5a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1310 microversion: 2.1 time: 1.195447 Nov 02 21:25:26.085698 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 564/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:24 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1310 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:26.112221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:26.113535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:26.146476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:26.146982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:26.147428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:26.148141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:26.148597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:26.149054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:26.954897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:26.967541 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96ecf6f0-60bc-425b-86a7-6772d8030bc2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1325 microversion: 2.1 time: 0.880563 Nov 02 21:25:26.969853 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 565/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:26 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1325 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:26.976191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:26.977730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:26.989959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:26.989959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:26.989959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:26.989959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:26.989959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:27.003372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.003802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.003913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.004304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.004827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.005086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.005472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.005591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.005896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.006340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.007306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.008272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.102021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:27.128511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for user 9ab2a1f2b5b74571b08c97e9493d568d and project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:27.185029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:25:27.186854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:25:27.255869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:27.276851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:27.294024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:27.295572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:27.298673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:27.309200 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9cfd774b-c6e9-47ea-a110-57b709f9b6c8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.337537 Nov 02 21:25:27.310570 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 566/1058] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:26 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:27.329396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:27.330916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:27.351477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.351988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.352453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.356623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.357785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.358425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.484003 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cc7c2f67-3a2e-47a2-a191-b968aea99b0d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.947854 Nov 02 21:25:27.484795 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 493/1059] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:25:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:25:27.506188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:27.513058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: b0a412bb-8df5-445f-8543-5e4b52e60115] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:27.522349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.523245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.523942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.525472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.526767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.527632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.564323 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] HTTP exception thrown: Instance b0a412bb-8df5-445f-8543-5e4b52e60115 could not be found. Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Request method failure captured: Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 HTTP/1.1 Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-iFBFvdm6bpFSpNcqMqAVwk7nzzxZspSYcHn-jwKwxXvbtf0HUnfsXGLDmpOHjau4SGLfAFLJz62997JC0Se7Hoo_fCX_xZh6bHYX4skprrF-A8FLZX9W2z_vrmo42TN35_JRMVXrslCU6OfYPIPTAfHhQ2ZFw0EnSJ19FSEmVkKw Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ad41afe8a2f04aee958c00322937c074 Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:25:27.566605 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad41afe8a2f04aee958c00322937c074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ad41afe8a2f04aee958c00322937c074 Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdminTestJSON-351926994-project Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: d1038966c4b6489ebafefb73c748e957 Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdminTestJSON-351926994-project Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b0a412bb-8df5-445f-8543-5e4b52e60115 could not be found. Nov 02 21:25:27.567937 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b0a412bb-8df5-445f-8543-5e4b52e60115'} Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a412bb-8df5-445f-8543-5e4b52e60115 could not be found. Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:27.568725 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a412bb-8df5-445f-8543-5e4b52e60115 could not be found. Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a412bb-8df5-445f-8543-5e4b52e60115 could not be found. Nov 02 21:25:27.574221 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:27.575276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Returning 404 to user: Instance b0a412bb-8df5-445f-8543-5e4b52e60115 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:27.577452 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f11a3f83-94c8-4a1c-b8a0-068cd6e3ea33 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115" status: 404 len: 111 microversion: 2.1 time: 0.089841 Nov 02 21:25:27.578534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 494/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:27 2022] GET /compute/v2.1/servers/b0a412bb-8df5-445f-8543-5e4b52e60115 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:25:27.584612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:27.585503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:27.596429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.597407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.598664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.599571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.600264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.606036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:27.868399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:27.903655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:27.908047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:27.923181 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9ecdf16-e860-4668-b0dc-c476a4259b97 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1416 microversion: 2.75 time: 0.342995 Nov 02 21:25:27.926074 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 495/1061] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:27 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1416 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:27.943770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-12e4b660-7794-489c-89c2-cd373aa21447 req-6074edcf-5496-4a99-9f78-8498728978c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a3e5b8-5d0c-4307-960d-4da823a904a2", "name": "network-vif-deleted", "tag": "a28dda6b-a1c2-4b33-90e0-80e0ecccf79c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:27.990845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-12e4b660-7794-489c-89c2-cd373aa21447 req-6074edcf-5496-4a99-9f78-8498728978c3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:27.991445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-12e4b660-7794-489c-89c2-cd373aa21447 req-6074edcf-5496-4a99-9f78-8498728978c3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:27.995299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-12e4b660-7794-489c-89c2-cd373aa21447 req-6074edcf-5496-4a99-9f78-8498728978c3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.007722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.010892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:28.023330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.025138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.027945 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-12e4b660-7794-489c-89c2-cd373aa21447 req-6074edcf-5496-4a99-9f78-8498728978c3 service nova] Creating event network-vif-deleted:a28dda6b-a1c2-4b33-90e0-80e0ecccf79c for instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 on n-h1-860863-4 Nov 02 21:25:28.030221 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f68bb4d6-ac94-4e72-a54d-1c549d9572db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1410 microversion: 2.25 time: 0.716731 Nov 02 21:25:28.033675 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 567/1062] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:27 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1410 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:28.039942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:28.043447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:28.048831 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-12e4b660-7794-489c-89c2-cd373aa21447 req-6074edcf-5496-4a99-9f78-8498728978c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120018 Nov 02 21:25:28.056158 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 496/1063] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:28.061974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.061974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.064795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.068158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.068825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.069462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.084737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-fb8b458a-1481-4732-9e43-a155d7a9ef00 req-eac28a4a-6b78-4492-9593-4fff4e448447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22ef89e-ee93-4cdf-8518-00b2219a29d9", "tag": "d9175032-8828-4122-af13-668346e4b744"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:28.115731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fb8b458a-1481-4732-9e43-a155d7a9ef00 req-eac28a4a-6b78-4492-9593-4fff4e448447 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.118036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fb8b458a-1481-4732-9e43-a155d7a9ef00 req-eac28a4a-6b78-4492-9593-4fff4e448447 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.120261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fb8b458a-1481-4732-9e43-a155d7a9ef00 req-eac28a4a-6b78-4492-9593-4fff4e448447 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.156810 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-fb8b458a-1481-4732-9e43-a155d7a9ef00 req-eac28a4a-6b78-4492-9593-4fff4e448447 service nova] Creating event network-changed:d9175032-8828-4122-af13-668346e4b744 for instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 on n-h1-860863-4 Nov 02 21:25:28.166054 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-fb8b458a-1481-4732-9e43-a155d7a9ef00 req-eac28a4a-6b78-4492-9593-4fff4e448447 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104937 Nov 02 21:25:28.167920 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 497/1064] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:28.173790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-abfb0738-9b83-4c6f-9c3d-69241812a4df tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:28.176523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-abfb0738-9b83-4c6f-9c3d-69241812a4df tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:28.353165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abfb0738-9b83-4c6f-9c3d-69241812a4df tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.365035 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-abfb0738-9b83-4c6f-9c3d-69241812a4df tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1207 microversion: 2.1 time: 0.192681 Nov 02 21:25:28.371754 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 498/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:28 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1207 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:28.388184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:28.388688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:28.397003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.398421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.399071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.400902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.401776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.402358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.453468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:25:28.621862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.630685 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa380647-a23a-4464-9a29-063226809040 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1310 microversion: 2.1 time: 0.594960 Nov 02 21:25:28.632897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 568/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:28 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1310 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:28.652820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-edbb375d-8218-4f3c-80b1-81fa161aa3ca req-c1f6c63b-f8a8-4462-a58c-594123d631d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c23781-8473-464f-8e15-febb6b169596", "name": "network-vif-plugged", "status": "completed", "tag": "24bbba71-3312-4add-9f2b-5bb5c51bc724"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:28.676687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-edbb375d-8218-4f3c-80b1-81fa161aa3ca req-c1f6c63b-f8a8-4462-a58c-594123d631d6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.677179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-edbb375d-8218-4f3c-80b1-81fa161aa3ca req-c1f6c63b-f8a8-4462-a58c-594123d631d6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.678586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-edbb375d-8218-4f3c-80b1-81fa161aa3ca req-c1f6c63b-f8a8-4462-a58c-594123d631d6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.693279 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-edbb375d-8218-4f3c-80b1-81fa161aa3ca req-c1f6c63b-f8a8-4462-a58c-594123d631d6 service nova] Creating event network-vif-plugged:24bbba71-3312-4add-9f2b-5bb5c51bc724 for instance 88c23781-8473-464f-8e15-febb6b169596 on n-h2-860863-4 Nov 02 21:25:28.699943 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-edbb375d-8218-4f3c-80b1-81fa161aa3ca req-c1f6c63b-f8a8-4462-a58c-594123d631d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065500 Nov 02 21:25:28.700754 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 569/1067] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:28.708498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:28.709394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:28.723309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.727175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.731474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.732495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.733154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.735691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.793871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7eb96ca0-a553-4e67-9671-d774db7a7724 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 204 len: 0 microversion: 2.1 time: 0.419827 Nov 02 21:25:28.795720 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 499/1068] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:25:28 2022] DELETE /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:28.801392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:28.804386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:28.824527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.825363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.825972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.827079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.831942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.833213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:28.945431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.961134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.963127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:28.968643 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e6b3584-995f-4ec2-b649-1b381894bfb8 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.171459 Nov 02 21:25:28.977790 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 500/1069] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:28 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:28.983812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:28.984423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:28.997828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:28.998952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:28.999398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.000093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.000706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.001473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.132190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.165865 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-81cb7497-f944-40bc-9eb5-c8cefc4727eb tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1325 microversion: 2.1 time: 0.457453 Nov 02 21:25:29.166861 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 570/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:28 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1325 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:29.172487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:29.176491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:29.193636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.194250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.194570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.195280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.195735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.196159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.253816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.270000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41eb0168-be09-4a61-8aa2-6124c92310e4 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1468 microversion: 2.1 time: 0.291757 Nov 02 21:25:29.271600 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 501/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:28 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1468 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:29.279109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:29.281182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:29.288096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.288952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.302761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.303566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.304050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.304591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.343734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.354387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.356172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.363743 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe27b443-d1fc-4c19-a33f-7849e8dfe7f3 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1416 microversion: 2.75 time: 0.195667 Nov 02 21:25:29.382327 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 571/1072] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:29 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1416 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:29.394158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:29.395036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:29.401673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.402656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.403296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.404162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.404771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.405439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.507456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.518920 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e23cadb5-4c4d-4c2c-9362-e164a07a701a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1211 microversion: 2.1 time: 0.130821 Nov 02 21:25:29.519514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 572/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:29 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:29.562105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.576432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.577907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.579041 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f898080d-ff89-4d62-92fe-600e3f4472b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1410 microversion: 2.25 time: 0.306096 Nov 02 21:25:29.579801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 502/1074] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:29 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1410 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:29.661180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:29.662903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:29.673757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.674903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.675359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.676074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:29.676525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:29.677141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:29.854553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:29.867210 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79c57c4f-bcde-449f-b450-98d8c4469dee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1310 microversion: 2.1 time: 0.214205 Nov 02 21:25:29.878721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 573/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:29 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1310 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:30.004289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:30.005501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:30.019714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:30.020390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:30.022325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:30.025364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:30.027641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:30.029700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:30.152456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:30.162004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:30.169309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:30.187546 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d6f74bbf-8145-4e25-9baf-e63d00abb4bb tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.186633 Nov 02 21:25:30.191102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:30.191949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:30.199784 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 503/1076] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:29 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:25:30.201801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:30.202306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:30.202751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:30.203459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:30.210302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:30.210985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:30.288471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6c3be43f-cef3-4c4c-b7c0-826c66b06a02 req-ab0d8e43-63b0-4a54-8b3d-f4ba13b79154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec0e4c5-b974-4e97-b40d-8b54b4d85558", "tag": "b985a751-243c-45ff-878a-a684e938c842"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:30.308879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c3be43f-cef3-4c4c-b7c0-826c66b06a02 req-ab0d8e43-63b0-4a54-8b3d-f4ba13b79154 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:30.316805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c3be43f-cef3-4c4c-b7c0-826c66b06a02 req-ab0d8e43-63b0-4a54-8b3d-f4ba13b79154 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:30.317630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c3be43f-cef3-4c4c-b7c0-826c66b06a02 req-ab0d8e43-63b0-4a54-8b3d-f4ba13b79154 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:30.348035 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6c3be43f-cef3-4c4c-b7c0-826c66b06a02 req-ab0d8e43-63b0-4a54-8b3d-f4ba13b79154 service nova] Creating event network-changed:b985a751-243c-45ff-878a-a684e938c842 for instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 on n-h1-860863-4 Nov 02 21:25:30.359695 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6c3be43f-cef3-4c4c-b7c0-826c66b06a02 req-ab0d8e43-63b0-4a54-8b3d-f4ba13b79154 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074687 Nov 02 21:25:30.363383 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 504/1077] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:25:30.381903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:30.382904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:30.390300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:30.391032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:30.391656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:30.393182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:30.397616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:30.398278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.396060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:31.405157 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-327096c6-6b56-493e-a6ec-8a96a5228dd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1325 microversion: 2.1 time: 1.218155 Nov 02 21:25:31.410526 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 574/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:30 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1325 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:31.425126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:31.426011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:31.452771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.453676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.454450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.455343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.455949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.456920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:31.459359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.471553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d902a128-1dd4-4da4-9a72-e11e07abbbf9 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1468 microversion: 2.1 time: 1.106715 Nov 02 21:25:31.477207 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 505/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:30 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1468 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:31.487624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:31.488481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:31.507301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.509588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.512299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.519131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.520109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.520763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.706810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:31.725964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:31.727867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:31.749318 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2ee9871-a219-4d72-a1b3-a43e6697f81f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1437 microversion: 2.75 time: 0.337049 Nov 02 21:25:31.749913 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 575/1080] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:31 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1437 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:31.755342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:31.758848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:31.773502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.787669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.788428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.789215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.789691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.790141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.805834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:31.815348 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-51c71829-5c3b-4b9f-8c97-3396363e2dd6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1259 microversion: 2.1 time: 0.336683 Nov 02 21:25:31.818094 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 506/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:31 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1259 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:31.841379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:31.842249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:31.850761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.853636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.854341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:31.855234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:31.859174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:31.859855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:32.998653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.009126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.017892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.019384 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be1363ee-3637-495d-9fc3-2e86aad621db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1410 microversion: 2.25 time: 1.268320 Nov 02 21:25:33.033319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 576/1082] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:31 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1410 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:33.039402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.043042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:33.043869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:33.046165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:33.048685 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ede02de3-fe3e-4b09-907f-bfba00977ce5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1310 microversion: 2.1 time: 1.217478 Nov 02 21:25:33.050730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.051481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.052108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.053005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.053848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.054439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.062023 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 507/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:31 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1310 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:33.077134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:33.080315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:33.094765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.095522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.096122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.101330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.101330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.101330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.234302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.247054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.251513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.264224 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f88a3a03-b01b-4ef7-9b4b-6b977f662236 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.229597 Nov 02 21:25:33.265638 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 577/1084] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:33 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:33.270079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:33.270657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:33.271270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:33.272080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:33.273174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:33.275510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:33.276873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:33.281783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.283796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.283796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.284371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.285026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.285630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.286498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:33.535624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.545642 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df002179-b7a1-44f6-86d0-34992449f001 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.278699 Nov 02 21:25:33.546479 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 578/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:33 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:33.552303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:33.553950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:33.564336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.565245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.565969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.566978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.567677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.568299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.732776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1038966c4b6489ebafefb73c748e957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad41afe8a2f04aee958c00322937c074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:33.745613 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ea9e373-4431-4a65-b5cd-55ac8ccc05f7 tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 200 len: 1468 microversion: 2.1 time: 0.197918 Nov 02 21:25:33.761426 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 579/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:33 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:33.762967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:33.763807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:33.776239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.776848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.777465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.778135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.778730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.779138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.897799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:33.918487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.919370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.920056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.921051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:33.922206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:33.926088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:33.969046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=24 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:34.078423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:34.094749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:34.096216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:34.118029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-addb34b4-13fa-45c9-adca-b4068000796b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "POST /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301/action" status: 202 len: 1494 microversion: 2.75 time: 1.046101 Nov 02 21:25:34.118029 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 508/1087] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:25:33 2022] POST /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301/action => generated 1494 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 21:25:34.146842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:34.158514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:34.165506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:34.166167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:34.166619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:34.167333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:34.167795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:34.170685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:34.766013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:34.774687 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e95b891d-8479-4b16-bba3-5b02c26290b3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1307 microversion: 2.1 time: 1.027295 Nov 02 21:25:34.784981 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 580/1088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:33 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1307 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:34.791386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f565fcc2-65d2-43d1-a48b-02b7a39a398c req-65d835d6-e7c6-42a7-9112-a8c440e49c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ef89e-ee93-4cdf-8518-00b2219a29d9", "name": "network-vif-plugged", "status": "completed", "tag": "d9175032-8828-4122-af13-668346e4b744"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:34.811473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f565fcc2-65d2-43d1-a48b-02b7a39a398c req-65d835d6-e7c6-42a7-9112-a8c440e49c79 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:34.813505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f565fcc2-65d2-43d1-a48b-02b7a39a398c req-65d835d6-e7c6-42a7-9112-a8c440e49c79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:34.817637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f565fcc2-65d2-43d1-a48b-02b7a39a398c req-65d835d6-e7c6-42a7-9112-a8c440e49c79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:34.846909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f565fcc2-65d2-43d1-a48b-02b7a39a398c req-65d835d6-e7c6-42a7-9112-a8c440e49c79 service nova] Creating event network-vif-plugged:d9175032-8828-4122-af13-668346e4b744 for instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 on n-h1-860863-4 Nov 02 21:25:34.861330 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f565fcc2-65d2-43d1-a48b-02b7a39a398c req-65d835d6-e7c6-42a7-9112-a8c440e49c79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074636 Nov 02 21:25:34.862521 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 581/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:34.874581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:34.881737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:34.890590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:34.892045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:34.892730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:34.893867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:34.894548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:34.896347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:35.523793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:35.539445 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97887adb-b8d4-41ea-891e-267a55e93523 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 1.428035 Nov 02 21:25:35.544371 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 509/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:34 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:35.553040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:35.565148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:35.588185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:35.599611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:35.600389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:35.603312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:35.606564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:35.609117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:35.813834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:35.856354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:35.865084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:35.867902 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b934ba8-29fa-4001-bc96-26d952ef9118 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1410 microversion: 2.25 time: 1.002896 Nov 02 21:25:35.871985 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 582/1091] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:34 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1410 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:35.882021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:35.884898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:35.908272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:35.909412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:35.912044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:35.913268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:35.914050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:35.914706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.387030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:36.427551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:36.432071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:36.447899 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f145a266-7ed2-4907-b5e8-860fec17a131 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.573989 Nov 02 21:25:36.449118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 583/1092] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:35 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:36.455310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:36.456638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:36.463680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.464405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.465030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.466559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.467215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.467811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.512727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:36.521152 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0898e621-7fd7-401d-bf4d-66b624487a0b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1310 microversion: 2.1 time: 0.974772 Nov 02 21:25:36.523129 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 510/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:35 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1310 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:36.529183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:36.530608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] [instance: 0a638e0a-0e2f-44b4-a1f9-702c78a5495e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:36.543038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.543963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.544495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.545627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.546430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.547093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.568237 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] HTTP exception thrown: Instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e could not be found. Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Request method failure captured: Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e HTTP/1.1 Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-iFBFvdm6bpFSpNcqMqAVwk7nzzxZspSYcHn-jwKwxXvbtf0HUnfsXGLDmpOHjau4SGLfAFLJz62997JC0Se7Hoo_fCX_xZh6bHYX4skprrF-A8FLZX9W2z_vrmo42TN35_JRMVXrslCU6OfYPIPTAfHhQ2ZFw0EnSJ19FSEmVkKw Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ad41afe8a2f04aee958c00322937c074 Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:25:36.591319 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ad41afe8a2f04aee958c00322937c074"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ad41afe8a2f04aee958c00322937c074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ad41afe8a2f04aee958c00322937c074 Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdminTestJSON-351926994 Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdminTestJSON-351926994-project Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: d1038966c4b6489ebafefb73c748e957 Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdminTestJSON-351926994-project Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e could not be found. Nov 02 21:25:36.593192 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0a638e0a-0e2f-44b4-a1f9-702c78a5495e'} Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e could not be found. Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:36.593944 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e could not be found. Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e could not be found. Nov 02 21:25:36.595157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.596207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] Returning 404 to user: Instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:36.596207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e332fb5-4f2c-492b-8131-a23b127f4d8a tempest-ServersAdminTestJSON-351926994 tempest-ServersAdminTestJSON-351926994-project] 10.222.0.25 "GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e" status: 404 len: 111 microversion: 2.1 time: 0.062794 Nov 02 21:25:36.596207 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 511/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:36 2022] GET /compute/v2.1/servers/0a638e0a-0e2f-44b4-a1f9-702c78a5495e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:25:36.600847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-fa65b03c-4aa2-409a-ae00-fc6e814fb2e4 req-a277e93f-cf49-4cb2-92a3-5463354e3fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a638e0a-0e2f-44b4-a1f9-702c78a5495e", "name": "network-vif-deleted", "tag": "959e5aa8-19e8-427e-86c3-a667021fcc01"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:36.608815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:36.613119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa65b03c-4aa2-409a-ae00-fc6e814fb2e4 req-a277e93f-cf49-4cb2-92a3-5463354e3fbb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.614107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa65b03c-4aa2-409a-ae00-fc6e814fb2e4 req-a277e93f-cf49-4cb2-92a3-5463354e3fbb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.619717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa65b03c-4aa2-409a-ae00-fc6e814fb2e4 req-a277e93f-cf49-4cb2-92a3-5463354e3fbb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.619866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:36.624140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:36.630547 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-fa65b03c-4aa2-409a-ae00-fc6e814fb2e4 req-a277e93f-cf49-4cb2-92a3-5463354e3fbb service nova] Creating event network-vif-deleted:959e5aa8-19e8-427e-86c3-a667021fcc01 for instance 0a638e0a-0e2f-44b4-a1f9-702c78a5495e on n-h2-860863-4 Nov 02 21:25:36.637539 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b167db7f-48dd-43c8-901b-a3161adf0866 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.187175 Nov 02 21:25:36.642298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-fa65b03c-4aa2-409a-ae00-fc6e814fb2e4 req-a277e93f-cf49-4cb2-92a3-5463354e3fbb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051391 Nov 02 21:25:36.643107 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 512/1095] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:36.649094 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 584/1096] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:36 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:36.650291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75fbf5f2-eeec-4cb4-acc7-ba1c4330516e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-481760023", "metadata": {"": ""}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75fbf5f2-eeec-4cb4-acc7-ba1c4330516e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action HTTP/1.1 Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 106 Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:25:36.654773 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-481760023", "metadata": {"": ""}}} Nov 02 21:25:36.656089 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '88c23781-8473-464f-8e15-febb6b169596', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-481760023', 'metadata': {'': ''}}}} Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'': ''} Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:36.656899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.658209 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:36.660623 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:36.660623 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:36.660623 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:25:36.660623 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:25:36.660623 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:36.660623 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:25:36.662161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75fbf5f2-eeec-4cb4-acc7-ba1c4330516e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:36.663296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-75fbf5f2-eeec-4cb4-acc7-ba1c4330516e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action" status: 400 len: 170 microversion: 2.1 time: 0.018460 Nov 02 21:25:36.666097 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 513/1097] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 21:25:36 2022] POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:25:36.668757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:36.673727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0a1b3663-076c-4dc5-8823-4df3658a8783 req-ff103a62-170c-4cd9-addc-f0983efe534f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9587065-f470-4a25-b540-62ca7d78e8bd", "tag": "c7560cb4-da89-4cfa-91fa-d2b1b1e2128c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:36.674888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:36.684036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0a1b3663-076c-4dc5-8823-4df3658a8783 req-ff103a62-170c-4cd9-addc-f0983efe534f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.684521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0a1b3663-076c-4dc5-8823-4df3658a8783 req-ff103a62-170c-4cd9-addc-f0983efe534f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.684966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0a1b3663-076c-4dc5-8823-4df3658a8783 req-ff103a62-170c-4cd9-addc-f0983efe534f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.689163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.692207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.692897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.693990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.694685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.698404 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0a1b3663-076c-4dc5-8823-4df3658a8783 req-ff103a62-170c-4cd9-addc-f0983efe534f service nova] Creating event network-changed:c7560cb4-da89-4cfa-91fa-d2b1b1e2128c for instance a9587065-f470-4a25-b540-62ca7d78e8bd on n-h1-860863-4 Nov 02 21:25:36.700130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.703862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0a1b3663-076c-4dc5-8823-4df3658a8783 req-ff103a62-170c-4cd9-addc-f0983efe534f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037969 Nov 02 21:25:36.704756 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 514/1098] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:36.712056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:36.714433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:36.722440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.723094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.728884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:36.728884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:36.728884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:36.728884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:37.034649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:37.458412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:37.467972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:37.502521 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-112c1716-d9e9-49d2-bab9-84674453fcab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1307 microversion: 2.1 time: 0.849529 Nov 02 21:25:37.516450 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 585/1099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:36 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1307 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:37.549590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:37.554154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:37.584259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:37.589572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:37.591359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:37.594247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:37.595338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:37.596396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:37.663097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:37.679737 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-992c046c-93ca-4823-949d-065b35db5685 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.973724 Nov 02 21:25:37.682592 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 515/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:36 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:37.693256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:37.700415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:37.725198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:37.726022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:37.726750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:37.727626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:37.735855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:37.740087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.118267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.129189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.134777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.148901 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ddb3b904-420d-4f80-98cb-3c9f0a347da1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.464866 Nov 02 21:25:38.151113 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 516/1101] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:37 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:38.157156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:38.174647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:38.194703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.199729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.200372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.201310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.201934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.202552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.357702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=48 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:38.522523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.535658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.537912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.539216 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d50f6cc-43da-4336-bfeb-37ef037d2892 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1410 microversion: 2.25 time: 1.021336 Nov 02 21:25:38.549081 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 586/1102] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:37 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1410 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:38.549081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:38.549525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:38.566636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.567139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.567576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.568452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.572073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.573835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.722776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.740892 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b1ea4340-1b7a-48ee-86d5-3ae14547ce71 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1491 microversion: 2.1 time: 0.587077 Nov 02 21:25:38.747533 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 517/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:38 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1491 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:38.767466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c73c9d3e-0359-49ed-89ae-490e127b6212 req-f0febfb1-8742-4247-9793-be42e291afac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec0e4c5-b974-4e97-b40d-8b54b4d85558", "name": "network-vif-plugged", "status": "completed", "tag": "b985a751-243c-45ff-878a-a684e938c842"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:38.771103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.784912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.785200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c73c9d3e-0359-49ed-89ae-490e127b6212 req-f0febfb1-8742-4247-9793-be42e291afac service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.785769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c73c9d3e-0359-49ed-89ae-490e127b6212 req-f0febfb1-8742-4247-9793-be42e291afac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.786458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c73c9d3e-0359-49ed-89ae-490e127b6212 req-f0febfb1-8742-4247-9793-be42e291afac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.788652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:38.795278 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d16c8d70-5dce-4147-822f-cb0016e087aa tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.253187 Nov 02 21:25:38.796671 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 587/1104] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:38 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:38.802007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:38.803044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:38.811072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.812050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.812727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.813649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.814288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.814978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.827382 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c73c9d3e-0359-49ed-89ae-490e127b6212 req-f0febfb1-8742-4247-9793-be42e291afac service nova] Creating event network-vif-plugged:b985a751-243c-45ff-878a-a684e938c842 for instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 on n-h1-860863-4 Nov 02 21:25:38.838847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c73c9d3e-0359-49ed-89ae-490e127b6212 req-f0febfb1-8742-4247-9793-be42e291afac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089105 Nov 02 21:25:38.841838 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 518/1105] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:38.849057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:38.849768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:38.874066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.874569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.875010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:38.875721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:38.876182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:38.876616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:39.705784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:39.715446 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7139ad5-c31d-4658-bff5-ba6af9a67226 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.917577 Nov 02 21:25:39.726034 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 588/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:38 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:39.823137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:39.837819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2322f55d-175d-4352-a293-3ed7cf75892d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1307 microversion: 2.1 time: 0.992861 Nov 02 21:25:39.838712 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 519/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:38 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1307 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:39.843891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:39.844758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:39.851855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:39.853273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:39.854469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:39.855540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:39.856209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:39.856992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:39.955705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:39.970455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:39.974387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:39.982209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ee5bf507-8dd1-4cea-b17f-79464dd0e5e8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.142016 Nov 02 21:25:39.983300 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 520/1108] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:39 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:39.988494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:39.990088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:40.001391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.002027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.003062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.004623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.005177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.005683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.067261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:40.068160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:40.076471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.077541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.083344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.083344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.083344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.083344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.499922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7091c717-b992-4c0d-92bd-16256a1090a3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1642 microversion: 2.1 time: 0.772441 Nov 02 21:25:40.501729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:40.511961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:40.513643 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 589/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:39 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1642 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:40.513795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:40.515018 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b4e14cb8-7ee7-40d4-b551-4658933a291b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1410 microversion: 2.25 time: 0.530472 Nov 02 21:25:40.516451 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 521/1110] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:39 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1410 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:40.526893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:40.527829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:40.528134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bdc93f15-835c-4ea8-aa91-4f9e9ad1c952 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-280985935", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bdc93f15-835c-4ea8-aa91-4f9e9ad1c952 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action HTTP/1.1 Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 618 Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:25:40.534281 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:40.536334 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:25:40.537507 n-d-860863-4 devstack@n-api.service[121040]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-280985935", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 02 21:25:40.537507 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:25:40.537507 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '88c23781-8473-464f-8e15-febb6b169596', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-280985935', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 21:25:40.537871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:40.538942 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:40.541404 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:40.542566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:40.542566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:40.542566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:25:40.542566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:25:40.542566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:25:40.542566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:40.543206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.543206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.543206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.543206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.543647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.543647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.545230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bdc93f15-835c-4ea8-aa91-4f9e9ad1c952 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:40.546504 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bdc93f15-835c-4ea8-aa91-4f9e9ad1c952 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action" status: 400 len: 938 microversion: 2.1 time: 0.031348 Nov 02 21:25:40.547695 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 590/1111] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 21:25:40 2022] POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action => generated 938 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:25:40.553824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:40.554440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:40.562595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.563258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.563921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.564855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.565718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.567741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.702795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:40.715246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:40.716776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:40.722250 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c040f23b-9c23-423d-9df9-8e372583124d tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.204537 Nov 02 21:25:40.737132 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 522/1112] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:40 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:40.747565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:40.747565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:40.752638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.753218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.753670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:40.756017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:40.756503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:40.757123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.002005 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2f74a02-de44-4d41-8331-a0cbbcdec5e0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1642 microversion: 2.1 time: 0.452302 Nov 02 21:25:41.003222 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 591/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:40 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1642 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:41.009881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:41.010734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:41.021784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.022624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.023423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.024357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.025244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.026614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.203528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.219904 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-20c6f03a-0023-468f-ba21-c9d1080182e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.494968 Nov 02 21:25:41.222999 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 523/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:40 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:41.239295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:41.240349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:41.256148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.259024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.260320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.262806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.266671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.273972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.302766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.312040 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22a3781b-b8f2-49c2-bd2e-01c0837fa52d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1307 microversion: 2.1 time: 0.307317 Nov 02 21:25:41.323690 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 592/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:41 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:41.336747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:41.342204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.342986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.343585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.345267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.345886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.346495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.376165 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-12c8b6d1-74d4-41c0-aa18-78b60dc1083b tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044998 Nov 02 21:25:41.387324 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 593/1116] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:25:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:41.393514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:41.394399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:41.402225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.403014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.403712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.404615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.405275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.406298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.434772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.446970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.452101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.464273 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-99121b8e-ff81-4332-81f0-a0d7d506e2a5 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.239929 Nov 02 21:25:41.467686 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 524/1117] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:41 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:41.477898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": true, "disk_over_commit": false}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:41.480653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:41.491754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.494898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.499923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.501786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.503544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.504302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.559654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lazy-loading 'flavor' on Instance uuid e22ef89e-ee93-4cdf-8518-00b2219a29d9 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:25:41.565673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:41.578001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121039) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:25:41.612495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.627163 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a524129b-1e97-484a-abd2-f6d22a5c108a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.238515 Nov 02 21:25:41.627748 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 594/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:41 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:41.632883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:41.633877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:41.641450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.642148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.642925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.643783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:41.644395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:41.644997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:41.824747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.843037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.844713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:41.846348 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-224497b1-7ea1-4f4a-a14c-5b9d4c65a446 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1605 microversion: 2.25 time: 0.217263 Nov 02 21:25:41.847310 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 595/1119] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:41 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:42.152870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ba4a0aa-fdc6-4fbd-acdb-dfd3d790922e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Action: 'create', calling method: .version_select at 0x7f9b68e3d310>, body: {"keypair": {"name": "tempest-keypair-1632708651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSnc/raOe4D/g5nzSucyeIo9hMw4joMadJha3HaoObl1gAo08+S5WZrA5DrNdOzTLYBqUTgingjzmnv6hazT5OjzPSIQqb8qWUHalVYs0MsxzdK2HV7EZKQqjvG7aRdeg=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:42.195647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7ba4a0aa-fdc6-4fbd-acdb-dfd3d790922e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Getting quotas for project 412f81b2166743e88ef1d054b59a1480. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:42.201824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7ba4a0aa-fdc6-4fbd-acdb-dfd3d790922e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Getting quotas for user c97c20477bb14d26bac5781dea1b315a and project 412f81b2166743e88ef1d054b59a1480. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:42.338621 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ba4a0aa-fdc6-4fbd-acdb-dfd3d790922e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.488398 Nov 02 21:25:42.345417 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 596/1120] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:25:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:42.351430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a31ef5d-7f9a-4130-b0fd-0a6f1fc633e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a31ef5d-7f9a-4130-b0fd-0a6f1fc633e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action HTTP/1.1 Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 285 Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:25:42.356242 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:25:42.357779 n-d-860863-4 devstack@n-api.service[121040]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '88c23781-8473-464f-8e15-febb6b169596', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:25:42.358554 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:25:42.359319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:25:42.360754 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:25:42.361729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:25:42.361729 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:42.362563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a31ef5d-7f9a-4130-b0fd-0a6f1fc633e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:42.363641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7a31ef5d-7f9a-4130-b0fd-0a6f1fc633e0 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action" status: 400 len: 619 microversion: 2.1 time: 0.016792 Nov 02 21:25:42.364375 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 597/1121] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 21:25:42 2022] POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:25:42.376660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:42.377535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:42.384100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.385315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.385778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:42.386635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.387249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.387694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:42.474448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:42.484300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:42.485846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:42.491374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2310707d-51d4-4366-a05e-7b559a2642ce tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1555 microversion: 2.91 time: 0.118735 Nov 02 21:25:42.507030 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 598/1122] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:42 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:42.520183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:42.522118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:42.532976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.543561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.543561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:42.543561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.543561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.544005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:42.642050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58725c22-7053-474a-b557-9b7e27d582f1 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.129678 Nov 02 21:25:42.642641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 599/1123] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:25:42 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:25:42.648213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:42.649018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:42.663179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.663670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.664111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:42.665016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.666130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.666559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:42.858886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:42.872502 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3bbba11-5b7d-42af-8704-a42362212a3a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1307 microversion: 2.1 time: 0.228047 Nov 02 21:25:42.874631 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 600/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:42 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:42.879667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:42.880277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:42.887202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.890342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.890927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:42.901198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:42.901198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:42.901705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:43.208717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:43.220502 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7624644c-e62e-45e4-bbcd-68ae809e256e tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.344464 Nov 02 21:25:43.222515 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 601/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:42 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:43.245855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:43.247241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:43.257020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:43.257847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:43.258631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:43.261534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:43.262939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:43.263638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:43.404063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:43.415121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:43.415812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:43.421533 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7027e39-9f20-4514-8333-704465772277 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.197488 Nov 02 21:25:43.422105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 602/1126] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:43 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:43.543496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1077464735", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:43.609983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:25:43.879749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:43.880250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:43.880961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:43.881614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:43.882207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:43.886747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:43.894314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:43.894851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:43.895386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:43.896379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:43.897133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:43.897794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:43.920265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Getting quotas for project efa07aab86e04d0880eb496703bd6914. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:43.926070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Getting quotas for user 45bc9474111b4496a9a71efa3cb5a95b and project efa07aab86e04d0880eb496703bd6914. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:43.940464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:25:43.943083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:25:44.038798 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11453075-85b1-49be-ae96-e8cb33e1ab35 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613436 Nov 02 21:25:44.038798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 603/1127] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:25:44.048303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:44.049642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:44.058808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:44.059496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:44.060101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:44.061005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:44.061609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:44.062190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:44.323400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:44.339098 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6287e493-7b1a-43a8-b637-0b3b58167b8b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.300113 Nov 02 21:25:44.354570 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 604/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:44 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:44.362979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:44.363596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:44.378645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:44.379362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:44.381350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:44.382152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:44.382802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:44.383422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:44.477827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:44.489318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:44.490545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:44.496968 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9556fbb4-9233-41db-bb11-71d7116f7515 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1537 microversion: 2.91 time: 0.141204 Nov 02 21:25:44.498251 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 605/1129] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:44 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1537 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:44.526189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-959abb60-9752-4131-9bb8-22780922b5f1 req-5d4f428c-6eb6-4ead-9c43-dbd142e27550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9587065-f470-4a25-b540-62ca7d78e8bd", "name": "network-vif-plugged", "status": "completed", "tag": "c7560cb4-da89-4cfa-91fa-d2b1b1e2128c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:44.534169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-959abb60-9752-4131-9bb8-22780922b5f1 req-5d4f428c-6eb6-4ead-9c43-dbd142e27550 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:44.535218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-959abb60-9752-4131-9bb8-22780922b5f1 req-5d4f428c-6eb6-4ead-9c43-dbd142e27550 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:44.535348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-959abb60-9752-4131-9bb8-22780922b5f1 req-5d4f428c-6eb6-4ead-9c43-dbd142e27550 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:44.557511 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-959abb60-9752-4131-9bb8-22780922b5f1 req-5d4f428c-6eb6-4ead-9c43-dbd142e27550 service nova] Creating event network-vif-plugged:c7560cb4-da89-4cfa-91fa-d2b1b1e2128c for instance a9587065-f470-4a25-b540-62ca7d78e8bd on n-h1-860863-4 Nov 02 21:25:44.565361 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-959abb60-9752-4131-9bb8-22780922b5f1 req-5d4f428c-6eb6-4ead-9c43-dbd142e27550 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065690 Nov 02 21:25:44.570155 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 606/1130] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:44.576519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:44.578428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:44.586802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:44.588108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:44.588910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:44.589826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:44.590582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:44.591459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:45.079752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:45.082113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:45.098424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99f19381-64e5-4022-8c53-59927ff442e6 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1307 microversion: 2.1 time: 0.526780 Nov 02 21:25:45.098963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 607/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:44 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1307 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:45.120497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b961507f-078b-4dd9-bbb3-cc417f219967 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:45.121505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b961507f-078b-4dd9-bbb3-cc417f219967 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:45.219205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b961507f-078b-4dd9-bbb3-cc417f219967 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:45.223753 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b961507f-078b-4dd9-bbb3-cc417f219967 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1214 microversion: 2.1 time: 0.107316 Nov 02 21:25:45.224602 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 608/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:45 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:45.229607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-829a44d6-5898-4803-b6aa-ccf20199cf6e req-d96ab362-cfec-4176-b6b2-01a23e3c35e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec0e4c5-b974-4e97-b40d-8b54b4d85558", "tag": "b985a751-243c-45ff-878a-a684e938c842"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:45.250003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-829a44d6-5898-4803-b6aa-ccf20199cf6e req-d96ab362-cfec-4176-b6b2-01a23e3c35e3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:45.250479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-829a44d6-5898-4803-b6aa-ccf20199cf6e req-d96ab362-cfec-4176-b6b2-01a23e3c35e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:45.251193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-829a44d6-5898-4803-b6aa-ccf20199cf6e req-d96ab362-cfec-4176-b6b2-01a23e3c35e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:45.265529 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-829a44d6-5898-4803-b6aa-ccf20199cf6e req-d96ab362-cfec-4176-b6b2-01a23e3c35e3 service nova] Creating event network-changed:b985a751-243c-45ff-878a-a684e938c842 for instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 on n-h1-860863-4 Nov 02 21:25:45.268682 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-829a44d6-5898-4803-b6aa-ccf20199cf6e req-d96ab362-cfec-4176-b6b2-01a23e3c35e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043031 Nov 02 21:25:45.272069 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 609/1133] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:45.278364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-482798562"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:45.281248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:45.288574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:45.289349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:45.289845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:45.291663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:45.292348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:45.292761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:45.761811 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-efee44a8-d948-42a0-94fe-ff557af36a59 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action" status: 202 len: 0 microversion: 2.1 time: 0.488275 Nov 02 21:25:45.769571 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 610/1134] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:25:45 2022] POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:25:45.778561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:45.781843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:45.799453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:45.799962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:45.800404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:45.801193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:45.801645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:45.802077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:45.949331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:45.954098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:45.956404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:45.961658 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8fb31916-06b1-4a3f-b7b9-36c556e6a4ed tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.190552 Nov 02 21:25:45.962392 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 611/1135] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:45 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:45.967105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:45.967715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:45.974646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:45.974875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:45.975432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:45.976144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:45.976601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:45.977090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.080725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:46.090436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:46.091918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:46.097655 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14c2f95b-54da-47d1-a567-dbdbec195251 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1540 microversion: 2.91 time: 0.134187 Nov 02 21:25:46.098243 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 612/1136] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:45 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1540 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:46.103716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2005216123"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:46.106514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:46.112737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.113272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.113729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.114828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.115296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.116297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.160723 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Cannot 'createImage' instance 88c23781-8473-464f-8e15-febb6b169596 while it is in task_state image_snapshot Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action HTTP/1.1 Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 85 Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:25:46.162617 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2005216123"}} Nov 02 21:25:46.164127 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: exception: Cannot 'createImage' instance 88c23781-8473-464f-8e15-febb6b169596 while it is in task_state image_snapshot Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '88c23781-8473-464f-8e15-febb6b169596', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2005216123'}}} Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88c23781-8473-464f-8e15-febb6b169596 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:25:46.169456 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 88c23781-8473-464f-8e15-febb6b169596 while it is in task_state image_snapshot Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 88c23781-8473-464f-8e15-febb6b169596 while it is in task_state image_snapshot Nov 02 21:25:46.170746 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:25:46.171976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 409 to user: Cannot 'createImage' instance 88c23781-8473-464f-8e15-febb6b169596 while it is in task_state image_snapshot {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:25:46.171976 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8c6018b7-9731-4ea7-ad60-416011580bde tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action" status: 409 len: 159 microversion: 2.1 time: 0.064847 Nov 02 21:25:46.171976 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 613/1137] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:25:46 2022] POST /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596/action => generated 159 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:25:46.171976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:46.171976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:46.178145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.178633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.179068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.179855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.180310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.181301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.310608 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a00c907b-fa90-407c-a517-b87a3223d309 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9/action" status: 202 len: 0 microversion: 2.1 time: 4.841769 Nov 02 21:25:46.311240 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 525/1138] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:25:41 2022] POST /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9/action => generated 0 bytes in 4843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:46.315781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:46.319181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:46.339276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.339997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.340437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.341182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.341632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.342060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.430216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860863-4". {{(pid=121039) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 21:25:46.526369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:46.537232 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11d62593-ad53-4502-96a3-bbca9dd0fc0c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1307 microversion: 2.1 time: 0.370304 Nov 02 21:25:46.541256 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 614/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:46 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:46.544097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a44bbe5-69ef-4229-a990-cbbebc557e21 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '.version_select at 0x7f9b68e3d790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:46.755295 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c9f6bbf-0795-4b85-b44a-550fb6b8bd22 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action" status: 202 len: 0 microversion: 2.91 time: 0.442991 Nov 02 21:25:46.760009 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 526/1140] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:25:46 2022] POST /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:46.765162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:46.766060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:46.769268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:46.773257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.773736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.774379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.775775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.776234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.776654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.803157 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a44bbe5-69ef-4229-a990-cbbebc557e21 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/images/b65c1812-af9b-4ab8-9e1f-04099bbbab4a" status: 204 len: 0 microversion: 2.1 time: 0.263183 Nov 02 21:25:46.804103 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 615/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:46 2022] DELETE /compute/v2.1/images/b65c1812-af9b-4ab8-9e1f-04099bbbab4a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:46.811158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:46.811997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:46.820373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.820878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.821582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.822529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.823149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.824379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.847771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:46.855691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ff3cf91-8b3b-49b4-8350-b95a0ab4ee02 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1266 microversion: 2.1 time: 0.094273 Nov 02 21:25:46.857308 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 527/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:46 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:46.862066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:46.862671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:46.871212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.871705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.872145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.873113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:46.873585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:46.874455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:46.994269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.003010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.004436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.010189 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ecff98e2-45fe-4b57-bed2-ad05cb204a88 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1488 microversion: 2.91 time: 0.151856 Nov 02 21:25:47.010879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 528/1143] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:46 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1488 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:47.020183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:47.020867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:47.030149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:47.030511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:47.031023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:47.031847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:47.033140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:47.033701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:47.082581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.090745 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35450745-4699-4579-9f4f-71d5cbbb549b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.284891 Nov 02 21:25:47.091317 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 616/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:46 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:47.097444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-202038241", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6ecf3eea-d4bc-4043-9f18-e0c6cd0be688"}], "security_groups": [{"name": "tempest-securitygroup--1590456589"}], "key_name": "tempest-keypair-1632708651", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:47.422857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] validate_networks() for [('6ecf3eea-d4bc-4043-9f18-e0c6cd0be688', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:25:47.446289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.457263 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a34ca9e-ccf4-442a-8c5c-6b8c4dddf73a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1534 microversion: 2.1 time: 0.440503 Nov 02 21:25:47.473156 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 529/1145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:47 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1534 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:47.473156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:47.473156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:47.473156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:47.473156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:47.473717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:47.473717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:47.473717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:47.473717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:47.658247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.668011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.669508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:47.675277 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-35ee0018-88f0-4f6b-a7dd-21868d3e7715 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.216222 Nov 02 21:25:47.675862 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 530/1146] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:47 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:47.693403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:47.693403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:47.693403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:47.693403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:47.693919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:47.695278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:47.696515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:47.697750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.053212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:48.062227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-96e6ec51-ffc3-48c1-a6b0-222ba504e2b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1487 microversion: 2.1 time: 0.385361 Nov 02 21:25:48.062907 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 531/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:47 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1487 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:48.080656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:48.084329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:48.092433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.092716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.093197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.093872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.094466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.094902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.213834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:48.229556 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de63f490-0764-4533-9e56-0fa79e8a81fd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1272 microversion: 2.1 time: 0.165498 Nov 02 21:25:48.230199 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 532/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:48 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:48.245963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:48.246655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:48.253062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.253625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.254135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.254919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.255447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.255944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.390768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:48.399528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:48.401202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:48.406992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c6b8318d-d988-44d0-8de0-b10d2a40b0b7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1490 microversion: 2.91 time: 0.165231 Nov 02 21:25:48.407574 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 533/1149] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:48 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1490 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:48.414871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:48.417214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:48.424112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.424602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.425066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.425894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.426389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.426984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.448570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Getting quotas for project 412f81b2166743e88ef1d054b59a1480. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:48.453651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Getting quotas for user c97c20477bb14d26bac5781dea1b315a and project 412f81b2166743e88ef1d054b59a1480. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:48.453884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lazy-loading 'flavor' on Instance uuid a9587065-f470-4a25-b540-62ca7d78e8bd {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:25:48.467949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:25:48.468598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:25:48.468830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:25:48.469302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:25:48.469714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:25:48.478735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.479407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.480150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.480889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.481380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.481810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.501527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Getting quotas for project 412f81b2166743e88ef1d054b59a1480. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:25:48.506852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Getting quotas for user c97c20477bb14d26bac5781dea1b315a and project 412f81b2166743e88ef1d054b59a1480. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:25:48.525461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:25:48.525461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:25:48.702036 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7a42bca8-16d2-4287-a6d4-e0c75a9b886e tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.609467 Nov 02 21:25:48.703115 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 617/1150] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:25:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:25:48.709842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:48.710512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:48.721552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.726053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.726053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.726053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.726053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.726633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.794089 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-396c8140-8852-423d-8b9e-6109459da6c9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd/action" status: 202 len: 0 microversion: 2.1 time: 0.385172 Nov 02 21:25:48.795058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 534/1151] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:25:48 2022] POST /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:25:48.802034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:48.803064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:48.810070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.810862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.811628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:48.812836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:48.813506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:48.814368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:49.097902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:49.106291 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-816f6a97-25b8-4747-93d8-6fdecefea2e1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.401838 Nov 02 21:25:49.123292 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 618/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:48 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:49.129816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:49.131913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:49.138610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:49.139179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:49.139719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:49.140561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:49.141070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:49.141573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:49.185369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:49.205504 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-867d239c-f289-4c44-96eb-d8d05790dd91 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1540 microversion: 2.1 time: 0.408985 Nov 02 21:25:49.206361 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 535/1153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:48 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1540 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:49.211339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bb06706-9623-46fb-a229-69ed8177cb9a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:49.219443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7bb06706-9623-46fb-a229-69ed8177cb9a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:49.309071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:49.319315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:49.322128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:49.329531 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6ca1955-d630-488a-b731-dbad03829dba tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.204722 Nov 02 21:25:49.330690 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 619/1154] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:49 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:49.335685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:49.336613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:49.347003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:49.353703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:49.353703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:49.353703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:49.353703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:49.354229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:49.362423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7bb06706-9623-46fb-a229-69ed8177cb9a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:49.370668 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7bb06706-9623-46fb-a229-69ed8177cb9a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1277 microversion: 2.1 time: 0.162987 Nov 02 21:25:49.375557 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 536/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:49 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:49.399855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:49.404646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:49.420161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:49.422471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:49.423866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:49.425987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:49.427563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:49.429180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.268557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:50.277981 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b071f2cf-a71c-496e-a69d-05d0413d37b1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1495 microversion: 2.1 time: 0.946033 Nov 02 21:25:50.278673 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 620/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:49 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1495 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:50.283441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:50.290743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:50.290743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:50.291269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:50.291979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.292921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:50.293620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:50.294263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.322646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:50.338933 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-903e0d6c-da8c-4b0e-b787-31ffb640ebd2 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.962014 Nov 02 21:25:50.339964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 537/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:49 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:50.369334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c9b9038f-c3d0-4e19-9059-8888c8bf5ea8 req-4adaa6ff-0482-4152-bc2e-390b683932d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ef89e-ee93-4cdf-8518-00b2219a29d9", "name": "network-vif-unplugged", "status": "completed", "tag": "d9175032-8828-4122-af13-668346e4b744"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:50.391246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c9b9038f-c3d0-4e19-9059-8888c8bf5ea8 req-4adaa6ff-0482-4152-bc2e-390b683932d3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:50.391246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c9b9038f-c3d0-4e19-9059-8888c8bf5ea8 req-4adaa6ff-0482-4152-bc2e-390b683932d3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:50.391246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c9b9038f-c3d0-4e19-9059-8888c8bf5ea8 req-4adaa6ff-0482-4152-bc2e-390b683932d3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.420958 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c9b9038f-c3d0-4e19-9059-8888c8bf5ea8 req-4adaa6ff-0482-4152-bc2e-390b683932d3 service nova] Creating event network-vif-unplugged:d9175032-8828-4122-af13-668346e4b744 for instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 on n-h1-860863-4 Nov 02 21:25:50.437274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c9b9038f-c3d0-4e19-9059-8888c8bf5ea8 req-4adaa6ff-0482-4152-bc2e-390b683932d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084894 Nov 02 21:25:50.438058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 538/1158] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:50.460354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:50.474482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:50.474482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:50.485868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:50.490166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:50.490743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:50.491840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:50.492963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.495561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:50.498798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:50.500384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.509787 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bef03df5-9725-4e0e-8672-2b0620176c8e tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.229149 Nov 02 21:25:50.511009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 621/1159] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:50 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:50.516086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:50.517899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:50.518670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:50.527059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:50.546078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:50.546078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.546078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:50.546078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:50.546781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:50.968444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:50.981872 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d49b754d-d266-42d0-a8fa-13b663eceb7e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.541477 Nov 02 21:25:50.983122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 539/1160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:50 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:50.996863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:50.998247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:51.012770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.012770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.012770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.014327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.015091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.015909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.188694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:51.191941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:51.215063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:51.216276 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46a04e14-e54d-4def-880a-a8685faca45b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1522 microversion: 2.1 time: 0.703944 Nov 02 21:25:51.216471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:51.239435 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 622/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:50 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1522 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:51.244859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:51.248676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:51.252841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-58440f68-9c1a-46c9-8748-db52461aec42 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.268404 Nov 02 21:25:51.256808 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 540/1162] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:50 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:51.263716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.263716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.263716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.263716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.264318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.264318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.294127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:51.294644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:51.309434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.310004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.311842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.311842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.311842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.312130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.388231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:25:51.544389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:51.556015 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d95e29c8-4e74-4eb0-ac2c-043e755bc391 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1329 microversion: 2.1 time: 0.315094 Nov 02 21:25:51.573226 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 623/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:51 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:51.579510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:51.580563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:51.588866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.592911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.592911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.592911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.592911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.593508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.736549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d10ade23-39be-4a47-957b-8a7dee9be8b6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 204 len: 0 microversion: 2.1 time: 0.458042 Nov 02 21:25:51.737244 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 541/1164] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:25:51 2022] DELETE /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:25:51.746249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:51.750927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:51.767179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.767933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.769869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:51.771740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:51.773097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:51.773842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.078530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.087685 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd627e7b-447a-403f-8e6d-3b582b4269f2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 200 len: 1478 microversion: 2.1 time: 0.512869 Nov 02 21:25:52.088758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 624/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:51 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 1478 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:52.094800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0b8a4e5c-7424-45b1-ba1e-c07a396c949f req-21314f30-7eba-4e60-9e03-549594dd5136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c23781-8473-464f-8e15-febb6b169596", "name": "network-vif-plugged", "status": "completed", "tag": "24bbba71-3312-4add-9f2b-5bb5c51bc724"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:52.117243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0b8a4e5c-7424-45b1-ba1e-c07a396c949f req-21314f30-7eba-4e60-9e03-549594dd5136 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.118084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0b8a4e5c-7424-45b1-ba1e-c07a396c949f req-21314f30-7eba-4e60-9e03-549594dd5136 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.119246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0b8a4e5c-7424-45b1-ba1e-c07a396c949f req-21314f30-7eba-4e60-9e03-549594dd5136 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.132513 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0b8a4e5c-7424-45b1-ba1e-c07a396c949f req-21314f30-7eba-4e60-9e03-549594dd5136 service nova] Creating event network-vif-plugged:24bbba71-3312-4add-9f2b-5bb5c51bc724 for instance 88c23781-8473-464f-8e15-febb6b169596 on n-h2-860863-4 Nov 02 21:25:52.138660 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0b8a4e5c-7424-45b1-ba1e-c07a396c949f req-21314f30-7eba-4e60-9e03-549594dd5136 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048111 Nov 02 21:25:52.139868 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 625/1166] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:52.147098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:52.148274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:52.156696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.157220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.157655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.158350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.158801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.159230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.235410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.244250 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb16ef8b-5d58-408a-8a64-91fad753c2d3 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.504723 Nov 02 21:25:52.248310 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 542/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:51 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:52.249981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:52.250579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:52.256807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.257648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.258155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.259570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.260190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.260655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.266969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.278771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.280861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.287326 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-59b5b67a-67c2-4951-a4a1-743a725f12ef tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.145763 Nov 02 21:25:52.289133 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 626/1168] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:52 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:52.294948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:52.295637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:52.301848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.302445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.303100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.303955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.304576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.305262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.310688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:52.652625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.661476 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-583a9abf-51b3-466b-9b19-e0151155a559 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1528 microversion: 2.1 time: 0.415466 Nov 02 21:25:52.677503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 543/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:52 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1528 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:52.677503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-3407534"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:52.677503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:52.677993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.678482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.678920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.679782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.680243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.680677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.689757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.702165 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d72aace-dc39-45cd-b730-5ab5750c1692 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.412001 Nov 02 21:25:52.714501 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 627/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:52 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:52.714501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:52.714501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:52.716812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.717614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.718163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.719157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.720068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.720199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.794122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.802921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.805422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.807347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:52.810288 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-553fc4a0-8712-483d-b109-2a945bcfbbad tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.106106 Nov 02 21:25:52.810862 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 628/1171] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:52 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:52.815588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d4611ce1-efad-4c8d-96ec-6fdcb8f91670 req-828e3277-7107-4554-b1da-4df5828f7d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22ef89e-ee93-4cdf-8518-00b2219a29d9", "tag": "d9175032-8828-4122-af13-668346e4b744"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:52.824792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d4611ce1-efad-4c8d-96ec-6fdcb8f91670 req-828e3277-7107-4554-b1da-4df5828f7d1b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.825220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d4611ce1-efad-4c8d-96ec-6fdcb8f91670 req-828e3277-7107-4554-b1da-4df5828f7d1b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.825647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d4611ce1-efad-4c8d-96ec-6fdcb8f91670 req-828e3277-7107-4554-b1da-4df5828f7d1b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.840138 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d4611ce1-efad-4c8d-96ec-6fdcb8f91670 req-828e3277-7107-4554-b1da-4df5828f7d1b service nova] Creating event network-changed:d9175032-8828-4122-af13-668346e4b744 for instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 on n-h1-860863-4 Nov 02 21:25:52.843787 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d4611ce1-efad-4c8d-96ec-6fdcb8f91670 req-828e3277-7107-4554-b1da-4df5828f7d1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031605 Nov 02 21:25:52.844421 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 629/1172] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:52.849478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:52.850166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:52.857204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.857692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.858134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.858827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:52.859273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:52.859692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:52.949474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:52.960773 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b83dfbc-dea7-47ce-9051-5158d5da2e04 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1335 microversion: 2.1 time: 0.114385 Nov 02 21:25:52.961499 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 630/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:52 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:53.201339 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-181ac43f-d3cc-4ec3-ab58-b6744c3868fc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd/action" status: 202 len: 0 microversion: 2.1 time: 0.536770 Nov 02 21:25:53.202736 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 544/1174] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:25:52 2022] POST /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:25:53.214000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f592abf-73ce-44bf-8c1b-7e56bbf0d697 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68dd80d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:53.269838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:53.270987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:53.283831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.286062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.286740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:53.287681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.291149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.291834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:53.305126 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f592abf-73ce-44bf-8c1b-7e56bbf0d697 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.095721 Nov 02 21:25:53.306225 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 631/1175] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:53 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:53.323345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:53.326560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:53.349955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.350525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.351051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:53.352090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.353639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.354223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:53.576960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:53.596340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:53.598175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:53.604183 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d71fc11d-5dc2-4aec-a78b-6cfd6d3782de tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.288931 Nov 02 21:25:53.608441 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 632/1176] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:53 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:53.652268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:53.661065 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e664b756-1a20-409a-86ac-41a50777260d tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.397089 Nov 02 21:25:53.687263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 545/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:53 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:53.690936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:53.692007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:53.706036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.707104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.707819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:53.708776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.710129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.711009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:53.726222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:53.726833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:53.740476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.740997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.741445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:53.742155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:53.742606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:53.743221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.067292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.085821 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3779a4a9-9273-4428-85a1-7df8d40c510b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.361266 Nov 02 21:25:54.089083 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 546/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:53 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:54.090743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.093919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:54.094532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:54.104708 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92c5a947-4bd8-4c25-b742-935d1e6ce3b7 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1528 microversion: 2.1 time: 0.420829 Nov 02 21:25:54.107618 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 633/1179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:53 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1528 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:54.113442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:54.119707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:54.123372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.124132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.125176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.126154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.127012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.127665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.130398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.131126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.131725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.132588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.133218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.134428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.270525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.286410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.287879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.294030 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88320b34-41b4-4be6-a69b-4837499da75e tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.203750 Nov 02 21:25:54.308965 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 547/1180] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:54 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:54.308965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-55d7eacc-29a5-48c6-abc5-0c30de8e5842 req-d2aba87b-992f-44fe-9296-b506b7de74aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c23781-8473-464f-8e15-febb6b169596", "name": "network-vif-unplugged", "status": "completed", "tag": "24bbba71-3312-4add-9f2b-5bb5c51bc724"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:54.311302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-55d7eacc-29a5-48c6-abc5-0c30de8e5842 req-d2aba87b-992f-44fe-9296-b506b7de74aa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.311302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-55d7eacc-29a5-48c6-abc5-0c30de8e5842 req-d2aba87b-992f-44fe-9296-b506b7de74aa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.311501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-55d7eacc-29a5-48c6-abc5-0c30de8e5842 req-d2aba87b-992f-44fe-9296-b506b7de74aa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.324434 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-55d7eacc-29a5-48c6-abc5-0c30de8e5842 req-d2aba87b-992f-44fe-9296-b506b7de74aa service nova] Creating event network-vif-unplugged:24bbba71-3312-4add-9f2b-5bb5c51bc724 for instance 88c23781-8473-464f-8e15-febb6b169596 on n-h2-860863-4 Nov 02 21:25:54.330595 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-55d7eacc-29a5-48c6-abc5-0c30de8e5842 req-d2aba87b-992f-44fe-9296-b506b7de74aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034374 Nov 02 21:25:54.331480 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 548/1181] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:54.340967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-94da20f3-53ea-46ba-b585-749bfdddf934 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d215820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:54.392804 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-94da20f3-53ea-46ba-b585-749bfdddf934 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.059954 Nov 02 21:25:54.396974 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 549/1182] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:54 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:54.459374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.472176 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-491b588a-e63a-42ef-a1b1-d40e3c82350a tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1403 microversion: 2.1 time: 0.363277 Nov 02 21:25:54.472779 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 634/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:54 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1403 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:54.642027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:54.642762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:54.650334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.651085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.651709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.652579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.653230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.653844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.709716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:54.710339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:54.716856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.717607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.718250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.719148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.719821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.720440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.767693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.776595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.780793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:54.797498 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0bd1c78-c20b-441c-ab82-28c0621231b5 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.159854 Nov 02 21:25:54.800112 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 550/1184] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:54 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:54.914998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-cf12e37d-5010-43ae-a8f7-8884c4492847 req-0f2ecbb5-dcff-4a35-8bc6-8023f72691e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd3dc71d-c86b-4cb0-b721-7afc85b02df9", "tag": "98bee515-e8a9-405e-b064-e491501cdab7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:54.925452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cf12e37d-5010-43ae-a8f7-8884c4492847 req-0f2ecbb5-dcff-4a35-8bc6-8023f72691e2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:54.925937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cf12e37d-5010-43ae-a8f7-8884c4492847 req-0f2ecbb5-dcff-4a35-8bc6-8023f72691e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:54.926363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cf12e37d-5010-43ae-a8f7-8884c4492847 req-0f2ecbb5-dcff-4a35-8bc6-8023f72691e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:54.947735 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-cf12e37d-5010-43ae-a8f7-8884c4492847 req-0f2ecbb5-dcff-4a35-8bc6-8023f72691e2 service nova] Creating event network-changed:98bee515-e8a9-405e-b064-e491501cdab7 for instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 on n-h2-860863-4 Nov 02 21:25:54.960039 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-cf12e37d-5010-43ae-a8f7-8884c4492847 req-0f2ecbb5-dcff-4a35-8bc6-8023f72691e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048652 Nov 02 21:25:54.961326 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 551/1185] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:25:55.044503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:55.056660 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ec366d6-c574-4b63-85cd-7b45f6d2362a tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.349169 Nov 02 21:25:55.058727 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 635/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:54 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:55.115443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:55.116658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:55.133466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.136043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:55.136191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.136619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.137253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:55.139764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.140290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.142345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.148331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.149116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.150286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.151714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.154774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.155409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.543247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:55.549666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:55.554776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe45e596-3e52-4205-b544-ebdddc2948e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.443533 Nov 02 21:25:55.561807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-815ccc31-b5a4-43ca-9d5a-534a4ba06c13 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1528 microversion: 2.1 time: 0.429671 Nov 02 21:25:55.574651 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 552/1187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:55 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:55.575550 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 636/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:55 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:55.584528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ea5bf20-dfb7-428d-a5e5-b6ff7480612c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f70820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:55.589059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:55.589242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:55.595971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.600271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.600734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.601498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.601964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.602505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.679515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ea5bf20-dfb7-428d-a5e5-b6ff7480612c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.102320 Nov 02 21:25:55.688984 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 637/1189] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:55 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:55.694252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:55.695111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:55.701817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.702604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.703209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.704091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.704700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.705380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.745116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:55.756569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:55.773062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:55.794680 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-09057892-baf2-4f12-a57c-4c72c6d8a55d tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.218790 Nov 02 21:25:55.795305 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 553/1190] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:55 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:55.833405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:55.841670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:55.849122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.851368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.853009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:55.854874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:55.861669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:55.862441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.008121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:56.022651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:56.025339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:56.034306 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-73af833a-ed29-4ed6-b101-9c082963ed72 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.205593 Nov 02 21:25:56.035458 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 554/1191] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:55 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:56.067237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:56.079543 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08b1a869-f94d-4fa2-b012-8658b2e4bebe tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1403 microversion: 2.1 time: 0.388310 Nov 02 21:25:56.081076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:56.081893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:56.091356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.093280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.095029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.101762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.101762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.101999 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 638/1192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:55 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1403 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:56.102089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.102089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:56.335950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:56.344616 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-82b36626-ff69-46c5-8575-924b62423baa tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.267245 Nov 02 21:25:56.359717 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 555/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:56 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:56.581229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:56.581757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:56.588795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.589320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.589760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.590060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:56.590454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.590905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.591327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.591729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:56.599545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.600561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.601280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.602267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.603523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.604228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.845081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:56.858999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:56.862275 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf419923-4c1d-4803-96cc-857a580b06d3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.284977 Nov 02 21:25:56.863043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 639/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:56 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:56.873654 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1f39b765-3df3-4252-af0d-b6c67c0a8a3f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1528 microversion: 2.1 time: 0.284658 Nov 02 21:25:56.878509 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 556/1195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:56 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1528 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:56.885543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:56.886153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:56.891217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad5391d1-fca4-468c-8da2-92fcd8adea2a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68d87040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:56.894988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.895494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.906514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.910667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:56.911351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:56.912047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:56.984341 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad5391d1-fca4-468c-8da2-92fcd8adea2a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.106147 Nov 02 21:25:56.985118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 640/1196] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:56 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:56.997478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5397295f-ea6d-4def-a98c-86471c66a910 req-a6739210-0c5d-431b-9ddc-9de601bb587d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a54a68d-cfef-4a08-9628-57207d27e0c0", "tag": "9d139ba6-a917-4667-ba1e-2674f5cfac67"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:57.018405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5397295f-ea6d-4def-a98c-86471c66a910 req-a6739210-0c5d-431b-9ddc-9de601bb587d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.027972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5397295f-ea6d-4def-a98c-86471c66a910 req-a6739210-0c5d-431b-9ddc-9de601bb587d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.028679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5397295f-ea6d-4def-a98c-86471c66a910 req-a6739210-0c5d-431b-9ddc-9de601bb587d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.033180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.043900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.046556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.052468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6afc33fb-c14e-4199-bd9e-500a5baba7b7 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.170666 Nov 02 21:25:57.053569 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 557/1197] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:56 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:57.054140 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5397295f-ea6d-4def-a98c-86471c66a910 req-a6739210-0c5d-431b-9ddc-9de601bb587d service nova] Creating event network-changed:9d139ba6-a917-4667-ba1e-2674f5cfac67 for instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 on n-h1-860863-4 Nov 02 21:25:57.065537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:57.067216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:57.067360 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5397295f-ea6d-4def-a98c-86471c66a910 req-a6739210-0c5d-431b-9ddc-9de601bb587d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080744 Nov 02 21:25:57.070843 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 641/1198] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:57.078791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.080598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.081410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.082770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.083469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.084628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.119144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:57.119144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:57.119144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.119144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.120529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.120529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.120529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.120845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.265654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.276035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.282410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.300175 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0d2b3967-12da-482a-88ea-202852368ca3 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.239924 Nov 02 21:25:57.322197 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 558/1199] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:57 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:25:57.367635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:57.368793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:57.381466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.390621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.390621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.390621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.390621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.393635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.461556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.477702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67bf3ec1-b9e0-495f-8eea-60e7fa1b4abc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1403 microversion: 2.1 time: 0.378518 Nov 02 21:25:57.483112 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 642/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:57 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1403 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:57.696219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:57.709337 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d23ef2c-f427-466f-a886-56fa9a357eec tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.345906 Nov 02 21:25:57.713417 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 559/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:57 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:25:57.818003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-09176c60-f4fc-4822-be34-63576b52823b req-48aad5a3-842a-4bbf-99f7-83b9652b6b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9587065-f470-4a25-b540-62ca7d78e8bd", "name": "network-vif-plugged", "status": "completed", "tag": "c7560cb4-da89-4cfa-91fa-d2b1b1e2128c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:25:57.818003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09176c60-f4fc-4822-be34-63576b52823b req-48aad5a3-842a-4bbf-99f7-83b9652b6b89 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.818003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09176c60-f4fc-4822-be34-63576b52823b req-48aad5a3-842a-4bbf-99f7-83b9652b6b89 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.818003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09176c60-f4fc-4822-be34-63576b52823b req-48aad5a3-842a-4bbf-99f7-83b9652b6b89 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.819052 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-09176c60-f4fc-4822-be34-63576b52823b req-48aad5a3-842a-4bbf-99f7-83b9652b6b89 service nova] Creating event network-vif-plugged:c7560cb4-da89-4cfa-91fa-d2b1b1e2128c for instance a9587065-f470-4a25-b540-62ca7d78e8bd on n-h1-860863-4 Nov 02 21:25:57.819052 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-09176c60-f4fc-4822-be34-63576b52823b req-48aad5a3-842a-4bbf-99f7-83b9652b6b89 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034124 Nov 02 21:25:57.819052 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 643/1202] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:25:57.901481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:57.902144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:57.905572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:57.906446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:57.922489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.932578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.933611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.934385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.934858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.935291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.942244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.943143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.944459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:57.945452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:57.946099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:57.946761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:58.495410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:58.523447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=22 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:59.265617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:59.293074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f518537c-90ea-4763-8ef0-a697cb83c8df tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1528 microversion: 2.1 time: 1.401138 Nov 02 21:25:59.296337 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 644/1203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:57 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1528 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:59.307398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d11ccd20-e7e2-4aa0-b4dc-33e06d1645cf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68d87550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:59.368126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:25:59.371830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:59.385194 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-95bab2a2-0572-45f8-a4fd-6417f03d4cde tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 1.492399 Nov 02 21:25:59.402107 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 560/1204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:25:57 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:25:59.402107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:59.402107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:25:59.441881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:59.442399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:59.442852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:59.443582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:25:59.444044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:25:59.449383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:25:59.918011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:59.928694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:59.935176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:25:59.943296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db1ffcea-c51a-438b-a115-3f2dda2316fb tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.554819 Nov 02 21:25:59.943296 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 561/1205] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:59 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:25:59.983846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:25:59.986070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:00.013783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:00.013783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:00.013783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:00.013783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:00.014146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:00.014263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:00.257593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:00.283724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:00.287510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:00.307073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:00.325756 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88a1d6e8-22f7-49e5-ac95-370f9c6454a7 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.355736 Nov 02 21:26:00.325756 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 562/1206] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:25:59 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:00.347164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:00.348130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:00.366677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:00.369380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:00.369380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:00.370329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:00.371012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:00.374258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:00.821811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:00.842242 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-888178cc-41e0-4338-bed9-ab95e03966fb tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1403 microversion: 2.1 time: 0.512898 Nov 02 21:26:00.856955 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 563/1207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:00 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1403 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:00.856955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:00.856955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:00.856955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:00.856955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:00.857556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:00.857556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:00.857556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:00.858185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.042241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.050485 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7230cdf2-bca6-417f-b6c0-27506b469aa7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.205941 Nov 02 21:26:01.051061 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 564/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:00 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:01.055494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7524ef7d-57a7-4451-a284-7217ecde6296 req-680ad4f1-96c3-42a5-8601-a7e7c886332e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c23781-8473-464f-8e15-febb6b169596", "name": "network-vif-deleted", "tag": "24bbba71-3312-4add-9f2b-5bb5c51bc724"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:01.066599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7524ef7d-57a7-4451-a284-7217ecde6296 req-680ad4f1-96c3-42a5-8601-a7e7c886332e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.067087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7524ef7d-57a7-4451-a284-7217ecde6296 req-680ad4f1-96c3-42a5-8601-a7e7c886332e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.067523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7524ef7d-57a7-4451-a284-7217ecde6296 req-680ad4f1-96c3-42a5-8601-a7e7c886332e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.079744 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7524ef7d-57a7-4451-a284-7217ecde6296 req-680ad4f1-96c3-42a5-8601-a7e7c886332e service nova] Creating event network-vif-deleted:24bbba71-3312-4add-9f2b-5bb5c51bc724 for instance 88c23781-8473-464f-8e15-febb6b169596 on n-h2-860863-4 Nov 02 21:26:01.084615 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7524ef7d-57a7-4451-a284-7217ecde6296 req-680ad4f1-96c3-42a5-8601-a7e7c886332e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032417 Nov 02 21:26:01.085261 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 565/1209] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:01.092813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:01.093150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:01.099397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.099891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.100330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.101053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.101509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.101946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.136443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.136956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.137403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.137857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lazy-loading 'fault' on Instance uuid 88c23781-8473-464f-8e15-febb6b169596 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:01.190573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.199324 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-551a81ec-95e5-441c-96b2-bc3ba7a3197c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1315 microversion: 2.1 time: 0.112876 Nov 02 21:26:01.200110 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 566/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:01 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1315 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:01.207070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:01.207684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:01.214149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.214632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.215072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.215772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.216226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.216654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.383309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.394312 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-127d5042-fcf9-49ae-a5cd-4594a61d96b0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.190957 Nov 02 21:26:01.394903 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 567/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:01 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:01.399809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:01.400527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:01.407341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.407341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.407607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.408298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.409400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.410050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.499738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.514832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.518693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.525253 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ef1f3223-ace2-4ae1-8172-a076dd04dd82 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.129148 Nov 02 21:26:01.526146 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 568/1212] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:01 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:01.531096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:01.531890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:01.538392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.539500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.539500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.540694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.541529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.542019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.617604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.626488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.628015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:01.633181 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b97fa60-c160-45f8-b06f-8c79d9f52ab6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.105781 Nov 02 21:26:01.634429 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 569/1213] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:01 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:01.658751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1567ea88-c365-4529-855d-45ea35c0e0c5 req-83464e22-9219-4e09-9142-cbc9987991a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a54a68d-cfef-4a08-9628-57207d27e0c0", "name": "network-vif-plugged", "status": "completed", "tag": "9d139ba6-a917-4667-ba1e-2674f5cfac67"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:01.669337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1567ea88-c365-4529-855d-45ea35c0e0c5 req-83464e22-9219-4e09-9142-cbc9987991a6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.669821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1567ea88-c365-4529-855d-45ea35c0e0c5 req-83464e22-9219-4e09-9142-cbc9987991a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.670271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1567ea88-c365-4529-855d-45ea35c0e0c5 req-83464e22-9219-4e09-9142-cbc9987991a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.683333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1567ea88-c365-4529-855d-45ea35c0e0c5 req-83464e22-9219-4e09-9142-cbc9987991a6 service nova] Creating event network-vif-plugged:9d139ba6-a917-4667-ba1e-2674f5cfac67 for instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 on n-h1-860863-4 Nov 02 21:26:01.688327 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1567ea88-c365-4529-855d-45ea35c0e0c5 req-83464e22-9219-4e09-9142-cbc9987991a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037803 Nov 02 21:26:01.688972 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 570/1214] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:01.872206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:01.874122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:01.881360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.881929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.882448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.883224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:01.883820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:01.884325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:01.947654 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d11ccd20-e7e2-4aa0-b4dc-33e06d1645cf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 2.647961 Nov 02 21:26:01.957277 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 645/1215] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:25:59 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 2660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:02.059207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.067574 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9d1645d-e525-4638-ae24-18c100d95420 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1403 microversion: 2.1 time: 0.201260 Nov 02 21:26:02.075230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:02.076114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:02.080988 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 571/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:01 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1403 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:02.085095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.085095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.085500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.086121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.086585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.087773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.227151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:02.228400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:02.236851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.237556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.238060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.238876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.239421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.239908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.277117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.277684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.278207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.278733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lazy-loading 'fault' on Instance uuid 88c23781-8473-464f-8e15-febb6b169596 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:02.280812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:02.370701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.374792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.382941 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f460dfd-a921-469e-9931-1b6b440badd6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1315 microversion: 2.1 time: 0.159680 Nov 02 21:26:02.384482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bc758f8-3ccc-47ec-8e49-48585bf92408 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.314216 Nov 02 21:26:02.385092 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 646/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:02 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:02.393716 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 572/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:02 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:02.422638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:02.423257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:02.429743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.430469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.430911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.431617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.432072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.432498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.554616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:02.558040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:02.561493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.561982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.562424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.563120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.563575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.564005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.583418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.592403 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eef16c9e-9afc-471f-898d-565f88a350c8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.173660 Nov 02 21:26:02.593101 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 647/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:02 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:02.636151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.644303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.645766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.650634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d259327-a7c5-4e94-ae0b-2ac7d8991325 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.100014 Nov 02 21:26:02.651193 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 573/1220] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:02 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:26:02.664373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:02.665049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:02.671256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.671844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.672207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.672907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:02.673374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:02.673800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:02.738495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.747045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.748744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:02.753604 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ff4858d-e0ba-409b-9f3a-5d1bfa2abacf tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.093117 Nov 02 21:26:02.754181 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 648/1221] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:02 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:02.964753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2dbf8aba-003c-4084-8ab2-0c84cae82a15 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d2150d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:03.015777 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2dbf8aba-003c-4084-8ab2-0c84cae82a15 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.055307 Nov 02 21:26:03.026268 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 574/1222] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:02 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:03.092285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:03.095514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:03.101605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.102134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.103094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.104516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.105993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.106441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.298494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:03.301164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:03.312026 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-832afb41-0e57-4955-aaf1-47558ed99e77 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1403 microversion: 2.1 time: 0.223690 Nov 02 21:26:03.317246 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 649/1223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:03 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1403 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:03.410045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:03.410717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:03.418891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:03.425815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:03.430075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.431202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.431650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.432745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.433681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.434267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.443802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.444171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.445831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.447317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.448225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.448826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.484058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.485387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.486116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.486810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lazy-loading 'fault' on Instance uuid 88c23781-8473-464f-8e15-febb6b169596 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:03.605521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:03.613803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ecd11fc-f818-4c51-bcda-52e61570fb08 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 200 len: 1315 microversion: 2.1 time: 0.210813 Nov 02 21:26:03.614982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 575/1224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:03 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:03.620160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:03.620700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:03.629329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.629329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.629329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.630569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.631275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.631883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.876168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:03.892049 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0953697a-bd82-4408-a801-7c7607637a95 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.486823 Nov 02 21:26:03.902239 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 650/1225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:03 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:03.933741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:03.934736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:03.941048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.941541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.941979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:03.942686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:03.943144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:03.943592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.011063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.029363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8e469cf-ec44-4d26-83d7-eb0276aa7e18 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.411962 Nov 02 21:26:04.033151 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 576/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:03 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:04.045198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:04.047063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:04.061407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.064089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.064089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.065653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.066859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.067535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.076398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.091896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.093386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.100100 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-309871ff-944b-447f-8953-d87444ed2783 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.178821 Nov 02 21:26:04.101022 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 651/1227] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:03 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:04.106778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c0659af-ec30-424b-b936-24997d723d2b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f70820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:04.172035 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c0659af-ec30-424b-b936-24997d723d2b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.069912 Nov 02 21:26:04.179064 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 652/1228] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:04 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:04.254137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.265740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.267464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.276762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0048ad7-1687-4fc8-8e13-be837334828a tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.242141 Nov 02 21:26:04.287234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 577/1229] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:04 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:04.347072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:04.348139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:04.356257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.357137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.357839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.358814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.359458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.360442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.561564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:04.568668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5be87ef1-bd52-4f6e-9743-33b25808340b tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1590 microversion: 2.1 time: 0.227358 Nov 02 21:26:04.585354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 653/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:04 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1590 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:04.591974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:04.593071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:04.599214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.599711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.600156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.601096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.601712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.602300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.642689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:04.643691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:04.652021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.652525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.653000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.653730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.654190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.654627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.670663 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 HTTP/1.1 Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:26:04.672325 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:26:04.673943 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '88c23781-8473-464f-8e15-febb6b169596'} Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:04.674716 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:26:04.676168 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:04.680747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:04.680747 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6862eed6-f6a9-4b26-a103-d66f16a12d28 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 404 len: 111 microversion: 2.1 time: 0.035504 Nov 02 21:26:04.681924 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 654/1231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:04 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:26:04.686853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f7793818-b483-41c1-aba5-191915916c9d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'create', calling method: .version_select at 0x7f9b68dd83a0>, body: {"keypair": {"name": "tempest-keypair-1570246535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPu+yTR8mPkGfy8vIRX2txqktca3HixLiB2e/jTkqUJBFV75ZWrKFq+phT3OF47+/8g9PaWK7njZYu+kXTI1b2R4jihXsvKf9yOUb9L1sFwbZK1W1/uGBKccPffXF1htow=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:04.703362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9932b35-128a-4494-98ab-f433b05e5f60 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114322 Nov 02 21:26:04.704422 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 578/1232] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:26:04 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:26:04.706592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f7793818-b483-41c1-aba5-191915916c9d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:26:04.717548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f7793818-b483-41c1-aba5-191915916c9d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for user 044e9aa5874a48b490b83c184aa470cc and project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:26:04.838158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f7793818-b483-41c1-aba5-191915916c9d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154116 Nov 02 21:26:04.839447 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 655/1233] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:26:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:04.928355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:04.929474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:04.940322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.943044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.943490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:04.948056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:04.948539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:04.949201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.060288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:05.061573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:05.088160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:05.089404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:05.090061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.091066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:05.096229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:05.096910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.279889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.293745 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-76a551e3-e60d-4a13-9eef-e69595428734 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.369822 Nov 02 21:26:05.294358 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 579/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:04 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:05.302862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:05.303691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:05.318689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:05.319412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:05.320039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.323027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:05.323754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:05.324353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.486908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.496998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.501243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.519463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7cc9c342-9d9f-4f12-a6b8-6703c56afc52 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.223969 Nov 02 21:26:05.520753 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 580/1235] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:05 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:05.538608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f00890cf-9be9-43ec-b63e-7dbf74480540 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d24c310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:05.627038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.636492 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a97ee815-da0f-4df1-bf7a-730b51c6f4a5 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.580889 Nov 02 21:26:05.642213 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 656/1236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:05 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:05.647295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:05.647461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:05.664122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:05.664611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:05.665193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.665907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:05.666366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:05.666791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.830034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.841601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.845296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:05.857872 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39a16693-b77b-4c6d-a5a2-cfba9160b636 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.213184 Nov 02 21:26:05.881453 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 657/1237] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:05 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:05.892484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-37af7ec8-7474-4af9-8186-7fc37456da36 req-b7431f1b-39b5-4d45-9fc0-db2bc3c0d073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3dc71d-c86b-4cb0-b721-7afc85b02df9", "name": "network-vif-plugged", "status": "completed", "tag": "98bee515-e8a9-405e-b064-e491501cdab7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:05.920973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-37af7ec8-7474-4af9-8186-7fc37456da36 req-b7431f1b-39b5-4d45-9fc0-db2bc3c0d073 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:05.921455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-37af7ec8-7474-4af9-8186-7fc37456da36 req-b7431f1b-39b5-4d45-9fc0-db2bc3c0d073 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:05.921893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-37af7ec8-7474-4af9-8186-7fc37456da36 req-b7431f1b-39b5-4d45-9fc0-db2bc3c0d073 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:05.935662 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-37af7ec8-7474-4af9-8186-7fc37456da36 req-b7431f1b-39b5-4d45-9fc0-db2bc3c0d073 service nova] Creating event network-vif-plugged:98bee515-e8a9-405e-b064-e491501cdab7 for instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 on n-h2-860863-4 Nov 02 21:26:05.941706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-37af7ec8-7474-4af9-8186-7fc37456da36 req-b7431f1b-39b5-4d45-9fc0-db2bc3c0d073 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058972 Nov 02 21:26:05.942603 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 658/1238] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:06.323422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:06.325884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:06.352046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:06.354046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:06.354509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:06.355244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:06.355922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:06.356361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.000917 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f00890cf-9be9-43ec-b63e-7dbf74480540 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 1.478775 Nov 02 21:26:07.011591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 581/1239] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:05 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:07.019655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:07.021256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:07.032224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.033104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.033755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.034677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.035313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.035914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.082371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.097475 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2c843cb-3258-4a8a-a363-04da802682da tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1314 microversion: 2.1 time: 0.780523 Nov 02 21:26:07.103788 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 659/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:06 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:07.117247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-78e0afef-cae6-416e-905c-8a6f8ce777bc req-19c6aaf2-0d8f-4ce1-aff0-d3ffeb1bc37c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a54a68d-cfef-4a08-9628-57207d27e0c0", "tag": "9d139ba6-a917-4667-ba1e-2674f5cfac67"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:07.130038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-78e0afef-cae6-416e-905c-8a6f8ce777bc req-19c6aaf2-0d8f-4ce1-aff0-d3ffeb1bc37c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.130870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-78e0afef-cae6-416e-905c-8a6f8ce777bc req-19c6aaf2-0d8f-4ce1-aff0-d3ffeb1bc37c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.131481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-78e0afef-cae6-416e-905c-8a6f8ce777bc req-19c6aaf2-0d8f-4ce1-aff0-d3ffeb1bc37c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.146040 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-78e0afef-cae6-416e-905c-8a6f8ce777bc req-19c6aaf2-0d8f-4ce1-aff0-d3ffeb1bc37c service nova] Creating event network-changed:9d139ba6-a917-4667-ba1e-2674f5cfac67 for instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 on n-h1-860863-4 Nov 02 21:26:07.152196 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-78e0afef-cae6-416e-905c-8a6f8ce777bc req-19c6aaf2-0d8f-4ce1-aff0-d3ffeb1bc37c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051092 Nov 02 21:26:07.208053 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 660/1241] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:07.208053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:07.208053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:07.208053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.208053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.209283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.209283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.209283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.209283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.338052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.351285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.373679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.375563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.379621 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cdb4d687-503d-4a1e-8321-49be3267b045 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1590 microversion: 2.1 time: 0.365910 Nov 02 21:26:07.380247 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 582/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:07 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1590 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:07.388716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:07.389365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:07.392231 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89c5c504-be6d-4b48-b1ba-c4847eec1570 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.237891 Nov 02 21:26:07.392816 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 661/1243] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:07 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:07.413991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.417799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:07.417935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.418075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:07.419212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.419966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.420480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.420971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.435507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.437209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.437660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.438375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:07.441578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:07.442038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:07.596883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.606762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.608495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.614334 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc6272a2-ff7b-4289-9d01-939a03d28411 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1546 microversion: 2.91 time: 0.207628 Nov 02 21:26:07.615058 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 662/1244] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:07 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:07.746969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:07.768377 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-accdd37b-1bb4-4ea3-ae26-c0450fdacc37 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1501 microversion: 2.1 time: 0.382617 Nov 02 21:26:07.768377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 583/1245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:07 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1501 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:08.016830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79a77840-c795-461e-aac5-afa8643e0ff8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68d8dca0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.101217 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79a77840-c795-461e-aac5-afa8643e0ff8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.084264 Nov 02 21:26:08.102005 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 663/1246] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:08.123549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.124825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:08.137131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.137467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.137924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.139867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.140355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.140946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.318595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:08.328636 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9f2f9bb-c3a8-4a5f-892e-adcb8fddc047 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1464 microversion: 2.1 time: 0.209877 Nov 02 21:26:08.329267 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 584/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1464 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:08.423290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.427626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:08.434539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.435219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.435807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.437201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.438077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.438763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.477697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Calling method '.version_select at 0x7f9b68e3d0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.499159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.499922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.500516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.518356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.519135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.519727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.540897 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d579970a-d37e-4840-ad6f-3fc583ce448b tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/efa07aab86e04d0880eb496703bd6914?start=2022-11-01T21%3A26%3A08.354897&end=2022-11-03T21%3A26%3A08.354897" status: 200 len: 696 microversion: 2.1 time: 0.181692 Nov 02 21:26:08.542394 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 664/1248] 10.222.0.25 () {58 vars in 1412 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/os-simple-tenant-usage/efa07aab86e04d0880eb496703bd6914?start=2022-11-01T21%3A26%3A08.354897&end=2022-11-03T21%3A26%3A08.354897 => generated 696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:08.548001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:08.561137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '.version_select at 0x7f9b68ef99d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.567721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:08.570026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:08.575829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.575829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.579014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.579169 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42d631bb-7aab-4de7-a7a2-e42192a92bbe tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1446 microversion: 2.75 time: 0.159824 Nov 02 21:26:08.579320 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 585/1249] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:08.595780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.596880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.596880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.613709 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7bb25540-0966-4ab9-8997-ba6991a83f27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/efa07aab86e04d0880eb496703bd6914?start=2022-11-01T21%3A26%3A08.354897&end=2022-11-03T21%3A26%3A08.354897" status: 200 len: 700 microversion: 2.1 time: 0.057004 Nov 02 21:26:08.614856 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 665/1250] 10.222.0.25 () {58 vars in 1412 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/os-simple-tenant-usage/efa07aab86e04d0880eb496703bd6914?start=2022-11-01T21%3A26%3A08.354897&end=2022-11-03T21%3A26%3A08.354897 => generated 700 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:08.630558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Calling method '.version_select at 0x7f9b6d24cca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.643615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.644295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:08.653390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.654408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.654977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.655467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.655858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.656009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.657168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.657847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.658660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.675196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.675675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.676114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.754293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:08.758487 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ffe7797-d32b-4796-9b1d-46a75aa4c2c0 tempest-TenantUsagesTestJSON-337741295 tempest-TenantUsagesTestJSON-337741295-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T21%3A26%3A08.354897&end=2022-11-03T21%3A26%3A08.354897&detailed=1" status: 200 len: 14620 microversion: 2.1 time: 0.132187 Nov 02 21:26:08.765897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:08.769018 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 586/1251] 10.222.0.25 () {58 vars in 1335 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T21%3A26%3A08.354897&end=2022-11-03T21%3A26%3A08.354897&detailed=1 => generated 14620 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:26:08.769174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:08.775125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e615dc85-f44d-4996-9e21-e2252e7b7001 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1533 microversion: 2.91 time: 0.135170 Nov 02 21:26:08.778673 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 666/1252] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1533 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:08.796566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.797107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:08.804686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.804686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.815003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.815003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.815003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.815280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:08.815370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.815450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:08.815450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.815450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.815661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.816333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:08.816780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:08.817227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:08.841775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:26:09.177478 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55520efd-16aa-4589-a81d-8fe358ba0717 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 204 len: 0 microversion: 2.1 time: 0.384877 Nov 02 21:26:09.178950 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 587/1253] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:26:08 2022] DELETE /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:26:09.183193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:09.188534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:09.189711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:09.192309 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2f58422-ca88-4ee3-80b7-7e4a5451308b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1491 microversion: 2.1 time: 0.393979 Nov 02 21:26:09.205878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 667/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:08 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1491 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:09.206004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.206004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.206004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.206004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.206372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.206372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.220137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a260dcb6-3ad1-4aa4-afa6-0cfaa4985161 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68e0c1f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:09.323751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a260dcb6-3ad1-4aa4-afa6-0cfaa4985161 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.125780 Nov 02 21:26:09.323910 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 668/1255] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:09 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:09.342884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:09.343590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:09.362802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.363275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.363896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.365521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.367061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.367501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.428678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] Lazy-loading 'services' on Instance uuid e97f5885-4d7e-4cda-a26a-9fe0358fd787 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:09.467264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c245167e-a83a-4366-96f0-1b27faa2e0d9 tempest-UnshelveToHostMultiNodesTest-1230880849 tempest-UnshelveToHostMultiNodesTest-1230880849-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1938 microversion: 2.91 time: 0.285531 Nov 02 21:26:09.489302 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 588/1256] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:09 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1938 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:09.496905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21f98131-a5b7-4679-8ce6-7594b114d87c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '.version_select at 0x7f9b69175af0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:09.513379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21f98131-a5b7-4679-8ce6-7594b114d87c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.513839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21f98131-a5b7-4679-8ce6-7594b114d87c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.515368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21f98131-a5b7-4679-8ce6-7594b114d87c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.532172 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-21f98131-a5b7-4679-8ce6-7594b114d87c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.041688 Nov 02 21:26:09.536487 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 589/1257] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:26:09 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:09.550440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:09.550947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:09.559763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.560267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.560714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.561458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.561915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.565316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.597511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:09.623044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:26:09.864332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:09.874328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e3a98ff-3531-4ac7-b3af-cdca26f9f9b7 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1470 microversion: 2.1 time: 0.549373 Nov 02 21:26:09.875088 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 669/1258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:09 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:09.881381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:09.882178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:09.889682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.890094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.890541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.891259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.891722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.892157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.918987 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c47ab11-160a-49a3-a1b4-d1096d13704b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 204 len: 0 microversion: 2.91 time: 0.380958 Nov 02 21:26:09.919917 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 590/1259] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:26:09 2022] DELETE /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:26:09.925239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:09.925930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:09.940572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.941096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.941533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:09.942231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:09.942679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:09.943095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:10.040391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:10.050676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:10.052115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:10.059033 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c461491-9cea-48d3-84a6-54da10f4a75f tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1452 microversion: 2.75 time: 0.138062 Nov 02 21:26:10.072963 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 591/1260] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:09 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:10.078396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1066239912", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:10.096385 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dcfa268d-a4cd-4548-ab20-e0ea6a30bc16 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1642 microversion: 2.1 time: 0.220421 Nov 02 21:26:10.096981 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 670/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:09 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1642 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:10.127040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:10.127040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:10.139404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:10.139943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:10.140327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:10.141075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:10.141543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:10.142518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:10.168442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] validate_networks() for [('322e1fd6-7639-465c-a6f3-6aaae3e95954', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:26:10.261149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:10.280416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:10.281697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:10.293121 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38b5a179-d56b-4db9-a5d5-5531f5956d60 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.193742 Nov 02 21:26:10.301286 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 671/1262] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:10 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:10.308117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-200086606", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "f1a27830-c4e6-4f86-894e-5e8eaac191b0"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:10.324470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:10.423277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] validate_networks() for [('f1a27830-c4e6-4f86-894e-5e8eaac191b0', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:26:10.928854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:26:10.929657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:26:10.929657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:26:10.930575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:26:10.930575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:26:10.944365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:10.944844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:10.945385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:10.946480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:10.946949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:10.947380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:10.972952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:26:10.972952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for user 044e9aa5874a48b490b83c184aa470cc and project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:26:11.009835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:26:11.009835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:26:11.009835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:11.116277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:26:11.117628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:26:11.119204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:26:11.119857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:26:11.120464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:26:11.132232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.133017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.134274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.135068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.135666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.136326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.161862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:26:11.167969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for user 9f705bbaa94a4a7d8e5bba79214bb359 and project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:26:11.183281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:26:11.186373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:26:11.471445 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8f41457f-7039-439a-b147-6bc2c5ee065f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.410621 Nov 02 21:26:11.478557 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 592/1263] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:26:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:26:11.499279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2df7427-c435-4a50-9578-11b987d12809 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d1e5940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:11.519761 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6f0a43d-c062-47ad-8bdd-27c93d958ba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217139 Nov 02 21:26:11.533378 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 672/1264] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:26:11.542594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:11.543236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:11.552289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.552807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.553405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.563876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.564543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.568595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.612134 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2df7427-c435-4a50-9578-11b987d12809 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.132088 Nov 02 21:26:11.612706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 593/1265] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:11 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:11.626011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:11.626601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:11.632991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.633513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.636733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.636733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.636733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.636733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.768692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:11.778730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:11.786412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:11.794878 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e941e48f-8c7e-4098-b06b-eb1a40e69b66 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1452 microversion: 2.75 time: 0.173276 Nov 02 21:26:11.795469 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 594/1266] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:11 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:11.813671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:11.814284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:11.822338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.822907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.823354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.824069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:11.824607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:11.825241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:11.957440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:11.966481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:11.970788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:11.987778 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ebe48827-74c3-4086-bb4a-4c74cba8a95b tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.191067 Nov 02 21:26:12.001716 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 595/1267] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:11 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:12.011564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff92534c-6fc7-4fb5-847c-00926aa7b01a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:12.012408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff92534c-6fc7-4fb5-847c-00926aa7b01a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:12.041844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:12.050491 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1dbc9a2e-47ee-4394-846c-79d0d62fbc27 tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1470 microversion: 2.1 time: 0.515266 Nov 02 21:26:12.065516 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 673/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:11 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:12.082141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc17d25d-3016-439d-b45b-7a545fbb8a77 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:12.083916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc17d25d-3016-439d-b45b-7a545fbb8a77 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:12.100514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff92534c-6fc7-4fb5-847c-00926aa7b01a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:12.109959 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff92534c-6fc7-4fb5-847c-00926aa7b01a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1225 microversion: 2.1 time: 0.106896 Nov 02 21:26:12.113300 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 596/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:12 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:12.207056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc17d25d-3016-439d-b45b-7a545fbb8a77 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:12.207056 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc17d25d-3016-439d-b45b-7a545fbb8a77 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1210 microversion: 2.1 time: 0.137057 Nov 02 21:26:12.207056 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 674/1270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:12 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:12.415400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2547375e-aacc-4001-9bff-721a3aac230c req-b83f04a4-b52d-4089-85b3-cd70bd2c186e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3dc71d-c86b-4cb0-b721-7afc85b02df9", "name": "network-vif-deleted", "tag": "98bee515-e8a9-405e-b064-e491501cdab7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:12.426891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2547375e-aacc-4001-9bff-721a3aac230c req-b83f04a4-b52d-4089-85b3-cd70bd2c186e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:12.427633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2547375e-aacc-4001-9bff-721a3aac230c req-b83f04a4-b52d-4089-85b3-cd70bd2c186e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:12.428068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2547375e-aacc-4001-9bff-721a3aac230c req-b83f04a4-b52d-4089-85b3-cd70bd2c186e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:12.439856 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2547375e-aacc-4001-9bff-721a3aac230c req-b83f04a4-b52d-4089-85b3-cd70bd2c186e service nova] Creating event network-vif-deleted:98bee515-e8a9-405e-b064-e491501cdab7 for instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 on n-h2-860863-4 Nov 02 21:26:12.445363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2547375e-aacc-4001-9bff-721a3aac230c req-b83f04a4-b52d-4089-85b3-cd70bd2c186e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Nov 02 21:26:12.447104 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 597/1271] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:26:12.630689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a90f6bb-f02a-4b14-8311-04054518ab03 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68dc6af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:12.685510 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a90f6bb-f02a-4b14-8311-04054518ab03 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1437 microversion: 2.1 time: 0.061634 Nov 02 21:26:12.686067 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 675/1272] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:12 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1437 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:12.825970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:12.829634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:12.833222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:12.833701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:12.834136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:12.834907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:12.835515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:12.835946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:12.906124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:12.914897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:12.916409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:12.921616 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae2c14d2-028b-4b5f-b48f-d2205cbb62c8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1452 microversion: 2.75 time: 0.101616 Nov 02 21:26:12.922480 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 598/1273] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:12 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:13.020182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.020828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:13.027902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.028314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.028752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.029466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.029948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.030397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.047819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:13.077349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.077951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:13.085995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.086488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.087472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.088171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.088615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.089317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.101933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:13.111643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:13.113307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:13.119488 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee0cd40c-aa43-41d7-af26-29623b73bcb6 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1539 microversion: 2.91 time: 0.103279 Nov 02 21:26:13.120057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 676/1274] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:13 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1539 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:13.149986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.150686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:13.157181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.157901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.158535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.159451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.160098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.160707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.170782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bc9474111b4496a9a71efa3cb5a95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa07aab86e04d0880eb496703bd6914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:13.180157 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d758b309-f223-42d4-a37b-a8c8359541bd tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 200 len: 1299 microversion: 2.1 time: 0.106464 Nov 02 21:26:13.182468 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 599/1275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:13 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:13.224681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:13.228975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.229833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:13.233881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94ee132c-63bf-4ee5-a7c7-04b4ea00850a tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1229 microversion: 2.1 time: 0.087668 Nov 02 21:26:13.234844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 677/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:13 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:13.236564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.237096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.237537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.238425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.238888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.239317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.304821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:13.312627 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c96d648-459b-4c9d-bfa2-d9a7cc79fde6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1214 microversion: 2.1 time: 0.088857 Nov 02 21:26:13.313233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 600/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:13 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:13.701945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d463246-8afe-434a-b4c8-d88859b19770 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68e93160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.748853 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d463246-8afe-434a-b4c8-d88859b19770 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1446 microversion: 2.1 time: 0.050431 Nov 02 21:26:13.749470 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 678/1278] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:13 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1446 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:13.764183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1714531-41d7-4686-ad08-72e3115cc8dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d23d280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.814694 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1714531-41d7-4686-ad08-72e3115cc8dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 200 len: 1446 microversion: 2.1 time: 0.055155 Nov 02 21:26:13.821024 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 601/1279] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:13 2022] GET /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 1446 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:13.830110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-585bab3a-575a-47b1-a23f-3c98544e842f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68dd9c10>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.950098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:13.950707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:13.957283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.957784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.958351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:13.959054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:13.959513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:13.959943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.029578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:14.037784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:14.039229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:14.044779 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4eac829-0fce-4799-ad77-054265afbce8 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1437 microversion: 2.75 time: 0.099667 Nov 02 21:26:14.045395 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 602/1280] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:13 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:14.189081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:14.191955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:14.199274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.199768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.200286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.201010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.201461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.201888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.297981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:26:14.298400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:26:14.298867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:26:14.299301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:26:14.299713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:26:14.509746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:14.516664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.517508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.518325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.519266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.519965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.520687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.624196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:14.652479 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0edf09c8-8444-4fe8-8b51-d07c18b5aade tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301/action" status: 202 len: 1940 microversion: 2.75 time: 0.583709 Nov 02 21:26:14.653553 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 603/1281] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:26:14 2022] POST /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301/action => generated 1940 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 21:26:14.661000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:14.661992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:14.668555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.669147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.669695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.670451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.670976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.671460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.708170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.708734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.709272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.709805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lazy-loading 'fault' on Instance uuid e97f5885-4d7e-4cda-a26a-9fe0358fd787 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:14.792796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:14.807854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:14.812213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '379afd7e565f45c3b3a7ea6489df9309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '531e75ec3b8f44bfa3caeb3d09ab1f83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:14.818719 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-921b0e8e-9c82-4dc0-897d-395387dd1f86 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 200 len: 1544 microversion: 2.91 time: 0.164147 Nov 02 21:26:14.820260 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 604/1282] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:14 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 1544 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:14.825945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:14.826887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] [instance: bd3dc71d-c86b-4cb0-b721-7afc85b02df9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:14.841545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.842042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.842485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.843383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.843999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.844593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.859283 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] HTTP exception thrown: Instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 could not be found. Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Request method failure captured: Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 HTTP/1.1 Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuBV3eFZhSg91s9PfLZ_D9e2ENLKOFWkylJM8fP4W0942xPYnjZaSfa3E1mQeGdDz6xrS5MSDC3V6uUk7QWtaHnk8mV3nNzq3wYPBGlb4ouc6Vo9Cmb7apzBPXDMdgvI4TrniW2vjVBzj62KfJAcuahwp8Wo-PC83tFrQnp5tLPlClU Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: efa07aab86e04d0880eb496703bd6914 Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TenantUsagesTestJSON-1971171801 Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:14.861132 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_efa07aab86e04d0880eb496703bd6914"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efa07aab86e04d0880eb496703bd6914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/efa07aab86e04d0880eb496703bd6914"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/efa07aab86e04d0880eb496703bd6914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TenantUsagesTestJSON-1971171801 Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: efa07aab86e04d0880eb496703bd6914 Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1971171801 Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TenantUsagesTestJSON-1971171801-project Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 45bc9474111b4496a9a71efa3cb5a95b Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TenantUsagesTestJSON-1971171801-project Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 could not be found. Nov 02 21:26:14.862735 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bd3dc71d-c86b-4cb0-b721-7afc85b02df9'} Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 could not be found. Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:14.863664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 could not be found. Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 could not be found. Nov 02 21:26:14.865139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:14.866787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] Returning 404 to user: Instance bd3dc71d-c86b-4cb0-b721-7afc85b02df9 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:14.866787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-70f74c08-735c-44ff-8072-16a457def56e tempest-TenantUsagesTestJSON-1971171801 tempest-TenantUsagesTestJSON-1971171801-project] 10.222.0.25 "GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9" status: 404 len: 111 microversion: 2.1 time: 0.040486 Nov 02 21:26:14.866787 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 605/1283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:14 2022] GET /compute/v2.1/servers/bd3dc71d-c86b-4cb0-b721-7afc85b02df9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:26:14.871036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:14.871639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:14.877938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.878612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.879219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.880113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.880571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.881021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.969655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:14.978511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31cf0c32-a540-49d4-b42c-685159e0529f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1277 microversion: 2.1 time: 0.111285 Nov 02 21:26:14.988543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 606/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:14 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:14.988543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:14.988543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:14.996362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.996362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.996362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:14.996362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:14.996825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:14.996825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:15.012308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:15.025471 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-585bab3a-575a-47b1-a23f-3c98544e842f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 204 len: 0 microversion: 2.1 time: 1.199659 Nov 02 21:26:15.026030 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 679/1285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:13 2022] DELETE /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 0 bytes in 1201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:26:15.032776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:15.033482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:15.040304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:15.041084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:15.041520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:15.042217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:15.042673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:15.045700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:15.078652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:15.089412 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e54fbb21-5126-4fab-9e0b-5cec301d4e40 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1268 microversion: 2.1 time: 0.108624 Nov 02 21:26:15.092967 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 607/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:14 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1268 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:15.109127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:15.110156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:15.119982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:15.120798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:15.121451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:15.124468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:15.125229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:15.125827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:15.155770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:26:15.197430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:15.220060 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7bd6e24f-beb7-40cf-8679-b9167d81695f tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.192771 Nov 02 21:26:15.220585 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 680/1287] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:15 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:15.552736 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b939fdf-f68a-4c6b-b1ad-0f0a183077ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 204 len: 0 microversion: 2.1 time: 0.461005 Nov 02 21:26:15.555230 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 608/1288] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:26:15 2022] DELETE /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:26:15.746877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1183435279", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fbb32731-3286-4309-9c0c-b898bc17a336"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:15.813715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] validate_networks() for [('fbb32731-3286-4309-9c0c-b898bc17a336', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:26:15.854595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:15.855591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] [instance: e97f5885-4d7e-4cda-a26a-9fe0358fd787] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:15.863621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:15.866878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:15.866878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:15.866878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:15.869053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:15.869828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:15.887192 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] HTTP exception thrown: Instance e97f5885-4d7e-4cda-a26a-9fe0358fd787 could not be found. Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Request method failure captured: Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 HTTP/1.1 Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt_CaZmWSg_fEJByZMiw71PufCDArpYHohINOGgot0R_R2AU_y3k7HIPuhuE3RMc7HFWevqa0YGk6d8qRZjjJ1Q3JjUz14cei8LkV6TSB578tueh83Rwzv1MGodZGvXt-8cg7CeSsOF1J3VaV4n4gSxj5PUFu3f0KTWdb0uSqqgHOcg Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 531e75ec3b8f44bfa3caeb3d09ab1f83 Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1269840500 Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:15.889536 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_531e75ec3b8f44bfa3caeb3d09ab1f83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/531e75ec3b8f44bfa3caeb3d09ab1f83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/531e75ec3b8f44bfa3caeb3d09ab1f83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/531e75ec3b8f44bfa3caeb3d09ab1f83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1269840500 Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 531e75ec3b8f44bfa3caeb3d09ab1f83 Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1269840500 Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-UnshelveToHostMultiNodesTest-1269840500-project Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 379afd7e565f45c3b3a7ea6489df9309 Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1269840500-project Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e97f5885-4d7e-4cda-a26a-9fe0358fd787 could not be found. Nov 02 21:26:15.896583 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e97f5885-4d7e-4cda-a26a-9fe0358fd787'} Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97f5885-4d7e-4cda-a26a-9fe0358fd787 could not be found. Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:15.897580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97f5885-4d7e-4cda-a26a-9fe0358fd787 could not be found. Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97f5885-4d7e-4cda-a26a-9fe0358fd787 could not be found. Nov 02 21:26:15.898764 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:15.901307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] Returning 404 to user: Instance e97f5885-4d7e-4cda-a26a-9fe0358fd787 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:15.901307 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92db712c-3967-467f-90af-8b32a1b75930 tempest-UnshelveToHostMultiNodesTest-1269840500 tempest-UnshelveToHostMultiNodesTest-1269840500-project] 10.222.0.25 "GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787" status: 404 len: 111 microversion: 2.91 time: 0.042184 Nov 02 21:26:15.901307 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 609/1289] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:15 2022] GET /compute/v2.1/servers/e97f5885-4d7e-4cda-a26a-9fe0358fd787 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:26:16.004873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:16.005805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:16.012427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.012983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.013429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.014191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.014649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.015077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.110767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:16.120137 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a3eee053-31f5-4500-bc63-208d4b6faf8c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1295 microversion: 2.1 time: 0.119702 Nov 02 21:26:16.125159 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 610/1290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:15 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:16.128467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:16.129297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:16.139395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.140153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.140744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.141636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.142237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.142813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.766272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:16.775207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bac53012-8315-4016-9344-5d750f9bca7b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.652676 Nov 02 21:26:16.781808 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 611/1291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:16 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:16.781808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:16.781808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:16.807411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.808639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.809330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.810604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.811343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.812115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.922166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:26:16.922696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:26:16.923042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:26:16.923444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:26:16.923846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:26:16.924081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:16.935059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.935827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.936578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.937513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:16.938139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:16.938733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:16.948762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-901b68bf-8f82-4ec1-8a1c-35ececa91496 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.171282 Nov 02 21:26:16.950103 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 612/1292] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:16 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:16.969775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:26:16.974894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for user 9ab2a1f2b5b74571b08c97e9493d568d and project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:26:16.987567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:26:16.992424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:26:17.121974 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b86b6667-6ba0-4945-8ff5-2517e582e42c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.379005 Nov 02 21:26:17.122806 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 681/1293] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:26:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:26:17.135512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7ec315eb-7344-40d3-a5b4-1361fa387372 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:17.141613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ec315eb-7344-40d3-a5b4-1361fa387372 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:17.143844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:17.146306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:17.153415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:17.153912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:17.154387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:17.155262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:17.155832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:17.156393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:17.211874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7ec315eb-7344-40d3-a5b4-1361fa387372 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:17.219365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7ec315eb-7344-40d3-a5b4-1361fa387372 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1208 microversion: 2.1 time: 0.088701 Nov 02 21:26:17.224253 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 613/1294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:17 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:17.412680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:17.438850 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7a4848a-67f6-46d8-88f1-9fc71b66cdea tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1337 microversion: 2.1 time: 0.299145 Nov 02 21:26:17.459431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 682/1295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:17 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1337 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:17.601256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-cb2dd47c-0563-4937-9a95-4888459f44f3 req-1a78c7ac-34b3-496d-9f28-772edf21c099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9587065-f470-4a25-b540-62ca7d78e8bd", "name": "network-vif-unplugged", "status": "completed", "tag": "c7560cb4-da89-4cfa-91fa-d2b1b1e2128c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:17.621100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cb2dd47c-0563-4937-9a95-4888459f44f3 req-1a78c7ac-34b3-496d-9f28-772edf21c099 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:17.621100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cb2dd47c-0563-4937-9a95-4888459f44f3 req-1a78c7ac-34b3-496d-9f28-772edf21c099 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:17.621100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cb2dd47c-0563-4937-9a95-4888459f44f3 req-1a78c7ac-34b3-496d-9f28-772edf21c099 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:17.632570 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-cb2dd47c-0563-4937-9a95-4888459f44f3 req-1a78c7ac-34b3-496d-9f28-772edf21c099 service nova] Creating event network-vif-unplugged:c7560cb4-da89-4cfa-91fa-d2b1b1e2128c for instance a9587065-f470-4a25-b540-62ca7d78e8bd on n-h1-860863-4 Nov 02 21:26:17.640718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-cb2dd47c-0563-4937-9a95-4888459f44f3 req-1a78c7ac-34b3-496d-9f28-772edf21c099 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044963 Nov 02 21:26:17.644208 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 614/1296] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:17.800018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:17.800908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:17.821595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:17.822500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:17.823451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:17.824243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:17.825646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:17.826070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:17.979310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:17.981443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:17.997192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:17.997727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:17.999590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:18.000599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:18.001881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:18.003888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:18.051245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:18.071724 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-00f77847-a6f0-4b60-90d8-271c4c793f38 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.276963 Nov 02 21:26:18.072343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 683/1297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:17 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:18.172123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:18.204481 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-33fdadc9-371d-4a89-852a-7f1e544fae82 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.230467 Nov 02 21:26:18.205804 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 615/1298] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:17 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:26:18.245901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d59f4cb6-6e95-403b-a36e-ad14cc70cd3b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:18.246813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d59f4cb6-6e95-403b-a36e-ad14cc70cd3b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:18.357562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d59f4cb6-6e95-403b-a36e-ad14cc70cd3b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:18.401481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d59f4cb6-6e95-403b-a36e-ad14cc70cd3b tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1208 microversion: 2.1 time: 0.160563 Nov 02 21:26:18.402510 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 684/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:18 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1208 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:18.469116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:18.469824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:18.488462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:18.489298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:18.490048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:18.491012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:18.491662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:18.492737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:18.743902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:18.757331 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-18fe8e88-65ea-47c8-a49f-4487d4541e7c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.292629 Nov 02 21:26:18.770389 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 616/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:18 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:18.968906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-dbe0fe88-8596-44bb-86b2-1fc0ab3dc9f9 req-9713eb41-d3ac-47e0-9ab1-586bf114e77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9587065-f470-4a25-b540-62ca7d78e8bd", "name": "network-vif-deleted", "tag": "c7560cb4-da89-4cfa-91fa-d2b1b1e2128c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:18.981261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b4159571-557c-4fb4-a1dd-1d3ebd1ea505 req-e6dee502-b495-4699-bd34-6b25c79beaac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff58a26b-5edd-41ab-96d0-d061ce223e8e", "tag": "58736955-93ab-4e70-ac30-4d7043597e6f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:18.996094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dbe0fe88-8596-44bb-86b2-1fc0ab3dc9f9 req-9713eb41-d3ac-47e0-9ab1-586bf114e77c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:18.998313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dbe0fe88-8596-44bb-86b2-1fc0ab3dc9f9 req-9713eb41-d3ac-47e0-9ab1-586bf114e77c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:18.998897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b4159571-557c-4fb4-a1dd-1d3ebd1ea505 req-e6dee502-b495-4699-bd34-6b25c79beaac service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:18.999389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b4159571-557c-4fb4-a1dd-1d3ebd1ea505 req-e6dee502-b495-4699-bd34-6b25c79beaac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:18.999827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b4159571-557c-4fb4-a1dd-1d3ebd1ea505 req-e6dee502-b495-4699-bd34-6b25c79beaac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.000338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dbe0fe88-8596-44bb-86b2-1fc0ab3dc9f9 req-9713eb41-d3ac-47e0-9ab1-586bf114e77c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.028280 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b4159571-557c-4fb4-a1dd-1d3ebd1ea505 req-e6dee502-b495-4699-bd34-6b25c79beaac service nova] Creating event network-changed:58736955-93ab-4e70-ac30-4d7043597e6f for instance ff58a26b-5edd-41ab-96d0-d061ce223e8e on n-h1-860863-4 Nov 02 21:26:19.033945 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-dbe0fe88-8596-44bb-86b2-1fc0ab3dc9f9 req-9713eb41-d3ac-47e0-9ab1-586bf114e77c service nova] Creating event network-vif-deleted:c7560cb4-da89-4cfa-91fa-d2b1b1e2128c for instance a9587065-f470-4a25-b540-62ca7d78e8bd on n-h1-860863-4 Nov 02 21:26:19.041648 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-dbe0fe88-8596-44bb-86b2-1fc0ab3dc9f9 req-9713eb41-d3ac-47e0-9ab1-586bf114e77c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079259 Nov 02 21:26:19.043053 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 685/1301] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:19.054003 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b4159571-557c-4fb4-a1dd-1d3ebd1ea505 req-e6dee502-b495-4699-bd34-6b25c79beaac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076607 Nov 02 21:26:19.059628 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 617/1302] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:26:19.100699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:19.101687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:19.112435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.113209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.113965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.114929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.115654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.116340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.236536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:19.237649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:19.245087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.249574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.250372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.251375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.252180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.253595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.294568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:19.306740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dcab0fa3-25aa-4514-b4c7-a9580aafde4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.210811 Nov 02 21:26:19.307406 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 686/1303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:19 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:19.360220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:19.394139 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1630dcae-dee5-4f2f-abb4-f3eeed3733af tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.164213 Nov 02 21:26:19.395243 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 618/1304] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:19 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:19.426793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:19.427409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:19.437131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.439524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.439524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.439524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.440032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.440209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.563883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:19.572493 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-734dadd8-c555-4d09-bbf6-54b0a2fa8654 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1260 microversion: 2.1 time: 0.150244 Nov 02 21:26:19.573106 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 687/1305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:19 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:19.780911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:19.781906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:19.788853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.789404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.793280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.794306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:19.794823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:19.795273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:19.969651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:19.981581 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd9ccad4-bd83-4a75-80ae-cab703641a01 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.204991 Nov 02 21:26:19.983205 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 619/1306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:19 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:20.330501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:20.331117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:20.338367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.338860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.339369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.340077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.340542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.340987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.423727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:20.424970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:20.443773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.443773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.443773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.443773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.444255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.444255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.527476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:20.535322 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b656a94-79cd-41e7-9020-42612fac2745 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.208760 Nov 02 21:26:20.535895 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 688/1307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:20 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:20.552598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:20.570153 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bea80014-892f-4f25-a205-ee2942ac15b8 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.150110 Nov 02 21:26:20.570743 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 620/1308] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:20 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:20.596698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:20.597361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:20.603420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.603903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.604341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.605062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.605517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.605946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.682018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:20.690123 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca235032-025e-413d-918a-98ec3410da24 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1266 microversion: 2.1 time: 0.097214 Nov 02 21:26:20.691233 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 689/1309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:20 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:20.815792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:20.816692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:20.826053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.826836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.828023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.829480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:20.830194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:20.830845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:20.957287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:21.013434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:21.029567 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4b6ec89f-fd63-4827-bfaa-23e80da77af6 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 2343 microversion: 2.25 time: 0.218478 Nov 02 21:26:21.033743 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 621/1310] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:20 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 2343 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:21.035597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:21.037173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:21.044792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.045538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.045980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.046672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.047122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.047546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.145755 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17848358-8956-4626-a5fe-e129911ed299 tempest-TenantUsagesNegativeTestJSON-2024486188 tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T21%3A26%3A20.986032&end=2022-11-03T21%3A26%3A20.986032" status: 404 len: 112 microversion: - time: 0.155961 Nov 02 21:26:21.146279 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 690/1311] 10.222.0.25 () {58 vars in 1316 bytes} [Wed Nov 2 21:26:20 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T21%3A26%3A20.986032&end=2022-11-03T21%3A26%3A20.986032 => generated 112 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 21:26:21.152011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:21.156572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.157674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.160109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.161210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.162083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.162685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.207081 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed903f16-38f9-4b99-bc14-7f17751e0f77 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.059602 Nov 02 21:26:21.208412 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 691/1312] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 21:26:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:26:21.224522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7d7b8477-4b47-4fe7-aaf0-519dd11acc4e req-2c2c3257-7bd8-4e99-a819-6b95473a3885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53aec4ef-fa22-47e6-ba86-c2b6c32a649a", "tag": "a0b5bc3f-5ea6-46f4-8235-ce4d722d131b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:21.235632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7d7b8477-4b47-4fe7-aaf0-519dd11acc4e req-2c2c3257-7bd8-4e99-a819-6b95473a3885 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.236209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7d7b8477-4b47-4fe7-aaf0-519dd11acc4e req-2c2c3257-7bd8-4e99-a819-6b95473a3885 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.262584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7d7b8477-4b47-4fe7-aaf0-519dd11acc4e req-2c2c3257-7bd8-4e99-a819-6b95473a3885 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.311615 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7d7b8477-4b47-4fe7-aaf0-519dd11acc4e req-2c2c3257-7bd8-4e99-a819-6b95473a3885 service nova] Creating event network-changed:a0b5bc3f-5ea6-46f4-8235-ce4d722d131b for instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a on n-h1-860863-4 Nov 02 21:26:21.323982 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7d7b8477-4b47-4fe7-aaf0-519dd11acc4e req-2c2c3257-7bd8-4e99-a819-6b95473a3885 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113501 Nov 02 21:26:21.325562 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 692/1313] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:21.340556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2ee82b1-ec97-40c2-854b-210c109e0e42 tempest-TenantUsagesNegativeTestJSON-2024486188 tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin] Calling method '.version_select at 0x7f9b68ec8d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:21.353126 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d2ee82b1-ec97-40c2-854b-210c109e0e42 tempest-TenantUsagesNegativeTestJSON-2024486188 tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2ee82b1-ec97-40c2-854b-210c109e0e42 tempest-TenantUsagesNegativeTestJSON-2024486188 tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin] Request method failure captured: Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-simple-tenant-usage/53b97ec419124d46bd7e26489d0c1859?start=2022-11-03T21%3A26%3A20.986032&end=2022-11-01T21%3A26%3A20.986032 HTTP/1.1 Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuB8fvOinbxvEexicd6f1MR4g2xb8iYV5lAylj4vQC9nFLLPraAGqc6lRyym7iD3qWo35D4Jnq0lJWCRaACHEvk0RThx5uEbYrvKnRjavEckPsHtJVHQEWQ_tSNho1a6NVTdxy4oFAjfl9049jwnlqrZzX24ivaiIrfsFXjtL4bcQIY Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a0fe93dec5bb4ef281fb71e361242310 Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2024486188 Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:26:21.362417 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0fe93dec5bb4ef281fb71e361242310"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0fe93dec5bb4ef281fb71e361242310"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0fe93dec5bb4ef281fb71e361242310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0fe93dec5bb4ef281fb71e361242310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2024486188 Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a0fe93dec5bb4ef281fb71e361242310 Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2024486188 Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b80a022aa2694bee88707be1c878e89a Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid start time. The start time cannot occur after the end time. Nov 02 21:26:21.366526 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '53b97ec419124d46bd7e26489d0c1859'} Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 21:26:21.367612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2ee82b1-ec97-40c2-854b-210c109e0e42 tempest-TenantUsagesNegativeTestJSON-2024486188 tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:21.369817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2ee82b1-ec97-40c2-854b-210c109e0e42 tempest-TenantUsagesNegativeTestJSON-2024486188 tempest-TenantUsagesNegativeTestJSON-2024486188-project-admin] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage/53b97ec419124d46bd7e26489d0c1859?start=2022-11-03T21%3A26%3A20.986032&end=2022-11-01T21%3A26%3A20.986032" status: 400 len: 111 microversion: 2.1 time: 0.034863 Nov 02 21:26:21.370694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 693/1314] 10.222.0.25 () {58 vars in 1412 bytes} [Wed Nov 2 21:26:21 2022] GET /compute/v2.1/os-simple-tenant-usage/53b97ec419124d46bd7e26489d0c1859?start=2022-11-03T21%3A26%3A20.986032&end=2022-11-01T21%3A26%3A20.986032 => generated 111 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:26:21.437241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:21.458617 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b0c8aef-1cbc-450e-b933-e41fda58098c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.426897 Nov 02 21:26:21.463306 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 622/1315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:21 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:21.531003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05a30831-ef36-4e0f-88f3-fc5e4963cd49 tempest-TenantUsagesNegativeTestJSON-1361672292 tempest-TenantUsagesNegativeTestJSON-1361672292-project] Calling method '.version_select at 0x7f9b68dd9a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:21.553497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05a30831-ef36-4e0f-88f3-fc5e4963cd49 tempest-TenantUsagesNegativeTestJSON-1361672292 tempest-TenantUsagesNegativeTestJSON-1361672292-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'de9ecd25fb2648f8b3be692f81339847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b97ec419124d46bd7e26489d0c1859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:21.561228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:21.561727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05a30831-ef36-4e0f-88f3-fc5e4963cd49 tempest-TenantUsagesNegativeTestJSON-1361672292 tempest-TenantUsagesNegativeTestJSON-1361672292-project] Request method failure captured: Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T21%3A26%3A20.986032&end=2022-11-03T21%3A26%3A20.986032&detailed=1 HTTP/1.1 Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuB7fMRTAdE-EB0-2EMM4wq_ltr4vB2jb_mKxX_u976ANvltbsuwBbC-n64zAnh3MTDm9gmDSNChF9lROQCGXgIyMbWkeA27pQ0jfNvL3PNN8q9RdaFcFSjGx1jFzdOvt_nWh3kpoJ43dzdhNkT0TIL4mA6145O1sPBqsmbLOFyvAbU Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 53b97ec419124d46bd7e26489d0c1859 Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1361672292 Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:26:21.567122 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53b97ec419124d46bd7e26489d0c1859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53b97ec419124d46bd7e26489d0c1859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53b97ec419124d46bd7e26489d0c1859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53b97ec419124d46bd7e26489d0c1859"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1361672292 Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 53b97ec419124d46bd7e26489d0c1859 Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1361672292 Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TenantUsagesNegativeTestJSON-1361672292-project Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: de9ecd25fb2648f8b3be692f81339847 Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1361672292-project Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: action_args: {} Nov 02 21:26:21.568522 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:26:21.569474 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:26:21.570658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:26:21.572809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 21:26:21.572809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:21.578141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.578141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.578366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05a30831-ef36-4e0f-88f3-fc5e4963cd49 tempest-TenantUsagesNegativeTestJSON-1361672292 tempest-TenantUsagesNegativeTestJSON-1361672292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:21.578463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.578463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.578463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.578463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.578760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05a30831-ef36-4e0f-88f3-fc5e4963cd49 tempest-TenantUsagesNegativeTestJSON-1361672292 tempest-TenantUsagesNegativeTestJSON-1361672292-project] 10.222.0.25 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T21%3A26%3A20.986032&end=2022-11-03T21%3A26%3A20.986032&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.201440 Nov 02 21:26:21.579156 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 694/1316] 10.222.0.25 () {58 vars in 1335 bytes} [Wed Nov 2 21:26:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T21%3A26%3A20.986032&end=2022-11-03T21%3A26%3A20.986032&detailed=1 => generated 123 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:26:21.599337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:21.601503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:21.614569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.615691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.616376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.620518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.625775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.627038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.912818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:21.934804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c4521b9-6816-4f7d-932d-5931974d9d07 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.339206 Nov 02 21:26:21.950147 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 695/1317] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:21 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:26:21.963356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:21.964229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:21.972052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.972803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.973528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:21.974609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:21.975395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:21.976194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:22.014844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:22.017890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:22.027386 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ff9bb99-bd5e-4f71-bc43-a92cc3e59a8b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.471553 Nov 02 21:26:22.028147 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 623/1318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:21 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:22.291775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:22.301018 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-795f53b8-88b5-4403-b770-42bb263e6358 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1308 microversion: 2.1 time: 0.349364 Nov 02 21:26:22.301606 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 696/1319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:21 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:22.484887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:22.485559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:22.492584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:22.493107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:22.493555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:22.494251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:22.494895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:22.495523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:22.745533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:22.757047 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6aa6e128-05f4-4c8c-8387-3dda485009b1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.276402 Nov 02 21:26:22.758269 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 624/1320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:22 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:22.968815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:22.969552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:22.978599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:22.979336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:22.980093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:22.980832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:22.981416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:22.981786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:23.009142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-98dd54d5-a9d0-482c-b468-de45230ef912 req-669d6718-b771-42cc-aa85-164064e5d42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9429781f-2367-4cec-bfdb-641db74cc989", "tag": "c5152ab2-61c4-418e-ba79-8965f88d0751"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:23.019011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:23.022408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-98dd54d5-a9d0-482c-b468-de45230ef912 req-669d6718-b771-42cc-aa85-164064e5d42e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:23.022889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-98dd54d5-a9d0-482c-b468-de45230ef912 req-669d6718-b771-42cc-aa85-164064e5d42e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:23.023317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-98dd54d5-a9d0-482c-b468-de45230ef912 req-669d6718-b771-42cc-aa85-164064e5d42e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:23.041305 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-98dd54d5-a9d0-482c-b468-de45230ef912 req-669d6718-b771-42cc-aa85-164064e5d42e service nova] Creating event network-changed:c5152ab2-61c4-418e-ba79-8965f88d0751 for instance 9429781f-2367-4cec-bfdb-641db74cc989 on n-h2-860863-4 Nov 02 21:26:23.047518 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-98dd54d5-a9d0-482c-b468-de45230ef912 req-669d6718-b771-42cc-aa85-164064e5d42e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042143 Nov 02 21:26:23.056082 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 625/1321] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:26:23.065747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:23.066652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:23.075403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:23.075896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:23.076333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:23.077213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:23.077805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:23.078235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:23.198953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:23.219130 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c9f37503-047c-4676-a988-43e0602c69c1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.254055 Nov 02 21:26:23.220017 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 697/1322] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:22 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:23.323993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:23.324710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:23.330843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:23.331551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:23.331996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:23.332730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:23.333211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:23.333805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:23.354705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:23.365608 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-907b9906-0a81-449f-9310-6527a4b60297 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.307673 Nov 02 21:26:23.366553 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 626/1323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:23 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:23.603289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:23.626146 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3feb737-39a5-44b4-b251-1fbdd9eff4f0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1308 microversion: 2.1 time: 0.306190 Nov 02 21:26:23.626784 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 698/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:23 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:23.782219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:23.782889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:23.795046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:23.795871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:23.796567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:23.800917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:23.800917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:23.800917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:24.250284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:24.250993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:24.258999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:24.259499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:24.259943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:24.260856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:24.261507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:24.261937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:24.389131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:24.428301 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-43f0dcc6-5ab4-4293-a540-a08af48238c6 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.181209 Nov 02 21:26:24.446855 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 699/1325] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:24 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:26:24.465929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:24.467156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:24.476444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:24.477539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:24.478237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:24.479245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:24.479910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:24.480597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:24.510563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:24.541048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:24.553672 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c7d0fae-f67c-4202-bb0f-7fd5a65c5516 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.776079 Nov 02 21:26:24.570503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 627/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:23 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:24.656886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:24.657819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:24.667056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:24.667896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:24.668616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:24.669804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:24.670673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:24.671114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:25.063535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:25.093966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd2e4dd3-9dca-4990-80d6-313b246d515e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.643095 Nov 02 21:26:25.112874 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 700/1327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:24 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:25.234009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:25.244334 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7411e32e-d4cf-4554-aa66-6d4f9a7bd62e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1308 microversion: 2.1 time: 0.594348 Nov 02 21:26:25.259571 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 628/1328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:24 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1308 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:25.463678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:25.465488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:25.479041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:25.479621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:25.480082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:25.482688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:25.487379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:25.488175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:25.585966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:25.585966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:25.591411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:25.598231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:25.598231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:25.599006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:25.604672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:25.605358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:25.655162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:25.675501 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4369091b-392a-4b19-9d95-2e7258675d7e tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.217398 Nov 02 21:26:25.677011 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 701/1329] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:25 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:25.841776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:25.850714 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b97f3e9-c161-4590-b62c-9998e3ed0976 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.273542 Nov 02 21:26:25.851398 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 629/1330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:25 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:25.938423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-de0f4fc7-90b1-4203-bd2b-93162445618d req-f04e06b9-47e8-490e-85e9-05defd3ed11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff58a26b-5edd-41ab-96d0-d061ce223e8e", "name": "network-vif-plugged", "status": "completed", "tag": "58736955-93ab-4e70-ac30-4d7043597e6f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:25.958002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b88500c3-be8a-4560-8d92-27dce3eaede6", "device": "/dev/xvdb"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:25.962598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:25.978173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:25.978877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:25.979862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de0f4fc7-90b1-4203-bd2b-93162445618d req-f04e06b9-47e8-490e-85e9-05defd3ed11d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:25.980311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:25.981473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:25.981759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de0f4fc7-90b1-4203-bd2b-93162445618d req-f04e06b9-47e8-490e-85e9-05defd3ed11d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:25.982301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:25.982849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de0f4fc7-90b1-4203-bd2b-93162445618d req-f04e06b9-47e8-490e-85e9-05defd3ed11d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:25.984218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:26.033626 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-de0f4fc7-90b1-4203-bd2b-93162445618d req-f04e06b9-47e8-490e-85e9-05defd3ed11d service nova] Creating event network-vif-plugged:58736955-93ab-4e70-ac30-4d7043597e6f for instance ff58a26b-5edd-41ab-96d0-d061ce223e8e on n-h1-860863-4 Nov 02 21:26:26.043210 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-de0f4fc7-90b1-4203-bd2b-93162445618d req-f04e06b9-47e8-490e-85e9-05defd3ed11d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110603 Nov 02 21:26:26.047509 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 702/1331] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:26.120952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:26.121675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:26.142355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:26.142850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:26.143309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:26.144019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:26.148416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:26.151483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:26.428157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:26.440383 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca524639-6763-4223-8c74-dc755f974c9b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.324186 Nov 02 21:26:26.441677 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 703/1332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:26 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:26.447202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:26.448111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:26.455854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:26.456640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:26.457340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:26.458207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:26.458832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:26.459312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:26.770879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:26.779670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6957c052-2b35-46e6-a3af-0ab0248359dd tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1308 microversion: 2.1 time: 0.336630 Nov 02 21:26:26.793494 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 704/1333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:26 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:26.801175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:26.802111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:26.808206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:26.809503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:26.810268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:26.810932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:26.811981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:26.812663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:26.813367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:26.953001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:26.976983 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-347ed1fe-79d1-4608-98d2-9f58e1c0a58b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.182117 Nov 02 21:26:26.977884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 705/1334] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:26 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:27.003416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:27.003942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:27.011671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:27.012234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:27.013229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:27.014831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:27.015453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:27.015949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:27.101857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10d40dbe-9581-481b-8035-d89299a086e2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "POST /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.147728 Nov 02 21:26:27.103810 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 630/1335] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Nov 2 21:26:25 2022] POST /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 194 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:26:27.183350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:27.191231 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae9bf755-e64f-4474-94ac-67511f41540f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.212336 Nov 02 21:26:27.193555 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 706/1336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:26 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:27.466496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:27.467426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:27.479169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:27.490017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:27.492339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:27.492339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:27.492339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:27.494365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:27.494867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:27.787220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:27.807617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:27.809118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:27.818247 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5715bdb0-a927-4c4a-b155-cd94ead2accd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1310 microversion: 2.1 time: 0.356513 Nov 02 21:26:27.824558 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 631/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:27 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1310 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:27.843990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:27.844504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:27.844967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:27.845691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:27.846146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:27.856273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:28.014674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:28.015290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:28.029329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:28.029834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:28.030271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:28.033807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:28.035114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:28.036159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:28.224465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:28.235678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:28.251840 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61ab42d3-c2f0-4037-964c-8e4d0931c0ad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1308 microversion: 2.1 time: 0.445148 Nov 02 21:26:28.253160 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 707/1338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:27 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:28.266502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5292f62f-a652-4276-8152-0f477b0502ac tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.260396 Nov 02 21:26:28.269064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-61b85c89-3108-4b31-81be-96ef98624b4f req-99bd74e2-a06c-46bb-8470-a9271432dd79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aec4ef-fa22-47e6-ba86-c2b6c32a649a", "name": "network-vif-plugged", "status": "completed", "tag": "a0b5bc3f-5ea6-46f4-8235-ce4d722d131b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:28.277520 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 632/1339] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:28 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:26:28.282436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:28.283055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:28.294003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:28.294502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:28.294939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:28.295652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:28.296103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:28.296670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:28.309426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61b85c89-3108-4b31-81be-96ef98624b4f req-99bd74e2-a06c-46bb-8470-a9271432dd79 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:28.310043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61b85c89-3108-4b31-81be-96ef98624b4f req-99bd74e2-a06c-46bb-8470-a9271432dd79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:28.310580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61b85c89-3108-4b31-81be-96ef98624b4f req-99bd74e2-a06c-46bb-8470-a9271432dd79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:28.343300 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-61b85c89-3108-4b31-81be-96ef98624b4f req-99bd74e2-a06c-46bb-8470-a9271432dd79 service nova] Creating event network-vif-plugged:a0b5bc3f-5ea6-46f4-8235-ce4d722d131b for instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a on n-h1-860863-4 Nov 02 21:26:28.360602 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-61b85c89-3108-4b31-81be-96ef98624b4f req-99bd74e2-a06c-46bb-8470-a9271432dd79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105680 Nov 02 21:26:28.362323 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 708/1340] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:28.610880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:28.621666 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-51285503-1196-4d3f-9bf0-2cc63eac4e64 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1325 microversion: 2.1 time: 0.342949 Nov 02 21:26:28.623505 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 633/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:28 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:28.847243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=20 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:28.854397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:28.855120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:28.862929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:28.864752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:28.864752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:28.864752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:28.865263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:28.865858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:29.193268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:29.207841 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82ac3589-cb0b-4078-9cec-cb313cfb0959 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1492 microversion: 2.1 time: 0.362131 Nov 02 21:26:29.210525 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 709/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:28 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1492 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:29.238013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:29.239273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:29.247715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:29.248919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:29.249669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:29.252076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:29.255158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:29.255865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:29.278500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:29.280674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:29.291732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:29.293675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:29.294333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:29.296218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:29.297998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:29.298745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.187394 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0770efbd-0cc9-4317-9737-71bc5f098baf tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1643 microversion: 2.1 time: 0.949273 Nov 02 21:26:30.188539 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 634/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:29 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1643 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:30.205171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:30.206983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:30.207617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:30.218645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4f525ab-1ef4-4e92-9147-dc2653562fad tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1308 microversion: 2.1 time: 0.943973 Nov 02 21:26:30.225422 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 710/1344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:29 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1308 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:30.226013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.227894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.228352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.231436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.231919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.232354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.242420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:30.246276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:30.269557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.272363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.281435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.282756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.285201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.292404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.481964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:30.519066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-555b12e4-a6f6-4cdf-8284-e1fd4ad9ed0c tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.324745 Nov 02 21:26:30.529462 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 635/1345] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:30 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:30.545950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:30.551516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:30.560878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.561660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.562340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.563281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.564611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.565317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.743696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:30.757953 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52ff09ce-e2c0-47e4-8442-7d92e519667d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1523 microversion: 2.1 time: 0.529338 Nov 02 21:26:30.773590 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 711/1346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:30 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:30.787628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:30.788753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:30.796700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.797512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.798152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:30.805319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:30.806032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:30.806915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.039086 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb0479fe-8338-4279-9700-f112a3c5ea8c tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1643 microversion: 2.1 time: 0.507674 Nov 02 21:26:31.041981 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 636/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:30 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1643 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:31.075096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:31.077469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.086023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.087246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.088074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.088536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.088980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.103635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:31.112009 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55eb853d-f79b-4fc0-92d2-ca8653575ba2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1523 microversion: 2.1 time: 0.328269 Nov 02 21:26:31.124955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 712/1348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:30 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:31.146813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-607555402"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:31.151200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:31.174070 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c34a8fde-6b53-4139-85c4-295f4dcb1c77 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106090 Nov 02 21:26:31.175238 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 637/1349] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:26:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:31.184981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.185748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.186998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.187745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.188388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.189046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.189786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:31.190311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:31.190709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:31.200952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.202271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.203115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.203984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.204656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.205492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.488610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:31.621983 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c7fed89-f339-4596-94b4-d1e7df50201d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e/action" status: 202 len: 0 microversion: 2.1 time: 0.437707 Nov 02 21:26:31.623004 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 638/1350] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:26:31 2022] POST /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:26:31.634874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:31.649722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:31.683421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.684173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.685987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.691549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.692681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.693336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.922807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e28f6715-9639-4265-a1fd-7ba7a513bad9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a/action" status: 202 len: 0 microversion: 2.1 time: 0.781534 Nov 02 21:26:31.938472 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 713/1351] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:26:31 2022] POST /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a/action => generated 0 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:26:31.944891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:31.972806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:31.987402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.990999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.991670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:31.993129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:31.995487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:31.999562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:32.247411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:32.271292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-43d370da-1a50-4761-92ad-cc253a29f847 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.330590 Nov 02 21:26:32.272126 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 714/1352] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:31 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:32.315885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:32.316515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:32.340684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:32.341501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:32.344523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:32.345302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:32.345773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:32.346214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:32.378498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:32.389975 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec750c39-652f-4965-b53c-46e2ecfdc106 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1308 microversion: 2.1 time: 0.764748 Nov 02 21:26:32.391394 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 639/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:31 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:32.397150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cb9e9189-4838-4b64-a4ae-d6d48f191614 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '.version_select at 0x7f9b6d12b550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:32.572703 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc9a4f7c-191d-4e11-b06c-1fb36ee2ac39 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1628 microversion: 2.1 time: 0.262272 Nov 02 21:26:32.589472 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 715/1354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:32 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1628 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:32.597359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-955fff66-81dd-4250-bdc0-321d5509ed89 req-03b10a43-84cc-466e-9e87-d90502470b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9429781f-2367-4cec-bfdb-641db74cc989", "name": "network-vif-plugged", "status": "completed", "tag": "c5152ab2-61c4-418e-ba79-8965f88d0751"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:32.617253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-955fff66-81dd-4250-bdc0-321d5509ed89 req-03b10a43-84cc-466e-9e87-d90502470b50 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:32.617253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-955fff66-81dd-4250-bdc0-321d5509ed89 req-03b10a43-84cc-466e-9e87-d90502470b50 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:32.617499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-955fff66-81dd-4250-bdc0-321d5509ed89 req-03b10a43-84cc-466e-9e87-d90502470b50 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:32.629952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:32.632527 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-955fff66-81dd-4250-bdc0-321d5509ed89 req-03b10a43-84cc-466e-9e87-d90502470b50 service nova] Creating event network-vif-plugged:c5152ab2-61c4-418e-ba79-8965f88d0751 for instance 9429781f-2367-4cec-bfdb-641db74cc989 on n-h2-860863-4 Nov 02 21:26:32.638534 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-955fff66-81dd-4250-bdc0-321d5509ed89 req-03b10a43-84cc-466e-9e87-d90502470b50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047511 Nov 02 21:26:32.640736 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 716/1355] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:32.759812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1471628008", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "a782d412-0278-4cfa-b529-a5327e1a62a9"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:32.796899 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cb9e9189-4838-4b64-a4ae-d6d48f191614 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d" status: 204 len: 0 microversion: 2.1 time: 0.404100 Nov 02 21:26:32.800677 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 640/1356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:32 2022] DELETE /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:26:32.812111 n-d-860863-4 devstack@n-api.service[121040]: Exception ignored in: . at 0x7f9b68ec61f0> Nov 02 21:26:32.812111 n-d-860863-4 devstack@n-api.service[121040]: Traceback (most recent call last): Nov 02 21:26:32.812111 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Nov 02 21:26:32.814935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": true, "disk_over_commit": false}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:32.817377 n-d-860863-4 devstack@n-api.service[121040]: and _finalize_fairy(None, rec, pool, ref, echo, True), Nov 02 21:26:32.817377 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Nov 02 21:26:32.820365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: connection_record.checkin() Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: pool.dispatch.checkin(connection, self) Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: fn(*args, **kw) Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: time.sleep(0) Nov 02 21:26:32.829505 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Nov 02 21:26:32.831195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:32.834343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:32.835093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:32.836156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:32.837575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:32.839705 n-d-860863-4 devstack@n-api.service[121040]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 21:26:32.839950 n-d-860863-4 devstack@n-api.service[121040]: AssertionError: do not call blocking functions from the mainloop Nov 02 21:26:32.841243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:32.862812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] validate_networks() for [('a782d412-0278-4cfa-b529-a5327e1a62a9', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:26:32.919790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lazy-loading 'flavor' on Instance uuid ff58a26b-5edd-41ab-96d0-d061ce223e8e {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:32.958796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121039) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:26:33.533680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:26:33.534278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:26:33.535039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:26:33.536768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:26:33.537776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:26:33.553971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:33.563847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:33.563847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:33.563847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:33.564353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:33.564353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:33.587863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Getting quotas for project 64b626934eea4654a4040b4432c1c6a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:26:33.600420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Getting quotas for user 8b5f877966204f2db585b04b8afee9e1 and project 64b626934eea4654a4040b4432c1c6a2. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:26:33.611094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:26:33.617047 n-d-860863-4 devstack@n-api.service[121040]: WARNING nova.utils [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1471628008 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-147162800 Nov 02 21:26:33.619160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:26:33.753173 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f422fa18-dfdd-4c2c-9842-1a49e986da51 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112056 Nov 02 21:26:33.754774 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 717/1357] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:26:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:26:33.766562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09e14619-93bd-413d-879d-8888624610fa tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '.version_select at 0x7f9b68dfbaf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:34.077828 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-09e14619-93bd-413d-879d-8888624610fa tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Image not found. Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09e14619-93bd-413d-879d-8888624610fa tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d HTTP/1.1 Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:26:34.084667 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '38ccf6a3-3c06-496e-862d-b6ffee8bdd6d'} Nov 02 21:26:34.094453 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:34.095297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 38ccf6a3-3c06-496e-862d-b6ffee8bdd6d Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:34.096401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 38ccf6a3-3c06-496e-862d-b6ffee8bdd6d could not be found. Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:34.098941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:34.101225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09e14619-93bd-413d-879d-8888624610fa tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:34.103760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09e14619-93bd-413d-879d-8888624610fa tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d" status: 404 len: 62 microversion: 2.1 time: 0.328687 Nov 02 21:26:34.103760 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 718/1358] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:33 2022] GET /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d => generated 62 bytes in 332 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:34.114893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:34.115967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:34.150549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:34.151173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:34.151630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:34.152378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:34.152903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:34.153370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:34.327117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:34.361520 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1ee4f15-d161-4857-bc1a-cd711d5c2d86 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.267302 Nov 02 21:26:34.362428 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 719/1359] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:34 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:34.368479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:34.369568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:34.376413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:34.377190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:34.377849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:34.378751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:34.379535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:34.380155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:34.618214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:34.633917 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eeaff1bf-f397-4673-ae46-b028e818edf5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 200 len: 1487 microversion: 2.1 time: 0.265337 Nov 02 21:26:34.633917 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 720/1360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:34 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 1487 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:34.650159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfdd8178-e141-4dad-80d0-601217379e41 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:34.655135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfdd8178-e141-4dad-80d0-601217379e41 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:34.766629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfdd8178-e141-4dad-80d0-601217379e41 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:34.779120 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfdd8178-e141-4dad-80d0-601217379e41 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1232 microversion: 2.1 time: 0.143130 Nov 02 21:26:34.780011 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 721/1361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:34 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1232 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:34.807964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:34.808589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:34.829089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:34.829680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:34.830093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:34.830810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:34.831403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:34.835642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:35.073610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:35.083496 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7fade5c-86f0-472a-b52e-8c7745b0ab9c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1541 microversion: 2.1 time: 0.279733 Nov 02 21:26:35.084863 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 722/1362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:34 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1541 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:35.090787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1966024764"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:35.094458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:35.101467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:35.102852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:35.103551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:35.104410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:35.105117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:35.105963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:35.677276 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d28a500d-f2b2-4196-9388-81392c0ab04f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989/action" status: 202 len: 0 microversion: 2.1 time: 0.590552 Nov 02 21:26:35.688641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 723/1363] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:26:35 2022] POST /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:26:35.712857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:35.713666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:35.745573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:35.746643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:35.747105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:35.747843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:35.748310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:35.754745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:35.907801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:35.942333 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a915739a-6b7b-4a95-b8ae-c6266200b786 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.251180 Nov 02 21:26:35.944048 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 724/1364] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:35 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:35.960146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26ffc10c-f7a8-4203-bde7-13ff894e9a14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f68820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:36.052058 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26ffc10c-f7a8-4203-bde7-13ff894e9a14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.105544 Nov 02 21:26:36.062410 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 725/1365] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:35 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:36.075501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:36.077084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:36.108183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.109305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.110880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.115566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.119468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.121343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.254965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:36.279401 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fec929f6-41ef-4992-b0de-8f28c7ad657f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1236 microversion: 2.1 time: 0.203006 Nov 02 21:26:36.280758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 726/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:36 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1236 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:36.288080 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48aa180b-8d11-4f05-9369-f3e7f2489cbe tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e/action" status: 202 len: 0 microversion: 2.1 time: 3.484848 Nov 02 21:26:36.289327 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 641/1367] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:26:32 2022] POST /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e/action => generated 0 bytes in 3488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:26:36.293086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:36.293931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:36.314073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:36.314924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:36.320543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.322055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.322710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.323691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.324067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.324501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.332833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.334648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.334648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.334648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.334955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.335309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.675772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:36.691017 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9a74d244-2084-4486-a9cb-64144cf22379 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 0.381667 Nov 02 21:26:36.692627 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 642/1368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:36 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:36.725719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:36.742541 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7839947-e1c6-4fe0-b5da-bcb870327249 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1523 microversion: 2.1 time: 0.459526 Nov 02 21:26:36.748208 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 727/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:36 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:36.778994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:36.781523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:36.798024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.799612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.800415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.801596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:36.802215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:36.802843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:36.848452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:26:36.979055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:36.979938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:36.999876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.004029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.007490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.012774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.015345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.016012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.203018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:37.252083 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b51ab5a5-3728-49e5-a266-90af20374c9b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.279511 Nov 02 21:26:37.264959 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 728/1370] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:36 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:26:37.264959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2a958b7-c279-45a0-b618-bdbf32d2f8c5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68ec6430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:37.294736 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62431a4c-5aa4-41f5-938e-d358c42d87a9 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 204 len: 0 microversion: 2.1 time: 0.529152 Nov 02 21:26:37.295705 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 643/1371] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:26:36 2022] DELETE /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:26:37.304326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:37.305353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:37.313259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.313408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.314555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.315482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.316510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.317176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.358045 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2a958b7-c279-45a0-b618-bdbf32d2f8c5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.101773 Nov 02 21:26:37.358045 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 729/1372] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:37 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:37.369704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:37.370732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:37.380436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.381599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.382068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.382825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.383854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.384293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.573298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:37.581330 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df063346-fd0f-44e1-8f28-ca5b2e884398 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1284 microversion: 2.1 time: 0.281299 Nov 02 21:26:37.582153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 644/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:37 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1284 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:37.672548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-937d5be2-e590-446b-97c8-82625461bf15 tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Calling method '.version_select at 0x7f9b68bdcee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:37.723454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:37.740390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c624b663-1f54-4387-a92d-95f4f92ea264 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1529 microversion: 2.1 time: 0.374613 Nov 02 21:26:37.753747 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 730/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:37 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1529 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:37.753747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:37.753747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:37.768306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.768306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.768306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.770866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:37.771410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:37.771940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:37.828335 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-937d5be2-e590-446b-97c8-82625461bf15 tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.244899 Nov 02 21:26:37.829280 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 645/1375] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:26:37 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:26:37.843183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a436a92-8f65-4d95-9977-dce07b127626 tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Action: 'create', calling method: .version_select at 0x7f9b68bd4f70>, body: {"pool": "non_exist_pool"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:37.937183 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-3a436a92-8f65-4d95-9977-dce07b127626 tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] HTTP exception thrown: Floating IP pool not found. Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a436a92-8f65-4d95-9977-dce07b127626 tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Request method failure captured: Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 26 Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCNRPX08ZBrRF5LIaCnG6xloQ45GBRxymPUq4P2tNjB6F0YeEbxkmtxe10ay-_OCgPkf3czuJhnkavFFTNzsAZsJ3fSWWM6TjE6kBBdWTjvojp-PRmEOd2tCdEyXQrnR-UK2-zTnGoxrZQM54EHU-vokfENupLDKBQDFW74ZBBNySU Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 516aa824540741269cb00806b6a4129c Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-219948219 Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:37.951010 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_516aa824540741269cb00806b6a4129c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/516aa824540741269cb00806b6a4129c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/516aa824540741269cb00806b6a4129c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/516aa824540741269cb00806b6a4129c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-219948219 Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 516aa824540741269cb00806b6a4129c Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-219948219 Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsNegativeTestJSON-219948219-project Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 0d4ee82b4fc24d73bbcefe3c3af476a1 Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-219948219-project Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: {"pool": "non_exist_pool"} Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: exception: Floating IP pool not found. Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 02 21:26:37.952653 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:37.953910 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 02 21:26:37.955429 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:37.958514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a436a92-8f65-4d95-9977-dce07b127626 tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Returning 404 to user: Floating IP pool not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:37.962706 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a436a92-8f65-4d95-9977-dce07b127626 tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.121631 Nov 02 21:26:37.963971 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 646/1376] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:26:37 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:37.977903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1ee11ab6-b19d-4c90-991f-fa13b1d6737e tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Calling method '.version_select at 0x7f9b6d18fdc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:38.078306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-1ee11ab6-b19d-4c90-991f-fa13b1d6737e tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ef00aab4-38aa-4451-ba56-8f05b1e8b368 could not be found", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:26:38.079197 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1ee11ab6-b19d-4c90-991f-fa13b1d6737e tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] HTTP exception thrown: Floating IP not found for ID ef00aab4-38aa-4451-ba56-8f05b1e8b368 Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1ee11ab6-b19d-4c90-991f-fa13b1d6737e tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Request method failure captured: Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-floating-ips/ef00aab4-38aa-4451-ba56-8f05b1e8b368 HTTP/1.1 Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCNRPX08ZBrRF5LIaCnG6xloQ45GBRxymPUq4P2tNjB6F0YeEbxkmtxe10ay-_OCgPkf3czuJhnkavFFTNzsAZsJ3fSWWM6TjE6kBBdWTjvojp-PRmEOd2tCdEyXQrnR-UK2-zTnGoxrZQM54EHU-vokfENupLDKBQDFW74ZBBNySU Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 516aa824540741269cb00806b6a4129c Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-219948219 Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:38.098260 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_516aa824540741269cb00806b6a4129c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/516aa824540741269cb00806b6a4129c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/516aa824540741269cb00806b6a4129c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/516aa824540741269cb00806b6a4129c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-219948219 Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 516aa824540741269cb00806b6a4129c Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-219948219 Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsNegativeTestJSON-219948219-project Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 0d4ee82b4fc24d73bbcefe3c3af476a1 Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-219948219-project Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: exception: Floating IP not found for ID ef00aab4-38aa-4451-ba56-8f05b1e8b368 Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'ef00aab4-38aa-4451-ba56-8f05b1e8b368'} Nov 02 21:26:38.100253 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:26:38.101187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ef00aab4-38aa-4451-ba56-8f05b1e8b368 could not be found Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce71eca-3243-43f8-8c40-9c658633b609'] Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ef00aab4-38aa-4451-ba56-8f05b1e8b368. Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:38.102704 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ef00aab4-38aa-4451-ba56-8f05b1e8b368 Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:38.104170 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:38.105656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ef00aab4-38aa-4451-ba56-8f05b1e8b368 Nov 02 21:26:38.105656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:38.105656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1ee11ab6-b19d-4c90-991f-fa13b1d6737e tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] Returning 404 to user: Floating IP not found for ID ef00aab4-38aa-4451-ba56-8f05b1e8b368 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:38.105656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1ee11ab6-b19d-4c90-991f-fa13b1d6737e tempest-FloatingIPsNegativeTestJSON-219948219 tempest-FloatingIPsNegativeTestJSON-219948219-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ef00aab4-38aa-4451-ba56-8f05b1e8b368" status: 404 len: 111 microversion: 2.1 time: 0.130980 Nov 02 21:26:38.106844 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 647/1377] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:26:37 2022] DELETE /compute/v2.1/os-floating-ips/ef00aab4-38aa-4451-ba56-8f05b1e8b368 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:26:38.287845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:38.289179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:38.308390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:38.314231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:38.314231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:38.314231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:38.314231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:38.315095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:38.496451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:38.528787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3935b9c8-8f06-454f-8492-a06f1d37d14a tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.246709 Nov 02 21:26:38.530180 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 648/1378] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:38 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:38.548533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59610f3c-4fac-4a19-a0c8-db66ceb269f1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d2158b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:38.567662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:38.590252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36ebdbcb-15ba-4d25-9798-41aa49dc227b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 0.847794 Nov 02 21:26:38.605087 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 731/1379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:37 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:38.606723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:38.608914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:38.631483 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59610f3c-4fac-4a19-a0c8-db66ceb269f1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.099659 Nov 02 21:26:38.632613 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 649/1380] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:38 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:38.650731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:38.651248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:38.651705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:38.652431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:38.654270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:38.655169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:38.766616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:38.768459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:38.781905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:38.786060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:38.788347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:38.789983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:38.792296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:38.795217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:38.795217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:38.799251 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6959dd6b-ebec-4db3-a987-d11e5e5ec734 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1290 microversion: 2.1 time: 0.196075 Nov 02 21:26:38.800040 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 732/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:38 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1290 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:39.107382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:39.119210 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cb0da23-1fe9-45e7-b953-ea20b0b3c11f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1529 microversion: 2.1 time: 0.356300 Nov 02 21:26:39.133957 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 650/1382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:38 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1529 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:39.560403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:39.562001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:39.569979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:39.572604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:39.573518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:39.581959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:39.583352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:39.588576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:39.621600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:39.625948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:39.676777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:39.677355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:39.681002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:39.686992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:39.692233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:39.692915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:39.944185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:39.972220 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8ac7b2a-ff34-41a1-9b42-5ea0f9a88fc1 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.415532 Nov 02 21:26:39.973523 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 733/1383] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:39 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:39.981327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51c9166e-6103-44d1-91d3-6a25958e7ce1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f68160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:40.047806 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51c9166e-6103-44d1-91d3-6a25958e7ce1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.072647 Nov 02 21:26:40.049594 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 734/1384] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:39 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:40.060174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:40.061884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:40.076437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:40.077344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:40.078126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:40.085738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:40.088163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:40.088698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:40.098837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:40.114679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59939113-c84b-40f3-bed9-87ba9aeef6ab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 0.497095 Nov 02 21:26:40.126227 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 651/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:39 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:40.145557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-268f2418-1fcc-416a-8089-ba8a40c7b4fd req-79b2d666-c10d-4328-acdc-68229ba127ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff58a26b-5edd-41ab-96d0-d061ce223e8e", "name": "network-vif-unplugged", "status": "completed", "tag": "58736955-93ab-4e70-ac30-4d7043597e6f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:40.172528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-268f2418-1fcc-416a-8089-ba8a40c7b4fd req-79b2d666-c10d-4328-acdc-68229ba127ae service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:40.173295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-268f2418-1fcc-416a-8089-ba8a40c7b4fd req-79b2d666-c10d-4328-acdc-68229ba127ae service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:40.177745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-268f2418-1fcc-416a-8089-ba8a40c7b4fd req-79b2d666-c10d-4328-acdc-68229ba127ae service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:40.197297 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-268f2418-1fcc-416a-8089-ba8a40c7b4fd req-79b2d666-c10d-4328-acdc-68229ba127ae service nova] Creating event network-vif-unplugged:58736955-93ab-4e70-ac30-4d7043597e6f for instance ff58a26b-5edd-41ab-96d0-d061ce223e8e on n-h1-860863-4 Nov 02 21:26:40.215015 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-268f2418-1fcc-416a-8089-ba8a40c7b4fd req-79b2d666-c10d-4328-acdc-68229ba127ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086932 Nov 02 21:26:40.216430 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 652/1386] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:40.228564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:40.229300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:40.246140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:40.246638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:40.247077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:40.247794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:40.248276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:40.254194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:40.837960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:40.863234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f3a07277-5b19-4970-b809-bf1f98f31f80 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1529 microversion: 2.1 time: 0.644952 Nov 02 21:26:40.893030 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 653/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:40 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1529 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:40.908672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-9258f4a9-fae9-44cd-b1b5-40afad5f4141 req-b407d28e-5d96-4e2f-ae07-235313fb439c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aec4ef-fa22-47e6-ba86-c2b6c32a649a", "name": "network-vif-deleted", "tag": "a0b5bc3f-5ea6-46f4-8235-ce4d722d131b"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:40.943560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:40.949046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9258f4a9-fae9-44cd-b1b5-40afad5f4141 req-b407d28e-5d96-4e2f-ae07-235313fb439c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:40.950942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9258f4a9-fae9-44cd-b1b5-40afad5f4141 req-b407d28e-5d96-4e2f-ae07-235313fb439c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:40.953915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9258f4a9-fae9-44cd-b1b5-40afad5f4141 req-b407d28e-5d96-4e2f-ae07-235313fb439c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:40.956552 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72c11a15-6119-45d1-a309-29a67603a6f9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.905702 Nov 02 21:26:40.972961 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 735/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:40 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:40.984154 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-9258f4a9-fae9-44cd-b1b5-40afad5f4141 req-b407d28e-5d96-4e2f-ae07-235313fb439c service nova] Creating event network-vif-deleted:a0b5bc3f-5ea6-46f4-8235-ce4d722d131b for instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a on n-h1-860863-4 Nov 02 21:26:41.003618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:41.008148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:41.008567 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-9258f4a9-fae9-44cd-b1b5-40afad5f4141 req-b407d28e-5d96-4e2f-ae07-235313fb439c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120917 Nov 02 21:26:41.008567 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 654/1389] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:41.029628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:41.042437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:41.043169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:41.044837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:41.047459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:41.048278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:41.069797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-788143a6-b14b-4e04-a15f-7a01c3aac462 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d2158b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:41.114230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:41.149917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:41.225258 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-788143a6-b14b-4e04-a15f-7a01c3aac462 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.162412 Nov 02 21:26:41.226701 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 655/1390] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:41 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:41.239443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:41.252759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:41.264245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:41.265917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:41.266642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:41.267583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:41.268239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:41.268922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:41.795642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:41.845463 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e188c79-0bde-493d-a261-07105213f354 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1927 microversion: 2.75 time: 0.842278 Nov 02 21:26:41.852667 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 736/1391] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:40 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1927 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:41.909921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:41.911927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:41.926244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:41.927033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:41.927649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:41.928768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:41.929414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:41.930269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:41.970300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:41.971490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:41.972159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:41.972798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lazy-loading 'fault' on Instance uuid 53aec4ef-fa22-47e6-ba86-c2b6c32a649a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:42.146842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:42.159163 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d8c7bd1e-1d2e-4dab-9d13-0d397ac9aea6 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 200 len: 1315 microversion: 2.1 time: 0.249954 Nov 02 21:26:42.163041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 737/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:41 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:42.187115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:42.187735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:42.200636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:42.205353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:42.207545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:42.209121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:42.216386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:42.216614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:42.346255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:42.370584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-17d351cd-55d9-4566-a83a-5478b5f9fc67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 1.133543 Nov 02 21:26:42.371175 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 656/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:41 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:42.386786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91ccf499-ee4e-43d4-90cd-804d14d338c7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68be9670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:42.469614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91ccf499-ee4e-43d4-90cd-804d14d338c7 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.097060 Nov 02 21:26:42.470868 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 657/1394] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:42 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:42.487922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8d6691f3-adcd-4d6e-8057-592f86afe5a7 req-f7b08bfa-8595-4c3a-965d-25a118d72edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff58a26b-5edd-41ab-96d0-d061ce223e8e", "tag": "58736955-93ab-4e70-ac30-4d7043597e6f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:42.503974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8d6691f3-adcd-4d6e-8057-592f86afe5a7 req-f7b08bfa-8595-4c3a-965d-25a118d72edb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:42.510252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8d6691f3-adcd-4d6e-8057-592f86afe5a7 req-f7b08bfa-8595-4c3a-965d-25a118d72edb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:42.511120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8d6691f3-adcd-4d6e-8057-592f86afe5a7 req-f7b08bfa-8595-4c3a-965d-25a118d72edb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:42.536895 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8d6691f3-adcd-4d6e-8057-592f86afe5a7 req-f7b08bfa-8595-4c3a-965d-25a118d72edb service nova] Creating event network-changed:58736955-93ab-4e70-ac30-4d7043597e6f for instance ff58a26b-5edd-41ab-96d0-d061ce223e8e on n-h1-860863-4 Nov 02 21:26:42.548860 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8d6691f3-adcd-4d6e-8057-592f86afe5a7 req-f7b08bfa-8595-4c3a-965d-25a118d72edb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076301 Nov 02 21:26:42.550743 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 658/1395] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:42.610561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:42.620486 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1549bf97-2218-4955-b409-4735db87372a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.453582 Nov 02 21:26:42.624583 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 738/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:42 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:42.881764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:42.882736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:42.891727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:42.897116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:42.897116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:42.897116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:42.897116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:42.897472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:43.036857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:43.094934 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-00939d16-d142-4fc6-99cd-602182a24f7b tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1945 microversion: 2.75 time: 0.219450 Nov 02 21:26:43.108729 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 659/1397] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:42 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1945 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:43.189897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:43.202604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:43.220366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:43.222287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:43.222743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:43.223472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:43.223937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:43.224370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:43.274147 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a HTTP/1.1 Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:26:43.283798 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:26:43.285189 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '53aec4ef-fa22-47e6-ba86-c2b6c32a649a'} Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:43.285932 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:26:43.287171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:43.290786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:43.293574 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32546bd0-69c0-4bb1-b4b4-00b66983a867 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 404 len: 111 microversion: 2.1 time: 0.108937 Nov 02 21:26:43.299847 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 739/1398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:43 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:26:43.396229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:43.397103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:43.406358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:43.407896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:43.408422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:43.412908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:43.413439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:43.413889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:43.488212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e8846e7-22fb-4cb8-a196-5769640825ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f68f70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:43.496133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:43.572054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:43.607317 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e8846e7-22fb-4cb8-a196-5769640825ce tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.123914 Nov 02 21:26:43.615258 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 740/1399] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:43 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:43.640496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1536632617", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:43.766958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] validate_networks() for [('322e1fd6-7639-465c-a6f3-6aaae3e95954', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:26:44.020979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:44.032997 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3e2b2e30-6e52-4bd5-8e6e-3696e29f867c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 0.641106 Nov 02 21:26:44.037666 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 660/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:43 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:44.078842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:44.082052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:44.099813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:44.104224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:44.104980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:44.106469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:44.107954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:44.112124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:44.771591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:44.828617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:44.837385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fd100def-369d-47a1-966a-921c54a0040f tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.797675 Nov 02 21:26:44.839853 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 661/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:44 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:44.843823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-013737b6-2168-40fe-a97c-c33b38df334a req-83d3385e-3efd-4aef-b42d-fd1cb5695d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9429781f-2367-4cec-bfdb-641db74cc989", "name": "network-vif-plugged", "status": "completed", "tag": "c5152ab2-61c4-418e-ba79-8965f88d0751"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:44.859872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-013737b6-2168-40fe-a97c-c33b38df334a req-83d3385e-3efd-4aef-b42d-fd1cb5695d9d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:44.860370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-013737b6-2168-40fe-a97c-c33b38df334a req-83d3385e-3efd-4aef-b42d-fd1cb5695d9d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:44.860833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-013737b6-2168-40fe-a97c-c33b38df334a req-83d3385e-3efd-4aef-b42d-fd1cb5695d9d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:44.875787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-013737b6-2168-40fe-a97c-c33b38df334a req-83d3385e-3efd-4aef-b42d-fd1cb5695d9d service nova] Creating event network-vif-plugged:c5152ab2-61c4-418e-ba79-8965f88d0751 for instance 9429781f-2367-4cec-bfdb-641db74cc989 on n-h2-860863-4 Nov 02 21:26:44.881135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:26:44.881712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:26:44.882004 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-013737b6-2168-40fe-a97c-c33b38df334a req-83d3385e-3efd-4aef-b42d-fd1cb5695d9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041389 Nov 02 21:26:44.882243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:26:44.882659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:26:44.883797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:26:44.884504 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 662/1402] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:44.890882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:44.891881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:44.894924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:44.895705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:44.896571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:44.899635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:44.903809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:44.903947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:44.904074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:44.904181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:44.904271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:44.904271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:44.904271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:44.906662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:44.965577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:26:44.988980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:45.004396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Getting quotas for user 044e9aa5874a48b490b83c184aa470cc and project 4277a3bfc9ea45aba77bbfc2ce35f5db. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:26:45.063485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:26:45.065920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:26:45.125251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:45.194870 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9ac4a83-a0eb-4f2d-942b-d73536255108 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1933 microversion: 2.75 time: 0.308894 Nov 02 21:26:45.195841 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 663/1403] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:44 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1933 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:45.209688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5761e1bf-c972-4ae7-bf8d-503518019569 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68bda790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:45.331001 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5761e1bf-c972-4ae7-bf8d-503518019569 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.133706 Nov 02 21:26:45.332270 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 664/1404] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:45 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:45.435741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-135fe221-1ec0-4b34-9633-3e56a1198e07 req-2f8c482c-6d5e-402c-8a45-1c5be841faa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eb4eff-540c-4650-a34a-9475fe1a96d2", "tag": "88166e6c-108a-4bcb-ac2e-e9ee554b7fa8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:45.449752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-135fe221-1ec0-4b34-9633-3e56a1198e07 req-2f8c482c-6d5e-402c-8a45-1c5be841faa0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:45.467108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-135fe221-1ec0-4b34-9633-3e56a1198e07 req-2f8c482c-6d5e-402c-8a45-1c5be841faa0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:45.467108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-135fe221-1ec0-4b34-9633-3e56a1198e07 req-2f8c482c-6d5e-402c-8a45-1c5be841faa0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:45.467108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-135fe221-1ec0-4b34-9633-3e56a1198e07 req-2f8c482c-6d5e-402c-8a45-1c5be841faa0 service nova] Creating event network-changed:88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 for instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 on n-h2-860863-4 Nov 02 21:26:45.470390 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-135fe221-1ec0-4b34-9633-3e56a1198e07 req-2f8c482c-6d5e-402c-8a45-1c5be841faa0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136614 Nov 02 21:26:45.471537 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 665/1405] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:45.477203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:45.478629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:45.485621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:45.486356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:45.487126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:45.488336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:45.488983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:45.489691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:45.595730 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-136365a6-af30-4977-b0e0-654b6ab984ce tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.978841 Nov 02 21:26:45.614522 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 741/1406] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:26:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:26:45.620582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0cb5cb7-1a2d-4feb-840f-2ecbf3ffd5ec tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:45.629078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0cb5cb7-1a2d-4feb-840f-2ecbf3ffd5ec tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:46.196816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f0cb5cb7-1a2d-4feb-840f-2ecbf3ffd5ec tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:46.204614 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0cb5cb7-1a2d-4feb-840f-2ecbf3ffd5ec tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1225 microversion: 2.1 time: 0.588318 Nov 02 21:26:46.205243 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 742/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:45 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1225 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:46.245127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:46.249395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:46.258256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.259220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.259919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.261154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.261835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.262476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.483846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:46.495841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-101ee2ed-5c80-477a-812c-72de4796aa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 1.022892 Nov 02 21:26:46.497048 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 666/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:45 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:46.502777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:46.503784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:46.511177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.511947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.513037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.514260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.514892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.515588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.676422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] Lazy-loading 'services' on Instance uuid 618c8ae4-504a-4f3d-942e-86ccad6be301 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:46.720099 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c3e4f59-e8fb-49b8-8e27-8826b6f8d6d9 tempest-ServersAdmin275Test-648683207 tempest-ServersAdmin275Test-648683207-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1918 microversion: 2.75 time: 0.221710 Nov 02 21:26:46.726004 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 667/1409] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:46 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1918 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:46.744436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f41eab9-a15f-4864-8f8f-a225c5518de3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68b55ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:46.782585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:46.812602 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f03af7bf-d2c0-4553-83be-4725f457fed7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.573888 Nov 02 21:26:46.816496 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 743/1410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:46 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:46.829362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f41eab9-a15f-4864-8f8f-a225c5518de3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.101959 Nov 02 21:26:46.836877 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 668/1411] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:46 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:46.840248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:46.842107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:46.843147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:46.844455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:46.857381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.858291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.858997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.862074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.863809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.864520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.865486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.866081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:46.871092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.871092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.871369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:46.871369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:46.901683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:26:47.146000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:47.155846 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f23d955-4703-4060-9f05-716c97f7a5be tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 2421 microversion: 2.25 time: 0.336479 Nov 02 21:26:47.156440 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 744/1412] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:46 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 2421 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:47.184516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": "auto"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:47.189070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:47.198869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.200027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.200839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:47.201797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.202436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.203051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:47.234086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'flavor' on Instance uuid 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:26:47.239778 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb7391cf-ff22-42f8-a1af-f9e2b56ad4c1 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "DELETE /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 204 len: 0 microversion: 2.75 time: 0.407637 Nov 02 21:26:47.240471 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 669/1413] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:26:46 2022] DELETE /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:26:47.252852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:47.253853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:47.260656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:47.262333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121040) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:26:47.273740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.274322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.274782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:47.275541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.276605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.277164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:47.373257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:47.386329 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85bbf0e2-656a-45bc-9be3-c2c074d37fb8 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1229 microversion: 2.1 time: 0.140021 Nov 02 21:26:47.387010 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 670/1414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:47 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1229 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:47.394893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:47.397471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:47.410929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.411868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.412462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:47.413619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.414121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.414775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:47.491993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:47.505011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:47.506484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:47.512094 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e1111d5-70db-4b54-bbf8-922775087141 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1443 microversion: 2.75 time: 0.123703 Nov 02 21:26:47.512703 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 671/1415] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:47 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1443 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:47.520486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:47.521144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:47.531752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.532247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.532715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:47.533439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:47.533918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:47.534352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:48.155088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:48.167201 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-453c0134-8339-4f6e-aea0-4e5cdcc4e009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 0.651145 Nov 02 21:26:48.169919 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 672/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:47 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:48.180998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:48.181713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:48.195997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:48.196590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:48.199286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:48.199286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:48.199286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:48.200239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:48.502821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:48.518511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c0287030-0aa5-4c08-bf27-f46589803f2d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.347282 Nov 02 21:26:48.519247 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 673/1417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:48 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:48.525785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9405019-4f60-4be8-ae1d-4d17664fdc88 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68b124c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:48.599204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9405019-4f60-4be8-ae1d-4d17664fdc88 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.078346 Nov 02 21:26:48.608513 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 674/1418] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:48 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:48.613928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:48.614863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:48.622358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:48.623168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:48.623686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:48.624747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:48.625299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:48.625969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:48.729319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:48.753421 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff883f85-28ba-4383-809b-25c5895a9598 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1277 microversion: 2.1 time: 0.143251 Nov 02 21:26:48.778439 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 675/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:48 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:48.785179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:48.786015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:48.799369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:48.800410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:48.801244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:48.802257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:48.803042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:48.804521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:48.943413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:48.960319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:48.967636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de1744ab32064ac183d7910dd73ea80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3943269757d42c0b1906f78b6a59b11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:48.979141 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8bcf2ff7-9a6b-4d8c-9daf-644a2d4b3150 tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 200 len: 1443 microversion: 2.75 time: 0.196403 Nov 02 21:26:48.981534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 676/1420] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:48 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 1443 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:49.196980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:49.198019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:49.206354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:49.206354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:49.207467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:49.207847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:49.208326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:49.208861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:49.610854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:49.620013 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5f519fb-ccdc-4dd4-8440-01eab3a3957c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 0.427657 Nov 02 21:26:49.651348 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 677/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:49 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:49.673949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:49.673949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:49.693803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:49.694305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:49.694743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:49.702664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:49.706400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:49.707319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:50.126649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:50.129083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:50.140704 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3c46f195-ff11-4fad-99f3-92e771e34b20 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.487106 Nov 02 21:26:50.142151 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 678/1422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:49 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:50.152770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62fc96d2-6cc2-44ca-8f66-eb02dccdea2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d1328b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:50.257258 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62fc96d2-6cc2-44ca-8f66-eb02dccdea2d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.111591 Nov 02 21:26:50.267176 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 679/1423] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:50 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:50.285194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:50.291913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:50.331669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:50.332212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:50.332665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:50.334839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:50.335374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:50.338332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:51.306748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:51.315953 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fdca8c4-7754-4f10-a74c-721e2f877926 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1325 microversion: 2.1 time: 1.046839 Nov 02 21:26:51.320092 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 680/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:50 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1325 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:51.332871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:51.338395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] [instance: 618c8ae4-504a-4f3d-942e-86ccad6be301] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:51.352421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:51.357285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:51.357285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:51.357285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:51.357285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:51.357645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:51.374348 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] HTTP exception thrown: Instance 618c8ae4-504a-4f3d-942e-86ccad6be301 could not be found. Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Request method failure captured: Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 HTTP/1.1 Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuA_hZYLvRXnNHk-lhERAwyOmBiT74V6bqmZ8zbAVAewk3exgcdaZDrl8yoRGLAZG5TQ_Sgp28dTf3bu8QPYSEKqVH6w6AHFa-gdl-Du5ZSOsUDnouxlK8Qp2HV77Q0AB0fDkHvSDxTgSO9pL83fzaYupjaisQUO8hNRx0ThipbMoYw Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.75 Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e3943269757d42c0b1906f78b6a59b11 Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdmin275Test-1581098465 Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:51.377513 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e3943269757d42c0b1906f78b6a59b11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3943269757d42c0b1906f78b6a59b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e3943269757d42c0b1906f78b6a59b11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e3943269757d42c0b1906f78b6a59b11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdmin275Test-1581098465 Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e3943269757d42c0b1906f78b6a59b11 Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdmin275Test-1581098465 Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdmin275Test-1581098465-project Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: de1744ab32064ac183d7910dd73ea80a Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdmin275Test-1581098465-project Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 618c8ae4-504a-4f3d-942e-86ccad6be301 could not be found. Nov 02 21:26:51.379033 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '618c8ae4-504a-4f3d-942e-86ccad6be301'} Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618c8ae4-504a-4f3d-942e-86ccad6be301 could not be found. Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:51.379844 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618c8ae4-504a-4f3d-942e-86ccad6be301 could not be found. Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618c8ae4-504a-4f3d-942e-86ccad6be301 could not be found. Nov 02 21:26:51.381989 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.391703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] Returning 404 to user: Instance 618c8ae4-504a-4f3d-942e-86ccad6be301 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:51.391703 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-74b8965d-b55c-4181-a423-5c93a892233b tempest-ServersAdmin275Test-1581098465 tempest-ServersAdmin275Test-1581098465-project] 10.222.0.25 "GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301" status: 404 len: 111 microversion: 2.75 time: 0.062703 Nov 02 21:26:51.392210 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 681/1425] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:51 2022] GET /compute/v2.1/servers/618c8ae4-504a-4f3d-942e-86ccad6be301 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:26:51.399104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:51.400042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:51.408762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:51.409543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:51.410221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:51.411142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:51.414317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:51.423573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:51.649197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:51.660760 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b6d4d4bb-543b-45f8-846e-9cdb19a6d94e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1502 microversion: 2.1 time: 0.267187 Nov 02 21:26:51.665114 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 682/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:51 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:51.892108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-65dc301a-af34-433e-ba0f-38f2842abeff tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Calling method '.version_select at 0x7f9b6d1fb820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:51.957708 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-65dc301a-af34-433e-ba0f-38f2842abeff tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] HTTP exception thrown: Image not found. Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-65dc301a-af34-433e-ba0f-38f2842abeff tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Request method failure captured: Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/images/937bfc25-016d-4ad4-a676-75f671ad8b5b/metadata/os_distro HTTP/1.1 Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCaUm2vNFYcwdY4TXxNv4HbHzKiZAUDcT7kKqtShHvIS3f0yy1YSe0WR9KgTwfgH34eTE6FHtuf4hzVxTA8Wd8dBvIwssJFpdEWo-tyrS552zB64gLX55lq0qqxFYf-dagUhsxkfpWr7l-FFOde2AKGrVIFtu6kFKkD8HGa8NmEDZQ Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:51.972063 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: c16d736a3b1c465cab9b691d215f2717 Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'image_id': '937bfc25-016d-4ad4-a676-75f671ad8b5b', 'id': 'os_distro'} Nov 02 21:26:51.978221 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:51.979643 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 937bfc25-016d-4ad4-a676-75f671ad8b5b Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:51.981010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 937bfc25-016d-4ad4-a676-75f671ad8b5b could not be found. Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:51.982528 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:51.983943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-65dc301a-af34-433e-ba0f-38f2842abeff tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:51.985843 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-65dc301a-af34-433e-ba0f-38f2842abeff tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] 10.222.0.25 "DELETE /compute/v2.1/images/937bfc25-016d-4ad4-a676-75f671ad8b5b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.309912 Nov 02 21:26:51.985843 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 683/1427] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 21:26:51 2022] DELETE /compute/v2.1/images/937bfc25-016d-4ad4-a676-75f671ad8b5b/metadata/os_distro => generated 62 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:52.002919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:52.012884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:52.013689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Searching by: {'deleted': False, 'project_id': '412f81b2166743e88ef1d054b59a1480'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:26:52.027251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.027741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.028174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.030720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.038915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.038915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.142630 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b542080-db00-4571-8dc3-8f8bd1e6ab86 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/action" status: 202 len: 0 microversion: 2.25 time: 4.963852 Nov 02 21:26:52.143945 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 745/1428] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:26:47 2022] POST /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/action => generated 0 bytes in 4966 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:26:52.151140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:52.152367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:52.170773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.170773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.170773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.172793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.177033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.177690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.192059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:26:52.328616 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c8584c7-7ec9-452f-b738-7f4ea7da7efc tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.346020 Nov 02 21:26:52.328616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 684/1429] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:26:51 2022] GET /compute/v2.1/servers => generated 339 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:52.333643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4bf6b067-c230-47ac-9b9d-8c73002f3c1d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68bdce50>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:52.415249 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4bf6b067-c230-47ac-9b9d-8c73002f3c1d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.086026 Nov 02 21:26:52.416989 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 685/1430] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:52 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:52.425212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-63c39c85-a38f-41b2-b263-45173223f4e2 req-6ee37830-bb5b-41bc-b079-c1efbd8c9d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eb4eff-540c-4650-a34a-9475fe1a96d2", "name": "network-vif-plugged", "status": "completed", "tag": "88166e6c-108a-4bcb-ac2e-e9ee554b7fa8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:52.436581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-63c39c85-a38f-41b2-b263-45173223f4e2 req-6ee37830-bb5b-41bc-b079-c1efbd8c9d06 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.437402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-63c39c85-a38f-41b2-b263-45173223f4e2 req-6ee37830-bb5b-41bc-b079-c1efbd8c9d06 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.438018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-63c39c85-a38f-41b2-b263-45173223f4e2 req-6ee37830-bb5b-41bc-b079-c1efbd8c9d06 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.452356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:52.473708 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0abd3625-a022-4d2a-975f-f0678c11c9c9 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.328386 Nov 02 21:26:52.474617 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 746/1431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:52 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:52.493759 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-63c39c85-a38f-41b2-b263-45173223f4e2 req-6ee37830-bb5b-41bc-b079-c1efbd8c9d06 service nova] Creating event network-vif-plugged:88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 for instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 on n-h2-860863-4 Nov 02 21:26:52.496614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-63c39c85-a38f-41b2-b263-45173223f4e2 req-6ee37830-bb5b-41bc-b079-c1efbd8c9d06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077897 Nov 02 21:26:52.501031 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 686/1432] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:52.507634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-656cd974-2a8b-4a80-b6e3-673bb3c6b7c7 req-6ff8c1f0-a05e-415c-bc92-bcd3156437ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdfc52a-a94a-4117-8952-f1d371f29c74", "tag": "f5e912ff-f742-4423-8e6d-32c9649b1164"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:52.518806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-656cd974-2a8b-4a80-b6e3-673bb3c6b7c7 req-6ff8c1f0-a05e-415c-bc92-bcd3156437ca service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.521430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-656cd974-2a8b-4a80-b6e3-673bb3c6b7c7 req-6ff8c1f0-a05e-415c-bc92-bcd3156437ca service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.523617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-656cd974-2a8b-4a80-b6e3-673bb3c6b7c7 req-6ff8c1f0-a05e-415c-bc92-bcd3156437ca service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.524942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e2d0647-0dd5-42b8-bb65-afe282685047 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Calling method '.version_select at 0x7f9b6d102dc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:52.539740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-656cd974-2a8b-4a80-b6e3-673bb3c6b7c7 req-6ff8c1f0-a05e-415c-bc92-bcd3156437ca service nova] Creating event network-changed:f5e912ff-f742-4423-8e6d-32c9649b1164 for instance ecdfc52a-a94a-4117-8952-f1d371f29c74 on n-h1-860863-4 Nov 02 21:26:52.549678 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-656cd974-2a8b-4a80-b6e3-673bb3c6b7c7 req-6ff8c1f0-a05e-415c-bc92-bcd3156437ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050612 Nov 02 21:26:52.549678 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 747/1433] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:52.556371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:52.559670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:52.564215 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1e2d0647-0dd5-42b8-bb65-afe282685047 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] HTTP exception thrown: Image not found. Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e2d0647-0dd5-42b8-bb65-afe282685047 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Request method failure captured: Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/images/3aec6561-ceb4-4e05-ac53-ceca1ffbd8c4/metadata/os_version HTTP/1.1 Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCaUm2vNFYcwdY4TXxNv4HbHzKiZAUDcT7kKqtShHvIS3f0yy1YSe0WR9KgTwfgH34eTE6FHtuf4hzVxTA8Wd8dBvIwssJFpdEWo-tyrS552zB64gLX55lq0qqxFYf-dagUhsxkfpWr7l-FFOde2AKGrVIFtu6kFKkD8HGa8NmEDZQ Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:52.566885 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: c16d736a3b1c465cab9b691d215f2717 Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'image_id': '3aec6561-ceb4-4e05-ac53-ceca1ffbd8c4', 'id': 'os_version'} Nov 02 21:26:52.569231 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:52.570263 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3aec6561-ceb4-4e05-ac53-ceca1ffbd8c4 Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:52.571592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3aec6561-ceb4-4e05-ac53-ceca1ffbd8c4 could not be found. Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:52.573034 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:26:52.574625 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:52.575862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.575862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.575862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.575862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.576230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.576230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.580773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e2d0647-0dd5-42b8-bb65-afe282685047 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:52.580773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e2d0647-0dd5-42b8-bb65-afe282685047 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] 10.222.0.25 "GET /compute/v2.1/images/3aec6561-ceb4-4e05-ac53-ceca1ffbd8c4/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.076826 Nov 02 21:26:52.580773 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 687/1434] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 21:26:52 2022] GET /compute/v2.1/images/3aec6561-ceb4-4e05-ac53-ceca1ffbd8c4/metadata/os_version => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:52.589548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:52.611785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:52.615302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Searching by: {'deleted': False, 'project_id': '412f81b2166743e88ef1d054b59a1480'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:26:52.626374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.627267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.627900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.630078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.630888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.631503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.773268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:26:52.891575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:52.934186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:52.935894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.937132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.938595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.944414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:52.953705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:52.959263 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4994f2e1-fe91-4f6d-a731-2022b013da08 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.411075 Nov 02 21:26:52.960493 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 748/1435] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:52 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:52.965813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:52.968170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:52.984523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.985394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.988380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:52.989379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:52.994082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:52.995128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.342590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47cad973-f163-45a4-9723-7cdc2e54d622 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.761833 Nov 02 21:26:53.357941 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 688/1436] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:26:52 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:53.373991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f47cbfb-0df3-487a-a8b4-68841f8225cc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Calling method '.version_select at 0x7f9b69b704c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.413541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:53.424444 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9f47cbfb-0df3-487a-a8b4-68841f8225cc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] HTTP exception thrown: Image not found. Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f47cbfb-0df3-487a-a8b4-68841f8225cc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Request method failure captured: Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/images/58aa9ef1-c8a7-4043-803d-77dd9fd27cb2/metadata HTTP/1.1 Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCaUm2vNFYcwdY4TXxNv4HbHzKiZAUDcT7kKqtShHvIS3f0yy1YSe0WR9KgTwfgH34eTE6FHtuf4hzVxTA8Wd8dBvIwssJFpdEWo-tyrS552zB64gLX55lq0qqxFYf-dagUhsxkfpWr7l-FFOde2AKGrVIFtu6kFKkD8HGa8NmEDZQ Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:53.428076 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: c16d736a3b1c465cab9b691d215f2717 Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'image_id': '58aa9ef1-c8a7-4043-803d-77dd9fd27cb2'} Nov 02 21:26:53.429748 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.431072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 58aa9ef1-c8a7-4043-803d-77dd9fd27cb2 Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.432229 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58aa9ef1-c8a7-4043-803d-77dd9fd27cb2 could not be found. Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:53.433660 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.435164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f47cbfb-0df3-487a-a8b4-68841f8225cc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:53.436354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92bcef18-306a-4d6c-a10a-7fcb8ebc8935 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1325 microversion: 2.1 time: 0.467020 Nov 02 21:26:53.436450 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f47cbfb-0df3-487a-a8b4-68841f8225cc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] 10.222.0.25 "GET /compute/v2.1/images/58aa9ef1-c8a7-4043-803d-77dd9fd27cb2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070640 Nov 02 21:26:53.436571 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 749/1437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:52 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:53.444440 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 689/1438] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/images/58aa9ef1-c8a7-4043-803d-77dd9fd27cb2/metadata => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:53.456648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.457844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:53.462621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c67843d3-9195-4027-98c4-bfc13acffc03 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.473916 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c67843d3-9195-4027-98c4-bfc13acffc03 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027058 Nov 02 21:26:53.647939 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 690/1439] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:53.650367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:53.650367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:53.650367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.650367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:53.650697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:53.650697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.650862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01969261-dda3-46a6-b633-cf1cf99577c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d102790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.650862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01969261-dda3-46a6-b633-cf1cf99577c8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.059186 Nov 02 21:26:53.650862 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 691/1440] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:53.650862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0009d3b4-7bf1-4a7f-a5c0-a6c2ef3d0279 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Action: 'update_all', calling method: .version_select at 0x7f9b68b55700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:53.650862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-0009d3b4-7bf1-4a7f-a5c0-a6c2ef3d0279 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] HTTP exception thrown: Image not found. Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0009d3b4-7bf1-4a7f-a5c0-a6c2ef3d0279 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Request method failure captured: Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/images/6daf71d1-c3ea-472b-82a7-5485223ab613/metadata HTTP/1.1 Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 57 Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCaUm2vNFYcwdY4TXxNv4HbHzKiZAUDcT7kKqtShHvIS3f0yy1YSe0WR9KgTwfgH34eTE6FHtuf4hzVxTA8Wd8dBvIwssJFpdEWo-tyrS552zB64gLX55lq0qqxFYf-dagUhsxkfpWr7l-FFOde2AKGrVIFtu6kFKkD8HGa8NmEDZQ Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:26:53.651287 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: c16d736a3b1c465cab9b691d215f2717 Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:26:53.652591 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'image_id': '6daf71d1-c3ea-472b-82a7-5485223ab613', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.654061 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6daf71d1-c3ea-472b-82a7-5485223ab613 Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.655321 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6daf71d1-c3ea-472b-82a7-5485223ab613 could not be found. Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:53.656547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:26:53.658413 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.668254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0009d3b4-7bf1-4a7f-a5c0-a6c2ef3d0279 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:53.668254 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0009d3b4-7bf1-4a7f-a5c0-a6c2ef3d0279 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] 10.222.0.25 "PUT /compute/v2.1/images/6daf71d1-c3ea-472b-82a7-5485223ab613/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033295 Nov 02 21:26:53.668254 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 692/1441] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:26:53 2022] PUT /compute/v2.1/images/6daf71d1-c3ea-472b-82a7-5485223ab613/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:53.668254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.668254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:53.668765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:53.668765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:53.668765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.669114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:53.669114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:53.669114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.669354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:53.669354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5055dd81-cf12-4148-86d5-a90cbae79ccd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1477 microversion: 2.1 time: 0.202291 Nov 02 21:26:53.669354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 750/1442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:53.677149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61f197bd-5abd-4e83-89b9-4050563f7276 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Action: 'update', calling method: .version_select at 0x7f9b68f0c4c0>, body: {"meta": {"os_distro": "alt"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:53.704116 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-61f197bd-5abd-4e83-89b9-4050563f7276 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] HTTP exception thrown: Image not found. Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61f197bd-5abd-4e83-89b9-4050563f7276 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Request method failure captured: Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/images/4ff08186-82e7-4379-851c-6d7d3256d124/metadata/os_distro HTTP/1.1 Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 30 Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCaUm2vNFYcwdY4TXxNv4HbHzKiZAUDcT7kKqtShHvIS3f0yy1YSe0WR9KgTwfgH34eTE6FHtuf4hzVxTA8Wd8dBvIwssJFpdEWo-tyrS552zB64gLX55lq0qqxFYf-dagUhsxkfpWr7l-FFOde2AKGrVIFtu6kFKkD8HGa8NmEDZQ Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:26:53.706726 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c16d736a3b1c465cab9b691d215f2717 Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: {"meta": {"os_distro": "alt"}} Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:26:53.708259 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'image_id': '4ff08186-82e7-4379-851c-6d7d3256d124', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.709254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4ff08186-82e7-4379-851c-6d7d3256d124 Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.710556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ff08186-82e7-4379-851c-6d7d3256d124 could not be found. Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:53.712977 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:26:53.714693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.716106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61f197bd-5abd-4e83-89b9-4050563f7276 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:53.716106 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61f197bd-5abd-4e83-89b9-4050563f7276 tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] 10.222.0.25 "PUT /compute/v2.1/images/4ff08186-82e7-4379-851c-6d7d3256d124/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.037497 Nov 02 21:26:53.716106 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 751/1443] 10.222.0.25 () {60 vars in 1310 bytes} [Wed Nov 2 21:26:53 2022] PUT /compute/v2.1/images/4ff08186-82e7-4379-851c-6d7d3256d124/metadata/os_distro => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:53.718542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eec78873-bd9e-4dd0-be95-7d15efe1efb3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '.version_select at 0x7f9b68fb1a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.723619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eec78873-bd9e-4dd0-be95-7d15efe1efb3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:53.724236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eec78873-bd9e-4dd0-be95-7d15efe1efb3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:53.724752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eec78873-bd9e-4dd0-be95-7d15efe1efb3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.735292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eec78873-bd9e-4dd0-be95-7d15efe1efb3 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1931 microversion: 2.1 time: 0.025190 Nov 02 21:26:53.735974 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 752/1444] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/os-migrations => generated 1931 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:53.740583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-435255b2-7131-4480-a606-3e812f8185dc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Action: 'create', calling method: .version_select at 0x7f9b68f0c4c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:53.748592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:53.757436 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e707fe28-f184-4c31-8d0e-7b5ca5733965 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1332 microversion: 2.1 time: 0.185754 Nov 02 21:26:53.758181 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 693/1445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1332 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:53.763072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.764299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:53.766180 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-435255b2-7131-4480-a606-3e812f8185dc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] HTTP exception thrown: Image not found. Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-435255b2-7131-4480-a606-3e812f8185dc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Request method failure captured: Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/images/a19165b4-ccc5-499f-946a-63f04a272a07/metadata HTTP/1.1 Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 57 Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCaUm2vNFYcwdY4TXxNv4HbHzKiZAUDcT7kKqtShHvIS3f0yy1YSe0WR9KgTwfgH34eTE6FHtuf4hzVxTA8Wd8dBvIwssJFpdEWo-tyrS552zB64gLX55lq0qqxFYf-dagUhsxkfpWr7l-FFOde2AKGrVIFtu6kFKkD8HGa8NmEDZQ Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:26:53.768265 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0bfc04d9f9a840b5869f3aa9cb2ccfcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0bfc04d9f9a840b5869f3aa9cb2ccfcf Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385 Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c16d736a3b1c465cab9b691d215f2717 Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1766580385-project Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:26:53.770010 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'image_id': 'a19165b4-ccc5-499f-946a-63f04a272a07', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.771104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a19165b4-ccc5-499f-946a-63f04a272a07 Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:26:53.772732 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a19165b4-ccc5-499f-946a-63f04a272a07 could not be found. Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:26:53.774857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:26:53.776739 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:26:53.779151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-435255b2-7131-4480-a606-3e812f8185dc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:26:53.779151 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-435255b2-7131-4480-a606-3e812f8185dc tempest-ImagesMetadataNegativeTestJSON-1766580385 tempest-ImagesMetadataNegativeTestJSON-1766580385-project] 10.222.0.25 "POST /compute/v2.1/images/a19165b4-ccc5-499f-946a-63f04a272a07/metadata" status: 404 len: 62 microversion: 2.1 time: 0.038983 Nov 02 21:26:53.779151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 753/1446] 10.222.0.25 () {60 vars in 1281 bytes} [Wed Nov 2 21:26:53 2022] POST /compute/v2.1/images/a19165b4-ccc5-499f-946a-63f04a272a07/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:26:53.779372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:53.779372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:53.779642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.780437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:53.783972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:53.784301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:53.936233 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24edf0b4-21b3-4279-b91c-8df564543df2 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1628 microversion: 2.1 time: 0.176579 Nov 02 21:26:53.936898 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 694/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1628 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:53.967483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1cd881a-d2e6-461d-89c6-1136c197c222 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Action: 'create', calling method: .version_select at 0x7f9b68fb1160>, body: {"keypair": {"name": "tempest-keypair-303034782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3pJe5wXsZJ126TxijO0PyDsSlY3DCx1N3Q7DOXYZubRGTGPeaN4ZjJExeKwI2sE2pX4mUpwKY5YUibUuq9EN+LkoxbJm35Vm75pFi3RdwT39O744NAFBq7fXd5TxIlXg=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:53.984008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f1cd881a-d2e6-461d-89c6-1136c197c222 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:26:53.987478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:53.987478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:53.990288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f1cd881a-d2e6-461d-89c6-1136c197c222 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for user 9f705bbaa94a4a7d8e5bba79214bb359 and project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:26:53.993728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.000331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.000331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.000331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.000331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.000788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.099841 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1cd881a-d2e6-461d-89c6-1136c197c222 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136057 Nov 02 21:26:54.107475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 754/1448] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:26:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:54.113898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:54.114418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:54.137079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.137712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.138171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.139567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.140165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.140613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.173898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:26:54.203433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:54.218256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:54.227866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:54.230341 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-501ed56e-4dcd-497e-bed3-549402f24c6a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.246540 Nov 02 21:26:54.250480 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 695/1449] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:53 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:26:54.472137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:54.472821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:54.479467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.479956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.480391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.481206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.481657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.482085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.616953 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d056c87-3712-415f-bed9-c22779ae8afd tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 204 len: 0 microversion: 2.1 time: 0.512447 Nov 02 21:26:54.617937 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 755/1450] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:26:54 2022] DELETE /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:26:54.641534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:54.642252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:54.694291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.697245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.699293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.701662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.703889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.704567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.719600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:54.730171 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e26f9559-91aa-4ad6-8e5a-cd6f6c1c74b2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1325 microversion: 2.1 time: 0.264273 Nov 02 21:26:54.731495 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 696/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:54 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:26:54.733054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:54.749901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61fad194-7014-415d-8de8-67ce1f20bdee tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d18f3a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:54.844612 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61fad194-7014-415d-8de8-67ce1f20bdee tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.111206 Nov 02 21:26:54.856283 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 697/1452] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:54 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:54.861438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:54.863765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:54.882404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.890813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.890813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.890813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:54.891172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:54.891172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:54.917182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:26:55.081002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:55.099347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d234fd6f-18ff-4277-82fe-dc8a897e9dff tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1715 microversion: 2.1 time: 0.472538 Nov 02 21:26:55.117185 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 756/1453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:54 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1715 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:55.231656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:55.243537 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-845d331e-fa2d-4256-8354-c3bba11a0ec1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1535 microversion: 2.1 time: 0.392227 Nov 02 21:26:55.254519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 698/1454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:54 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1535 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:55.265679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:55.266559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:55.274688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:55.275428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:55.276164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:55.276465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1372c74-300e-4c55-ad0d-34b146377476 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'create', calling method: .version_select at 0x7f9b6d18f280>, body: {"pool": "55f73d09-d8fc-4fe3-b407-bd8011dab919"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:55.277234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:55.278024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:55.278831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:55.813689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:55.832058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:55.835392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:55.839277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ecdda66-ab98-4a1c-bf99-ec80396e2871 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.578151 Nov 02 21:26:55.839887 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 757/1455] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:55 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:55.851822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:55.853674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:55.869347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:55.871873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:55.873457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:55.877153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:55.878666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:55.881835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:56.130962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:56.144834 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02334e7e-3bb5-4101-9c3d-490062aa566b tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1325 microversion: 2.1 time: 0.300844 Nov 02 21:26:56.147564 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 758/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:55 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:56.156909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-623d2fcf-ac0e-4c4b-9e23-9b1c9c2f3449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f274c0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:56.259146 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-623d2fcf-ac0e-4c4b-9e23-9b1c9c2f3449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.106380 Nov 02 21:26:56.259146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 759/1457] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:56 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:56.275039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:56.281935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:56.321830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:56.326005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:56.326672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:56.328433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:56.331076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:56.331775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:57.092959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:57.104963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e0a4db4-32ef-4257-8c6b-5a1aaa476052 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1715 microversion: 2.1 time: 0.837815 Nov 02 21:26:57.115459 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 760/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:56 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1715 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:57.144066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:57.148124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:57.158311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:57.158819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:57.159863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:57.160582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:57.161464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:57.162157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:57.618386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:57.636994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:57.638905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:57.640382 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f827cdc-bdb1-4a68-b300-bba95c46e112 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.523861 Nov 02 21:26:57.644607 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 761/1459] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:57 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:57.649952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:57.654876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:57.670634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:57.673195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:57.673947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:57.677895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:57.678847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:57.679487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:58.441475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:58.450790 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4bc3ab47-0200-47ad-a6a2-fe2e1c6bd99c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1325 microversion: 2.1 time: 0.804812 Nov 02 21:26:58.457595 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 762/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:57 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1325 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:58.465735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6bb1fd7d-ad80-413b-998c-afc0afa47ef2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68f6f790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:58.536533 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6bb1fd7d-ad80-413b-998c-afc0afa47ef2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.076827 Nov 02 21:26:58.542853 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 763/1461] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:26:58 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:58.565338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-47b32cb2-6faf-4a1d-834c-928023e94886 req-c0381a11-90a5-45ad-a9ce-715d309b41eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdfc52a-a94a-4117-8952-f1d371f29c74", "name": "network-vif-plugged", "status": "completed", "tag": "f5e912ff-f742-4423-8e6d-32c9649b1164"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:26:58.606378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-47b32cb2-6faf-4a1d-834c-928023e94886 req-c0381a11-90a5-45ad-a9ce-715d309b41eb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:58.607849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-47b32cb2-6faf-4a1d-834c-928023e94886 req-c0381a11-90a5-45ad-a9ce-715d309b41eb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:58.610044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-47b32cb2-6faf-4a1d-834c-928023e94886 req-c0381a11-90a5-45ad-a9ce-715d309b41eb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:58.643426 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-47b32cb2-6faf-4a1d-834c-928023e94886 req-c0381a11-90a5-45ad-a9ce-715d309b41eb service nova] Creating event network-vif-plugged:f5e912ff-f742-4423-8e6d-32c9649b1164 for instance ecdfc52a-a94a-4117-8952-f1d371f29c74 on n-h1-860863-4 Nov 02 21:26:58.653440 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-47b32cb2-6faf-4a1d-834c-928023e94886 req-c0381a11-90a5-45ad-a9ce-715d309b41eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109038 Nov 02 21:26:58.658783 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 764/1462] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:26:58.669111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:58.676119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:58.699538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:58.706790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:58.708431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:58.709458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:58.712922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:58.717266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:59.125290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:59.144577 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6915e69b-ee61-4d0b-8058-b9c40dcb3bc2 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1715 microversion: 2.1 time: 0.484172 Nov 02 21:26:59.149780 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 765/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:58 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1715 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:26:59.167454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:59.170234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:59.191981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:59.192791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:59.193624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:59.195000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:59.196283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:59.200571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:59.479015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:59.494318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:59.497064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:26:59.499424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ccaccb00-7056-40e1-956a-9679b1d1d026 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.348124 Nov 02 21:26:59.500685 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 766/1464] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:26:59 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:26:59.508686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:26:59.509845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:26:59.520380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:59.521289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:59.522092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:26:59.524142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:26:59.525035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:26:59.525744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:00.039991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:00.059735 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02dccfb2-5760-43cb-b028-16e3cc7179a2 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1325 microversion: 2.1 time: 0.556069 Nov 02 21:27:00.078907 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 767/1465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:26:59 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:00.085742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f8ff9ca-dae8-4de6-bb4b-dd0c378f0f2f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68ffd310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:00.127971 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1372c74-300e-4c55-ad0d-34b146377476 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.856916 Nov 02 21:27:00.132641 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 699/1466] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:26:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:27:00.174975 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f8ff9ca-dae8-4de6-bb4b-dd0c378f0f2f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1414 microversion: 2.1 time: 0.093767 Nov 02 21:27:00.178106 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 768/1467] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:00 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:00.193250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.216"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:00.199304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:00.211037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:00.212415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:00.213147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:00.214164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:00.214702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:00.215273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:00.295568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:27:00.301437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquired lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:27:00.343250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1917774398", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:00.454103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:01.528004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:01.529242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:01.529939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:01.530941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:01.531562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:01.558424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:01.559063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:01.559531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:01.560347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:01.560811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:01.561278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:01.633687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:01.653156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:01.687799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:01.689569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:01.873590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d62747e6-5d36-42bd-99f1-3317f019c938 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738100 Nov 02 21:27:01.875209 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 700/1468] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:27:01.889063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:01.891427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:01.905270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:01.906198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:01.907103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:01.908161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:01.908843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:01.913629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:01.973011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:01.973509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:01.974943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:01.975415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lazy-loading 'fault' on Instance uuid 3a54a68d-cfef-4a08-9628-57207d27e0c0 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:02.096901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97c20477bb14d26bac5781dea1b315a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412f81b2166743e88ef1d054b59a1480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:02.114556 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4851047d-b157-4e07-bad2-596022095645 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 200 len: 1367 microversion: 2.1 time: 0.222138 Nov 02 21:27:02.114556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 701/1469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:01 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:02.118775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:02.124731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:02.132022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:02.132518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:02.133505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:02.142600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:02.142600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:02.142600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:02.626902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:02.642163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:02.645723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:02.647733 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de41b4b0-7bb7-438d-a269-487988466bb5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.533415 Nov 02 21:27:02.650850 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 702/1470] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:02 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:02.740973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e38ce291-fb9f-4b17-8acc-ca84a744312c req-4af2717f-8f68-4ade-8f9c-a1131f964c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a54a68d-cfef-4a08-9628-57207d27e0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "9d139ba6-a917-4667-ba1e-2674f5cfac67"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:02.756683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e38ce291-fb9f-4b17-8acc-ca84a744312c req-4af2717f-8f68-4ade-8f9c-a1131f964c7c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:02.757441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e38ce291-fb9f-4b17-8acc-ca84a744312c req-4af2717f-8f68-4ade-8f9c-a1131f964c7c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:02.758195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e38ce291-fb9f-4b17-8acc-ca84a744312c req-4af2717f-8f68-4ade-8f9c-a1131f964c7c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:02.784031 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e38ce291-fb9f-4b17-8acc-ca84a744312c req-4af2717f-8f68-4ade-8f9c-a1131f964c7c service nova] Creating event network-vif-unplugged:9d139ba6-a917-4667-ba1e-2674f5cfac67 for instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 on n-h1-860863-4 Nov 02 21:27:02.796301 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e38ce291-fb9f-4b17-8acc-ca84a744312c req-4af2717f-8f68-4ade-8f9c-a1131f964c7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143833 Nov 02 21:27:02.798548 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 703/1471] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:02.910013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f5fede91-b2e3-46fa-9348-3e5dc97c1ffd req-5ac8e65f-399c-4968-be32-35cc567cd66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a54a68d-cfef-4a08-9628-57207d27e0c0", "name": "network-vif-deleted", "tag": "9d139ba6-a917-4667-ba1e-2674f5cfac67"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:02.920921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f5fede91-b2e3-46fa-9348-3e5dc97c1ffd req-5ac8e65f-399c-4968-be32-35cc567cd66d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:02.921423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f5fede91-b2e3-46fa-9348-3e5dc97c1ffd req-5ac8e65f-399c-4968-be32-35cc567cd66d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:02.922221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f5fede91-b2e3-46fa-9348-3e5dc97c1ffd req-5ac8e65f-399c-4968-be32-35cc567cd66d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:02.934339 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f5fede91-b2e3-46fa-9348-3e5dc97c1ffd req-5ac8e65f-399c-4968-be32-35cc567cd66d service nova] Creating event network-vif-deleted:9d139ba6-a917-4667-ba1e-2674f5cfac67 for instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 on n-h1-860863-4 Nov 02 21:27:02.939960 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f5fede91-b2e3-46fa-9348-3e5dc97c1ffd req-5ac8e65f-399c-4968-be32-35cc567cd66d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137051 Nov 02 21:27:02.941112 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 704/1472] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:02.947478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:02.948710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:02.956258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:02.957069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:02.957872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:02.958877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:02.959488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:02.960075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:03.299863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:03.313995 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7bdbafe9-5d02-4b90-8b4b-8cb318e10816 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1523 microversion: 2.1 time: 0.366652 Nov 02 21:27:03.313995 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 705/1473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:02 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:03.322988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-400a4f19-a123-477e-ace8-242c22d90086 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68b55670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:03.396092 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-400a4f19-a123-477e-ace8-242c22d90086 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1423 microversion: 2.1 time: 0.081097 Nov 02 21:27:03.396877 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 706/1474] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:03 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1423 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:03.402424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2023470983", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "f1a27830-c4e6-4f86-894e-5e8eaac191b0"}], "security_groups": [{"name": "tempest-securitygroup--588778779"}], "key_name": "tempest-keypair-303034782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:03.589387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] validate_networks() for [('f1a27830-c4e6-4f86-894e-5e8eaac191b0', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:03.715105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Building network info cache for instance {{(pid=121040) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:27:04.003938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:04.865140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:04.865652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:04.866115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:04.866595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:04.867634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:04.900332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:04.901162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:04.901837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:04.902785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:04.903678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:04.912549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:04.968244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:04.974591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for user 9f705bbaa94a4a7d8e5bba79214bb359 and project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:04.994451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:04.997141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:05.040986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Updating instance_info_cache with network_info: [{"id": "88166e6c-108a-4bcb-ac2e-e9ee554b7fa8", "address": "fa:16:3e:a4:34:08", "network": {"id": "a782d412-0278-4cfa-b529-a5327e1a62a9", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-896841958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "64b626934eea4654a4040b4432c1c6a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88166e6c-10", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121040) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:27:05.145072 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f901aa36-6fd7-454c-8cfb-9cdbaa63cd50 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.746840 Nov 02 21:27:05.146363 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 707/1475] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:27:05.151656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:05.152610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:05.160841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.161739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.162432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.163365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.164646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.165324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.170080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Releasing lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:27:05.171209 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-038190ee-1aa7-4945-8181-e133801648f7 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action" status: 202 len: 0 microversion: 2.1 time: 4.989322 Nov 02 21:27:05.172354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 769/1476] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:27:00 2022] POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action => generated 0 bytes in 4991 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:27:05.177597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:05.178421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] [instance: 3a54a68d-cfef-4a08-9628-57207d27e0c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:05.229493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.240227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.240227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.241116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.246477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.247219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.288081 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] HTTP exception thrown: Instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 could not be found. Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Request method failure captured: Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 HTTP/1.1 Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuBVZ8nbi1tbFw2LwY0lluXGxXy1UMPkMyQv1yi4oYQOvsylUV6YTvas7JaH7FvNygqW4PE5Th4rwhke_BrpvD776jZavXEeRNTmrtapgCmBzPJWoWR5x_qSDXkdw7EmmVkdK1MHyhF8t5tBsSsfdcJWXydCdz0FwW8r7s_OwI1Jym0 Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 412f81b2166743e88ef1d054b59a1480 Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestManualDisk-181673184 Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:05.290642 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_412f81b2166743e88ef1d054b59a1480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/412f81b2166743e88ef1d054b59a1480"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/412f81b2166743e88ef1d054b59a1480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/412f81b2166743e88ef1d054b59a1480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestManualDisk-181673184 Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 412f81b2166743e88ef1d054b59a1480 Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestManualDisk-181673184 Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestManualDisk-181673184-project Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c97c20477bb14d26bac5781dea1b315a Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestManualDisk-181673184-project Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 could not be found. Nov 02 21:27:05.292427 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3a54a68d-cfef-4a08-9628-57207d27e0c0'} Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 could not be found. Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:05.293439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 could not be found. Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 could not be found. Nov 02 21:27:05.295031 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:05.299852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Returning 404 to user: Instance 3a54a68d-cfef-4a08-9628-57207d27e0c0 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:05.303401 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ebc44b0-6b39-4a88-92aa-bd00ab3e9a9d tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0" status: 404 len: 111 microversion: 2.1 time: 0.129601 Nov 02 21:27:05.304188 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 770/1477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:05 2022] GET /compute/v2.1/servers/3a54a68d-cfef-4a08-9628-57207d27e0c0 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:05.315642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:05.318456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:05.318993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:05.326718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38288178-1a9a-4aac-8411-b1e40dbc8102 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1287 microversion: 2.1 time: 0.178770 Nov 02 21:27:05.327329 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 708/1478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:05 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:05.338067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-919e469b-61dd-4b0f-91ce-89f5b307a671 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d2fc8b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:05.342995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.346367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.346367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.346367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.346367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.346856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.421472 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-919e469b-61dd-4b0f-91ce-89f5b307a671 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 200 len: 1423 microversion: 2.1 time: 0.091963 Nov 02 21:27:05.431498 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 709/1479] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:05 2022] GET /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:05.435987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:27:05.444575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:05.445805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:05.463492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.464501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.465867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.466608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.467068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.467483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.484823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:05.708296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:05.732288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:05.734655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:05.735843 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf72c05f-b59c-455d-838e-8bf09082daf5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.303283 Nov 02 21:27:05.736483 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 710/1480] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:05 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:05.771629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ad2222d2-5903-4345-98fa-5de5d6453061 req-2f0497cb-873b-4301-a755-ea138618a402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11eb4eff-540c-4650-a34a-9475fe1a96d2", "tag": "88166e6c-108a-4bcb-ac2e-e9ee554b7fa8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:05.782151 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ed12ab0-e916-48d8-b906-3926ca73225d tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 204 len: 0 microversion: 2.1 time: 0.473911 Nov 02 21:27:05.782992 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 771/1481] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:05 2022] DELETE /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:27:05.789626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be0b47c4-c8e4-433c-b2e7-05947a6cc1e4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:05.790527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be0b47c4-c8e4-433c-b2e7-05947a6cc1e4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:05.797882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ad2222d2-5903-4345-98fa-5de5d6453061 req-2f0497cb-873b-4301-a755-ea138618a402 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:05.798594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ad2222d2-5903-4345-98fa-5de5d6453061 req-2f0497cb-873b-4301-a755-ea138618a402 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:05.798903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ad2222d2-5903-4345-98fa-5de5d6453061 req-2f0497cb-873b-4301-a755-ea138618a402 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:05.877217 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ad2222d2-5903-4345-98fa-5de5d6453061 req-2f0497cb-873b-4301-a755-ea138618a402 service nova] Creating event network-changed:88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 for instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 on n-h2-860863-4 Nov 02 21:27:05.891209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ad2222d2-5903-4345-98fa-5de5d6453061 req-2f0497cb-873b-4301-a755-ea138618a402 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140988 Nov 02 21:27:05.893744 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 711/1482] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:05.920258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-532dc418-48c4-49e2-86c0-f8c2df013cfd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'create', calling method: .version_select at 0x7f9b68bd4700>, body: {"pool": "55f73d09-d8fc-4fe3-b407-bd8011dab919"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:05.925829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be0b47c4-c8e4-433c-b2e7-05947a6cc1e4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:05.937178 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be0b47c4-c8e4-433c-b2e7-05947a6cc1e4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1234 microversion: 2.1 time: 0.152718 Nov 02 21:27:05.943715 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 772/1483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:05 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1234 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:05.949524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4a4012e-38d9-41f5-ae26-c52fda5bbd33 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] Calling method '.version_select at 0x7f9b68f68a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:06.055524 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4a4012e-38d9-41f5-ae26-c52fda5bbd33 tempest-ServersTestManualDisk-181673184 tempest-ServersTestManualDisk-181673184-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632708651" status: 202 len: 0 microversion: 2.1 time: 0.110185 Nov 02 21:27:06.056208 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 773/1484] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632708651 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:27:06.064558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1456631660", "imageRef": "3aa615a4-11e5-4c03-bbb4-4486ebd8640f", "flavorRef": "452", "networks": [{"uuid": "fbb32731-3286-4309-9c0c-b898bc17a336"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:06.206009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] validate_networks() for [('fbb32731-3286-4309-9c0c-b898bc17a336', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:08.317998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:08.318672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:08.319079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:08.320973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:08.321623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:08.341094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:08.341908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:08.342556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:08.343804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:08.347259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:08.347996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:08.384230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:08.402585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for user 9ab2a1f2b5b74571b08c97e9493d568d and project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:08.408620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:08.450736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:08.453219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3aa615a4-11e5-4c03-bbb4-4486ebd8640f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:08.646480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cabeb85e-305f-4921-b91a-f261e8f0bf3c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.585650 Nov 02 21:27:08.657680 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 774/1485] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:27:08.663599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:08.664786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:08.698839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:08.698839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:08.698839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:08.698839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:08.699235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:08.699235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:09.826580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '044e9aa5874a48b490b83c184aa470cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4277a3bfc9ea45aba77bbfc2ce35f5db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:09.836045 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6baaea0-a568-4183-9b8f-ebdc8ab5587f tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 200 len: 1529 microversion: 2.1 time: 1.177081 Nov 02 21:27:09.837348 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 775/1486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:08 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 1529 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:09.842403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:09.843178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:09.849289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:09.849946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:09.850632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:09.852175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:09.852922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:09.853550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:10.274205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:10.278584 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e73bf80-58e1-4546-b208-14f5e0703de4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1317 microversion: 2.1 time: 0.439957 Nov 02 21:27:10.279493 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 776/1487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:09 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:10.287557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:10.288346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:10.306035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:10.306035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:10.306035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:10.306035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:10.306521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:10.306521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:10.306521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:10.692442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:10.709590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:10.711964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:10.714278 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7da15522-4034-44af-95dd-31ba6129286c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.430556 Nov 02 21:27:10.715835 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 777/1488] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:10 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:10.720830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:10.723402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:10.741328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:10.741836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:10.742863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:10.743626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:10.744095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:10.744540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:10.897713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:10.912205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0db46250-b436-4d86-afea-a114f3551653 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1292 microversion: 2.1 time: 0.195024 Nov 02 21:27:10.913536 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 778/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:10 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1292 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:10.919529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-36d4ce8e-4078-4f4e-9c0c-70a0559410df req-bfaf4881-eb98-4900-97ec-173e920ea518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9429781f-2367-4cec-bfdb-641db74cc989", "name": "network-vif-unplugged", "status": "completed", "tag": "c5152ab2-61c4-418e-ba79-8965f88d0751"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:10.931206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-36d4ce8e-4078-4f4e-9c0c-70a0559410df req-bfaf4881-eb98-4900-97ec-173e920ea518 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:10.931994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-36d4ce8e-4078-4f4e-9c0c-70a0559410df req-bfaf4881-eb98-4900-97ec-173e920ea518 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:10.932607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-36d4ce8e-4078-4f4e-9c0c-70a0559410df req-bfaf4881-eb98-4900-97ec-173e920ea518 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:10.949936 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-36d4ce8e-4078-4f4e-9c0c-70a0559410df req-bfaf4881-eb98-4900-97ec-173e920ea518 service nova] Creating event network-vif-unplugged:c5152ab2-61c4-418e-ba79-8965f88d0751 for instance 9429781f-2367-4cec-bfdb-641db74cc989 on n-h2-860863-4 Nov 02 21:27:10.958760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-36d4ce8e-4078-4f4e-9c0c-70a0559410df req-bfaf4881-eb98-4900-97ec-173e920ea518 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041831 Nov 02 21:27:10.965326 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 779/1490] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:10.985996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:10.987450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:10.996727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:10.997275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:10.997706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:10.999280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.000969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.001434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.193288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:11.235593 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89c758a7-129e-4cb6-a93d-78703a8ddedf tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1260 microversion: 2.1 time: 0.266610 Nov 02 21:27:11.242304 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 780/1491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:10 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:11.273635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e6532c69-4693-41b7-a25f-a0e1bc2b36b4 req-9b0d33b4-4977-47dc-9ff7-841edfbe9642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdfc52a-a94a-4117-8952-f1d371f29c74", "name": "network-vif-deleted", "tag": "f5e912ff-f742-4423-8e6d-32c9649b1164"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:11.301056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e6532c69-4693-41b7-a25f-a0e1bc2b36b4 req-9b0d33b4-4977-47dc-9ff7-841edfbe9642 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.301611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e6532c69-4693-41b7-a25f-a0e1bc2b36b4 req-9b0d33b4-4977-47dc-9ff7-841edfbe9642 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.303993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e6532c69-4693-41b7-a25f-a0e1bc2b36b4 req-9b0d33b4-4977-47dc-9ff7-841edfbe9642 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.312291 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-532dc418-48c4-49e2-86c0-f8c2df013cfd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.415477 Nov 02 21:27:11.312965 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 712/1492] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:27:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:11.323552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:11.324317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: ecdfc52a-a94a-4117-8952-f1d371f29c74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:11.347258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.352109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.354899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.357161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.358146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.359894 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e6532c69-4693-41b7-a25f-a0e1bc2b36b4 req-9b0d33b4-4977-47dc-9ff7-841edfbe9642 service nova] Creating event network-vif-deleted:f5e912ff-f742-4423-8e6d-32c9649b1164 for instance ecdfc52a-a94a-4117-8952-f1d371f29c74 on n-h1-860863-4 Nov 02 21:27:11.362722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.378203 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e6532c69-4693-41b7-a25f-a0e1bc2b36b4 req-9b0d33b4-4977-47dc-9ff7-841edfbe9642 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122745 Nov 02 21:27:11.380295 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 781/1493] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:11.393063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:11.397361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:11.407419 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Instance ecdfc52a-a94a-4117-8952-f1d371f29c74 could not be found. Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 HTTP/1.1 Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:11.410055 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance ecdfc52a-a94a-4117-8952-f1d371f29c74 could not be found. Nov 02 21:27:11.411356 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'ecdfc52a-a94a-4117-8952-f1d371f29c74'} Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecdfc52a-a94a-4117-8952-f1d371f29c74 could not be found. Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:11.412256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecdfc52a-a94a-4117-8952-f1d371f29c74 could not be found. Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecdfc52a-a94a-4117-8952-f1d371f29c74 could not be found. Nov 02 21:27:11.413683 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:11.416262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Instance ecdfc52a-a94a-4117-8952-f1d371f29c74 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:11.416262 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03e6d114-a4f5-46aa-ab82-52772173926c tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74" status: 404 len: 111 microversion: 2.1 time: 0.096204 Nov 02 21:27:11.417400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.417967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.418181 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 713/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:11 2022] GET /compute/v2.1/servers/ecdfc52a-a94a-4117-8952-f1d371f29c74 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:11.421730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.422716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.423397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.424163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.432303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.79"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:11.435304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:11.442586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:11.448075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.448838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.449550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.451159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:11.451810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:11.452424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:11.487859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:27:11.488607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquired lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:27:12.274570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:12.286719 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e143c47e-0326-4dad-9efa-56bc430e589d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1317 microversion: 2.1 time: 0.904392 Nov 02 21:27:12.287388 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 782/1495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:11 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1317 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:12.307529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a2a6996-d6c3-447f-b13f-bc7c01871201 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '.version_select at 0x7f9b68f0cb80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:12.375978 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4a2a6996-d6c3-447f-b13f-bc7c01871201 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Image not found. Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a2a6996-d6c3-447f-b13f-bc7c01871201 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d HTTP/1.1 Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:12.378111 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '38ccf6a3-3c06-496e-862d-b6ffee8bdd6d'} Nov 02 21:27:12.379475 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 38ccf6a3-3c06-496e-862d-b6ffee8bdd6d to delete Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:12.380317 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 38ccf6a3-3c06-496e-862d-b6ffee8bdd6d could not be found. Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:12.387111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a2a6996-d6c3-447f-b13f-bc7c01871201 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:12.388878 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a2a6996-d6c3-447f-b13f-bc7c01871201 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d" status: 404 len: 62 microversion: 2.1 time: 0.080903 Nov 02 21:27:12.389846 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 783/1496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:12 2022] DELETE /compute/v2.1/images/38ccf6a3-3c06-496e-862d-b6ffee8bdd6d => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:27:12.453013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1747258816", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "950fac67-fb9b-4c75-bf57-bac6a1c664e1"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:12.512134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] validate_networks() for [('950fac67-fb9b-4c75-bf57-bac6a1c664e1', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:13.262713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919.", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:27:13.262713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Releasing lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:27:13.262713 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919. Nov 02 21:27:13.262713 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-af192eb1-c503-4f7d-a026-d2563d5f1e24'] Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Request method failure captured: Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action HTTP/1.1 Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 45 Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCI8YmDQtZNzW2HhGccq4yRSqPdcYbg5jF_LLxIPs7WYJ3STbAby7ZGVVYh_or6jdhMNtJz-I331507Mxw6wNHBHQiBoUx9-4D6bESg21BFyWH1XPStGxvtXTHJNOFqWQFvCWTBc8RUtRY-5BNbFVUHtt5u4G6Zl65yAYPduMnV1ms Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:13.263503 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8b5f877966204f2db585b04b8afee9e1 Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: {"addFloatingIp": {"address": "172.25.1.79"}} Nov 02 21:27:13.264819 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919. Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-af192eb1-c503-4f7d-a026-d2563d5f1e24'] Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '11eb4eff-540c-4650-a34a-9475fe1a96d2', 'body': {'addFloatingIp': {'address': '172.25.1.79'}}} Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:27:13.265642 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:27:13.269592 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919. Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af192eb1-c503-4f7d-a026-d2563d5f1e24'] Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919. Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af192eb1-c503-4f7d-a026-d2563d5f1e24'] Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:13.270880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919. Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af192eb1-c503-4f7d-a026-d2563d5f1e24'] Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:13.272497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919. Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af192eb1-c503-4f7d-a026-d2563d5f1e24'] Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Returning 400 to user: Cannot associate floating IP 172.25.1.79 (a3b0d1a0-a460-4796-b2a4-41398a3aac4c) with port 88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 55f73d09-d8fc-4fe3-b407-bd8011dab919. Nov 02 21:27:13.274044 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-af192eb1-c503-4f7d-a026-d2563d5f1e24'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:13.274887 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e654c480-2869-459b-aea1-e791f09868b8 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action" status: 400 len: 380 microversion: 2.1 time: 1.845510 Nov 02 21:27:13.274887 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 714/1497] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:27:11 2022] POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action => generated 380 bytes in 1851 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:27:13.288835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:13.290289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:13.298291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:13.298784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:13.299213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:13.300135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:13.300745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:13.301612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:14.331211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:14.349663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:14.355993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:14.360227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9f2ca4d-f06a-4d8f-b73b-5dd8efe28d0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 1.089266 Nov 02 21:27:14.360971 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 715/1498] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:13 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:14.371387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:14.381831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:14.396368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:14.400191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:14.400958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:14.402042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:14.402974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:14.404780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:14.682729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:14.682729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:14.682729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:14.682729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:14.682729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:14.766586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:14.770915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:14.774139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:14.776276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:14.780330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:14.781715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:14.878654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Getting quotas for project c036e48d06bf49d9b9caae92d5444e43. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:14.889424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Getting quotas for user 9a636b6e37a049b08cef243d52a600c7 and project c036e48d06bf49d9b9caae92d5444e43. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:14.915745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:14.933754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:14.951835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:14.984001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=14 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:15.139421 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f87bb984-ffe6-4a9d-8f14-fd8c5ee59b4e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.754750 Nov 02 21:27:15.146259 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 784/1499] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:27:15.153634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:15.155041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:15.162937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:15.163432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:15.164127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:15.165213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:15.165668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:15.166278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:15.260093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:15.269772 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3e5c27d-706f-4e0c-b560-40443fc506fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1359 microversion: 2.1 time: 0.906409 Nov 02 21:27:15.270589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 716/1500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:14 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1359 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:15.276898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:15.278033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:15.284556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:15.285307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:15.286238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:15.287114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:15.287794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:15.288392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:15.325438 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a HTTP/1.1 Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:15.327967 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:15.329700 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '53aec4ef-fa22-47e6-ba86-c2b6c32a649a'} Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:15.330663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:15.332665 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:15.335037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:15.336907 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e0c33d35-69d5-4a1e-a51c-f08616fc8b65 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 404 len: 111 microversion: 2.1 time: 0.065008 Nov 02 21:27:15.345678 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 717/1501] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:15 2022] DELETE /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:15.350716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81047d34-b250-4616-85cf-32b438ae574d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '.version_select at 0x7f9b6d285550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:15.378748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:15.389726 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0e2538a-adc4-4a1a-bbcc-f167be592ec0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1266 microversion: 2.1 time: 0.247566 Nov 02 21:27:15.390857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 785/1502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:15 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:15.396815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:15.406255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:15.422625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:15.423102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:15.423571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:15.424274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:15.424725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:15.425341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:15.930324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:15.948567 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-136f9e08-7996-4a2e-8ea8-c2e78627853e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1317 microversion: 2.1 time: 0.556230 Nov 02 21:27:15.949673 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 786/1503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:15 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:15.963286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6a23b842-aea8-49d8-8580-0ff5e9b03da8 req-f41a08b5-a2d2-40ca-9b55-2e5191a21ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e28f9f5-f825-43fe-9a55-c3f78710a2d4", "tag": "0ea99f46-5715-446d-b6e9-95445fbfd48f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:15.997516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6a23b842-aea8-49d8-8580-0ff5e9b03da8 req-f41a08b5-a2d2-40ca-9b55-2e5191a21ed7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:15.999120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6a23b842-aea8-49d8-8580-0ff5e9b03da8 req-f41a08b5-a2d2-40ca-9b55-2e5191a21ed7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:16.000148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6a23b842-aea8-49d8-8580-0ff5e9b03da8 req-f41a08b5-a2d2-40ca-9b55-2e5191a21ed7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:16.023816 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6a23b842-aea8-49d8-8580-0ff5e9b03da8 req-f41a08b5-a2d2-40ca-9b55-2e5191a21ed7 service nova] Creating event network-changed:0ea99f46-5715-446d-b6e9-95445fbfd48f for instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 on n-h1-860863-4 Nov 02 21:27:16.030677 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6a23b842-aea8-49d8-8580-0ff5e9b03da8 req-f41a08b5-a2d2-40ca-9b55-2e5191a21ed7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079237 Nov 02 21:27:16.031920 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 787/1504] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:16.039330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d69f5885-6ff9-4762-9b4f-6ae899f2b9ad tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:16.040765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d69f5885-6ff9-4762-9b4f-6ae899f2b9ad tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:16.190748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d69f5885-6ff9-4762-9b4f-6ae899f2b9ad tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:16.201132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d69f5885-6ff9-4762-9b4f-6ae899f2b9ad tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1216 microversion: 2.1 time: 0.167611 Nov 02 21:27:16.202427 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 788/1505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:16 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:16.228961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:16.232449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 53aec4ef-fa22-47e6-ba86-c2b6c32a649a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:16.250098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:16.255425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:16.256170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:16.257138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:16.258137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:16.258816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:16.292888 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a HTTP/1.1 Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:16.294861 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:16.296256 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '53aec4ef-fa22-47e6-ba86-c2b6c32a649a'} Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:16.297067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. Nov 02 21:27:16.298424 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:16.301122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Instance 53aec4ef-fa22-47e6-ba86-c2b6c32a649a could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:16.302311 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d234a199-7c30-4b1f-916f-7032a9a3d726 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a" status: 404 len: 111 microversion: 2.1 time: 0.083876 Nov 02 21:27:16.309537 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 789/1506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:16 2022] GET /compute/v2.1/servers/53aec4ef-fa22-47e6-ba86-c2b6c32a649a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:16.324357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:16.325279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:16.343877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:16.344601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:16.345282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:16.348818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:16.351006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:16.355846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:17.342653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:17.361644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:17.365920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:17.368628 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce78b3ba-111b-4cf9-9c3a-2c5c06ee4dc9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 1.055217 Nov 02 21:27:17.370246 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 790/1507] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:16 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:17.381664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-83bf89bf-68b2-442e-bf83-5b5a0c6b3f67 req-bfc3d9b8-4563-4759-b583-bee0f5d84681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e28f9f5-f825-43fe-9a55-c3f78710a2d4", "name": "network-vif-plugged", "status": "completed", "tag": "0ea99f46-5715-446d-b6e9-95445fbfd48f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:17.406064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83bf89bf-68b2-442e-bf83-5b5a0c6b3f67 req-bfc3d9b8-4563-4759-b583-bee0f5d84681 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:17.407639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83bf89bf-68b2-442e-bf83-5b5a0c6b3f67 req-bfc3d9b8-4563-4759-b583-bee0f5d84681 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:17.421533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83bf89bf-68b2-442e-bf83-5b5a0c6b3f67 req-bfc3d9b8-4563-4759-b583-bee0f5d84681 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:17.426374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-83bf89bf-68b2-442e-bf83-5b5a0c6b3f67 req-bfc3d9b8-4563-4759-b583-bee0f5d84681 service nova] Creating event network-vif-plugged:0ea99f46-5715-446d-b6e9-95445fbfd48f for instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 on n-h1-860863-4 Nov 02 21:27:17.434119 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-83bf89bf-68b2-442e-bf83-5b5a0c6b3f67 req-bfc3d9b8-4563-4759-b583-bee0f5d84681 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061212 Nov 02 21:27:17.437783 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 791/1508] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:17.450419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:17.455742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:17.471989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:17.472706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:17.473347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:17.474878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:17.475520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:17.477033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:18.291316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:18.300716 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1034133-2ff5-4159-9ed0-cde3d3181a17 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1359 microversion: 2.1 time: 0.861397 Nov 02 21:27:18.320963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 792/1509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:17 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1359 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:18.328342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74d48084-0e7f-4146-b037-411e9bbb4f78 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '.version_select at 0x7f9b68f0c700>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:18.438735 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74d48084-0e7f-4146-b037-411e9bbb4f78 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570246535" status: 202 len: 0 microversion: 2.1 time: 0.129636 Nov 02 21:27:18.440316 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 793/1510] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570246535 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:27:18.469308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:18.472985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:18.509661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:18.509661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:18.511381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:18.513831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:18.516476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:18.521453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:18.951782 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81047d34-b250-4616-85cf-32b438ae574d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/a3b0d1a0-a460-4796-b2a4-41398a3aac4c" status: 202 len: 0 microversion: 2.1 time: 3.604838 Nov 02 21:27:18.952370 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 718/1511] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:27:15 2022] DELETE /compute/v2.1/os-floating-ips/a3b0d1a0-a460-4796-b2a4-41398a3aac4c => generated 0 bytes in 3606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:27:18.958529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:18.959852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:18.987632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:18.992891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:18.996749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:18.998849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:19.000468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:19.001160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:19.051001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:19.060675 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f3fa62f-cdd4-490f-8df3-86cb71956e45 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 0.612884 Nov 02 21:27:19.065264 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 794/1512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:18 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:19.087045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:19.092885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:19.104120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:19.105554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:19.113060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:19.114212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:19.114932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:19.116139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:19.495514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:19.511445 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a121efe-4273-4355-a8cf-03b03fd87e6e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1274 microversion: 2.1 time: 0.442724 Nov 02 21:27:19.513393 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 795/1513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:19 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1274 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:19.534440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-906481c1-12ed-488c-ad36-88a27b5eae8e req-5a98e407-f122-44e0-8ae6-cd3db39b6761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e33e1d-76d6-4011-8810-dec200b78844", "tag": "86827113-650e-49b8-abdc-ca4ae487e196"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:19.556040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-906481c1-12ed-488c-ad36-88a27b5eae8e req-5a98e407-f122-44e0-8ae6-cd3db39b6761 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:19.561561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-906481c1-12ed-488c-ad36-88a27b5eae8e req-5a98e407-f122-44e0-8ae6-cd3db39b6761 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:19.566386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-906481c1-12ed-488c-ad36-88a27b5eae8e req-5a98e407-f122-44e0-8ae6-cd3db39b6761 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:19.613441 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-906481c1-12ed-488c-ad36-88a27b5eae8e req-5a98e407-f122-44e0-8ae6-cd3db39b6761 service nova] Creating event network-changed:86827113-650e-49b8-abdc-ca4ae487e196 for instance 07e33e1d-76d6-4011-8810-dec200b78844 on n-h1-860863-4 Nov 02 21:27:19.620381 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-906481c1-12ed-488c-ad36-88a27b5eae8e req-5a98e407-f122-44e0-8ae6-cd3db39b6761 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105352 Nov 02 21:27:19.621530 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 796/1514] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:19.627370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:19.630629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:19.648615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:19.649846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:19.650217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:19.651290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:19.652185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:19.666338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:20.135455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:20.172270 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-508613f7-825d-4273-b457-98fd9c864c39 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1317 microversion: 2.1 time: 1.218612 Nov 02 21:27:20.173405 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 719/1515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:18 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1317 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:20.181102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.216"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:20.650275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:20.670890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:20.672361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:20.673590 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1aee0756-8b31-40e2-89ca-4423be0a1dd4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 1.050730 Nov 02 21:27:20.685111 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 797/1516] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:19 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:20.692702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:20.704546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:20.734570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:20.735393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:20.735984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:20.737839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:20.738461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:20.739046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:21.031107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:21.043268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:21.047712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:21.048400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:21.049586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:21.051890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:21.057724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:21.434057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:21.444747 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d7cbcf3-a342-4d0d-86ac-abafe681b51d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1359 microversion: 2.1 time: 0.758065 Nov 02 21:27:21.447256 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 798/1517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:20 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1359 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:21.479635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:21.482085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:21.495243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:21.496144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:21.496907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:21.499778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:21.500600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:21.501479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:21.871370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:27:21.872448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquired lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:27:22.137738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:22.157918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d484432-3d6b-4635-8975-d12526315210 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 0.708549 Nov 02 21:27:22.159039 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 799/1518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:21 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:22.165336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:22.177323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:22.201925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:22.202703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:22.203185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:22.204215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:22.206844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:22.207725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:22.760138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:22.769636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51b05b40-c5c1-4c86-aece-54437aecd2f4 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1316 microversion: 2.1 time: 0.608492 Nov 02 21:27:22.791914 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 800/1519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:22 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:22.797014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:22.797859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:22.811389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:22.812206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:22.812941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:22.813844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:22.814536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:22.815144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:22.864880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:23.819831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:23.834935 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3e89acf-bc38-42f2-8d17-f259cc05ad62 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1467 microversion: 2.1 time: 1.041605 Nov 02 21:27:23.841180 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 801/1520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:22 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1467 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:23.869207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2469a0d6-9089-4a61-bfe7-65e4a36263ca req-d1abbac7-ec22-4593-a8b6-e7e04323d0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec0e4c5-b974-4e97-b40d-8b54b4d85558", "name": "network-vif-unplugged", "status": "completed", "tag": "b985a751-243c-45ff-878a-a684e938c842"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:23.899707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2469a0d6-9089-4a61-bfe7-65e4a36263ca req-d1abbac7-ec22-4593-a8b6-e7e04323d0b2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:23.901736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2469a0d6-9089-4a61-bfe7-65e4a36263ca req-d1abbac7-ec22-4593-a8b6-e7e04323d0b2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:23.901736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2469a0d6-9089-4a61-bfe7-65e4a36263ca req-d1abbac7-ec22-4593-a8b6-e7e04323d0b2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:23.955731 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2469a0d6-9089-4a61-bfe7-65e4a36263ca req-d1abbac7-ec22-4593-a8b6-e7e04323d0b2 service nova] Creating event network-vif-unplugged:b985a751-243c-45ff-878a-a684e938c842 for instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 on n-h1-860863-4 Nov 02 21:27:23.990347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2469a0d6-9089-4a61-bfe7-65e4a36263ca req-d1abbac7-ec22-4593-a8b6-e7e04323d0b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147416 Nov 02 21:27:24.000320 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 802/1521] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:24.030324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:24.034508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:24.052901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:24.069495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:24.071307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:24.072119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:24.072560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:24.073017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:24.509142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Building network info cache for instance {{(pid=121039) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:27:24.633938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:24.660019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:24.669963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:24.671228 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c7ad0c3-7e70-4aa0-86df-ef67c9d2a017 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.666958 Nov 02 21:27:24.677212 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 803/1522] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:24 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:24.696418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:24.698485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:24.722775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:24.729925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:24.730756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:24.731833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:24.732528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:24.733211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:24.841538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:25.189368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:25.198740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b42d3af-3546-44ba-9e9f-3b988aab1ad8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1359 microversion: 2.1 time: 0.519903 Nov 02 21:27:25.199925 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 804/1523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:24 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1359 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:25.204636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a20cb70-e5ff-41ac-8b22-b899ebae8013 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '.version_select at 0x7f9b68fb1a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:25.254850 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-0a20cb70-e5ff-41ac-8b22-b899ebae8013 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Image not found. Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a20cb70-e5ff-41ac-8b22-b899ebae8013 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/images/b65c1812-af9b-4ab8-9e1f-04099bbbab4a HTTP/1.1 Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:25.263191 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'b65c1812-af9b-4ab8-9e1f-04099bbbab4a'} Nov 02 21:27:25.265044 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b65c1812-af9b-4ab8-9e1f-04099bbbab4a to delete Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:25.266098 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b65c1812-af9b-4ab8-9e1f-04099bbbab4a could not be found. Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:25.267625 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a20cb70-e5ff-41ac-8b22-b899ebae8013 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:25.274728 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a20cb70-e5ff-41ac-8b22-b899ebae8013 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/images/b65c1812-af9b-4ab8-9e1f-04099bbbab4a" status: 404 len: 62 microversion: 2.1 time: 0.071502 Nov 02 21:27:25.279880 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 805/1524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:25 2022] DELETE /compute/v2.1/images/b65c1812-af9b-4ab8-9e1f-04099bbbab4a => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:27:25.294437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:25.297799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:25.316568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:25.319651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:25.326545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:25.326545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:25.326545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:25.326545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:25.959817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:25.971249 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b98814ee-4716-4b3d-ac57-3a1c37896ff3 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 0.689509 Nov 02 21:27:25.971925 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 806/1525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:25 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:25.977772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:25.999969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:26.028665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.030284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.031101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.033531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.034197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.037513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.101877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Updating instance_info_cache with network_info: [{"id": "88166e6c-108a-4bcb-ac2e-e9ee554b7fa8", "address": "fa:16:3e:a4:34:08", "network": {"id": "a782d412-0278-4cfa-b529-a5327e1a62a9", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-896841958-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "64b626934eea4654a4040b4432c1c6a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88166e6c-10", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:27:26.196774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:26.243339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:26.250013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Releasing lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:27:26.250951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b718200-38de-42ea-8fe9-ccb1d966c2d1 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action" status: 202 len: 0 microversion: 2.1 time: 6.075175 Nov 02 21:27:26.251639 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 720/1526] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:27:20 2022] POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action => generated 0 bytes in 6077 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:27:26.276480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-729bcdc5-ed7f-42ec-84e0-ebea18c637aa tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1316 microversion: 2.1 time: 0.302368 Nov 02 21:27:26.277153 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 807/1527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:25 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:26.301741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-838c38c1-b46b-405e-b714-9cbb1f0c2ec5 req-f5cb29b8-fca8-4a90-8453-ee25df90be1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e33e1d-76d6-4011-8810-dec200b78844", "name": "network-vif-plugged", "status": "completed", "tag": "86827113-650e-49b8-abdc-ca4ae487e196"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:26.315997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-838c38c1-b46b-405e-b714-9cbb1f0c2ec5 req-f5cb29b8-fca8-4a90-8453-ee25df90be1e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.316708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-838c38c1-b46b-405e-b714-9cbb1f0c2ec5 req-f5cb29b8-fca8-4a90-8453-ee25df90be1e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.317381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-838c38c1-b46b-405e-b714-9cbb1f0c2ec5 req-f5cb29b8-fca8-4a90-8453-ee25df90be1e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.334106 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-838c38c1-b46b-405e-b714-9cbb1f0c2ec5 req-f5cb29b8-fca8-4a90-8453-ee25df90be1e service nova] Creating event network-vif-plugged:86827113-650e-49b8-abdc-ca4ae487e196 for instance 07e33e1d-76d6-4011-8810-dec200b78844 on n-h1-860863-4 Nov 02 21:27:26.342583 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-838c38c1-b46b-405e-b714-9cbb1f0c2ec5 req-f5cb29b8-fca8-4a90-8453-ee25df90be1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045490 Nov 02 21:27:26.343791 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 808/1528] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:26.354491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:26.356403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:26.365910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.367262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.368631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.370307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.370946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.372806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.392329 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 HTTP/1.1 Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:26.395033 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:26.396857 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '88c23781-8473-464f-8e15-febb6b169596'} Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:26.397792 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:26.400887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:26.403317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:26.404644 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04b1405d-b578-4b55-907d-2480cf5f50d1 tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 404 len: 111 microversion: 2.1 time: 0.059053 Nov 02 21:27:26.405379 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 809/1529] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:26 2022] DELETE /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:26.410371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c22ef109-09c0-4321-b61e-86923d045fd2 req-47328d1b-b08f-4eec-8b57-5f30dd843f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75af098-63dd-4436-a808-953b2506c6f2", "tag": "f2ae7b87-e013-4212-b8cb-2d4d457ec78d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:26.423079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c22ef109-09c0-4321-b61e-86923d045fd2 req-47328d1b-b08f-4eec-8b57-5f30dd843f7c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.423866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c22ef109-09c0-4321-b61e-86923d045fd2 req-47328d1b-b08f-4eec-8b57-5f30dd843f7c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.424306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c22ef109-09c0-4321-b61e-86923d045fd2 req-47328d1b-b08f-4eec-8b57-5f30dd843f7c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.437072 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c22ef109-09c0-4321-b61e-86923d045fd2 req-47328d1b-b08f-4eec-8b57-5f30dd843f7c service nova] Creating event network-changed:f2ae7b87-e013-4212-b8cb-2d4d457ec78d for instance e75af098-63dd-4436-a808-953b2506c6f2 on n-h1-860863-4 Nov 02 21:27:26.442581 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c22ef109-09c0-4321-b61e-86923d045fd2 req-47328d1b-b08f-4eec-8b57-5f30dd843f7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035319 Nov 02 21:27:26.444142 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 810/1530] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:26.454348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:26.454348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:26.459590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.460088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.462092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.463044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.464644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.465178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.527214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:26.529848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:26.534312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.534807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.535250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.535958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.536446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.536878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.678959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:26.687745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:26.689707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:26.690915 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4e47a57c-b1c2-41f7-aa99-5504eb6be131 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.245485 Nov 02 21:27:26.705424 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 811/1531] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:26 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:26.711901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac46b6c1-84c9-4683-8427-f25b342dad4d", "tag": "efb62441-959e-49e6-ad00-59acd1131995"}, {"name": "network-changed", "server_uuid": "9ec0e4c5-b974-4e97-b40d-8b54b4d85558", "tag": "b985a751-243c-45ff-878a-a684e938c842"}, {"name": "network-changed", "server_uuid": "11eb4eff-540c-4650-a34a-9475fe1a96d2", "tag": "88166e6c-108a-4bcb-ac2e-e9ee554b7fa8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:26.723007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.723480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.723971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.738595 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] Creating event network-changed:efb62441-959e-49e6-ad00-59acd1131995 for instance ac46b6c1-84c9-4683-8427-f25b342dad4d on n-h2-860863-4 Nov 02 21:27:26.739098 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] Creating event network-changed:b985a751-243c-45ff-878a-a684e938c842 for instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 on n-h1-860863-4 Nov 02 21:27:26.739590 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] Creating event network-changed:88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 for instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 on n-h2-860863-4 Nov 02 21:27:26.751133 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8143f426-441a-4cce-b8e3-a82ad5a51d71 req-a10071ef-a88c-47f0-94bb-14a3c6923777 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.044146 Nov 02 21:27:26.751726 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 812/1532] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:26.759851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:26.759851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:26.764249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.764628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.765178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.765898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.766355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.766776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:26.945705 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bef44bad-4a02-45cd-8084-e9bca418ca24 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1618 microversion: 2.1 time: 0.692423 Nov 02 21:27:26.946591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 721/1533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:26 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1618 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:26.951700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:26.952500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-761f0357-cea7-4691-bb87-1d824b6dbd87 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '.version_select at 0x7f9b6d285670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:26.962760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1dcc9aae-7fb2-44a6-9ef0-a39b2fe3ee32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1359 microversion: 2.1 time: 0.209446 Nov 02 21:27:26.977846 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 813/1534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:26 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:26.985150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:26.985772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] [instance: 88c23781-8473-464f-8e15-febb6b169596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:26.988922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:26.993197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:26.993726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:26.994366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:27.001765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:27.002261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:27.008064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:27.018676 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] HTTP exception thrown: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Request method failure captured: Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 HTTP/1.1 Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAx7K1tK_kkNkpD3mKjM1E9Eyx8157oQmrLPLlVspZLdkul70EqSijxhZJcheXnQfQd1HGtbs2HbM47R3ulMThLq1l1xn76VmNXmQv8vQBOPvJF4Z1JIr8ek41FGw-SUrZUXSbFDOO76os_gN62rVYN02LZz3DvSjrRMH60VqmRg-Y Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:27.021537 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4277a3bfc9ea45aba77bbfc2ce35f5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4277a3bfc9ea45aba77bbfc2ce35f5db Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565 Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 044e9aa5874a48b490b83c184aa470cc Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1098363565-project Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:27.022919 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '88c23781-8473-464f-8e15-febb6b169596'} Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:27.023890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. Nov 02 21:27:27.025211 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:27.026392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] Returning 404 to user: Instance 88c23781-8473-464f-8e15-febb6b169596 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:27.026392 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f7dd03e-29c4-433b-bd26-7a71346a98ef tempest-ImagesOneServerNegativeTestJSON-1098363565 tempest-ImagesOneServerNegativeTestJSON-1098363565-project] 10.222.0.25 "GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596" status: 404 len: 111 microversion: 2.1 time: 0.047393 Nov 02 21:27:27.030844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 814/1535] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:26 2022] GET /compute/v2.1/servers/88c23781-8473-464f-8e15-febb6b169596 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:27.040639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5dc6a99e-e08a-406a-91bc-1a8f44ef85c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: .version_select at 0x7f9b69724a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-568216819", "policies": ["affinity"]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:27.068236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5dc6a99e-e08a-406a-91bc-1a8f44ef85c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:27.070710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5dc6a99e-e08a-406a-91bc-1a8f44ef85c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:27.224369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5dc6a99e-e08a-406a-91bc-1a8f44ef85c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:27.232822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5dc6a99e-e08a-406a-91bc-1a8f44ef85c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:27.250302 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5dc6a99e-e08a-406a-91bc-1a8f44ef85c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.220748 Nov 02 21:27:27.254860 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 815/1536] 10.222.0.25 () {60 vars in 1174 bytes} [Wed Nov 2 21:27:27 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:27.260254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:27.262149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:27.274613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:27.275178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:27.275807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:27.276559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:27.277047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:27.277543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:27.629311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:27.639529 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e943af0d-e85b-4b4f-b94a-a6e6c34a82a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 0.386828 Nov 02 21:27:27.640409 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 816/1537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:27 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:27.648774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:27.649779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:27.662685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:27.663192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:27.664793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:27.667400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:27.667400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:27.667400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:27.989607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:27.997298 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9225980d-039c-44ac-8661-17123cb4d42d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1316 microversion: 2.1 time: 0.355150 Nov 02 21:27:28.001494 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 817/1538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:27 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:28.009808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-195685083", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2946cc9c-f0a4-427b-ade8-829394505904"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:28.078561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:28.695898 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-761f0357-cea7-4691-bb87-1d824b6dbd87 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/d3637b81-d8cd-4948-ac20-6d42931f5675" status: 202 len: 0 microversion: 2.1 time: 1.747628 Nov 02 21:27:28.701591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 722/1539] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:27:26 2022] DELETE /compute/v2.1/os-floating-ips/d3637b81-d8cd-4948-ac20-6d42931f5675 => generated 0 bytes in 1754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:27:28.707030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:28.707731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:28.716537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:28.717158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:28.717663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:28.718434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:28.718963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:28.719474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:29.074865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:29.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:29.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:29.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:29.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:29.119901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:29.120395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:29.120840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:29.121605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:29.122058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:29.122490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:29.142269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:29.149131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:29.162132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Going to run 2 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:29.165996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:29.256742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:29.273342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:29.278157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:29.283865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121040) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 21:27:29.286640 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85e40f1a-6d0f-4b25-8ac3-02c6e05c172b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.580582 Nov 02 21:27:29.288271 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 723/1540] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:28 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:29.297940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:29.299440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:29.307204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:29.308031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:29.308715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:29.309740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:29.310580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:29.311225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:29.326649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:29.333046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:29.450935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:29.459214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:29.476855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:29.625690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:29.631530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:29.777051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:29.801626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:29.816367 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55fc9662-f8f9-4bff-a73f-781c4baca3a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1541 microversion: 2.1 time: 0.525030 Nov 02 21:27:29.822538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:29.830581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 724/1541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:29 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1541 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:29.835140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:29.847031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:29.847697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:29.859843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:29.860355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:29.860808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:29.861569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:29.862200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:29.862584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:29.937799 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfd65c33-381e-4f45-9a2e-6d3e7157a998 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.934542 Nov 02 21:27:29.939820 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 818/1542] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1938 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:27:29.957451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5eb458a8-88d9-458a-8102-e0868d225531 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5eb458a8-88d9-458a-8102-e0868d225531 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Request method failure captured: Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action HTTP/1.1 Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 34 Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCI8YmDQtZNzW2HhGccq4yRSqPdcYbg5jF_LLxIPs7WYJ3STbAby7ZGVVYh_or6jdhMNtJz-I331507Mxw6wNHBHQiBoUx9-4D6bESg21BFyWH1XPStGxvtXTHJNOFqWQFvCWTBc8RUtRY-5BNbFVUHtt5u4G6Zl65yAYPduMnV1ms Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:29.965506 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8b5f877966204f2db585b04b8afee9e1 Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: {"addFloatingIp": {"address": ""}} Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:27:29.967092 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '11eb4eff-540c-4650-a34a-9475fe1a96d2', 'body': {'addFloatingIp': {'address': ''}}} Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '' Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:29.967917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:27:29.969556 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:27:29.971728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 21:27:29.971728 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:29.974586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5eb458a8-88d9-458a-8102-e0868d225531 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:29.978140 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5eb458a8-88d9-458a-8102-e0868d225531 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action" status: 400 len: 142 microversion: 2.1 time: 0.032918 Nov 02 21:27:29.980664 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 819/1543] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:27:29 2022] POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action => generated 142 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:27:30.009738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:30.012979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:30.035166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:30.035675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:30.037696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:30.038447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:30.039135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:30.039579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:30.837633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:30.849020 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6119c036-a9fe-4251-a310-46a2b72aebb0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 1.014485 Nov 02 21:27:30.861845 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 725/1544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:29 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:30.872520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:30.873332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:30.880059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:30.880869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:30.881763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:30.883689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:30.884855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:30.886096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:30.934259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:30.943628 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d2cbd21-63dc-4465-bb2a-f43177443d51 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1316 microversion: 2.1 time: 0.959698 Nov 02 21:27:30.946971 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 820/1545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:29 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1316 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:30.951610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:30.958346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:30.959343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Searching by: {'deleted': False, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:27:30.983453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:30.993087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:30.993087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:30.993087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:30.993087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:30.993513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.053246 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fad92bc8-bc14-4ab8-9331-6210cab545f1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189873 Nov 02 21:27:31.054778 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 726/1546] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:27:30 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:31.071688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:31.080684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:31.095632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:27:31.113654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.115775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.116453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.124406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.126541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.128807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.184207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:27:31.184956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquired lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:27:31.211966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0543adcb-2ba9-4485-a660-ac50775a24c8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.264823 Nov 02 21:27:31.212885 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 821/1547] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:27:30 2022] GET /compute/v2.1/servers => generated 1002 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:31.218311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:31.219182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:31.232414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.234871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.235556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.236715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.240157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.240782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Releasing lock "refresh_cache-11eb4eff-540c-4650-a34a-9475fe1a96d2" {{(pid=121039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] HTTP exception thrown: floating IP not found Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Request method failure captured: Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action HTTP/1.1 Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 41 Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCI8YmDQtZNzW2HhGccq4yRSqPdcYbg5jF_LLxIPs7WYJ3STbAby7ZGVVYh_or6jdhMNtJz-I331507Mxw6wNHBHQiBoUx9-4D6bESg21BFyWH1XPStGxvtXTHJNOFqWQFvCWTBc8RUtRY-5BNbFVUHtt5u4G6Zl65yAYPduMnV1ms Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:31.723541 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8b5f877966204f2db585b04b8afee9e1 Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:27:31.726201 n-d-860863-4 devstack@n-api.service[121039]: exception: floating IP not found Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '11eb4eff-540c-4650-a34a-9475fe1a96d2', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:31.727230 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 02 21:27:31.728696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.730551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Returning 404 to user: floating IP not found {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:31.730551 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d1dfc6bf-a144-4543-a950-bdc14a712020 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action" status: 404 len: 67 microversion: 2.1 time: 0.563571 Nov 02 21:27:31.730551 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 727/1548] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:27:31 2022] POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action => generated 67 bytes in 567 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:27:31.730551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42122c67-6bbc-49ef-81e8-c1e532e28240 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:31.730551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42122c67-6bbc-49ef-81e8-c1e532e28240 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:31.730989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:31.730989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:31.731207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:31.731207 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48945642-2fa9-4e1a-9b98-aeacc3a47dc3 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.477764 Nov 02 21:27:31.731207 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 822/1549] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:31 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:31.731207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8b94d76-03be-4970-82be-f836ef4eff00 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:31.737405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42122c67-6bbc-49ef-81e8-c1e532e28240 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:31.749624 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42122c67-6bbc-49ef-81e8-c1e532e28240 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1218 microversion: 2.1 time: 0.125845 Nov 02 21:27:31.770864 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 728/1550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:31 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:31.791395 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a8b94d76-03be-4970-82be-f836ef4eff00 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8b94d76-03be-4970-82be-f836ef4eff00 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Request method failure captured: Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action HTTP/1.1 Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 44 Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCI8YmDQtZNzW2HhGccq4yRSqPdcYbg5jF_LLxIPs7WYJ3STbAby7ZGVVYh_or6jdhMNtJz-I331507Mxw6wNHBHQiBoUx9-4D6bESg21BFyWH1XPStGxvtXTHJNOFqWQFvCWTBc8RUtRY-5BNbFVUHtt5u4G6Zl65yAYPduMnV1ms Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:31.795267 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8b5f877966204f2db585b04b8afee9e1 Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:27:31.797116 n-d-860863-4 devstack@n-api.service[121040]: exception: Floating IP not found for address 0.0.0.0. Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '11eb4eff-540c-4650-a34a-9475fe1a96d2', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:31.798111 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 02 21:27:31.799671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:31.802727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8b94d76-03be-4970-82be-f836ef4eff00 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:31.803963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8b94d76-03be-4970-82be-f836ef4eff00 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action" status: 404 len: 88 microversion: 2.1 time: 0.101679 Nov 02 21:27:31.805873 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 823/1551] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:27:31 2022] POST /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2/action => generated 88 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:27:31.817943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:31.818737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:31.836978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.839044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.839733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.840449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.840916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.841609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.878671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:27:31.880897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:31.881813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:31.895397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.896589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.899101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:31.900551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:31.901216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:31.901826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:32.310109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:32.339612 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0e8da5b-1708-484c-9c81-12ec94a34d64 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 0.467921 Nov 02 21:27:32.352955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 824/1552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:31 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:32.353161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8bc00131-f5c4-4f59-9fd1-d380e168aa8a tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "DELETE /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 204 len: 0 microversion: 2.1 time: 0.538496 Nov 02 21:27:32.359543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 729/1553] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:31 2022] DELETE /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:27:32.364700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:32.365601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:32.377647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:32.381542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:32.386544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:32.388304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:32.389970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:32.391311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:32.392299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:32.393752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:32.402331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:32.407051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:32.408036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:32.410657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:32.413803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:32.415527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:33.134078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:33.146926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25e51d3a-e7e7-469a-a7f7-135236aaebd0 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1316 microversion: 2.1 time: 0.802129 Nov 02 21:27:33.149672 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 825/1554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:32 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:33.160846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:33.161912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:33.162039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:33.181613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:33.184466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:33.185083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:33.187426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:33.188248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:33.189182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:33.192092 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40e68900-3c01-41f2-bee0-a2a398a139ec tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1541 microversion: 2.1 time: 0.832267 Nov 02 21:27:33.192900 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 730/1555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:32 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1541 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:33.207240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e38892ea-14b3-487e-bbe7-4b484b27778b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:33.209017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e38892ea-14b3-487e-bbe7-4b484b27778b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:33.259394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:33.337397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e38892ea-14b3-487e-bbe7-4b484b27778b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:33.350635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e38892ea-14b3-487e-bbe7-4b484b27778b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1218 microversion: 2.1 time: 0.152896 Nov 02 21:27:33.353431 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 731/1556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:33 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:33.374258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8407a37a-c8ae-4082-9659-29da83c0be78 req-73ffaf7a-fd87-4a98-8ead-6de34754fb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac46b6c1-84c9-4683-8427-f25b342dad4d", "name": "network-vif-plugged", "status": "completed", "tag": "efb62441-959e-49e6-ad00-59acd1131995"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:33.402267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8407a37a-c8ae-4082-9659-29da83c0be78 req-73ffaf7a-fd87-4a98-8ead-6de34754fb52 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:33.402757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8407a37a-c8ae-4082-9659-29da83c0be78 req-73ffaf7a-fd87-4a98-8ead-6de34754fb52 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:33.403205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8407a37a-c8ae-4082-9659-29da83c0be78 req-73ffaf7a-fd87-4a98-8ead-6de34754fb52 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:33.418244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:33.433944 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8407a37a-c8ae-4082-9659-29da83c0be78 req-73ffaf7a-fd87-4a98-8ead-6de34754fb52 service nova] Creating event network-vif-plugged:efb62441-959e-49e6-ad00-59acd1131995 for instance ac46b6c1-84c9-4683-8427-f25b342dad4d on n-h2-860863-4 Nov 02 21:27:33.451857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8407a37a-c8ae-4082-9659-29da83c0be78 req-73ffaf7a-fd87-4a98-8ead-6de34754fb52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096072 Nov 02 21:27:33.454589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 732/1557] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:33.462456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:33.476501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:33.496370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:33.513506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:33.514122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:33.517694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:33.518290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:33.518754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:34.034550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:34.036452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:34.046730 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e5f95082-e955-435e-84f2-73725fc47002 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 0.590722 Nov 02 21:27:34.050295 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 733/1558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:33 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:34.055288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:34.059271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e9d1ae06-68d8-4512-8a47-b02b5619d700 req-57520065-324d-4d29-ba87-d8474a1f1136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e33e1d-76d6-4011-8810-dec200b78844", "tag": "86827113-650e-49b8-abdc-ca4ae487e196"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:34.063052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:34.064380 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2cc59b5-490a-4637-b182-86b73231cb03 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.913363 Nov 02 21:27:34.066852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 826/1559] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:33 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:34.103761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e9d1ae06-68d8-4512-8a47-b02b5619d700 req-57520065-324d-4d29-ba87-d8474a1f1136 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:34.104253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e9d1ae06-68d8-4512-8a47-b02b5619d700 req-57520065-324d-4d29-ba87-d8474a1f1136 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:34.104691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e9d1ae06-68d8-4512-8a47-b02b5619d700 req-57520065-324d-4d29-ba87-d8474a1f1136 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:34.120383 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e9d1ae06-68d8-4512-8a47-b02b5619d700 req-57520065-324d-4d29-ba87-d8474a1f1136 service nova] Creating event network-changed:86827113-650e-49b8-abdc-ca4ae487e196 for instance 07e33e1d-76d6-4011-8810-dec200b78844 on n-h1-860863-4 Nov 02 21:27:34.140371 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e9d1ae06-68d8-4512-8a47-b02b5619d700 req-57520065-324d-4d29-ba87-d8474a1f1136 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088585 Nov 02 21:27:34.143593 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 734/1560] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:34.180858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:34.183037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:34.195236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:34.195736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:34.196196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:34.197055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:34.204682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:34.205226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:34.222083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:34.222952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:34.237387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:34.237903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:34.238349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:34.256540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:34.257163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:34.261998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:35.120992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:35.135992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fb2be99f-fb29-455c-ac9b-36779b74bf60 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1541 microversion: 2.1 time: 0.919005 Nov 02 21:27:35.162063 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 735/1561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:34 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1541 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:35.188177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:35.190667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:35.202969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:35.203870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:35.204551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:35.205737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:35.206443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:35.207093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:35.325466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:35.335252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfca2649-1003-49c1-8d59-1e5fe124210e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1316 microversion: 2.1 time: 1.160837 Nov 02 21:27:35.337758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 827/1562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:34 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1316 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:35.343261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:35.344458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:35.363308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:35.366912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:35.367646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:35.368475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:35.370390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:35.371558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:35.386481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:35.407010 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f13bfd83-6fcd-4b8b-a660-94324835d31d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1270 microversion: 2.1 time: 0.240928 Nov 02 21:27:35.407643 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 736/1563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:35 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:35.425836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:35.429771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:35.437870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:35.439339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:35.440142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:35.441400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:35.442047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:35.442636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:36.031944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:36.044561 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4dade6b7-c15b-4e35-a404-26816426df57 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1308 microversion: 2.1 time: 0.703882 Nov 02 21:27:36.046538 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 828/1564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:35 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1308 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:36.076363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:36.091761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8301f599-f462-4a75-a7aa-30735896b8b1 req-04840cdc-980e-433a-8c30-003037d0bf2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75af098-63dd-4436-a808-953b2506c6f2", "name": "network-vif-plugged", "status": "completed", "tag": "f2ae7b87-e013-4212-b8cb-2d4d457ec78d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:36.097694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:36.105321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:36.107350 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fd42e072-488b-4fa0-b57d-ddcd225388ac tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.696585 Nov 02 21:27:36.108169 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 737/1565] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:35 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:36.120479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8301f599-f462-4a75-a7aa-30735896b8b1 req-04840cdc-980e-433a-8c30-003037d0bf2e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:36.122156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8301f599-f462-4a75-a7aa-30735896b8b1 req-04840cdc-980e-433a-8c30-003037d0bf2e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:36.125244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8301f599-f462-4a75-a7aa-30735896b8b1 req-04840cdc-980e-433a-8c30-003037d0bf2e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:36.144615 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8301f599-f462-4a75-a7aa-30735896b8b1 req-04840cdc-980e-433a-8c30-003037d0bf2e service nova] Creating event network-vif-plugged:f2ae7b87-e013-4212-b8cb-2d4d457ec78d for instance e75af098-63dd-4436-a808-953b2506c6f2 on n-h1-860863-4 Nov 02 21:27:36.150842 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8301f599-f462-4a75-a7aa-30735896b8b1 req-04840cdc-980e-433a-8c30-003037d0bf2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063605 Nov 02 21:27:36.152094 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 829/1566] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:36.164216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:36.164611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:36.183493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:36.184006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:36.184460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:36.185976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:36.186238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:36.186679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:36.385779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:36.395607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:36.439635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:36.442775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:36.447552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:36.447552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:36.451313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:36.453070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:37.534122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:37.544657 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-45d90dda-6668-41ba-b74c-cd43c656b0de tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1541 microversion: 2.1 time: 1.384614 Nov 02 21:27:37.545478 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 738/1567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:36 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1541 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:37.549842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:37.550989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:37.566364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:37.567397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:37.568289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:37.569583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:37.571084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:37.571686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:37.734015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:37.755510 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4b51713-d721-4e62-a798-878f54f3fd07 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1316 microversion: 2.1 time: 1.394839 Nov 02 21:27:37.760179 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 830/1568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:36 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1316 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:27:37.768361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:37.773871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:37.807688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:37.808287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:37.808789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:37.810807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:37.810807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:37.810807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:37.870467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:37.895798 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c72c018c-c5a7-42e4-94bc-3425e1394c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1276 microversion: 2.1 time: 0.341182 Nov 02 21:27:37.897266 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 739/1569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:37 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1276 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:37.907706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:37.908400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:37.921557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:37.922245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:37.923051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:37.923796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:37.924841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:37.924841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.416352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:38.422974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:38.425060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:38.426744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:38.427681 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d52e4840-8c47-488b-a0bc-b9592ec6185d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.528828 Nov 02 21:27:38.428494 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 740/1570] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:37 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:38.433340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a96088f3-7376-4e26-8185-70c041e4c3d3 req-e3418e52-552b-49b1-907c-b5ffa0c8579e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11eb4eff-540c-4650-a34a-9475fe1a96d2", "name": "network-vif-deleted", "tag": "88166e6c-108a-4bcb-ac2e-e9ee554b7fa8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:38.434747 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48d82e6e-d03a-46bc-85f4-3cada57aafc0 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1488 microversion: 2.1 time: 0.670151 Nov 02 21:27:38.436482 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 831/1571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:37 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1488 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:38.453609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a96088f3-7376-4e26-8185-70c041e4c3d3 req-e3418e52-552b-49b1-907c-b5ffa0c8579e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.454096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a96088f3-7376-4e26-8185-70c041e4c3d3 req-e3418e52-552b-49b1-907c-b5ffa0c8579e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.454651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a96088f3-7376-4e26-8185-70c041e4c3d3 req-e3418e52-552b-49b1-907c-b5ffa0c8579e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.459081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:38.459906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:38.467881 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a96088f3-7376-4e26-8185-70c041e4c3d3 req-e3418e52-552b-49b1-907c-b5ffa0c8579e service nova] Creating event network-vif-deleted:88166e6c-108a-4bcb-ac2e-e9ee554b7fa8 for instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 on n-h2-860863-4 Nov 02 21:27:38.470567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.473340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.473340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.473560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.474091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.474271 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a96088f3-7376-4e26-8185-70c041e4c3d3 req-e3418e52-552b-49b1-907c-b5ffa0c8579e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044085 Nov 02 21:27:38.474788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.475123 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 741/1572] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:38.503430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:27:38.568316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:38.569048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:38.577244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.577651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.578098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.581813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.581813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.581813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.615189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.615739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.616264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.617412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lazy-loading 'fault' on Instance uuid 11eb4eff-540c-4650-a34a-9475fe1a96d2 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:38.714316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:38.730363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fd5c09ee-6022-4bcb-81f7-39cda71f43fd tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1322 microversion: 2.1 time: 0.166299 Nov 02 21:27:38.731112 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 742/1573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:38 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:27:38.735951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f41ff59b-15ed-47ad-b65a-ab3cca3601d2 req-a36b84b2-fbbd-49aa-b411-a1fa73d5f69b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8", "tag": "32289bf3-b7fb-4c7f-91d1-920db5bfd078"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:38.752422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f41ff59b-15ed-47ad-b65a-ab3cca3601d2 req-a36b84b2-fbbd-49aa-b411-a1fa73d5f69b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.753043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f41ff59b-15ed-47ad-b65a-ab3cca3601d2 req-a36b84b2-fbbd-49aa-b411-a1fa73d5f69b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.753554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f41ff59b-15ed-47ad-b65a-ab3cca3601d2 req-a36b84b2-fbbd-49aa-b411-a1fa73d5f69b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.780586 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f41ff59b-15ed-47ad-b65a-ab3cca3601d2 req-a36b84b2-fbbd-49aa-b411-a1fa73d5f69b service nova] Creating event network-changed:32289bf3-b7fb-4c7f-91d1-920db5bfd078 for instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 on n-h1-860863-4 Nov 02 21:27:38.786426 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f41ff59b-15ed-47ad-b65a-ab3cca3601d2 req-a36b84b2-fbbd-49aa-b411-a1fa73d5f69b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053869 Nov 02 21:27:38.787196 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 743/1574] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:38.793431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:38.795250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:38.801374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.801961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.802438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.803139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.803770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.804374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.852778 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7f26460-f990-4180-a0b9-beb8a494714e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 204 len: 0 microversion: 2.1 time: 0.398208 Nov 02 21:27:38.857242 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 832/1575] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:38 2022] DELETE /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:27:38.862734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:38.863441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:38.869927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.870345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.870782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:38.871578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:38.872029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:38.872453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.182292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:39.191213 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a891c5f6-9734-4691-bfb9-d9cec463b31b tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1503 microversion: 2.1 time: 0.402540 Nov 02 21:27:39.191803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:39.191998 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 744/1576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:38 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:39.207436 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-afa6bdeb-b9ee-4bda-b705-2410fc459946 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1494 microversion: 2.1 time: 0.346445 Nov 02 21:27:39.209500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:39.209927 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 833/1577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:38 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:39.211045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:39.219109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.219881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.220561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.221496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.222308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.222967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.236006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:39.236990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:39.245137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.245853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.246501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.247758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.248192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.248628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.280898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:27:39.341855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:39.350122 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d92bddf5-dd5a-4b52-8907-3aa99c760c3c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1276 microversion: 2.1 time: 0.156890 Nov 02 21:27:39.350764 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 745/1578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:39 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:39.454840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:39.455463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:39.462012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.462719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.463351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.464490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.465350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.470135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.640457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:39.652427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:39.660665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:39.663053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-04a8519a-a76c-4f3b-9a9d-3591d65b1796 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.212892 Nov 02 21:27:39.665061 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 746/1579] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:39 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:39.690570 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dea13922-d675-439c-9bb7-69cb71a5870f tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 204 len: 0 microversion: 2.1 time: 0.458068 Nov 02 21:27:39.691606 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 834/1580] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:39 2022] DELETE /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:27:39.709975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:39.710976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:39.718449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.719206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.720265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.721193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.722126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.723864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.759103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:39.759103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:39.765648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.766382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.767095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.767955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.768560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.769165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.838481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:39.839376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:39.840065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:39.840840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lazy-loading 'fault' on Instance uuid 11eb4eff-540c-4650-a34a-9475fe1a96d2 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:39.859970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=30 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:39.919300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b5f877966204f2db585b04b8afee9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b626934eea4654a4040b4432c1c6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:39.936691 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8aa3c51-da33-4a4d-a1de-fae84db7c85c tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 200 len: 1322 microversion: 2.1 time: 0.184388 Nov 02 21:27:39.937392 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 835/1581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:39 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:27:39.948124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04d80515-d520-4d5c-90a6-a8c1f8439936 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b691e6e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:40.051493 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04d80515-d520-4d5c-90a6-a8c1f8439936 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/fc93b270-3ee7-4e13-9b59-8d04d2c6ee94" status: 200 len: 662 microversion: 2.1 time: 0.111752 Nov 02 21:27:40.064527 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 836/1582] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:39 2022] GET /compute/v2.1/images/fc93b270-3ee7-4e13-9b59-8d04d2c6ee94 => generated 662 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:40.079729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ea5f195-c645-451b-ae4d-3015e88654bb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b696e6ca0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:40.121724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:40.138611 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3125158-c7d1-4b00-9f11-fb425800e15c tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1509 microversion: 2.1 time: 0.432509 Nov 02 21:27:40.144747 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ea5f195-c645-451b-ae4d-3015e88654bb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/fc93b270-3ee7-4e13-9b59-8d04d2c6ee94" status: 200 len: 662 microversion: 2.1 time: 0.078744 Nov 02 21:27:40.152413 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 837/1583] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:40 2022] GET /compute/v2.1/images/fc93b270-3ee7-4e13-9b59-8d04d2c6ee94 => generated 662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:40.159052 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 747/1584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:39 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1509 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:40.248324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:40.249397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:40.263292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:40.264189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:40.266961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:40.266961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:40.266961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:40.266961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:40.373997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:40.374610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:40.396282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:40.402009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:40.402615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:40.412022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:40.412022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:40.412022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:41.032639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:41.126415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:41.137238 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2039445b-ae2b-4aa9-b122-6037923b1675 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1494 microversion: 2.1 time: 0.900910 Nov 02 21:27:41.138039 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 838/1585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:40 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1494 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:41.143428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:41.146194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:41.152167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:41.152871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:41.153701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:41.154666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:41.155289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:41.155804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:41.318997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:41.327325 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-46cac4b1-ae10-4244-b063-7cf99c028ea7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.957105 Nov 02 21:27:41.328108 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 748/1586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:40 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:27:41.332795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:41.333424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] [instance: 11eb4eff-540c-4650-a34a-9475fe1a96d2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:41.340120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:41.340841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:41.341766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:41.342773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:41.343385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:41.343970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:41.368668 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] HTTP exception thrown: Instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 could not be found. Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Request method failure captured: Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 HTTP/1.1 Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCI8YmDQtZNzW2HhGccq4yRSqPdcYbg5jF_LLxIPs7WYJ3STbAby7ZGVVYh_or6jdhMNtJz-I331507Mxw6wNHBHQiBoUx9-4D6bESg21BFyWH1XPStGxvtXTHJNOFqWQFvCWTBc8RUtRY-5BNbFVUHtt5u4G6Zl65yAYPduMnV1ms Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:41.370680 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64b626934eea4654a4040b4432c1c6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 64b626934eea4654a4040b4432c1c6a2 Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8b5f877966204f2db585b04b8afee9e1 Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:27:41.372432 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 could not be found. Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '11eb4eff-540c-4650-a34a-9475fe1a96d2'} Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 could not be found. Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:41.379130 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 could not be found. Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 could not be found. Nov 02 21:27:41.380634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:41.382643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] Returning 404 to user: Instance 11eb4eff-540c-4650-a34a-9475fe1a96d2 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:41.382643 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e38fa149-888b-4630-b78e-cf21c5fbe82d tempest-FloatingIPsAssociationNegativeTestJSON-1779453722 tempest-FloatingIPsAssociationNegativeTestJSON-1779453722-project] 10.222.0.25 "GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2" status: 404 len: 111 microversion: 2.1 time: 0.045361 Nov 02 21:27:41.383851 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 749/1587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:41 2022] GET /compute/v2.1/servers/11eb4eff-540c-4650-a34a-9475fe1a96d2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:41.388904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:41.389761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:41.399046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:41.400383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:41.401084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:41.401964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:41.402621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:41.403205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:41.711923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:41.726796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:41.728209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:41.729405 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2244c927-248f-4e9f-9ec5-8265c0c8687a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1812 microversion: 2.25 time: 0.589991 Nov 02 21:27:41.729963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 839/1588] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:41 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1812 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:42.026083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:42.040065 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d9897ffe-d35e-4a2f-8c64-75ed02304b3d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1509 microversion: 2.1 time: 0.654864 Nov 02 21:27:42.040655 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 750/1589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:41 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:42.164672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:42.166072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:42.175748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:42.188889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:42.189458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:42.190558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:42.190915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:42.191451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:42.282684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ccc08b02-6d40-43a9-a476-bbcf10b78af2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b691af040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:42.343311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ccc08b02-6d40-43a9-a476-bbcf10b78af2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/61ba0f25-7e39-416a-ab4c-3d0d14023b62" status: 200 len: 662 microversion: 2.1 time: 0.064326 Nov 02 21:27:42.353060 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 751/1590] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:42 2022] GET /compute/v2.1/images/61ba0f25-7e39-416a-ab4c-3d0d14023b62 => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:42.367579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:42.368363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:42.379584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:42.388990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:42.389700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:42.390586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:42.391203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:42.391745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:42.448424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:42.457207 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-59ab7e3e-6dd6-47d2-9b30-45334b3b6202 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1452 microversion: 2.1 time: 0.297122 Nov 02 21:27:42.485074 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 840/1591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:42 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1452 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:42.485074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a619551c-8a43-4d9b-822b-d0991f467613 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d2ba670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:42.555612 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a619551c-8a43-4d9b-822b-d0991f467613 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/61ba0f25-7e39-416a-ab4c-3d0d14023b62" status: 200 len: 662 microversion: 2.1 time: 0.082907 Nov 02 21:27:42.556418 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 841/1592] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:42 2022] GET /compute/v2.1/images/61ba0f25-7e39-416a-ab4c-3d0d14023b62 => generated 662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:42.758357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:42.758884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:42.766020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:42.766900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:42.767353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:42.768273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:42.768911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:42.769589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.218861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:43.223006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:43.229283 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b78a0aec-da0b-4b85-8625-f7801b781637 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.874829 Nov 02 21:27:43.230246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 752/1593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:42 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:43.235254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5c2ae8a1-fdf5-4805-9679-9b5b3947d3e3 req-42ed2d8f-36e4-4343-ac4c-8d99754863d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac46b6c1-84c9-4683-8427-f25b342dad4d", "name": "network-vif-deleted", "tag": "efb62441-959e-49e6-ad00-59acd1131995"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:43.245168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:43.248126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5c2ae8a1-fdf5-4805-9679-9b5b3947d3e3 req-42ed2d8f-36e4-4343-ac4c-8d99754863d2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.249057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5c2ae8a1-fdf5-4805-9679-9b5b3947d3e3 req-42ed2d8f-36e4-4343-ac4c-8d99754863d2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.249650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5c2ae8a1-fdf5-4805-9679-9b5b3947d3e3 req-42ed2d8f-36e4-4343-ac4c-8d99754863d2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.263619 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5c2ae8a1-fdf5-4805-9679-9b5b3947d3e3 req-42ed2d8f-36e4-4343-ac4c-8d99754863d2 service nova] Creating event network-vif-deleted:efb62441-959e-49e6-ad00-59acd1131995 for instance ac46b6c1-84c9-4683-8427-f25b342dad4d on n-h2-860863-4 Nov 02 21:27:43.269921 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5c2ae8a1-fdf5-4805-9679-9b5b3947d3e3 req-42ed2d8f-36e4-4343-ac4c-8d99754863d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038056 Nov 02 21:27:43.271810 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 753/1594] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:43.279287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:43.281112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:43.292638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.293343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.293947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.295126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.295795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.296765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.347854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:43.639270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:43.650363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:43.652223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:43.653758 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35be9563-9934-45d7-a5f9-a4219ee9ff48 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1802 microversion: 2.25 time: 0.900512 Nov 02 21:27:43.671646 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 842/1595] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:42 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1802 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:27:43.680236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:43.680832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:43.687336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.688017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.688808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.690832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.691484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.692070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.697290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:43.747702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.748184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.748620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.752627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lazy-loading 'fault' on Instance uuid ac46b6c1-84c9-4683-8427-f25b342dad4d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:43.854687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:43.857154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:43.865311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d48cfbcb-195b-459d-ae9f-ea5e1120fd9a tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1509 microversion: 2.1 time: 0.590785 Nov 02 21:27:43.868143 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 754/1596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:43 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1509 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:43.875463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8390e18e-3071-4ff8-be77-a1fd7a72dd29 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '.version_select at 0x7f9b6d2fcf70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:43.878846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8390e18e-3071-4ff8-be77-a1fd7a72dd29 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.879333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8390e18e-3071-4ff8-be77-a1fd7a72dd29 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.879773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8390e18e-3071-4ff8-be77-a1fd7a72dd29 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.912123 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8390e18e-3071-4ff8-be77-a1fd7a72dd29 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.042655 Nov 02 21:27:43.915644 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 755/1597] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 21:27:43 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:43.933410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:43.935603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:43.935721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff2f36d1-539e-41bb-8d27-63ffbffedb0f tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 200 len: 1298 microversion: 2.1 time: 0.264171 Nov 02 21:27:43.941320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.942025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.942810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.943803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:43.944404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:43.945064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:43.952752 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 843/1598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:43 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:44.895728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:44.950381 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-620cdff7-5955-4523-835f-70483c8a7695 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 2421 microversion: 2.25 time: 1.022949 Nov 02 21:27:44.957179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2114206737", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "67c3f76f-7a17-4f1f-a61d-9ec78598dc27"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:44.957710 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 756/1599] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:43 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 2421 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:27:44.971767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:44.976464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:44.992036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:44.996539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:44.997400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:44.997976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:44.998443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:45.006833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:45.088547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] validate_networks() for [('67c3f76f-7a17-4f1f-a61d-9ec78598dc27', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:45.681044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:45.698662 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-73cd02cb-02e6-4e9d-8c62-bbf1855f49cb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.740295 Nov 02 21:27:45.699842 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 757/1600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:44 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:45.705989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6c02b676-e024-4815-b4c7-03be3aadb131 req-a29492a7-18d2-4743-8464-3cbb187fac2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8", "name": "network-vif-plugged", "status": "completed", "tag": "32289bf3-b7fb-4c7f-91d1-920db5bfd078"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:45.736329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c02b676-e024-4815-b4c7-03be3aadb131 req-a29492a7-18d2-4743-8464-3cbb187fac2f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:45.736810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c02b676-e024-4815-b4c7-03be3aadb131 req-a29492a7-18d2-4743-8464-3cbb187fac2f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:45.737431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c02b676-e024-4815-b4c7-03be3aadb131 req-a29492a7-18d2-4743-8464-3cbb187fac2f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:45.762016 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6c02b676-e024-4815-b4c7-03be3aadb131 req-a29492a7-18d2-4743-8464-3cbb187fac2f service nova] Creating event network-vif-plugged:32289bf3-b7fb-4c7f-91d1-920db5bfd078 for instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 on n-h1-860863-4 Nov 02 21:27:45.779469 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6c02b676-e024-4815-b4c7-03be3aadb131 req-a29492a7-18d2-4743-8464-3cbb187fac2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077889 Nov 02 21:27:45.785707 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 758/1601] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:45.806006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:45.807809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:45.825475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:45.826278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:45.826899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:45.827785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:45.843753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:45.844528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:45.971849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:45.981350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:45.983698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:45.985637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lazy-loading 'fault' on Instance uuid e75af098-63dd-4436-a808-953b2506c6f2 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:46.090352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a636b6e37a049b08cef243d52a600c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036e48d06bf49d9b9caae92d5444e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:46.106397 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3350ec4-46d2-4e0e-afb3-695776135f55 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 200 len: 1306 microversion: 2.1 time: 0.302959 Nov 02 21:27:46.107901 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 759/1602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:45 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 1306 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:46.119720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d830c40c-5857-481f-af9c-4a8d229b5a4e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b691fe820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:46.171214 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d830c40c-5857-481f-af9c-4a8d229b5a4e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/c784fa17-e2d4-441f-9933-6b566e364cd9" status: 200 len: 662 microversion: 2.1 time: 0.054949 Nov 02 21:27:46.172528 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 760/1603] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:46 2022] GET /compute/v2.1/images/c784fa17-e2d4-441f-9933-6b566e364cd9 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:46.181217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:46.182097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:46.196019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.198063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.198682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.199583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.200314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.200945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.219837 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d HTTP/1.1 Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:46.222631 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:27:46.224318 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'ac46b6c1-84c9-4683-8427-f25b342dad4d'} Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:46.225637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:27:46.227122 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:46.229648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:46.230687 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fe87523-0628-4658-9821-2b803be09129 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 404 len: 111 microversion: 2.1 time: 0.056818 Nov 02 21:27:46.231431 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 761/1604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:46 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:46.253457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:46.254199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:46.261350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.262025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.262458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.263170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.264360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.265089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.497980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:46.498534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:46.498858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:46.499626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:46.500626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:46.521373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.524368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.525625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.526640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.528896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.529693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.567777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:46.580388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:46.591368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for user 1cb7808dc9e54e86811e0b7ad1cec847 and project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:46.610124 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e6c008a-9a62-49cb-beca-4bedce3b18c3 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 2421 microversion: 2.25 time: 0.373037 Nov 02 21:27:46.616088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 762/1605] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:27:46 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 2421 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:27:46.616221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:46.616221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:46.617934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f6a2b92a-94a9-47cc-b2c4-cbf44cb5648e req-45502515-7755-4b9b-809d-cb1605aeb85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75af098-63dd-4436-a808-953b2506c6f2", "name": "network-vif-deleted", "tag": "f2ae7b87-e013-4212-b8cb-2d4d457ec78d"}, {"name": "network-changed", "server_uuid": "f5e6d441-91f0-416d-b6ca-6b1a1645252b", "tag": "dc9c66a9-effe-43b7-be0f-926f7c85d53b"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:46.631100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f6a2b92a-94a9-47cc-b2c4-cbf44cb5648e req-45502515-7755-4b9b-809d-cb1605aeb85a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.631741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f6a2b92a-94a9-47cc-b2c4-cbf44cb5648e req-45502515-7755-4b9b-809d-cb1605aeb85a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.633471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f6a2b92a-94a9-47cc-b2c4-cbf44cb5648e req-45502515-7755-4b9b-809d-cb1605aeb85a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.686871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f6a2b92a-94a9-47cc-b2c4-cbf44cb5648e req-45502515-7755-4b9b-809d-cb1605aeb85a service nova] Creating event network-vif-deleted:f2ae7b87-e013-4212-b8cb-2d4d457ec78d for instance e75af098-63dd-4436-a808-953b2506c6f2 on n-h1-860863-4 Nov 02 21:27:46.687693 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f6a2b92a-94a9-47cc-b2c4-cbf44cb5648e req-45502515-7755-4b9b-809d-cb1605aeb85a service nova] Creating event network-changed:dc9c66a9-effe-43b7-be0f-926f7c85d53b for instance f5e6d441-91f0-416d-b6ca-6b1a1645252b on n-h1-860863-4 Nov 02 21:27:46.695098 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f6a2b92a-94a9-47cc-b2c4-cbf44cb5648e req-45502515-7755-4b9b-809d-cb1605aeb85a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081000 Nov 02 21:27:46.707923 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 763/1606] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:46.724847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-93f0d71c-f8df-41e3-bbfd-1c125b3230b7 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b691fe310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:46.767710 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b0bc684-5d06-423c-b2fd-f0261b2a2f2f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.555987 Nov 02 21:27:46.778398 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 844/1607] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:27:46.783709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3e99bb4-4a1b-4b25-b3ea-00f6ed9df811 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d24cd30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:46.800100 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-93f0d71c-f8df-41e3-bbfd-1c125b3230b7 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/c784fa17-e2d4-441f-9933-6b566e364cd9" status: 200 len: 662 microversion: 2.1 time: 0.092518 Nov 02 21:27:46.805642 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 764/1608] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:46 2022] GET /compute/v2.1/images/c784fa17-e2d4-441f-9933-6b566e364cd9 => generated 662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:46.809019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:46.809917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:46.817153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.817955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.818562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:46.819460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:46.820400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:46.821105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:47.124373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:47.135130 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5d00076d-b28c-4afc-b7bd-926c5bff67a5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.332949 Nov 02 21:27:47.135997 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 765/1609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:46 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:47.151028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0be67b46-5997-4f25-b453-63bf093b20b0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:47.151736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0be67b46-5997-4f25-b453-63bf093b20b0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:47.216104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0be67b46-5997-4f25-b453-63bf093b20b0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:47.225366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0be67b46-5997-4f25-b453-63bf093b20b0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1215 microversion: 2.1 time: 0.088202 Nov 02 21:27:47.226502 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 766/1610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:47 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:47.231512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:47.236091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:47.248395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:47.249175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:47.249737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:47.250843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:47.251392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:47.251913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:47.446237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lazy-loading 'services' on Instance uuid 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:27:47.814352 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77c60d72-97fc-4ce2-88df-0ea06aab70ea tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments/b88500c3-be8a-4560-8d92-27dce3eaede6" status: 202 len: 0 microversion: 2.25 time: 0.586423 Nov 02 21:27:47.814953 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 767/1611] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Nov 2 21:27:47 2022] DELETE /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments/b88500c3-be8a-4560-8d92-27dce3eaede6 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:27:47.829884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1958866105", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:47.897056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:48.212687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:48.213382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:48.213607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:48.214048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:48.214481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:48.245802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.246351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.246799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.247527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.247982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.248478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.331452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Getting quotas for project 82b9d02c247b40dc88ed230398b0613e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:48.336746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Getting quotas for user 1f3b6eb3bdd54df39a977d90228914ac and project 82b9d02c247b40dc88ed230398b0613e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:48.358370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:48.390926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:48.597585 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3e99bb4-4a1b-4b25-b3ea-00f6ed9df811 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 204 len: 0 microversion: 2.1 time: 1.817944 Nov 02 21:27:48.598146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 845/1612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:46 2022] DELETE /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 0 bytes in 1819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:27:48.603744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:48.604360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:48.619143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.619673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.621692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.621692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.621692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.623010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.685817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] HTTP exception thrown: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Request method failure captured: Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 HTTP/1.1 Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCvBwW7goXVGenp6MWVd_3CLMKYt89yIupDjQzOWqAXl1nE1-e9Fo4QUS9cXKYqFtDxuzh5a8UZ_lEznzLqd_TMBhWMzSRXb3x0yhFWsAzWy34Pu1aFVATvMSnZHlFRKWAWxy9Ewp3xvMz1zdSo9nHHcfspMuFcUnzsJDV8emDyyog Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:48.689153 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9a636b6e37a049b08cef243d52a600c7 Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:48.690583 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e75af098-63dd-4436-a808-953b2506c6f2'} Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:48.691850 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:48.693711 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:48.695896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Returning 404 to user: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:48.695989 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72be8305-6a60-436b-a1d7-ce02dc63c94f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853352 Nov 02 21:27:48.696079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ca09f95-c673-4872-bf81-424c6690dcdd tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 404 len: 111 microversion: 2.1 time: 0.090737 Nov 02 21:27:48.697361 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 846/1613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:48 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:48.701332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 768/1614] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:27:48.729300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:48.733477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:48.749792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.750991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.751807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.752922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.753912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.760255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.760533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:48.777572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:48.814758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.815274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.829266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.829266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.829266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.829266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.892901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fab76dd-2ec8-48bc-8b4e-a537aeac6047 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.194366 Nov 02 21:27:48.901390 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 847/1615] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:27:48 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:27:48.907097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:48.907817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:48.919913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.925165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.925165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:48.925165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:48.925165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:48.925587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.030267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:49.042425 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0eab5311-72e6-454a-bef0-d6705e48267a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1219 microversion: 2.1 time: 0.139680 Nov 02 21:27:49.045483 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 848/1616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:48 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:49.053468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:49.057616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:49.070532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.071142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.071606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.072854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.073359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.073797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.135626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:27:49.156039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:49.163966 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ca11e77-424c-46dc-9012-ebbcf13929d9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.458030 Nov 02 21:27:49.177736 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 769/1617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:48 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:49.187390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-906170021", "metadata": {"image_type": "test"}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:49.190238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:49.204665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.205217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.205665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.206382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.206839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.207285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.240199 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] HTTP exception thrown: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Request method failure captured: Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2/action HTTP/1.1 Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 111 Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCvBwW7goXVGenp6MWVd_3CLMKYt89yIupDjQzOWqAXl1nE1-e9Fo4QUS9cXKYqFtDxuzh5a8UZ_lEznzLqd_TMBhWMzSRXb3x0yhFWsAzWy34Pu1aFVATvMSnZHlFRKWAWxy9Ewp3xvMz1zdSo9nHHcfspMuFcUnzsJDV8emDyyog Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:49.245029 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9a636b6e37a049b08cef243d52a600c7 Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-906170021", "metadata": {"image_type": "test"}}} Nov 02 21:27:49.246541 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e75af098-63dd-4436-a808-953b2506c6f2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-906170021', 'metadata': {'image_type': 'test'}}}} Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.247323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.248645 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.250335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.250335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:49.250335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:49.250335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.250335 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.250335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Returning 404 to user: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:49.252535 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b7e8c53f-1a11-41fb-8e9e-1bd7d26c9c0e tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "POST /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2/action" status: 404 len: 111 microversion: 2.1 time: 0.078832 Nov 02 21:27:49.253911 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 770/1618] 10.222.0.25 () {60 vars in 1279 bytes} [Wed Nov 2 21:27:49 2022] POST /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:49.286289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2115417429", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:49.353130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:49.638695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6989c850-2b93-4110-be51-d58221ebc004 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 204 len: 0 microversion: 2.1 time: 0.591908 Nov 02 21:27:49.652236 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 849/1619] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:49 2022] DELETE /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:27:49.666620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ac90c85-b87d-4409-a36d-9f4fc08b6d43 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-281505456", "metadata": {"image_type": "test"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:49.688788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ac90c85-b87d-4409-a36d-9f4fc08b6d43 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Failed to fetch instance by id tempest-invalid-1763638733 {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 21:27:49.690758 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9ac90c85-b87d-4409-a36d-9f4fc08b6d43 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] HTTP exception thrown: Instance tempest-invalid-1763638733 could not be found. Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ac90c85-b87d-4409-a36d-9f4fc08b6d43 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Request method failure captured: Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/tempest-invalid-1763638733/action HTTP/1.1 Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 111 Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCvBwW7goXVGenp6MWVd_3CLMKYt89yIupDjQzOWqAXl1nE1-e9Fo4QUS9cXKYqFtDxuzh5a8UZ_lEznzLqd_TMBhWMzSRXb3x0yhFWsAzWy34Pu1aFVATvMSnZHlFRKWAWxy9Ewp3xvMz1zdSo9nHHcfspMuFcUnzsJDV8emDyyog Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:49.692779 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9a636b6e37a049b08cef243d52a600c7 Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-281505456", "metadata": {"image_type": "test"}}} Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:49.694901 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance tempest-invalid-1763638733 could not be found. Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'tempest-invalid-1763638733', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-281505456', 'metadata': {'image_type': 'test'}}}} Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1763638733 could not be found. Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.696567 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1763638733 could not be found. Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1763638733 could not be found. Nov 02 21:27:49.698357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.706658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ac90c85-b87d-4409-a36d-9f4fc08b6d43 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Returning 404 to user: Instance tempest-invalid-1763638733 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:49.707855 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ac90c85-b87d-4409-a36d-9f4fc08b6d43 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "POST /compute/v2.1/servers/tempest-invalid-1763638733/action" status: 404 len: 101 microversion: 2.1 time: 0.052198 Nov 02 21:27:49.709864 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 850/1620] 10.222.0.25 () {60 vars in 1249 bytes} [Wed Nov 2 21:27:49 2022] POST /compute/v2.1/servers/tempest-invalid-1763638733/action => generated 101 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:49.724063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-288c8ae5-aa0b-473d-a23d-b05398d7f69d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-232396578"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:49.728558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-288c8ae5-aa0b-473d-a23d-b05398d7f69d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 21:27:49.733900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-288c8ae5-aa0b-473d-a23d-b05398d7f69d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-288c8ae5-aa0b-473d-a23d-b05398d7f69d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Request method failure captured: Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 56 Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCvBwW7goXVGenp6MWVd_3CLMKYt89yIupDjQzOWqAXl1nE1-e9Fo4QUS9cXKYqFtDxuzh5a8UZ_lEznzLqd_TMBhWMzSRXb3x0yhFWsAzWy34Pu1aFVATvMSnZHlFRKWAWxy9Ewp3xvMz1zdSo9nHHcfspMuFcUnzsJDV8emDyyog Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:49.738632 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9a636b6e37a049b08cef243d52a600c7 Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: {"createImage": {"name": "tempest-test-snap-232396578"}} Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:49.740366 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-232396578'}}} Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.742049 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.744184 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.746728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:49.746728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:49.746728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:49.746728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:49.746728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:49.750232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-288c8ae5-aa0b-473d-a23d-b05398d7f69d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:49.750232 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-288c8ae5-aa0b-473d-a23d-b05398d7f69d tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.033330 Nov 02 21:27:49.750232 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 851/1621] 10.222.0.25 () {60 vars in 1275 bytes} [Wed Nov 2 21:27:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:49.764014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.764486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4633e7a0-16a8-4c2f-adec-eac135a180fe tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-307659265"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:49.766387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.766387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.766387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.766387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.766759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.768156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4633e7a0-16a8-4c2f-adec-eac135a180fe tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 21:27:49.768844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4633e7a0-16a8-4c2f-adec-eac135a180fe tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4633e7a0-16a8-4c2f-adec-eac135a180fe tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Request method failure captured: Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 56 Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCvBwW7goXVGenp6MWVd_3CLMKYt89yIupDjQzOWqAXl1nE1-e9Fo4QUS9cXKYqFtDxuzh5a8UZ_lEznzLqd_TMBhWMzSRXb3x0yhFWsAzWy34Pu1aFVATvMSnZHlFRKWAWxy9Ewp3xvMz1zdSo9nHHcfspMuFcUnzsJDV8emDyyog Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:49.770702 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9a636b6e37a049b08cef243d52a600c7 Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: {"createImage": {"name": "tempest-test-snap-307659265"}} Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:49.772475 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-307659265'}}} Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.774243 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 21:27:49.775759 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.778316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4633e7a0-16a8-4c2f-adec-eac135a180fe tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:49.780034 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4633e7a0-16a8-4c2f-adec-eac135a180fe tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.023401 Nov 02 21:27:49.781163 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 852/1622] 10.222.0.25 () {60 vars in 1281 bytes} [Wed Nov 2 21:27:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:49.791679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:49.793123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:49.797077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Getting quotas for project 82b9d02c247b40dc88ed230398b0613e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:49.804540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.804689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Getting quotas for user 1f3b6eb3bdd54df39a977d90228914ac and project 82b9d02c247b40dc88ed230398b0613e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:49.804799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.804799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.805575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:49.806204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:49.806850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:49.826040 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] HTTP exception thrown: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Request method failure captured: Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 HTTP/1.1 Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuCvBwW7goXVGenp6MWVd_3CLMKYt89yIupDjQzOWqAXl1nE1-e9Fo4QUS9cXKYqFtDxuzh5a8UZ_lEznzLqd_TMBhWMzSRXb3x0yhFWsAzWy34Pu1aFVATvMSnZHlFRKWAWxy9Ewp3xvMz1zdSo9nHHcfspMuFcUnzsJDV8emDyyog Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:27:49.828091 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9a636b6e37a049b08cef243d52a600c7 Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.829871 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e75af098-63dd-4436-a808-953b2506c6f2'} Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:49.830892 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:49.833380 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:27:49.834977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Returning 404 to user: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:49.834977 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8fe7835a-3a97-4c6a-980d-84c40e0131ef tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 404 len: 111 microversion: 2.1 time: 0.047264 Nov 02 21:27:49.836205 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 853/1623] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:27:49 2022] DELETE /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:49.841262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1021565039", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fbb32731-3286-4309-9c0c-b898bc17a336"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:49.841977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:49.849047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:49.901559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] validate_networks() for [('fbb32731-3286-4309-9c0c-b898bc17a336', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:27:50.039944 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ce042afe-8186-4092-be67-e13107546749 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761061 Nov 02 21:27:50.041095 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 771/1624] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:27:50.050874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:50.052254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] [instance: e75af098-63dd-4436-a808-953b2506c6f2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:50.064824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.065758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.066436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.067402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.068104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.070121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.089264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] HTTP exception thrown: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Request method failure captured: Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 HTTP/1.1 Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuCvBwW7goXVGenp6MWVd_3CLMKYt89yIupDjQzOWqAXl1nE1-e9Fo4QUS9cXKYqFtDxuzh5a8UZ_lEznzLqd_TMBhWMzSRXb3x0yhFWsAzWy34Pu1aFVATvMSnZHlFRKWAWxy9Ewp3xvMz1zdSo9nHHcfspMuFcUnzsJDV8emDyyog Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:27:50.091887 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c036e48d06bf49d9b9caae92d5444e43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: c036e48d06bf49d9b9caae92d5444e43 Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-736403191 Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9a636b6e37a049b08cef243d52a600c7 Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesNegativeTestJSON-736403191-project Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:50.099213 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e75af098-63dd-4436-a808-953b2506c6f2'} Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:27:50.100194 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. Nov 02 21:27:50.103605 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:27:50.105110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] Returning 404 to user: Instance e75af098-63dd-4436-a808-953b2506c6f2 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:27:50.105110 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b654cdb4-cdc9-47c2-ae24-868b3f255d71 tempest-ImagesNegativeTestJSON-736403191 tempest-ImagesNegativeTestJSON-736403191-project] 10.222.0.25 "GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2" status: 404 len: 111 microversion: 2.1 time: 0.051250 Nov 02 21:27:50.105110 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 772/1625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:50 2022] GET /compute/v2.1/servers/e75af098-63dd-4436-a808-953b2506c6f2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:27:50.106366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:50.108957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:50.115463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.116986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.117716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.118851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.119577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.120230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.183506 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59d1c5c6-ec05-468b-b946-21dd3bc5e976 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083565 Nov 02 21:27:50.183506 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 773/1626] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:27:50 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:27:50.185728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-57dd49d8-1edd-4a25-b950-f1f23e23e923 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:50.187682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-57dd49d8-1edd-4a25-b950-f1f23e23e923 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:50.333341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-57dd49d8-1edd-4a25-b950-f1f23e23e923 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:50.344644 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-57dd49d8-1edd-4a25-b950-f1f23e23e923 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1218 microversion: 2.1 time: 0.163491 Nov 02 21:27:50.358717 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 774/1627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:50 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:50.377410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:50.378395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:50.389318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.390709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.390709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.405729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.407959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.409773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.565916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:50.576064 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5b179247-038a-4b48-8b23-932e86350fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1267 microversion: 2.1 time: 0.216013 Nov 02 21:27:50.577788 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 775/1628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:50 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:50.599205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:50.601940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:50.626178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.629643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.645270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.650986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.657492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.658161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.686466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:27:50.687565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:27:50.688592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:27:50.689329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:27:50.690410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:27:50.723187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.723809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.724127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.729289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:50.729780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:50.730214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:50.780465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:50.791832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Getting quotas for user 9ab2a1f2b5b74571b08c97e9493d568d and project 671105d3974446ba9f2d440caecf4dea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:50.801298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:50.836482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:27:50.838848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:27:50.937117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:50.954780 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a210f220-ce15-40f9-810f-6d9b01efc9d4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.375621 Nov 02 21:27:50.959727 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 776/1629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:50 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:51.006078 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7282cb0e-a38b-4058-9124-b519f548bf8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.168424 Nov 02 21:27:51.008381 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 854/1630] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:27:51.019676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1aa5d4ea-b1f2-458c-92c7-6f0686856d8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:51.020305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1aa5d4ea-b1f2-458c-92c7-6f0686856d8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:51.130280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1aa5d4ea-b1f2-458c-92c7-6f0686856d8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:51.156148 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1aa5d4ea-b1f2-458c-92c7-6f0686856d8e tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1208 microversion: 2.1 time: 0.140682 Nov 02 21:27:51.157543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 777/1631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:51 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1208 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:51.202564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:51.208726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:51.224448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:51.225876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:51.226737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:51.227870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:51.228637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:51.230220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:51.290785 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b9aef55-8e19-43db-ba29-ef78ac577beb tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099009 Nov 02 21:27:51.295554 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 855/1632] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:27:51 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:27:51.388150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:51.390591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:51.400985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:51.401489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:51.403173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:51.403919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:51.404387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:51.405570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:51.532226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:51.536464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:51.544302 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3c3af0f7-aa34-4e86-9db0-81bfcdfea21e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1222 microversion: 2.1 time: 0.159887 Nov 02 21:27:51.545624 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 778/1633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:51 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:51.606438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:51.607061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:51.616077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:51.616673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:51.617617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:51.618576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:51.619530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:51.620199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:51.693769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:51.703215 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4dd9064a-82e3-42d1-baf5-4b67b7ec2b10 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1267 microversion: 2.1 time: 0.100855 Nov 02 21:27:51.704240 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 856/1634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:51 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:51.985940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:51.986622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:52.017646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:52.018724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:52.020013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:52.022333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:52.023681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:52.025667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:52.183465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4dcd25dd-9a45-4ac1-8b45-1b30cc6762a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:52.184444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4dcd25dd-9a45-4ac1-8b45-1b30cc6762a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:52.543154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4dcd25dd-9a45-4ac1-8b45-1b30cc6762a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:52.552327 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4dcd25dd-9a45-4ac1-8b45-1b30cc6762a8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1208 microversion: 2.1 time: 0.374296 Nov 02 21:27:52.574371 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 857/1635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:52 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1208 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:27:52.588067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:52.591581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:52.634091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:52.634091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:52.634091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:52.635008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:52.635731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:52.636407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:52.759610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85efde75-c80b-46af-a48b-5d70bbff1938 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.176392 Nov 02 21:27:52.761303 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 858/1636] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:27:52 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:27:52.770545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:52.772162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:52.782582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:52.784759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:52.785528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:52.787259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:52.790177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:52.791336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:52.927307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:52.943672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:52.960727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-932f1a8f-f72c-44c9-8395-4b4749143f21 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.981022 Nov 02 21:27:52.962836 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02f23710-72d2-41d2-ad87-40178f1620f3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1214 microversion: 2.1 time: 0.199831 Nov 02 21:27:52.963454 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 859/1637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:52 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:52.982648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c62fdb43-448b-47ce-bdc1-085d2d601bd8 req-649ddfbe-735d-4ace-b825-75c184e0b9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e6d441-91f0-416d-b6ca-6b1a1645252b", "name": "network-vif-plugged", "status": "completed", "tag": "dc9c66a9-effe-43b7-be0f-926f7c85d53b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:52.983169 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 779/1638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:51 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:53.000314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:53.002169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c62fdb43-448b-47ce-bdc1-085d2d601bd8 req-649ddfbe-735d-4ace-b825-75c184e0b9bc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.002569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c62fdb43-448b-47ce-bdc1-085d2d601bd8 req-649ddfbe-735d-4ace-b825-75c184e0b9bc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.002871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:53.003431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c62fdb43-448b-47ce-bdc1-085d2d601bd8 req-649ddfbe-735d-4ace-b825-75c184e0b9bc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.018686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.019593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.020211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.029717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.030027 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c62fdb43-448b-47ce-bdc1-085d2d601bd8 req-649ddfbe-735d-4ace-b825-75c184e0b9bc service nova] Creating event network-vif-plugged:dc9c66a9-effe-43b7-be0f-926f7c85d53b for instance f5e6d441-91f0-416d-b6ca-6b1a1645252b on n-h1-860863-4 Nov 02 21:27:53.030705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.031947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.045349 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c62fdb43-448b-47ce-bdc1-085d2d601bd8 req-649ddfbe-735d-4ace-b825-75c184e0b9bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076530 Nov 02 21:27:53.049672 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 860/1639] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:53.464553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:53.486031 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7500e84b-c3ed-4f82-9e84-2cd7383eda87 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1273 microversion: 2.1 time: 0.488801 Nov 02 21:27:53.487060 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 780/1640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:52 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1273 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:53.580878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:53.581617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:53.597139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.597632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.598073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.598784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.599279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.613325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.635967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d35d8eb0-ab4a-4b5e-8a06-07a64b8e98e8 req-ede0234d-4f02-40fb-a25d-a9097ad9ab93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9429781f-2367-4cec-bfdb-641db74cc989", "name": "network-vif-deleted", "tag": "c5152ab2-61c4-418e-ba79-8965f88d0751"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:53.649295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d35d8eb0-ab4a-4b5e-8a06-07a64b8e98e8 req-ede0234d-4f02-40fb-a25d-a9097ad9ab93 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.650080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d35d8eb0-ab4a-4b5e-8a06-07a64b8e98e8 req-ede0234d-4f02-40fb-a25d-a9097ad9ab93 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.650812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d35d8eb0-ab4a-4b5e-8a06-07a64b8e98e8 req-ede0234d-4f02-40fb-a25d-a9097ad9ab93 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.665390 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d35d8eb0-ab4a-4b5e-8a06-07a64b8e98e8 req-ede0234d-4f02-40fb-a25d-a9097ad9ab93 service nova] Creating event network-vif-deleted:c5152ab2-61c4-418e-ba79-8965f88d0751 for instance 9429781f-2367-4cec-bfdb-641db74cc989 on n-h2-860863-4 Nov 02 21:27:53.674615 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d35d8eb0-ab4a-4b5e-8a06-07a64b8e98e8 req-ede0234d-4f02-40fb-a25d-a9097ad9ab93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045982 Nov 02 21:27:53.698160 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 781/1641] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:53.775965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:53.780593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:53.781278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:53.793889 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c5210dd7-cdf7-4b24-b41f-ffb9106b6470 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1204 microversion: 2.1 time: 0.217467 Nov 02 21:27:53.795944 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 861/1642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:53 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1204 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:53.811316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.812145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.812782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.814149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:53.814954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:53.815787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:53.941691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-831694cf-481d-47eb-9367-0ae97872e79b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172232 Nov 02 21:27:53.948285 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 782/1643] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:27:53 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:27:53.996021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:53.997407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:54.004518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:54.005885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:54.017375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.022479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.023290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.024206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.030335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.030933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.033350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.035610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.044891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.047475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.049630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.052211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.370554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:54.418283 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-77777515-5f7a-4015-87f7-38cb9d0bda52 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1270 microversion: 2.1 time: 0.423587 Nov 02 21:27:54.436083 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 862/1644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:53 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1270 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:54.519573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:54.520523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:54.532237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.532743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.533214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.533928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.541907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.542373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.795046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:54.813060 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8b14010e-6ac0-4ac6-af90-f77730fa601b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1318 microversion: 2.1 time: 0.820596 Nov 02 21:27:54.813773 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 783/1645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:53 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:54.825843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:54.847120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a4ba599-a423-4c0b-a3e5-8488a5db54a0 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b68bda040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:54.870547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d8e02e3-2204-4483-a3c4-22fc16788232 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1273 microversion: 2.1 time: 0.355495 Nov 02 21:27:54.873573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 863/1646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:54 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1273 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:54.903478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:54.904110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:54.931109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.931785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.933790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.933790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:54.934357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:54.934903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:54.948997 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a4ba599-a423-4c0b-a3e5-8488a5db54a0 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7" status: 200 len: 636 microversion: 2.1 time: 0.133220 Nov 02 21:27:54.961287 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 784/1647] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:27:54 2022] GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7 => generated 636 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:54.976370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:54.987950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:55.023569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:55.024591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:55.025524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:55.026916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:55.029633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:55.030283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:55.140830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3217faf0-61c3-40ba-93fd-1dc9811f008f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.175813 Nov 02 21:27:55.147244 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 785/1648] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:27:54 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:27:55.162875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e6770f0-e951-49b0-9109-3fc7260dd157 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update_all', calling method: .version_select at 0x7f9b69688040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:55.164512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:55.176758 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2eab940a-48e6-474d-abf8-e11b753a8696 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1204 microversion: 2.1 time: 0.300568 Nov 02 21:27:55.181994 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 864/1649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:54 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1204 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:55.267482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8e6770f0-e951-49b0-9109-3fc7260dd157 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:55.287777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8e6770f0-e951-49b0-9109-3fc7260dd157 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:55.316458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:55.452759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:55.454744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:55.504500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:55.506617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:55.508127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:55.510624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:55.513585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:55.514277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:55.881496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e6770f0-e951-49b0-9109-3fc7260dd157 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.730970 Nov 02 21:27:55.884351 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 786/1650] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:27:55 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 61 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:27:55.901649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:55.906475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:55.927217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:55.930660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:55.931304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:55.932201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:55.932819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:55.933466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:55.973489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:55.983623 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dbf5693d-d7f9-4cc9-bee7-67e594c7c311 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1288 microversion: 2.1 time: 0.535621 Nov 02 21:27:55.984971 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 865/1651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:55 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1288 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:27:56.005732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af5fe9ae-bb7e-47ef-9a81-003f141e4983 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b6d217ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:56.280163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:56.290673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd8af954-d922-4ec7-a79e-d4169cad78ff tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1467 microversion: 2.1 time: 0.403791 Nov 02 21:27:56.291522 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 787/1652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:55 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1467 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:56.300803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:56.307402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:56.330624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:56.331086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:56.331857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:56.333063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:56.333735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:56.334630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:56.543371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af5fe9ae-bb7e-47ef-9a81-003f141e4983 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "DELETE /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.556510 Nov 02 21:27:56.553565 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 866/1653] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 21:27:55 2022] DELETE /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata/os_version => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:27:56.569768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:56.574328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:56.597239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:56.598463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:56.599312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:56.600301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:56.601918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:56.603700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:56.609129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:56.674599 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47f7a39a-fa84-4733-9d52-90a92bc4ad9d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.117193 Nov 02 21:27:56.676972 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 867/1654] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:27:56 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:56.685207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:56.685868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:56.698492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:56.699204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:56.699819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:56.700890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:56.701562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:56.702152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:57.252736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:57.262463 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed9b04e3-5f22-4b3a-8415-35bca3761967 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1268 microversion: 2.1 time: 0.585870 Nov 02 21:27:57.263771 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 868/1655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:56 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1268 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:57.275276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:57.276083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:57.290682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:57.297726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:57.298923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:57.299683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:57.300159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:57.300595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:57.676581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:57.688034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c73228d-5c16-431d-91f2-5f4c8cd2e38f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 1.395153 Nov 02 21:27:57.697165 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 788/1656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:56 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:57.702047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad9e408b-ed71-4fdb-a957-5896b3482cc3 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b691fe310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:57.766542 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad9e408b-ed71-4fdb-a957-5896b3482cc3 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 37 microversion: 2.1 time: 0.068211 Nov 02 21:27:57.767742 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 789/1657] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:27:57 2022] GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 37 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:27:57.776528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:57.779186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:57.787611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:57.789988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:57.794623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:57.794623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:57.794623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:57.794623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:58.043411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:58.063515 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8978cae0-ca43-488e-a40b-3f4735e3214b tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1276 microversion: 2.1 time: 0.293819 Nov 02 21:27:58.065113 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 790/1658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:57 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:58.097067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85e5a181-dc4f-446e-b3be-160e81638b3f tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update_all', calling method: .version_select at 0x7f9b6926ff70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:58.144114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:58.151935 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96a1e64d-069e-4a0c-9cc3-dde4aaac37c7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8" status: 200 len: 1468 microversion: 2.1 time: 0.883579 Nov 02 21:27:58.153175 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 869/1659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:57 2022] GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 => generated 1468 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:58.181451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:58.198072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:58.201858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Searching by: {'reservation_id': 'r-xnol0p66', 'deleted': False, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:27:58.219148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:58.223261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:58.224686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:58.225812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:58.226695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:58.229507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:58.233085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-85e5a181-dc4f-446e-b3be-160e81638b3f tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:58.244142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-85e5a181-dc4f-446e-b3be-160e81638b3f tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:27:58.523515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:27:58.655223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:58.663662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:58.664283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:58.664735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:58.809658 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85e5a181-dc4f-446e-b3be-160e81638b3f tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.743054 Nov 02 21:27:58.819298 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 791/1660] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:27:58 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 61 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:27:58.824426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:58.825135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:58.842118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:58.842118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:58.842118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:58.842118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:58.842923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:58.843529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:58.974934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:58.987139 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-454910ca-8ea7-4082-a553-62e2a9bee1ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1266 microversion: 2.1 time: 0.166397 Nov 02 21:27:58.988428 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 792/1661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:58 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:58.997516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:58.999462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:59.015991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:59.015991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:59.015991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:59.015991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:59.016452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:59.016452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:59.130943 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1258447f-4d27-46e7-8f94-1450c615fe2d tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-xnol0p66" status: 200 len: 2928 microversion: 2.1 time: 0.956125 Nov 02 21:27:59.137173 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 870/1662] 10.222.0.25 () {58 vars in 1197 bytes} [Wed Nov 2 21:27:58 2022] GET /compute/v2.1/servers/detail?reservation_id=r-xnol0p66 => generated 2928 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:59.140118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-68695dc7-3ede-40c4-9e70-7e1b567bea12 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b6d2bfaf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:59.209832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-68695dc7-3ede-40c4-9e70-7e1b567bea12 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.075070 Nov 02 21:27:59.210661 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 871/1663] 10.222.0.25 () {58 vars in 1290 bytes} [Wed Nov 2 21:27:59 2022] GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata/os_distro => generated 33 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:27:59.230037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:59.230954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:59.242083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:59.242083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:59.242083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:59.242083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:59.242621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:59.242621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:59.542135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:59.550998 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f5eb02e1-74f1-4ebc-ac22-b662eca5c121 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 0.559683 Nov 02 21:27:59.565017 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 793/1664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:58 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:59.570689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f612f73-60ac-4bf3-8c82-dec4c1e252a4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:59.621348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.server_groups [None req-9f612f73-60ac-4bf3-8c82-dec4c1e252a4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Querying cell 8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) for 2 instances {{(pid=121039) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 21:27:59.626102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f612f73-60ac-4bf3-8c82-dec4c1e252a4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:59.626763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f612f73-60ac-4bf3-8c82-dec4c1e252a4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:59.627296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f612f73-60ac-4bf3-8c82-dec4c1e252a4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:59.694244 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f612f73-60ac-4bf3-8c82-dec4c1e252a4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/2946cc9c-f0a4-427b-ade8-829394505904" status: 200 len: 265 microversion: 2.1 time: 0.121048 Nov 02 21:27:59.694244 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 794/1665] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:27:59 2022] GET /compute/v2.1/os-server-groups/2946cc9c-f0a4-427b-ade8-829394505904 => generated 265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:27:59.703733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-08cf5a89-4d8e-4bad-b75d-94e7f0c289e3 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update_all', calling method: .version_select at 0x7f9b691fe790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:27:59.715837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:27:59.728135 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14de9936-fb7a-4b8a-9d35-5ab98586ec5a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.514904 Nov 02 21:27:59.734007 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 872/1666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:59 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:27:59.739508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:27:59.742163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:27:59.756096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:59.763726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:59.765050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:59.766728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:27:59.768045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:27:59.775341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:27:59.779787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:27:59.813077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-08cf5a89-4d8e-4bad-b75d-94e7f0c289e3 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:27:59.832496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-08cf5a89-4d8e-4bad-b75d-94e7f0c289e3 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:00.141397 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-08cf5a89-4d8e-4bad-b75d-94e7f0c289e3 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.450294 Nov 02 21:28:00.143231 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 795/1667] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:27:59 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 61 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:00.151618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d0ec2de3-2448-438b-b76a-6d5a75b941c9 req-70ebb578-ebb4-4839-ba5d-a99486364d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082dcea3-173c-4af7-8c8b-9b8f5e0bf476", "tag": "1c732ff2-0b62-4318-9635-be7d8011a2c0"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:00.162878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d0ec2de3-2448-438b-b76a-6d5a75b941c9 req-70ebb578-ebb4-4839-ba5d-a99486364d2c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:00.163471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d0ec2de3-2448-438b-b76a-6d5a75b941c9 req-70ebb578-ebb4-4839-ba5d-a99486364d2c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:00.163995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d0ec2de3-2448-438b-b76a-6d5a75b941c9 req-70ebb578-ebb4-4839-ba5d-a99486364d2c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:00.185125 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d0ec2de3-2448-438b-b76a-6d5a75b941c9 req-70ebb578-ebb4-4839-ba5d-a99486364d2c service nova] Creating event network-changed:1c732ff2-0b62-4318-9635-be7d8011a2c0 for instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 on n-h2-860863-4 Nov 02 21:28:00.190234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d0ec2de3-2448-438b-b76a-6d5a75b941c9 req-70ebb578-ebb4-4839-ba5d-a99486364d2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045609 Nov 02 21:28:00.191121 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 796/1668] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:00.202135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:00.202853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:00.226508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:00.227011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:00.227463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:00.228182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:00.236052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:00.236527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:00.337273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c932f717-f3d4-4a84-9709-4dde713a7259 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8" status: 200 len: 1619 microversion: 2.1 time: 0.597407 Nov 02 21:28:00.337273 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 873/1669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:27:59 2022] GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 => generated 1619 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:00.346591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9460052-5b93-4cb1-b35e-d68a70486e08 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b69597af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:00.411456 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9460052-5b93-4cb1-b35e-d68a70486e08 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.072843 Nov 02 21:28:00.412023 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 874/1670] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:28:00 2022] GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 61 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:00.423248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ff4a41c6-7fb2-476e-9f30-b2b7a878f5f7 req-d037be2d-d50d-4a33-8347-2aeb96881918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed1b872-ec5d-49a1-8377-e5ae331eb050", "tag": "be8e2db3-3686-4477-9908-a126ccc17a17"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:00.444021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ff4a41c6-7fb2-476e-9f30-b2b7a878f5f7 req-d037be2d-d50d-4a33-8347-2aeb96881918 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:00.445057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ff4a41c6-7fb2-476e-9f30-b2b7a878f5f7 req-d037be2d-d50d-4a33-8347-2aeb96881918 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:00.445661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ff4a41c6-7fb2-476e-9f30-b2b7a878f5f7 req-d037be2d-d50d-4a33-8347-2aeb96881918 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:00.460988 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ff4a41c6-7fb2-476e-9f30-b2b7a878f5f7 req-d037be2d-d50d-4a33-8347-2aeb96881918 service nova] Creating event network-changed:be8e2db3-3686-4477-9908-a126ccc17a17 for instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 on n-h2-860863-4 Nov 02 21:28:00.466701 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ff4a41c6-7fb2-476e-9f30-b2b7a878f5f7 req-d037be2d-d50d-4a33-8347-2aeb96881918 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051277 Nov 02 21:28:00.468293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 875/1671] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:00.477037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:00.478042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:00.485981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:00.486820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:00.487431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:00.488335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:00.488790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:00.489243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:01.131659 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-708bc273-30d1-4b38-a4a8-13c349aca6f6 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 200 len: 1618 microversion: 2.1 time: 0.661901 Nov 02 21:28:01.132788 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 876/1672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:00 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 1618 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:01.140709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3687b35b-7a65-40e3-8ca3-4ee491e2dae5 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update_all', calling method: .version_select at 0x7f9b695ae4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:01.202814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:01.212508 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-37b83fec-b0bf-4e5f-88b1-6ba163972ffb tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 1.020134 Nov 02 21:28:01.213870 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 797/1673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:00 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:01.218199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3687b35b-7a65-40e3-8ca3-4ee491e2dae5 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:01.220721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:01.222123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:01.224864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3687b35b-7a65-40e3-8ca3-4ee491e2dae5 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:01.229838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:01.231004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:01.231820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:01.232787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:01.237426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:01.238415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:01.464550 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3687b35b-7a65-40e3-8ca3-4ee491e2dae5 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.330554 Nov 02 21:28:01.465211 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 877/1674] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:28:01 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 61 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:01.473324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:01.474493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:01.482203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:01.482728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:01.483201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:01.483885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:01.484346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:01.484776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:01.562907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:01.571634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-78b09a5c-24db-497d-9944-f5a611b560b8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 0.356253 Nov 02 21:28:01.572223 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 798/1675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:01 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:01.577628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a67ec78-0692-45d1-ad77-1c6f752e579f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: .version_select at 0x7f9b6929dd30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1580205889", "policies": ["anti-affinity"]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:01.612093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8a67ec78-0692-45d1-ad77-1c6f752e579f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:01.619478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8a67ec78-0692-45d1-ad77-1c6f752e579f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:01.751150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8a67ec78-0692-45d1-ad77-1c6f752e579f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:01.758193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8a67ec78-0692-45d1-ad77-1c6f752e579f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:01.771466 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a67ec78-0692-45d1-ad77-1c6f752e579f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.197688 Nov 02 21:28:01.772944 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 799/1676] 10.222.0.25 () {60 vars in 1174 bytes} [Wed Nov 2 21:28:01 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:01.861404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:01.876562 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d3afb35-98b4-43a3-a4c0-3b29813dce0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.410164 Nov 02 21:28:01.880419 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 878/1677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:01 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:01.893349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9add18ca-ba34-4e70-92a9-d836532b2e9d tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update_all', calling method: .version_select at 0x7f9b6d27fa60>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:01.970795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9add18ca-ba34-4e70-92a9-d836532b2e9d tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:01.978068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9add18ca-ba34-4e70-92a9-d836532b2e9d tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:02.033851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98988782-2cdc-4b7b-b9d1-e3a1a30f6a2f tempest-ListImagesTestJSON-1160828594 tempest-ListImagesTestJSON-1160828594-project] Calling method '.version_select at 0x7f9b691af280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:02.119158 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98988782-2cdc-4b7b-b9d1-e3a1a30f6a2f tempest-ListImagesTestJSON-1160828594 tempest-ListImagesTestJSON-1160828594-project] 10.222.0.25 "GET /compute/v2.1/images/612221e9-0156-4770-a8ac-3a978f4e721c" status: 200 len: 784 microversion: 2.1 time: 0.344204 Nov 02 21:28:02.123608 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 800/1678] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:01 2022] GET /compute/v2.1/images/612221e9-0156-4770-a8ac-3a978f4e721c => generated 784 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:02.153654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1480197189", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "35583db5-9d7d-49be-a89e-efecc8c8a4ef"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:02.533485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:28:02.573355 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9add18ca-ba34-4e70-92a9-d836532b2e9d tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.690089 Nov 02 21:28:02.574489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 879/1679] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:28:01 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 64 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:02.584755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cafcd46e-b3d9-4632-afc9-efeb9cd5c7fa tempest-ListImagesTestJSON-1160828594 tempest-ListImagesTestJSON-1160828594-project] Calling method '.version_select at 0x7f9b69597e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:02.751671 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cafcd46e-b3d9-4632-afc9-efeb9cd5c7fa tempest-ListImagesTestJSON-1160828594 tempest-ListImagesTestJSON-1160828594-project] 10.222.0.25 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.170898 Nov 02 21:28:02.752602 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 880/1680] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Nov 2 21:28:02 2022] GET /compute/v2.1/images => generated 445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:02.777439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:02.778225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:02.786154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:02.786658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:02.787105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:02.787819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:02.788526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:02.789493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.126047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:03.138430 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee620617-0c38-460b-8499-584c75b4ccab tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 0.384323 Nov 02 21:28:03.147198 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 881/1681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:02 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:03.147198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d6b6aeb3-954c-41f8-8172-216539c3d4a0 req-83f5239e-024b-4a31-b16f-ded62d347d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86c3828-5255-496f-b756-65a49cfc9cfb", "tag": "905eed9b-20b1-4629-a3a7-3a45b44eab21"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:03.149287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:28:03.149986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:28:03.150691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:28:03.151513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:28:03.152353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:28:03.160161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d6b6aeb3-954c-41f8-8172-216539c3d4a0 req-83f5239e-024b-4a31-b16f-ded62d347d2a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.160989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d6b6aeb3-954c-41f8-8172-216539c3d4a0 req-83f5239e-024b-4a31-b16f-ded62d347d2a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.161938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d6b6aeb3-954c-41f8-8172-216539c3d4a0 req-83f5239e-024b-4a31-b16f-ded62d347d2a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.177009 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d6b6aeb3-954c-41f8-8172-216539c3d4a0 req-83f5239e-024b-4a31-b16f-ded62d347d2a service nova] Creating event network-changed:905eed9b-20b1-4629-a3a7-3a45b44eab21 for instance b86c3828-5255-496f-b756-65a49cfc9cfb on n-h2-860863-4 Nov 02 21:28:03.182770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.182770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.182770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.183119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.183583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.184014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.184243 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d6b6aeb3-954c-41f8-8172-216539c3d4a0 req-83f5239e-024b-4a31-b16f-ded62d347d2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042506 Nov 02 21:28:03.185451 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 882/1682] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:03.191902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d739f6b-3c90-4660-be3e-219bdcea0b71 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b6d2ba040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:03.205693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:03.211885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:03.228114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Going to run 2 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:28:03.234477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:28:03.245238 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d739f6b-3c90-4660-be3e-219bdcea0b71 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 64 microversion: 2.1 time: 0.058098 Nov 02 21:28:03.246389 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 883/1683] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:28:03 2022] GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 64 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:03.252713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:03.253528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:03.261289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.261289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.261759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.262389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.262837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.263256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.346521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=121039) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 21:28:03.367207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:03.372952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:03.409988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:03.418782 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8e3f6b1-c616-46e8-b55b-5d7e17887693 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 0.171344 Nov 02 21:28:03.419367 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 884/1684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:03 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:03.423841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a70e4535-dd8b-419a-bd71-23e69f14ee27 tempest-ListImagesTestJSON-1160828594 tempest-ListImagesTestJSON-1160828594-project] Calling method '.version_select at 0x7f9b69597280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:03.464174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:03.473881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:03.476160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a70e4535-dd8b-419a-bd71-23e69f14ee27 tempest-ListImagesTestJSON-1160828594 tempest-ListImagesTestJSON-1160828594-project] 10.222.0.25 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.055753 Nov 02 21:28:03.477439 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 885/1685] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:28:03 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:03.479572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:03.482336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:03.482660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:03.492316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.493420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.493932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.494653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.495919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.496511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.503118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=5c881bde-f1ab-4c45-a6dd-42020aea198d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:28:03.660633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:03.666809 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b80dbd62-aa17-44c0-aabd-501d3d4a1b63 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.188196 Nov 02 21:28:03.667613 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 886/1686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:03 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:03.689200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0de426c3-f34c-4858-a548-ba29a676ccd0 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update_all', calling method: .version_select at 0x7f9b697824c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:03.695511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:03.704661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:03.743892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-0de426c3-f34c-4858-a548-ba29a676ccd0 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:03.749724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-0de426c3-f34c-4858-a548-ba29a676ccd0 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:03.841081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:03.846708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:03.891505 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-442dcf49-bd76-4e48-a067-e4234ce5d7c9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.748139 Nov 02 21:28:03.892291 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 801/1687] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:28:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 1750 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:28:03.905681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:03.917430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:03.918222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Searching by: {'deleted': False, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:28:03.938714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.939535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.940164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.941285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:03.941967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:03.942567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:03.991931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:28:04.074322 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-816934e2-f0ed-4602-b59f-a99d5a0caedf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.177838 Nov 02 21:28:04.075633 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 802/1688] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:28:03 2022] GET /compute/v2.1/servers => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:28:04.095067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-caf61fa3-1057-4e41-a3b7-bd0fe6246b1c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:04.101294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-caf61fa3-1057-4e41-a3b7-bd0fe6246b1c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:04.256553 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0de426c3-f34c-4858-a548-ba29a676ccd0 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.573602 Nov 02 21:28:04.259636 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 887/1689] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:28:03 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 61 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:04.276798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:04.276798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:04.283020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:04.283699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:04.284303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:04.285221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:04.285809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:04.286261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:04.325755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-caf61fa3-1057-4e41-a3b7-bd0fe6246b1c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:04.335173 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-caf61fa3-1057-4e41-a3b7-bd0fe6246b1c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1219 microversion: 2.1 time: 0.250453 Nov 02 21:28:04.340631 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 803/1690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:04 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1219 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:04.355042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ea53bd62-0b18-424a-8cd1-e73889dcc7cc tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update', calling method: .version_select at 0x7f9b689efca0>, body: {"meta": {"os_version": "alt"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:04.457916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ea53bd62-0b18-424a-8cd1-e73889dcc7cc tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:04.466774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ea53bd62-0b18-424a-8cd1-e73889dcc7cc tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:04.674228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:04.690071 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b481dbb7-4321-42b9-b03a-dc1ff264d651 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 0.426499 Nov 02 21:28:04.693956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 888/1691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:04 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:04.696146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:04.696773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:04.729088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:04.729771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:04.730235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:04.731006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:04.731463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:04.731896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:05.030875 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ea53bd62-0b18-424a-8cd1-e73889dcc7cc tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.688964 Nov 02 21:28:05.036483 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 804/1692] 10.222.0.25 () {60 vars in 1313 bytes} [Wed Nov 2 21:28:04 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata/os_version => generated 31 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:05.042637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:05.043257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:05.072683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:05.074347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:05.079831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:05.079831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:05.079831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:05.079831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:05.467602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:05.475498 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90981b87-863c-4e08-b237-874aff2dd7d7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 0.783176 Nov 02 21:28:05.476186 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 889/1693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:04 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:05.496126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ed61382-1850-44c7-b12f-beff041a0cd4 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b6d1528b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:05.551839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ed61382-1850-44c7-b12f-beff041a0cd4 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 58 microversion: 2.1 time: 0.059238 Nov 02 21:28:05.558898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:05.559983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 890/1694] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:28:05 2022] GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 58 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:05.565513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-61a2b49b-8bbf-4679-887b-0a4a27c453f0 req-117f1262-6720-4e83-b955-7d0e57bafc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed1b872-ec5d-49a1-8377-e5ae331eb050", "name": "network-vif-plugged", "status": "completed", "tag": "be8e2db3-3686-4477-9908-a126ccc17a17"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:05.569494 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5246a046-6728-4fab-853a-86f6410eb932 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.529517 Nov 02 21:28:05.571512 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 805/1695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:05 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:05.577967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61a2b49b-8bbf-4679-887b-0a4a27c453f0 req-117f1262-6720-4e83-b955-7d0e57bafc5c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:05.580072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61a2b49b-8bbf-4679-887b-0a4a27c453f0 req-117f1262-6720-4e83-b955-7d0e57bafc5c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:05.580072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61a2b49b-8bbf-4679-887b-0a4a27c453f0 req-117f1262-6720-4e83-b955-7d0e57bafc5c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:05.589836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-57d72dd4-bf94-4b0d-8735-ef6cfdd05e43 req-d5eabf01-39be-4bb9-8c6f-f75999b8307b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4fc182a-a536-4bf0-8cc8-55709adf5165", "tag": "26eb942e-23bd-42ba-90d9-dd057ab77634"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:05.595375 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-61a2b49b-8bbf-4679-887b-0a4a27c453f0 req-117f1262-6720-4e83-b955-7d0e57bafc5c service nova] Creating event network-vif-plugged:be8e2db3-3686-4477-9908-a126ccc17a17 for instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 on n-h2-860863-4 Nov 02 21:28:05.601629 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-61a2b49b-8bbf-4679-887b-0a4a27c453f0 req-117f1262-6720-4e83-b955-7d0e57bafc5c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039327 Nov 02 21:28:05.602248 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 891/1696] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:05.606309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-57d72dd4-bf94-4b0d-8735-ef6cfdd05e43 req-d5eabf01-39be-4bb9-8c6f-f75999b8307b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:05.607070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-57d72dd4-bf94-4b0d-8735-ef6cfdd05e43 req-d5eabf01-39be-4bb9-8c6f-f75999b8307b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:05.607797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b8f1690-37d2-4236-ade9-198c9c94b4bd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:05.608003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-57d72dd4-bf94-4b0d-8735-ef6cfdd05e43 req-d5eabf01-39be-4bb9-8c6f-f75999b8307b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:05.609293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b8f1690-37d2-4236-ade9-198c9c94b4bd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:05.624862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-57d72dd4-bf94-4b0d-8735-ef6cfdd05e43 req-d5eabf01-39be-4bb9-8c6f-f75999b8307b service nova] Creating event network-changed:26eb942e-23bd-42ba-90d9-dd057ab77634 for instance e4fc182a-a536-4bf0-8cc8-55709adf5165 on n-h2-860863-4 Nov 02 21:28:05.632590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-57d72dd4-bf94-4b0d-8735-ef6cfdd05e43 req-d5eabf01-39be-4bb9-8c6f-f75999b8307b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058447 Nov 02 21:28:05.634075 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 806/1697] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:05.643857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4357e2ac-63f7-40f8-a619-4b28530dd541 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'update_all', calling method: .version_select at 0x7f9b689efdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:05.685643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b8f1690-37d2-4236-ade9-198c9c94b4bd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:05.701074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b8f1690-37d2-4236-ade9-198c9c94b4bd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1219 microversion: 2.1 time: 0.094296 Nov 02 21:28:05.714710 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 892/1698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:05 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:05.719719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:05.720408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:05.721255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-4357e2ac-63f7-40f8-a619-4b28530dd541 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:05.728309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:05.728643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-4357e2ac-63f7-40f8-a619-4b28530dd541 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:05.729347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:05.729469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:05.730215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:05.730741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:05.731243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:05.894567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:05.909786 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f737fd6-8d97-4cc1-92c4-042ec4704502 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 0.193583 Nov 02 21:28:05.910605 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 893/1699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:05 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:06.135493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4357e2ac-63f7-40f8-a619-4b28530dd541 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 61 microversion: 2.1 time: 0.499850 Nov 02 21:28:06.136186 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 807/1700] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:28:05 2022] PUT /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 61 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:06.145592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f69151aa-34ec-4c54-a659-401f9ba05734 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Action: 'create', calling method: .version_select at 0x7f9b6d152790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:06.196818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f69151aa-34ec-4c54-a659-401f9ba05734 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:06.202060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f69151aa-34ec-4c54-a659-401f9ba05734 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Getting quotas for user cd6dc8381e0943b3b097b7b41a9c98e5 and project e10de7eae2484b798b2495ca122953f7. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:06.205017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:06.500070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:06.501530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:06.511546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:06.512488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:06.514067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:06.517060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:06.517824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:06.518599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:06.548390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:06.704072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:06.716031 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db3e285b-393d-4576-97b8-3012079a0d29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 0.220623 Nov 02 21:28:06.732940 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 808/1701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:06 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:06.738961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:06.739950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:06.746986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:06.747824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:06.748493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:06.749480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:06.750204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:06.751284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:06.761047 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f69151aa-34ec-4c54-a659-401f9ba05734 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "POST /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.619291 Nov 02 21:28:06.761828 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 894/1702] 10.222.0.25 () {60 vars in 1281 bytes} [Wed Nov 2 21:28:06 2022] POST /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 85 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:06.766638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:06.769500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:06.783196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:06.786256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:06.789767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:06.789767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:06.795797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:06.798844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:06.937502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:06.955331 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cdf6f06-9e94-4079-aca5-219a7de68a87 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1223 microversion: 2.1 time: 0.186739 Nov 02 21:28:06.956359 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 895/1703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:06 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1223 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:06.963899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84a3bd6d-4859-4832-a2ee-27df63720fc9 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] Calling method '.version_select at 0x7f9b68f6f670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:06.971030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:06.984006 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-93f9f6e6-b287-4e95-82de-bd53a0990714 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.249204 Nov 02 21:28:06.986880 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 809/1704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:06 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:06.989740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:06.991720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:07.009905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:07.010656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:07.011422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:07.012657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:07.013596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:07.015084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:07.024133 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84a3bd6d-4859-4832-a2ee-27df63720fc9 tempest-ImagesMetadataTestJSON-773557691 tempest-ImagesMetadataTestJSON-773557691-project] 10.222.0.25 "GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata" status: 200 len: 85 microversion: 2.1 time: 0.066475 Nov 02 21:28:07.030567 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 896/1705] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:28:06 2022] GET /compute/v2.1/images/46e14174-8c81-43e2-98d7-67ab29bfb3c7/metadata => generated 85 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:28:07.233399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:07.245729 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8603a689-2274-49ea-adc3-0f20f11ea5e8 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 0.259274 Nov 02 21:28:07.247013 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 810/1706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:06 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:07.695310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c9028c2b-0e23-4fd3-a201-1062975af6a8 req-84156e5e-e3e9-46b6-8257-2ea2fb10be8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082dcea3-173c-4af7-8c8b-9b8f5e0bf476", "name": "network-vif-plugged", "status": "completed", "tag": "1c732ff2-0b62-4318-9635-be7d8011a2c0"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:07.724069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9028c2b-0e23-4fd3-a201-1062975af6a8 req-84156e5e-e3e9-46b6-8257-2ea2fb10be8e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:07.724457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9028c2b-0e23-4fd3-a201-1062975af6a8 req-84156e5e-e3e9-46b6-8257-2ea2fb10be8e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:07.743797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9028c2b-0e23-4fd3-a201-1062975af6a8 req-84156e5e-e3e9-46b6-8257-2ea2fb10be8e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:07.744400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:07.744734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:07.771561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:07.771561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:07.771965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:07.778743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:07.779296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:07.779743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:07.786179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:07.792459 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c9028c2b-0e23-4fd3-a201-1062975af6a8 req-84156e5e-e3e9-46b6-8257-2ea2fb10be8e service nova] Creating event network-vif-plugged:1c732ff2-0b62-4318-9635-be7d8011a2c0 for instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 on n-h2-860863-4 Nov 02 21:28:07.821549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c9028c2b-0e23-4fd3-a201-1062975af6a8 req-84156e5e-e3e9-46b6-8257-2ea2fb10be8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129357 Nov 02 21:28:07.829057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 897/1707] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:07.981354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:07.982078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:08.000084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:08.000838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:08.001332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:08.002045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:08.002502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:08.002934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:08.145429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:08.154663 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-77aad179-895f-423d-8fc0-f70468b9254c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1271 microversion: 2.1 time: 0.178007 Nov 02 21:28:08.165857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 898/1708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:07 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:08.179342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:08.180540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:08.187619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:08.188470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:08.189193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:08.190129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:08.190826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:08.191474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:08.300053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:08.434242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:08.447338 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01dec0ea-a0d8-4ac1-b2f5-fed653a74497 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 0.708930 Nov 02 21:28:08.447938 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 811/1709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:07 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:08.462786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:08.463764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:08.477878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:08.478378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:08.478824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:08.479539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:08.480003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:08.480433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:08.613464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:08.622853 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2662e01-a53d-49ea-a5b9-df3f9198fca3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.455426 Nov 02 21:28:08.623697 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 899/1710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:08 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:08.713395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:08.722212 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de69ad31-73f8-4d76-9215-401cff5becf1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 0.268557 Nov 02 21:28:08.722813 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 812/1711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:08 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:09.183592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:09.184319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:09.191226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.191782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.193146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:09.193944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.194989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.195422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:09.271048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:09.279258 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed1bee9e-98b0-4125-a6a0-4192f55e2ed1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1271 microversion: 2.1 time: 0.101410 Nov 02 21:28:09.279833 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 900/1712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:09 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:09.472212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:09.472790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:09.481672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.487963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.487963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:09.487963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.487963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.488351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:09.562560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:09.563474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:09.578317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.581148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.581148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:09.581148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.586911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.589289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:09.713074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:09.730070 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ba7e5857-993b-40a2-9611-80e5358af8d2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1315 microversion: 2.1 time: 0.261777 Nov 02 21:28:09.732306 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 813/1713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:09 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:09.740399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:09.744508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:09.754970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.755866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.756548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:09.757872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:09.758618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:09.759241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.076231 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-597b46dc-09d5-4625-960b-5c88d1b37b47 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1811 microversion: 2.1 time: 0.515192 Nov 02 21:28:10.079500 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 901/1714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:09 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1811 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:10.087076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:10.087700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:10.108191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.109079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.109815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.110722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.111510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.112264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.147448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:10.157594 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ad4910b-bed2-47e4-bddf-49b6d0b76a55 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.422059 Nov 02 21:28:10.164447 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 814/1715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:09 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:10.178226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0c4bdd75-c98e-47ac-90b4-706cf332710c req-3a6232f4-7428-44b4-9055-2799f65586da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fc182a-a536-4bf0-8cc8-55709adf5165", "name": "network-vif-plugged", "status": "completed", "tag": "26eb942e-23bd-42ba-90d9-dd057ab77634"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:10.280998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0c4bdd75-c98e-47ac-90b4-706cf332710c req-3a6232f4-7428-44b4-9055-2799f65586da service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.282378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0c4bdd75-c98e-47ac-90b4-706cf332710c req-3a6232f4-7428-44b4-9055-2799f65586da service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.282834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0c4bdd75-c98e-47ac-90b4-706cf332710c req-3a6232f4-7428-44b4-9055-2799f65586da service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.304765 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0c4bdd75-c98e-47ac-90b4-706cf332710c req-3a6232f4-7428-44b4-9055-2799f65586da service nova] Creating event network-vif-plugged:26eb942e-23bd-42ba-90d9-dd057ab77634 for instance e4fc182a-a536-4bf0-8cc8-55709adf5165 on n-h2-860863-4 Nov 02 21:28:10.323634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0c4bdd75-c98e-47ac-90b4-706cf332710c req-3a6232f4-7428-44b4-9055-2799f65586da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157448 Nov 02 21:28:10.327477 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 815/1716] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:10.332598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:10.339098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.357460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.357999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.358836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.359507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.359921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.415855 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8adb993b-927f-4754-a940-0afa0fc371de tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087082 Nov 02 21:28:10.416671 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 816/1717] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:28:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:10.421037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:10.421707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:10.456843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.457359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.457801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.459099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.459494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.460462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.550529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:10.554321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:10.562392 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be6cf3fd-64ac-48e6-a7c7-0c2257a74aa5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 0.481819 Nov 02 21:28:10.563646 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-af8ef7bc-4eec-4dc7-8cc4-4b2128271c3e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1271 microversion: 2.1 time: 0.144427 Nov 02 21:28:10.564263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 817/1718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:10 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:10.576910 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 902/1719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:10 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:10.755692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:10.757319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:10.764463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.770420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.771133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:10.772051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:10.772580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:10.773043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.189253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:11.190002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:11.209432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.214434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.216291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.217790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.219755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.221441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.260353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:11.269896 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e6f9ff3-99f3-4693-b94b-f985be455448 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1501 microversion: 2.1 time: 0.518114 Nov 02 21:28:11.284638 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 818/1720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:10 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1501 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:11.332840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:11.332840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:11.346240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.347351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.348026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.355864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.356433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.360410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.428008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:28:11.796407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:11.812768 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16ee0846-a635-43d5-b4cf-0b512c9ad68d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.628963 Nov 02 21:28:11.821255 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 903/1721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:11 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:11.856245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:11.856873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:11.881840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.885443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.885901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.886634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.887095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.887521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.902342 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9729e3d9-fe26-4c2a-a4f9-3c8b90b3b666 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 204 len: 0 microversion: 2.1 time: 0.594067 Nov 02 21:28:11.908245 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 819/1722] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:11 2022] DELETE /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:28:11.910400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:11.911339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:11.943803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.944870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.945342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:11.967267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:11.967267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:11.976172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:12.129312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:12.151952 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0be63b71-cf08-4e45-af06-96ad6176baeb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1277 microversion: 2.1 time: 0.247004 Nov 02 21:28:12.153588 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 820/1723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:11 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:12.164048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:12.165189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:12.175861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:12.176681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:12.177175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:12.180583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:12.182151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:12.182684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:13.005169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:13.063560 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2def8d2-fca9-4d89-a324-dba1d6992b72 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1308 microversion: 2.1 time: 1.229303 Nov 02 21:28:13.065870 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 904/1724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:11 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1308 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:13.066067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:13.075275 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db2d4f81-e9f7-4d5c-b279-262c2fc8e620 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1507 microversion: 2.1 time: 0.920112 Nov 02 21:28:13.075862 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 821/1725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:12 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1507 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:13.097947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:13.103289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:13.115857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:13.120826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:13.120826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:13.120826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:13.122014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:13.122687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:13.186626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:13.187427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:13.190880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:13.195546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:13.195989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:13.196599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:13.197639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:13.198247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:13.198939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:13.325844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:13.336722 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-23420672-6f9b-4fc1-b9ed-50694f301e52 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1277 microversion: 2.1 time: 0.158799 Nov 02 21:28:13.339243 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 822/1726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:13 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:28:13.627008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:13.628019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-33d09f3e-7122-4c0a-b3b9-30f8967caf12 req-b8377f4f-086d-4681-b823-b6fa7c705990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86c3828-5255-496f-b756-65a49cfc9cfb", "name": "network-vif-plugged", "status": "completed", "tag": "905eed9b-20b1-4629-a3a7-3a45b44eab21"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:13.639978 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52ccfb09-1a82-4439-9a8e-aabf6e9baa64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.571579 Nov 02 21:28:13.649116 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 905/1727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:13 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:13.656795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-33d09f3e-7122-4c0a-b3b9-30f8967caf12 req-b8377f4f-086d-4681-b823-b6fa7c705990 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:13.661535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-33d09f3e-7122-4c0a-b3b9-30f8967caf12 req-b8377f4f-086d-4681-b823-b6fa7c705990 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:13.662205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-33d09f3e-7122-4c0a-b3b9-30f8967caf12 req-b8377f4f-086d-4681-b823-b6fa7c705990 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:13.690638 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-33d09f3e-7122-4c0a-b3b9-30f8967caf12 req-b8377f4f-086d-4681-b823-b6fa7c705990 service nova] Creating event network-vif-plugged:905eed9b-20b1-4629-a3a7-3a45b44eab21 for instance b86c3828-5255-496f-b756-65a49cfc9cfb on n-h2-860863-4 Nov 02 21:28:13.705433 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-33d09f3e-7122-4c0a-b3b9-30f8967caf12 req-b8377f4f-086d-4681-b823-b6fa7c705990 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081800 Nov 02 21:28:13.711150 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 823/1728] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:14.090819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:14.091472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:14.107118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:14.108707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:14.115559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.117668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.117668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.124202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.125175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.126679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.127537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.128112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.128623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.129511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.130086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.130587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.727200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:14.735871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:14.736748 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69cfe6f1-e138-4724-881b-1f9e43df397c tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1488 microversion: 2.1 time: 0.653727 Nov 02 21:28:14.738242 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 906/1729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:14 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1488 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:14.744240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:14.744698 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8208f41b-77b3-4076-a84e-8ec00df4ed54 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1507 microversion: 2.1 time: 0.642961 Nov 02 21:28:14.745627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:14.748888 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 824/1730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:14 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1507 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:28:14.760576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:14.763475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:14.774031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.774720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.775774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.777010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.778017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.778478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.778989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.779263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.779514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.780243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:14.780691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:14.781198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:14.795545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:14.979553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:14.998756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c7fae81-674f-4b8d-85eb-18910de78b2a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1277 microversion: 2.1 time: 0.258917 Nov 02 21:28:15.011626 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 907/1731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:14 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:15.017080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-488397406"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:15.029557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:15.043881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:15.046271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:15.046271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:15.046271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:15.046271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:15.046695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:15.274158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:15.299305 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c66d94cd-8974-4045-9fd2-406628bcc7a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1318 microversion: 2.1 time: 0.547226 Nov 02 21:28:15.318326 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 825/1732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:14 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:15.345587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0eb3ce0-2714-4482-ac29-f6f6d2b423e2", "device": "/dev/xvdb"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:15.357663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:15.368486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:15.369349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:15.370026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:15.371691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:15.372326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:15.373048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:15.737944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=70 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:15.807752 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bbd7d6c2-f26f-4947-ae3d-40243d9f00d1 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "POST /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165/action" status: 202 len: 0 microversion: 2.1 time: 0.791678 Nov 02 21:28:15.811253 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 908/1733] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:28:15 2022] POST /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:28:15.825320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6680984a-3b5f-44dc-9c0f-27ef73795bcd req-bff34834-9d75-462c-a4f5-83dcaaf75eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c881bde-f1ab-4c45-a6dd-42020aea198d", "tag": "242c0afd-9bc4-4ea2-be71-4509c923baa6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:15.863050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6680984a-3b5f-44dc-9c0f-27ef73795bcd req-bff34834-9d75-462c-a4f5-83dcaaf75eaa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:15.865448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6680984a-3b5f-44dc-9c0f-27ef73795bcd req-bff34834-9d75-462c-a4f5-83dcaaf75eaa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:15.868656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6680984a-3b5f-44dc-9c0f-27ef73795bcd req-bff34834-9d75-462c-a4f5-83dcaaf75eaa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:15.929966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6680984a-3b5f-44dc-9c0f-27ef73795bcd req-bff34834-9d75-462c-a4f5-83dcaaf75eaa service nova] Creating event network-changed:242c0afd-9bc4-4ea2-be71-4509c923baa6 for instance 5c881bde-f1ab-4c45-a6dd-42020aea198d on n-h1-860863-4 Nov 02 21:28:15.956205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6680984a-3b5f-44dc-9c0f-27ef73795bcd req-bff34834-9d75-462c-a4f5-83dcaaf75eaa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134285 Nov 02 21:28:15.956897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 909/1734] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:15.986484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4f4f833c-597d-4e2d-9890-fa2d88eb7746 req-e6827019-a2c6-425f-ba50-ad0e968d9124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082dcea3-173c-4af7-8c8b-9b8f5e0bf476", "name": "network-vif-deleted", "tag": "1c732ff2-0b62-4318-9635-be7d8011a2c0"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:16.040200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4f4f833c-597d-4e2d-9890-fa2d88eb7746 req-e6827019-a2c6-425f-ba50-ad0e968d9124 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:16.040744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4f4f833c-597d-4e2d-9890-fa2d88eb7746 req-e6827019-a2c6-425f-ba50-ad0e968d9124 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:16.041196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4f4f833c-597d-4e2d-9890-fa2d88eb7746 req-e6827019-a2c6-425f-ba50-ad0e968d9124 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:16.072273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4f4f833c-597d-4e2d-9890-fa2d88eb7746 req-e6827019-a2c6-425f-ba50-ad0e968d9124 service nova] Creating event network-vif-deleted:1c732ff2-0b62-4318-9635-be7d8011a2c0 for instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 on n-h2-860863-4 Nov 02 21:28:16.086936 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4f4f833c-597d-4e2d-9890-fa2d88eb7746 req-e6827019-a2c6-425f-ba50-ad0e968d9124 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124847 Nov 02 21:28:16.088498 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 910/1735] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:16.116765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:16.119720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:16.135303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:16.135803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:16.136243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:16.137042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:16.137684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:16.140789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:16.216269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:16.301049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:16.317507 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e6ed51a-4ff0-48e5-962e-1659a4916dda tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1300 microversion: 2.1 time: 0.225011 Nov 02 21:28:16.324695 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 911/1736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:16 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1300 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:16.349627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a2b5ecc2-65fe-439d-b536-ca18e4852d80 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d156d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:16.437995 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a2b5ecc2-65fe-439d-b536-ca18e4852d80 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa" status: 200 len: 1413 microversion: 2.1 time: 0.111144 Nov 02 21:28:16.446906 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 912/1737] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:16 2022] GET /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:16.473348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:16.473992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:16.488088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:16.488088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:16.491674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:16.492450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:16.492943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:16.495164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:16.651045 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7aa0a72-91cb-4939-838d-3b8f99475a32 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "POST /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.330945 Nov 02 21:28:16.652035 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 826/1738] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:28:15 2022] POST /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments => generated 194 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:16.661292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:16.666171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:16.685086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:16.698626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:16.698626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:16.698626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:16.698626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:16.699009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:17.343277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:17.353662 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-169caa2c-f04c-458d-a330-3bf7fd97f37b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 0.905183 Nov 02 21:28:17.361829 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 913/1739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:16 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:17.384057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca871f9b-c338-4a53-9bfd-fb247ff52cac tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d180550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:17.492212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca871f9b-c338-4a53-9bfd-fb247ff52cac tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa" status: 200 len: 1413 microversion: 2.1 time: 0.113199 Nov 02 21:28:17.499885 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 914/1740] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:17 2022] GET /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:17.518057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:17.530636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:17.538392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:17.538874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:17.549450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:17.551046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:17.552001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:17.552557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:17.668571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:17.669537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:17.672610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:17.674543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'fault' on Instance uuid 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:28:17.962391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:17.963126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:17.977712 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a02d24d-66e8-4b74-bc63-603d6b0718b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1468 microversion: 2.1 time: 1.324407 Nov 02 21:28:17.989470 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 827/1741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:16 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1468 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:18.001127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c499212e-c72b-4c86-ae56-5ebb8f051d2a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b69768670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:18.020561 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-453e1786-779d-4be0-bb07-46a660b8f17e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 200 len: 1305 microversion: 2.1 time: 0.490312 Nov 02 21:28:18.032778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 915/1742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:17 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 1305 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:18.066028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:18.068972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:18.094199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:18.115462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:18.119346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:18.121972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:18.127664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:18.128196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:18.197467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:18.395482 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c499212e-c72b-4c86-ae56-5ebb8f051d2a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa" status: 204 len: 0 microversion: 2.1 time: 0.404625 Nov 02 21:28:18.400890 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 828/1743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:17 2022] DELETE /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:28:18.405959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:18.407646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:18.429399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:18.437478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:18.437478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:18.437478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:18.438157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:18.438753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:19.078063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:19.094747 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-897d3edf-6e6e-4f8b-9f9f-69b74d346998 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 1468 microversion: 2.1 time: 1.055983 Nov 02 21:28:19.096851 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 916/1744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:18 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 1468 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:19.113972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4491d41-36c6-4ced-a7c8-631bbe55b459 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d27fa60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:19.195703 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f4491d41-36c6-4ced-a7c8-631bbe55b459 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Image not found. Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4491d41-36c6-4ced-a7c8-631bbe55b459 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa HTTP/1.1 Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:19.199822 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4ad5957e-6d2a-429d-b918-392e49c345fa'} Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:19.205011 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4ad5957e-6d2a-429d-b918-392e49c345fa Nov 02 21:28:19.206183 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:28:19.207709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ad5957e-6d2a-429d-b918-392e49c345fa could not be found. Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:28:19.210495 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4491d41-36c6-4ced-a7c8-631bbe55b459 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:19.213547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4491d41-36c6-4ced-a7c8-631bbe55b459 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa" status: 404 len: 62 microversion: 2.1 time: 0.102569 Nov 02 21:28:19.216331 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 917/1745] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:19 2022] GET /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:28:19.247865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:19.250234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:19.299474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:19.305047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:19.306272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:19.311832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:19.313617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:19.318590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:19.372724 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 HTTP/1.1 Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:19.377497 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:28:19.378989 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '082dcea3-173c-4af7-8c8b-9b8f5e0bf476'} Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:19.379881 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:28:19.381283 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:19.385619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:19.390822 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-00057392-d26a-4c69-8838-0c334aa14b7a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 404 len: 111 microversion: 2.1 time: 0.181950 Nov 02 21:28:19.406787 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 918/1746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:19 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:19.418813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-392132335"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:19.428271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:19.441934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:19.446366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:19.447162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:19.448606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:19.450218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:19.455710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:19.793788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:19.807585 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3e4fa0fe-ef7e-4ad9-be74-94261ccc2b51 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 1.409644 Nov 02 21:28:19.843239 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 829/1747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:18 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:19.843239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:19.843239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:19.851732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:19.853571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:19.854221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:19.856959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:19.857621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:19.859015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:20.369560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:20.517473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:20.528323 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1fd86183-ee24-4268-a8b4-0aae971333a5 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1501 microversion: 2.1 time: 0.716323 Nov 02 21:28:20.534149 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 830/1748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:19 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1501 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:20.541584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-18356027", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "67c3f76f-7a17-4f1f-a61d-9ec78598dc27"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:20.563235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2dd5b8a9-0157-490f-bf57-9072e7be6602 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "POST /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050/action" status: 202 len: 0 microversion: 2.1 time: 1.154720 Nov 02 21:28:20.576319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 919/1749] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:28:19 2022] POST /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050/action => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:28:20.585334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be2651be-46a2-43df-9ff5-507def2e60a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d1bf040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:20.652150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] validate_networks() for [('67c3f76f-7a17-4f1f-a61d-9ec78598dc27', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:28:20.678885 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be2651be-46a2-43df-9ff5-507def2e60a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.100740 Nov 02 21:28:20.688331 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 920/1750] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:20 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:20.872888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:20.875258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:20.892561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:20.893475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:20.894196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:20.895439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:20.897677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:20.898560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:22.895335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:22.908391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-baf94b10-17ce-47b0-aa7a-56ed8b41babe tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 2.040955 Nov 02 21:28:22.911788 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 921/1751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:20 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:22.935350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e9a8d2b7-5cd9-4a36-8ae2-b615fb609420 req-067e2376-9a63-41ae-a29d-be7dc68d4234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00475509-983d-47f1-a9c9-30f182d29331", "tag": "5f11fb95-f5af-4521-8a52-4f12e5237f3e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:22.995689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e9a8d2b7-5cd9-4a36-8ae2-b615fb609420 req-067e2376-9a63-41ae-a29d-be7dc68d4234 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:23.004051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e9a8d2b7-5cd9-4a36-8ae2-b615fb609420 req-067e2376-9a63-41ae-a29d-be7dc68d4234 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:23.004812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e9a8d2b7-5cd9-4a36-8ae2-b615fb609420 req-067e2376-9a63-41ae-a29d-be7dc68d4234 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:23.062606 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e9a8d2b7-5cd9-4a36-8ae2-b615fb609420 req-067e2376-9a63-41ae-a29d-be7dc68d4234 service nova] Creating event network-changed:5f11fb95-f5af-4521-8a52-4f12e5237f3e for instance 00475509-983d-47f1-a9c9-30f182d29331 on n-h2-860863-4 Nov 02 21:28:23.087844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e9a8d2b7-5cd9-4a36-8ae2-b615fb609420 req-067e2376-9a63-41ae-a29d-be7dc68d4234 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169534 Nov 02 21:28:23.091374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 922/1752] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:23.107515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:23.117200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:23.134065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:23.135834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:23.137026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:23.138356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:23.140130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:23.142606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:23.927729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:28:23.928841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:28:23.929427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:28:23.930221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:28:23.930850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:28:23.936907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:23.949786 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e574e2ad-ecd3-4a31-a75e-ac382df180f9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1488 microversion: 2.1 time: 0.851800 Nov 02 21:28:23.951888 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 923/1753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:23 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1488 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:23.962980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55e428f3-5906-43b4-9fed-b5f16903a28d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d1bf820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:23.967973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:23.968892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:23.972807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:23.977342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:23.980318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:23.983931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:24.041259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:24.062555 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55e428f3-5906-43b4-9fed-b5f16903a28d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.107251 Nov 02 21:28:24.063166 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 924/1754] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:23 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:24.081617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:24.085480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:24.088508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for user 1cb7808dc9e54e86811e0b7ad1cec847 and project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:24.114446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:24.118626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:24.119189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:24.122681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:24.123235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:24.123687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:24.147689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:28:24.154877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:28:24.435216 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40e09f40-66a4-42e6-b773-4ceeb65e9643 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.891202 Nov 02 21:28:24.441843 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 831/1755] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:28:24.453764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:24.478970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:24.502279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:24.504443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:24.504443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:24.504443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:24.504443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:24.504821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:24.583005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:28:24.831613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:24.845871 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1341111f-5e54-49bc-8ba1-29bfc5bb6615 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 0.780967 Nov 02 21:28:24.851210 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 925/1756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:24 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:24.876501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c753129-dff5-4aeb-81d7-c1004d4fe5b7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:24.877124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c753129-dff5-4aeb-81d7-c1004d4fe5b7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:25.036327 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b29173b5-3395-4316-8fa0-0983fe4f9a07 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 204 len: 0 microversion: 2.1 time: 0.594989 Nov 02 21:28:25.038336 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 832/1757] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:24 2022] DELETE /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:28:25.058535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dcbc44d2-13b7-4d24-9f47-9fa3062e2aef tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b696ddca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:25.134391 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-dcbc44d2-13b7-4d24-9f47-9fa3062e2aef tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Image not found. Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dcbc44d2-13b7-4d24-9f47-9fa3062e2aef tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa HTTP/1.1 Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:25.136514 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4ad5957e-6d2a-429d-b918-392e49c345fa'} Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:25.138027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4ad5957e-6d2a-429d-b918-392e49c345fa to delete Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:25.139040 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ad5957e-6d2a-429d-b918-392e49c345fa could not be found. Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:25.140352 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dcbc44d2-13b7-4d24-9f47-9fa3062e2aef tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dcbc44d2-13b7-4d24-9f47-9fa3062e2aef tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa" status: 404 len: 62 microversion: 2.1 time: 0.086611 Nov 02 21:28:25.141767 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 833/1758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:25 2022] DELETE /compute/v2.1/images/4ad5957e-6d2a-429d-b918-392e49c345fa => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:28:25.157406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f4493413-1b9d-4456-b46a-2c6ba20a6085 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d19adc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:25.244264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f4493413-1b9d-4456-b46a-2c6ba20a6085 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.097110 Nov 02 21:28:25.244264 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 834/1759] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:25 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:25.252070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:25.252696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:25.285721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:25.286214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:25.296085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:25.296085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:25.296624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:25.297095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:25.377530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:28:25.462287 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.api [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Instance is already in deleting state, ignoring this request Nov 02 21:28:25.465193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fd70bf7f-1a74-4cd3-b96f-61352238e296 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 204 len: 0 microversion: 2.1 time: 0.224183 Nov 02 21:28:25.473028 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 835/1760] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:25 2022] DELETE /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:28:25.488598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-9a94f4db-4d24-4a19-ae95-5426588afbe8 req-aceb2fdf-d086-4747-a1cb-85cb2b1521f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fc182a-a536-4bf0-8cc8-55709adf5165", "name": "network-vif-plugged", "status": "completed", "tag": "26eb942e-23bd-42ba-90d9-dd057ab77634"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:25.511296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c753129-dff5-4aeb-81d7-c1004d4fe5b7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:25.536615 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c753129-dff5-4aeb-81d7-c1004d4fe5b7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1213 microversion: 2.1 time: 0.684259 Nov 02 21:28:25.539340 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 926/1761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:24 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1213 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:25.551903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9a94f4db-4d24-4a19-ae95-5426588afbe8 req-aceb2fdf-d086-4747-a1cb-85cb2b1521f4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:25.552398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9a94f4db-4d24-4a19-ae95-5426588afbe8 req-aceb2fdf-d086-4747-a1cb-85cb2b1521f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:25.552837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9a94f4db-4d24-4a19-ae95-5426588afbe8 req-aceb2fdf-d086-4747-a1cb-85cb2b1521f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:25.570306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:25.574338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:25.603956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:25.607530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:25.608802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:25.614009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:25.614547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:25.614997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:25.624276 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-9a94f4db-4d24-4a19-ae95-5426588afbe8 req-aceb2fdf-d086-4747-a1cb-85cb2b1521f4 service nova] Creating event network-vif-plugged:26eb942e-23bd-42ba-90d9-dd057ab77634 for instance e4fc182a-a536-4bf0-8cc8-55709adf5165 on n-h2-860863-4 Nov 02 21:28:25.660636 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-9a94f4db-4d24-4a19-ae95-5426588afbe8 req-aceb2fdf-d086-4747-a1cb-85cb2b1521f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183570 Nov 02 21:28:25.661168 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 836/1762] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:25.873747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:25.874096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:25.892622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:25.893157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:25.914031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:25.917412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:25.917412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:25.917412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:26.336851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:26.367250 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4e06ae0-c64c-4680-b6f8-e84d939dcad9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1494 microversion: 2.1 time: 0.812296 Nov 02 21:28:26.371477 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 927/1763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:25 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1494 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:26.390868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dec9f227-f226-4601-a7e7-22092036b7ef tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b695ae550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:26.487737 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dec9f227-f226-4601-a7e7-22092036b7ef tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.114870 Nov 02 21:28:26.488317 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 928/1764] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:26 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:26.561083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:26.562566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:26.582938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:26.589743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:26.594016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:26.594016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:26.594016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:26.594016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:26.890839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:26.905137 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-142387b4-3f2e-491e-83a0-2b306496ff1c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1217 microversion: 2.1 time: 0.348285 Nov 02 21:28:26.925320 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 929/1765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:26 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1217 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:28:27.002747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:27.019996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3644f50e-26d8-4c3f-af7c-8d23a45d5650 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 1.146672 Nov 02 21:28:27.026115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 837/1766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:25 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:27.399171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:27.399891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:27.407352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:27.415489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:27.420117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:27.421446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:27.422173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:27.422897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:27.508112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e343b9d7-4121-448e-9581-71f07a9328e5 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b689a79d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:27.624670 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e343b9d7-4121-448e-9581-71f07a9328e5 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.117058 Nov 02 21:28:27.628052 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 838/1767] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:27 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:28.011310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05ebf3ac-8f48-4752-ad14-46d664999829 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6d24c670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1757613875", "description": "tempest-description-1731153277"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:29.266910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:29.278868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-807e59c6-f254-43d6-a467-d7356d06b45d tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1494 microversion: 2.1 time: 1.883782 Nov 02 21:28:29.297713 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 930/1768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:27 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1494 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:29.302995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:29.304703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:29.319057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:29.320192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:29.320905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:29.322379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:29.323509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:29.324232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:29.588770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:29.617790 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2fcd6a02-724c-4735-b805-c0003f113058 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1271 microversion: 2.1 time: 0.318540 Nov 02 21:28:29.625025 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 931/1769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:29 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1271 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:29.640368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-34496c03-9335-45bc-b06a-d43a7742b4e2 req-98d07a07-2939-411f-a733-c7d82eeb9ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c881bde-f1ab-4c45-a6dd-42020aea198d", "name": "network-vif-plugged", "status": "completed", "tag": "242c0afd-9bc4-4ea2-be71-4509c923baa6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:29.667944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-34496c03-9335-45bc-b06a-d43a7742b4e2 req-98d07a07-2939-411f-a733-c7d82eeb9ad8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:29.668423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-34496c03-9335-45bc-b06a-d43a7742b4e2 req-98d07a07-2939-411f-a733-c7d82eeb9ad8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:29.675554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-34496c03-9335-45bc-b06a-d43a7742b4e2 req-98d07a07-2939-411f-a733-c7d82eeb9ad8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:29.705416 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-34496c03-9335-45bc-b06a-d43a7742b4e2 req-98d07a07-2939-411f-a733-c7d82eeb9ad8 service nova] Creating event network-vif-plugged:242c0afd-9bc4-4ea2-be71-4509c923baa6 for instance 5c881bde-f1ab-4c45-a6dd-42020aea198d on n-h1-860863-4 Nov 02 21:28:29.717539 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-34496c03-9335-45bc-b06a-d43a7742b4e2 req-98d07a07-2939-411f-a733-c7d82eeb9ad8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089122 Nov 02 21:28:29.718151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 932/1770] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:29.742309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:29.745824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:29.762489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:29.763286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:29.766683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:29.767438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:29.767908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:29.768364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:30.408622 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05ebf3ac-8f48-4752-ad14-46d664999829 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.660970 Nov 02 21:28:30.410493 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 839/1771] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:28:27 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:30.432518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44eaef6f-4f85-4578-b3e3-a244194bfc02 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6891cdc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:30.509570 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44eaef6f-4f85-4578-b3e3-a244194bfc02 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.097654 Nov 02 21:28:30.510948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 840/1772] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:30 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:30.530223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:30.543144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:30.571761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:30.572633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:30.573519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:30.574472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:30.580128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:30.581304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:30.602877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:30.610912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-21f443f3-b1a9-49a7-993c-0df6da79b7eb tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 0.891323 Nov 02 21:28:30.613838 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 933/1773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:29 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:30.629539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd789c15-44f6-46f6-a802-5d0c6cc02e49 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6d110550>, body: {"security_group_rule": {"parent_group_id": "585c9524-7eed-43b4-80cb-e78645c647d0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:31.527404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:31.544059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d643603a-8f24-4a0e-9d89-0163997e2912 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1452 microversion: 2.1 time: 1.031204 Nov 02 21:28:31.550951 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 841/1774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:30 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1452 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:31.580850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:31.581905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:31.606473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:31.611866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:31.612703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:31.619170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:31.620020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:31.625022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:31.790589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:31.803394 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ce96b54-01bc-46cb-9373-8f9f8694ad0c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1271 microversion: 2.1 time: 0.244015 Nov 02 21:28:31.805528 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 842/1775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:31 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1271 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:31.924171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8578ac3a-d1d2-43ff-8ad9-346a0aca2d9b tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Action: 'create', calling method: .version_select at 0x7f9b688eb8b0>, body: {"keypair": {"name": "tempest-keypair-2051592366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm3W3e4md3b7Su5sNkucA3HpWoc1iEgdkWWdS/KzyRjHJt2gpqAcMDBp6S43WqEKWT5KjOabuyh2/dIfwlCn1quebW9YFAmnuh1WYBwFtTio5CCo18eOsNU//JdC/nXXQ=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:31.943197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8578ac3a-d1d2-43ff-8ad9-346a0aca2d9b tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Getting quotas for project 78183deb86b94bc9ae6519ca914a917d. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:31.954096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8578ac3a-d1d2-43ff-8ad9-346a0aca2d9b tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Getting quotas for user e18d754669364e9f92a6563aa5f4fd42 and project 78183deb86b94bc9ae6519ca914a917d. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:32.166261 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8578ac3a-d1d2-43ff-8ad9-346a0aca2d9b tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.359405 Nov 02 21:28:32.167796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 843/1776] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:28:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:32.179372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54fe5544-7c9e-4ce9-8c63-b68490f5b686 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b689161f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:32.256557 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54fe5544-7c9e-4ce9-8c63-b68490f5b686 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.087314 Nov 02 21:28:32.265167 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 844/1777] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:32 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:32.292461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a2385790-c449-4e92-a0b1-001413d29663 req-d6afa97c-5494-4afc-8a66-800f28b4fd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4fc182a-a536-4bf0-8cc8-55709adf5165", "name": "network-vif-deleted", "tag": "26eb942e-23bd-42ba-90d9-dd057ab77634"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:32.311588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a2385790-c449-4e92-a0b1-001413d29663 req-d6afa97c-5494-4afc-8a66-800f28b4fd62 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:32.312344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a2385790-c449-4e92-a0b1-001413d29663 req-d6afa97c-5494-4afc-8a66-800f28b4fd62 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:32.312846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a2385790-c449-4e92-a0b1-001413d29663 req-d6afa97c-5494-4afc-8a66-800f28b4fd62 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:32.330421 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a2385790-c449-4e92-a0b1-001413d29663 req-d6afa97c-5494-4afc-8a66-800f28b4fd62 service nova] Creating event network-vif-deleted:26eb942e-23bd-42ba-90d9-dd057ab77634 for instance e4fc182a-a536-4bf0-8cc8-55709adf5165 on n-h2-860863-4 Nov 02 21:28:32.340846 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a2385790-c449-4e92-a0b1-001413d29663 req-d6afa97c-5494-4afc-8a66-800f28b4fd62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080568 Nov 02 21:28:32.344825 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 845/1778] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:32.358827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:32.358827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:32.372763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:32.375998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:32.376463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:32.380177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:32.381022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:32.386491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:32.894019 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd789c15-44f6-46f6-a802-5d0c6cc02e49 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.279060 Nov 02 21:28:32.911577 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 934/1779] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:28:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:32.937175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-64fa03a2-f7b0-42b7-acc7-d9b9a83d34f6 req-d25c9e0e-bf81-4bff-b38d-57dd24f562fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed1b872-ec5d-49a1-8377-e5ae331eb050", "name": "network-vif-plugged", "status": "completed", "tag": "be8e2db3-3686-4477-9908-a126ccc17a17"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:33.008291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-64fa03a2-f7b0-42b7-acc7-d9b9a83d34f6 req-d25c9e0e-bf81-4bff-b38d-57dd24f562fe service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:33.011437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-64fa03a2-f7b0-42b7-acc7-d9b9a83d34f6 req-d25c9e0e-bf81-4bff-b38d-57dd24f562fe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:33.012687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-64fa03a2-f7b0-42b7-acc7-d9b9a83d34f6 req-d25c9e0e-bf81-4bff-b38d-57dd24f562fe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:33.017527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:33.030844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-64fa03a2-f7b0-42b7-acc7-d9b9a83d34f6 req-d25c9e0e-bf81-4bff-b38d-57dd24f562fe service nova] Creating event network-vif-plugged:be8e2db3-3686-4477-9908-a126ccc17a17 for instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 on n-h2-860863-4 Nov 02 21:28:33.036651 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-64fa03a2-f7b0-42b7-acc7-d9b9a83d34f6 req-d25c9e0e-bf81-4bff-b38d-57dd24f562fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123349 Nov 02 21:28:33.038362 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 935/1780] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:33.042550 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d1403f3-c249-4896-9c6c-aeaad9a19249 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 0.692612 Nov 02 21:28:33.043732 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 846/1781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:32 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:33.048559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:33.049535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:33.057933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:33.058668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:33.059303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:33.060492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:33.061291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:33.061900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:33.079634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:33.083058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:33.104236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:33.106008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:33.109122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:33.109477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:33.110013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:33.110520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:33.110792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:33.112183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lazy-loading 'fault' on Instance uuid e4fc182a-a536-4bf0-8cc8-55709adf5165 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:28:33.115097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:33.120956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:33.162250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:33.382543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab2a1f2b5b74571b08c97e9493d568d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671105d3974446ba9f2d440caecf4dea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:33.435844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-40e59f77-1499-4948-a0fc-afac92a6db21 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 200 len: 1298 microversion: 2.1 time: 0.395848 Nov 02 21:28:33.443675 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 936/1782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:33 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 1298 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:33.465183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67f475f0-9d45-4182-b987-5c1d2307f2f1 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b697eb430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1216484506", "description": "tempest-description-1040033283"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:33.498471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:33.519954 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40e6cb3c-227d-4123-ad5b-24f985f0a159 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1313 microversion: 2.1 time: 0.473509 Nov 02 21:28:33.528285 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 847/1783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:33 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:33.557656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b5c8fba-64c7-4919-a219-271fb57113a0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b691fe1f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:33.677373 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8b5c8fba-64c7-4919-a219-271fb57113a0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.145494 Nov 02 21:28:33.681591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 848/1784] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:33 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:34.023706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:34.027608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:34.028231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:34.051290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.051290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.051290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:34.052293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.052465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.052899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:34.610274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ddd2fc74-2f71-4772-a1f4-4357826fafcd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1857 microversion: 2.1 time: 0.587674 Nov 02 21:28:34.616575 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 849/1785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:34 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1857 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:34.644570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:34.645543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:34.660479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.665348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.665884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:34.666644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.668414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.669060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:34.750466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67f475f0-9d45-4182-b987-5c1d2307f2f1 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.305408 Nov 02 21:28:34.760629 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 937/1786] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:28:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:34.765815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:34.766432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e4fc182a-a536-4bf0-8cc8-55709adf5165] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:34.790169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.790751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.791599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:34.792510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.793754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.793754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:34.833095 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance e4fc182a-a536-4bf0-8cc8-55709adf5165 could not be found. Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 HTTP/1.1 Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:34.835190 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e4fc182a-a536-4bf0-8cc8-55709adf5165 could not be found. Nov 02 21:28:34.837432 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e4fc182a-a536-4bf0-8cc8-55709adf5165'} Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4fc182a-a536-4bf0-8cc8-55709adf5165 could not be found. Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:34.838441 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4fc182a-a536-4bf0-8cc8-55709adf5165 could not be found. Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4fc182a-a536-4bf0-8cc8-55709adf5165 could not be found. Nov 02 21:28:34.840115 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:34.841731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance e4fc182a-a536-4bf0-8cc8-55709adf5165 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:34.841731 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47e8ee86-5879-48c9-bae9-9dc1ceacdf85 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165" status: 404 len: 111 microversion: 2.1 time: 0.074949 Nov 02 21:28:34.844597 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 938/1787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:34 2022] GET /compute/v2.1/servers/e4fc182a-a536-4bf0-8cc8-55709adf5165 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:34.849693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:34.850860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:34.869777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.870585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.871225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:34.872848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:34.873564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:34.874173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:35.206701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:35.224785 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-948e0ca9-1289-4b81-b21b-d3ceae15efc3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 0.597427 Nov 02 21:28:35.224785 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 850/1788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:34 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:35.226917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": true, "disk_over_commit": false}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:35.230014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:35.240319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:35.242238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:35.243466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:35.244512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:35.245231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:35.256833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:35.281913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:35.299091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26221e32-5823-41f9-9cc1-dc699c217786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1313 microversion: 2.1 time: 0.449588 Nov 02 21:28:35.299091 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 939/1789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:34 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:35.307667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df1e83d4-3100-4a7a-bac3-1bfe24333aa9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d2bf4c0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:35.311937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lazy-loading 'flavor' on Instance uuid 07e33e1d-76d6-4011-8810-dec200b78844 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:28:35.353859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121039) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:28:35.439740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df1e83d4-3100-4a7a-bac3-1bfe24333aa9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.136846 Nov 02 21:28:35.457728 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 940/1790] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:35 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:35.471293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-056e20a8-d829-4072-8b77-db8e8edbd5b1 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6d1bfaf0>, body: {"security_group_rule": {"parent_group_id": "331d0fdf-e522-4e6c-9377-294fd65df69e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:35.530691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:36.747640 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-056e20a8-d829-4072-8b77-db8e8edbd5b1 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.284886 Nov 02 21:28:36.748951 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 941/1791] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:28:35 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:36.755013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:36.756182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:36.798636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=82 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:36.806432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:36.807075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:36.807568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:36.808466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:36.808966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:36.809441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:36.825163 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d HTTP/1.1 Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:36.826725 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:36.828347 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'ac46b6c1-84c9-4683-8427-f25b342dad4d'} Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:36.829241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:36.830669 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:36.832160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:36.832160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-18c66832-e36a-4ad4-8699-104041bbbdbc tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 404 len: 111 microversion: 2.1 time: 0.078214 Nov 02 21:28:36.832374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 942/1792] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:36 2022] DELETE /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:36.838254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0f6eaf00-1b4d-4632-ab7e-8bd7ecf30838 req-95ba09f2-9598-4e68-a38c-3167978c5325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00475509-983d-47f1-a9c9-30f182d29331", "name": "network-vif-plugged", "status": "completed", "tag": "5f11fb95-f5af-4521-8a52-4f12e5237f3e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:36.852719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0f6eaf00-1b4d-4632-ab7e-8bd7ecf30838 req-95ba09f2-9598-4e68-a38c-3167978c5325 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:36.853485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0f6eaf00-1b4d-4632-ab7e-8bd7ecf30838 req-95ba09f2-9598-4e68-a38c-3167978c5325 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:36.853921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0f6eaf00-1b4d-4632-ab7e-8bd7ecf30838 req-95ba09f2-9598-4e68-a38c-3167978c5325 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:36.874192 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0f6eaf00-1b4d-4632-ab7e-8bd7ecf30838 req-95ba09f2-9598-4e68-a38c-3167978c5325 service nova] Creating event network-vif-plugged:5f11fb95-f5af-4521-8a52-4f12e5237f3e for instance 00475509-983d-47f1-a9c9-30f182d29331 on n-h2-860863-4 Nov 02 21:28:36.880025 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0f6eaf00-1b4d-4632-ab7e-8bd7ecf30838 req-95ba09f2-9598-4e68-a38c-3167978c5325 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046204 Nov 02 21:28:36.882356 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 943/1793] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:36.887523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fd824d0b-3daa-420b-bc33-12c7c7d62b9a req-a6621578-0c90-405c-a067-5ad28ab321d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ff1b00-bb4f-4926-8659-5aaca6904bfe", "tag": "a63c88e6-e754-4fa9-a998-ed6d9afd0916"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:36.902650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd824d0b-3daa-420b-bc33-12c7c7d62b9a req-a6621578-0c90-405c-a067-5ad28ab321d1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:36.903233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd824d0b-3daa-420b-bc33-12c7c7d62b9a req-a6621578-0c90-405c-a067-5ad28ab321d1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:36.903735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd824d0b-3daa-420b-bc33-12c7c7d62b9a req-a6621578-0c90-405c-a067-5ad28ab321d1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:36.916562 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fd824d0b-3daa-420b-bc33-12c7c7d62b9a req-a6621578-0c90-405c-a067-5ad28ab321d1 service nova] Creating event network-changed:a63c88e6-e754-4fa9-a998-ed6d9afd0916 for instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe on n-h1-860863-4 Nov 02 21:28:36.921629 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fd824d0b-3daa-420b-bc33-12c7c7d62b9a req-a6621578-0c90-405c-a067-5ad28ab321d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039104 Nov 02 21:28:36.924824 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 944/1794] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:36.932908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:36.933638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:36.940307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:36.940792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:36.941268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:36.942552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:36.943008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:36.943454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:36.967541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:37.169566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:37.180473 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-49dcfb9c-21f8-4629-9786-45d316a14acc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1319 microversion: 2.1 time: 0.253438 Nov 02 21:28:37.200198 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 945/1795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:36 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:37.215893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:37.216813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:37.224525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:37.225620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:37.226077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:37.226783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:37.227238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:37.227665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:37.411120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:37.421230 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f746166e-ab2d-4c0e-bedd-78dd48eba924 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1313 microversion: 2.1 time: 0.216471 Nov 02 21:28:37.426333 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 946/1796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:37 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:37.426333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6da2170d-0df7-4635-9cba-5e707194b6f2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d2bfa60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:37.502420 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6da2170d-0df7-4635-9cba-5e707194b6f2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.079544 Nov 02 21:28:37.505957 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 947/1797] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:37 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:37.512006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1748668844", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6931e057-8a5a-44b9-bc06-350c4bc2e1d4"}], "security_groups": [{"name": "tempest-securitygroup--239463397"}], "key_name": "tempest-keypair-2051592366", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:37.653385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] validate_networks() for [('6931e057-8a5a-44b9-bc06-350c4bc2e1d4', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:28:38.386272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Getting quotas for project 78183deb86b94bc9ae6519ca914a917d. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:38.392922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Getting quotas for user e18d754669364e9f92a6563aa5f4fd42 and project 78183deb86b94bc9ae6519ca914a917d. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:38.414395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:28:38.415094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:28:38.415563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:28:38.416029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:28:38.416666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:28:38.426876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:38.431457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:38.432184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:38.435638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:38.436568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:38.438372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:38.466316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Getting quotas for project 78183deb86b94bc9ae6519ca914a917d. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:38.474765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Getting quotas for user e18d754669364e9f92a6563aa5f4fd42 and project 78183deb86b94bc9ae6519ca914a917d. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:38.491887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:28:38.494450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:28:38.695324 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a534e835-00b4-4888-bd74-c5985d0ec902 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.187286 Nov 02 21:28:38.695927 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 948/1798] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:28:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:28:38.700887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5a9d60d-4c3d-42dc-86e7-348c599e9bf7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6d11d1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1059289703", "description": "tempest-description-1474827983"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:39.392012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5a9d60d-4c3d-42dc-86e7-348c599e9bf7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.694659 Nov 02 21:28:39.399598 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 949/1799] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:28:38 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:39.404743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:39.405408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: ac46b6c1-84c9-4683-8427-f25b342dad4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:39.412037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:39.413140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:39.413788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:39.414278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:39.414731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:39.415160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:39.430780 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d HTTP/1.1 Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:39.432439 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:39.434194 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'ac46b6c1-84c9-4683-8427-f25b342dad4d'} Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:39.435218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. Nov 02 21:28:39.436611 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:39.438078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance ac46b6c1-84c9-4683-8427-f25b342dad4d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:39.438078 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08b6bda6-f87e-4df3-8a77-a9ce0266d769 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d" status: 404 len: 111 microversion: 2.1 time: 0.033232 Nov 02 21:28:39.438078 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 950/1800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:39 2022] GET /compute/v2.1/servers/ac46b6c1-84c9-4683-8427-f25b342dad4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:39.439430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:39.439856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:39.445909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:39.446681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:39.447057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:39.447778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:39.448226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:39.448652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:39.585373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:39.593256 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ef5ea4a-f831-4c0c-a2e7-196b0e1f9895 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1469 microversion: 2.1 time: 0.157915 Nov 02 21:28:39.593826 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 951/1801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:39 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:39.598263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:39.598887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:39.605106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:39.605814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:39.606581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:39.607565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:39.608322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:39.610082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:39.757669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:39.765324 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b6924113-42ee-4c2c-a41a-49578c977871 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1313 microversion: 2.1 time: 0.170511 Nov 02 21:28:39.765885 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 952/1802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:39 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:39.770387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5fb411e5-280e-4fca-b87b-c0825b1e93f7 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d1bf0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:39.815800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5fb411e5-280e-4fca-b87b-c0825b1e93f7 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.048877 Nov 02 21:28:39.824070 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 953/1803] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:39 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:39.824070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e16e0c04-199d-49a0-8fc7-066a73dd2b10 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:39.824070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e16e0c04-199d-49a0-8fc7-066a73dd2b10 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:39.879453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e16e0c04-199d-49a0-8fc7-066a73dd2b10 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:39.888021 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e16e0c04-199d-49a0-8fc7-066a73dd2b10 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1270 microversion: 2.1 time: 0.069876 Nov 02 21:28:39.888586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 954/1804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:39 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1270 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:39.893258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15e6f17f-0d59-4c6d-a2fd-717ec632ee70 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b696c8b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-610675809", "description": "tempest-description-1261199627"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:40.029776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e36d0bb5-b835-43a4-8ad6-9df4d7b8008f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/action" status: 202 len: 0 microversion: 2.1 time: 4.809984 Nov 02 21:28:40.032171 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 851/1805] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:28:35 2022] POST /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/action => generated 0 bytes in 4813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:28:40.041371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8baf5ba3-f144-45b8-b1d0-b94f6be24541 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d102ee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:40.065513 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8baf5ba3-f144-45b8-b1d0-b94f6be24541 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Image not found. Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8baf5ba3-f144-45b8-b1d0-b94f6be24541 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f HTTP/1.1 Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:40.067780 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '3aa615a4-11e5-4c03-bbb4-4486ebd8640f'} Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:40.077783 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3aa615a4-11e5-4c03-bbb4-4486ebd8640f to delete Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.078988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3aa615a4-11e5-4c03-bbb4-4486ebd8640f could not be found. Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:40.080547 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8baf5ba3-f144-45b8-b1d0-b94f6be24541 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8baf5ba3-f144-45b8-b1d0-b94f6be24541 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f" status: 404 len: 62 microversion: 2.1 time: 0.035439 Nov 02 21:28:40.082226 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 852/1806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:40 2022] DELETE /compute/v2.1/images/3aa615a4-11e5-4c03-bbb4-4486ebd8640f => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:28:40.083454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:40.083454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:40.089038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.089540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.089990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.090704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.091159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.093405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.361493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:40.374715 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e423314-bda3-49c7-8e8b-068b5a05a7ef tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d" status: 200 len: 1468 microversion: 2.1 time: 0.300558 Nov 02 21:28:40.379147 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 853/1807] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:40 2022] GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d => generated 1468 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:40.381081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:40.382495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:40.391908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.392394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.392843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.393876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.394329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.394752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.630206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:40.639554 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fc4c72a0-b8ec-49aa-90ba-534ba78bec67 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.262167 Nov 02 21:28:40.640415 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 854/1808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:40 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:40.645575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:40.646241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:40.654995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.655845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.658030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.658934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.659548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.660132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.681097 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 HTTP/1.1 Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:40.683238 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.685026 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9429781f-2367-4cec-bfdb-641db74cc989'} Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:40.686055 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.687837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.690225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:40.691085 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2b7fa903-24cb-4bba-8bd1-a05c4d2af7ff tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 404 len: 111 microversion: 2.1 time: 0.049562 Nov 02 21:28:40.691650 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 855/1809] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:40 2022] DELETE /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:40.696604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:40.709514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:40.712119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Searching by: {'reservation_id': 'r-pp30ds6w', 'deleted': False, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:28:40.718514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.719663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.720377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.727954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.729170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.730154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.754111 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15e6f17f-0d59-4c6d-a2fd-717ec632ee70 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.864403 Nov 02 21:28:40.758300 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 955/1810] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:28:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:40.769350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:40.769974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: 9429781f-2367-4cec-bfdb-641db74cc989] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:40.776802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.777612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.778065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.778849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.779305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.779737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:40.818776 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 HTTP/1.1 Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:40.821382 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.823062 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9429781f-2367-4cec-bfdb-641db74cc989'} Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:40.823866 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. Nov 02 21:28:40.825342 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:40.831169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance 9429781f-2367-4cec-bfdb-641db74cc989 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:40.832423 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3d76ac4-209b-41b1-b06b-d17ef1624449 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989" status: 404 len: 111 microversion: 2.1 time: 0.073069 Nov 02 21:28:40.843742 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 956/1811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:40 2022] GET /compute/v2.1/servers/9429781f-2367-4cec-bfdb-641db74cc989 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:40.849027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2aa7e183-d420-4c20-931c-d28833074f44 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6d1103a0>, body: {"security_group_rule": {"parent_group_id": "8c448951-1ac0-4d44-b7f0-61334372a264", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e332fdf1-d9a9-4019-891a-c97ce16be490"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:40.857650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:28:40.964189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:40.979105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:40.979905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:40.980542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:41.327618 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bfbe0dc9-ed2f-4356-a40b-0ef174233c65 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?reservation_id=r-pp30ds6w" status: 200 len: 2930 microversion: 2.1 time: 0.634735 Nov 02 21:28:41.345300 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 856/1812] 10.222.0.25 () {58 vars in 1197 bytes} [Wed Nov 2 21:28:40 2022] GET /compute/v2.1/servers/detail?reservation_id=r-pp30ds6w => generated 2930 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:41.345300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:41.345300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:41.347211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:41.350987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:41.351733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:41.352655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:41.355047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:41.355494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:41.990106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:41.999301 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ac8bec0-ce56-4c59-926d-85b8ddced23b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1313 microversion: 2.1 time: 0.669620 Nov 02 21:28:42.000108 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 857/1813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:41 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:42.013957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-67697f3e-720f-415e-b347-3b6f0647cb28 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b689c3040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.083000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-67697f3e-720f-415e-b347-3b6f0647cb28 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.082018 Nov 02 21:28:42.093706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 858/1814] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:41 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:42.103579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1f38621-810f-414b-bd6d-21cb79fb68b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b68916ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.145993 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-c1f38621-810f-414b-bd6d-21cb79fb68b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Image not found. Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1f38621-810f-414b-bd6d-21cb79fb68b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb HTTP/1.1 Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:42.148378 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'a38409f5-3345-43bc-8745-99b33ac609eb'} Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:42.154244 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a38409f5-3345-43bc-8745-99b33ac609eb to delete Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.155487 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a38409f5-3345-43bc-8745-99b33ac609eb could not be found. Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:42.156800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1f38621-810f-414b-bd6d-21cb79fb68b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1f38621-810f-414b-bd6d-21cb79fb68b4 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb" status: 404 len: 62 microversion: 2.1 time: 0.054756 Nov 02 21:28:42.160819 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 859/1815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:42 2022] DELETE /compute/v2.1/images/a38409f5-3345-43bc-8745-99b33ac609eb => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:28:42.185278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.187804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:42.203185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.205747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.207322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.208584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.212058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.212749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.302807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:42.306785 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2aa7e183-d420-4c20-931c-d28833074f44 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.461506 Nov 02 21:28:42.307753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 957/1816] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:28:40 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:42.313784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e7b6970-1d8d-4276-a0e0-04b23c2518ab tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1322 microversion: 2.1 time: 0.158213 Nov 02 21:28:42.322147 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 860/1817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:42 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:42.324827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0fbd873e-998b-410e-b095-50c67def9def tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.330646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.332621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:42.340694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.341421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.342469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.343958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.344605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.345080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.353707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.server_groups [None req-0fbd873e-998b-410e-b095-50c67def9def tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Querying cell 8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) for 2 instances {{(pid=121040) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 21:28:42.356756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fbd873e-998b-410e-b095-50c67def9def tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.357488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fbd873e-998b-410e-b095-50c67def9def tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.359971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fbd873e-998b-410e-b095-50c67def9def tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.433910 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0fbd873e-998b-410e-b095-50c67def9def tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/35583db5-9d7d-49be-a89e-efecc8c8a4ef" status: 200 len: 271 microversion: 2.1 time: 0.124639 Nov 02 21:28:42.434576 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 958/1818] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:28:42 2022] GET /compute/v2.1/os-server-groups/35583db5-9d7d-49be-a89e-efecc8c8a4ef => generated 271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:42.442013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.448042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:42.461371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.461970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.462424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.465186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.466128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.469899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.514280 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd HTTP/1.1 Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:42.517046 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:42.518714 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'a9587065-f470-4a25-b540-62ca7d78e8bd'} Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:42.519684 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:42.521397 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:42.525758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:42.526944 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d21df52-eb7f-49b9-84c6-2907e0c66110 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 404 len: 111 microversion: 2.1 time: 0.091238 Nov 02 21:28:42.527843 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 959/1819] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:42 2022] DELETE /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:42.535831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53f69881-93de-4cdc-9b73-8fd19fd57253 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6d180040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-401582303", "description": "tempest-description-241666848"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:42.701807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:42.713012 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3c70877b-cabb-484c-8b86-d068ed3d248e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.387534 Nov 02 21:28:42.726887 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 861/1820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:42 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:42.737749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.738379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:42.745011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.745778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.746218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.747342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:42.747800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:42.748411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:42.986849 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e8d0203-7425-401f-849a-08356d27afb7 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 200 len: 1620 microversion: 2.1 time: 0.258719 Nov 02 21:28:42.987524 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 862/1821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:42 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 1620 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:42.993886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:42.994506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: a9587065-f470-4a25-b540-62ca7d78e8bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:43.007282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.007979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.008420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.010707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.010707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.010707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.025833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd HTTP/1.1 Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:43.027450 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:43.029446 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'a9587065-f470-4a25-b540-62ca7d78e8bd'} Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:43.030695 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. Nov 02 21:28:43.033575 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.036209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance a9587065-f470-4a25-b540-62ca7d78e8bd could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:43.036209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb264c9f-d9c2-4c5e-a927-98fe09639c52 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd" status: 404 len: 111 microversion: 2.1 time: 0.040221 Nov 02 21:28:43.036209 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 863/1822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:42 2022] GET /compute/v2.1/servers/a9587065-f470-4a25-b540-62ca7d78e8bd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:43.036209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-95208bb6-9b2e-4c83-b5b9-7eef55a762ea req-9e234a17-28b7-4f50-9322-0083b17dcbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ff1b00-bb4f-4926-8659-5aaca6904bfe", "name": "network-vif-plugged", "status": "completed", "tag": "a63c88e6-e754-4fa9-a998-ed6d9afd0916"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:43.046524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-95208bb6-9b2e-4c83-b5b9-7eef55a762ea req-9e234a17-28b7-4f50-9322-0083b17dcbf2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.047363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-95208bb6-9b2e-4c83-b5b9-7eef55a762ea req-9e234a17-28b7-4f50-9322-0083b17dcbf2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.047494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-95208bb6-9b2e-4c83-b5b9-7eef55a762ea req-9e234a17-28b7-4f50-9322-0083b17dcbf2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.062158 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-95208bb6-9b2e-4c83-b5b9-7eef55a762ea req-9e234a17-28b7-4f50-9322-0083b17dcbf2 service nova] Creating event network-vif-plugged:a63c88e6-e754-4fa9-a998-ed6d9afd0916 for instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe on n-h1-860863-4 Nov 02 21:28:43.067401 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-95208bb6-9b2e-4c83-b5b9-7eef55a762ea req-9e234a17-28b7-4f50-9322-0083b17dcbf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036555 Nov 02 21:28:43.068018 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 864/1823] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:43.075147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:43.075765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:43.082310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.083062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.083675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.085258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.085987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.086628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.197260 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53f69881-93de-4cdc-9b73-8fd19fd57253 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.668151 Nov 02 21:28:43.198645 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 960/1824] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:28:42 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:43.204662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:43.224299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:43.224299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.224299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.224299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.224769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.224769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.224769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.570745 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24ac8f42-b15b-42b0-a178-7987ff470239 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d" status: 200 len: 1619 microversion: 2.1 time: 0.500383 Nov 02 21:28:43.571504 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 865/1825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:43 2022] GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d => generated 1619 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:43.589670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15437ece-d986-45c3-913e-c939229b61a2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b689bc790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:43.629493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-15437ece-d986-45c3-913e-c939229b61a2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Image not found. Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15437ece-d986-45c3-913e-c939229b61a2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 HTTP/1.1 Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:43.633036 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bebe7fdd-33bd-4732-bada-33c96885d447'} Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:43.634887 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bebe7fdd-33bd-4732-bada-33c96885d447 to delete Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.636077 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bebe7fdd-33bd-4732-bada-33c96885d447 could not be found. Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:43.637646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:28:43.639328 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:43.641371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15437ece-d986-45c3-913e-c939229b61a2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:43.642452 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15437ece-d986-45c3-913e-c939229b61a2 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447" status: 404 len: 62 microversion: 2.1 time: 0.070148 Nov 02 21:28:43.655253 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 866/1826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:43 2022] DELETE /compute/v2.1/images/bebe7fdd-33bd-4732-bada-33c96885d447 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:28:43.655253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38dfaa21-bf90-4e6c-b69d-1ed5329592ba tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68916ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:43.732443 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38dfaa21-bf90-4e6c-b69d-1ed5329592ba tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.087900 Nov 02 21:28:43.733048 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 867/1827] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:43 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:43.747555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fccfe972-6e1d-4298-a0b4-abdbc2a83be5 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b689bc550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1598288326", "description": "tempest-description-1642965782"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:43.768005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:43.778756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95c9a808-d99a-4143-8c45-91f692ef4332 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1313 microversion: 2.1 time: 0.579188 Nov 02 21:28:43.780027 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 961/1828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:43 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:43.785891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:43.787300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:43.796113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.797012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.797707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.799013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:43.799798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:43.800458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:43.972652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:43.995359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff3d2f2d-7619-412a-953e-5afe48619bf2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1330 microversion: 2.1 time: 0.213404 Nov 02 21:28:43.996225 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 962/1829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:43 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1330 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:44.017805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:44.018335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:44.026094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:44.026594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:44.027084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:44.027810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:44.028284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:44.028921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:44.051104 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 HTTP/1.1 Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:44.052692 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.056152 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'b7a3e5b8-5d0c-4307-960d-4da823a904a2'} Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:44.058256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.061767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.067114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:44.067114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19bac9e7-3b33-4cdc-87d7-f6b0d26bb193 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 404 len: 111 microversion: 2.1 time: 0.057926 Nov 02 21:28:44.067114 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 963/1830] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:43 2022] DELETE /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:44.067114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:44.067114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:44.069351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:44.069351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:44.069351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:44.069351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:44.070045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:44.070045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:44.299602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:44.306851 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e888787-3029-419d-8683-9a5d2c7697c9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.249917 Nov 02 21:28:44.307723 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 964/1831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:44 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:44.312853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1607909980", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "4e28f9f5-f825-43fe-9a55-c3f78710a2d4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:44.384485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:28:44.617534 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fccfe972-6e1d-4298-a0b4-abdbc2a83be5 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.882607 Nov 02 21:28:44.633958 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 868/1832] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:28:43 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:44.638809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:44.639430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: b7a3e5b8-5d0c-4307-960d-4da823a904a2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:44.656036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:44.657556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:44.660420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:44.664642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:44.665100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:44.665802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:44.668912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:44.687399 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 HTTP/1.1 Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:44.689108 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.690611 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b7a3e5b8-5d0c-4307-960d-4da823a904a2'} Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:44.691440 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. Nov 02 21:28:44.693472 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:44.696799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance b7a3e5b8-5d0c-4307-960d-4da823a904a2 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:44.696799 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-474509ca-b412-43dd-b5f7-11317906805a tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2" status: 404 len: 111 microversion: 2.1 time: 0.055710 Nov 02 21:28:44.696799 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 869/1833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:44 2022] GET /compute/v2.1/servers/b7a3e5b8-5d0c-4307-960d-4da823a904a2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:44.701091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-18e43bad-ea05-44f6-af0d-ee40d7661515 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6929dd30>, body: {"security_group_rule": {"parent_group_id": "0b6bbeb0-586c-4eae-88fa-b30341ff6b5f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b385c4d4-e67c-4065-ba95-eca4c5294581"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:44.996537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:28:44.997618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:28:44.998616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:28:44.999209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:28:45.001755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:28:45.015136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.017353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.018270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:45.019349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.020112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.020802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:45.109758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:45.167180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:45.188659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:28:45.191752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:28:45.346557 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-97a2c821-0aad-404c-a3aa-823ccce2e00b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037540 Nov 02 21:28:45.347540 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 965/1834] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:28:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:28:45.353115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ccf3a10-2df4-4c43-a1c1-82ec1b8483b9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '.version_select at 0x7f9b6d13b9d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7ccf3a10-2df4-4c43-a1c1-82ec1b8483b9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Image not found. Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ccf3a10-2df4-4c43-a1c1-82ec1b8483b9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f HTTP/1.1 Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:28:45.407842 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f2270562-5fcd-4048-9d23-8ad6d1eb956f'} Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:45.410385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f2270562-5fcd-4048-9d23-8ad6d1eb956f to delete Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:45.411610 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2270562-5fcd-4048-9d23-8ad6d1eb956f could not be found. Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:45.414261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ccf3a10-2df4-4c43-a1c1-82ec1b8483b9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ccf3a10-2df4-4c43-a1c1-82ec1b8483b9 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f" status: 404 len: 62 microversion: 2.1 time: 0.036210 Nov 02 21:28:45.420975 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 966/1835] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:45 2022] DELETE /compute/v2.1/images/f2270562-5fcd-4048-9d23-8ad6d1eb956f => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:28:45.422310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce99c145-a075-4a23-97e6-9f3bd9e9e478 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d13b310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:45.456586 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce99c145-a075-4a23-97e6-9f3bd9e9e478 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1454 microversion: 2.1 time: 0.066382 Nov 02 21:28:45.457522 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 967/1836] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:45 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:45.462184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:45.463073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:45.469349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.469823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.470326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:45.471035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.471558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.471984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:45.721723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-18e43bad-ea05-44f6-af0d-ee40d7661515 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.024364 Nov 02 21:28:45.725945 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 870/1837] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:28:44 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:45.728505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:45.732357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:45.741742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.742875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.743517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:45.744321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.745023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.745694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:45.885611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:45.896538 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-658e170f-d31d-4f36-93a5-173e4534f078 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1499 microversion: 2.1 time: 0.437962 Nov 02 21:28:45.944058 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 968/1838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:45 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1499 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:45.949955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:45.950691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:45.976653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.977181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.982833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:45.982833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:45.982833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:45.983367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.217752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:46.228093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6099c2bf-d655-42c7-80dc-883f74cd92b1 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1395 microversion: 2.1 time: 0.504186 Nov 02 21:28:46.229751 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 871/1839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:45 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1395 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:46.237264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1b8c8ee-613d-49ff-a29b-bc895cfb90be tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.238462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1b8c8ee-613d-49ff-a29b-bc895cfb90be tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:46.328029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1b8c8ee-613d-49ff-a29b-bc895cfb90be tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:46.337455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:46.338048 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1b8c8ee-613d-49ff-a29b-bc895cfb90be tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1217 microversion: 2.1 time: 0.104567 Nov 02 21:28:46.353501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 872/1840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:46 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:46.360433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-45c02562-4163-49e0-8a6a-6ea811fa3e1f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.414907 Nov 02 21:28:46.361304 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 969/1841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:45 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:46.370157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.370666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:46.375205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-efeab1ae-0109-4f71-aea3-e10d4ab1c345 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b6d1bf8b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.382512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.383090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.383533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.387210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.387687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.388117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.411327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:46.413376 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 HTTP/1.1 Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:46.415798 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.417372 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e7b0cb2f-8ffb-43e2-bd68-446bc4b05289'} Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:46.418373 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.419817 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.423321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:46.424456 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b4ae69db-cb6c-49bd-8396-b8134f6f2d14 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 404 len: 111 microversion: 2.1 time: 0.068140 Nov 02 21:28:46.425577 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 873/1842] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:28:46 2022] DELETE /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:46.440690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.441378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] [instance: e7b0cb2f-8ffb-43e2-bd68-446bc4b05289] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:46.450300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.450794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.451233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.462367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.462875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.463325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.482097 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] HTTP exception thrown: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Request method failure captured: Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 HTTP/1.1 Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-tUVzww_5N2pnd1bX4kdXt6pR0vJzEzyBIPEDM86tvXJ2hi2age76-5RV16xUpAu29JgDcy0a5OncjT2-rWXMqU7rjU1lvaRUQ5A1rrTf8A9HI3Gp7ORSkSmLFkCEsrpHrbvPICy-H8Zg-zjfXSlV31uQL_BePO7lGO1ZuD__MBKQ Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:46.483640 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_671105d3974446ba9f2d440caecf4dea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/671105d3974446ba9f2d440caecf4dea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 671105d3974446ba9f2d440caecf4dea Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesTestJSON-1767324014 Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ab2a1f2b5b74571b08c97e9493d568d Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesTestJSON-1767324014-project Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.485164 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e7b0cb2f-8ffb-43e2-bd68-446bc4b05289'} Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:46.485988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. Nov 02 21:28:46.487348 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:46.488565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] Returning 404 to user: Instance e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:46.488565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c7d6ccf-acd1-4ac7-8a1b-ff5088e1e645 tempest-ImagesTestJSON-1767324014 tempest-ImagesTestJSON-1767324014-project] 10.222.0.25 "GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289" status: 404 len: 111 microversion: 2.1 time: 0.054828 Nov 02 21:28:46.495755 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 874/1843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:46 2022] GET /compute/v2.1/servers/e7b0cb2f-8ffb-43e2-bd68-446bc4b05289 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:46.501283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-58930efc-a4f7-46b3-af32-a5ef9153cf79 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68960b80>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.564037 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-58930efc-a4f7-46b3-af32-a5ef9153cf79 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1463 microversion: 2.1 time: 0.066979 Nov 02 21:28:46.565381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 875/1844] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:46 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1463 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:46.585051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83cfdb14-3697-4181-8e27-93d7b5f75093 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b689ef790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.655365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83cfdb14-3697-4181-8e27-93d7b5f75093 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 200 len: 1463 microversion: 2.1 time: 0.080323 Nov 02 21:28:46.664556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 876/1845] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:46 2022] GET /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 1463 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:46.670943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.671869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:46.681215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.682478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.686098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.686098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.686098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.687460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.895677 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-efeab1ae-0109-4f71-aea3-e10d4ab1c345 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b385c4d4-e67c-4065-ba95-eca4c5294581" status: 202 len: 0 microversion: 2.1 time: 0.531340 Nov 02 21:28:46.896762 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 970/1846] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:28:46 2022] DELETE /compute/v2.1/os-security-groups/b385c4d4-e67c-4065-ba95-eca4c5294581 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:28:46.906977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb509340-8e7c-4077-986a-6d08ca59b290 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b6d145040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:46.919139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:46.931956 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4b221b6-6e3e-4fcd-8f89-6c9fb4f6abb2 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 1468 microversion: 2.1 time: 0.265682 Nov 02 21:28:46.932565 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 877/1847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:46 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:46.959756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-130904349"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:46.963230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:46.972250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.973250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.974318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:46.976385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:46.977273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:46.978047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:47.154990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb509340-8e7c-4077-986a-6d08ca59b290 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/0b6bbeb0-586c-4eae-88fa-b30341ff6b5f" status: 200 len: 246 microversion: 2.1 time: 0.254150 Nov 02 21:28:47.156135 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 971/1848] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:28:46 2022] GET /compute/v2.1/os-security-groups/0b6bbeb0-586c-4eae-88fa-b30341ff6b5f => generated 246 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:47.171395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1883120855", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fce733bb-4d9b-4a3f-8666-2b353f0ca65b"}], "block_device_mapping_v2": [{"uuid": "420c9c97-1819-4509-85c9-f18c30e67151", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:47.311583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] validate_networks() for [('fce733bb-4d9b-4a3f-8666-2b353f0ca65b', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:28:47.722755 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf0af2ab-cb33-4d27-b5e1-8911eb2f4271 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "POST /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.767076 Nov 02 21:28:47.748175 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 878/1849] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:28:46 2022] POST /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:28:47.755331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-695cab4f-5a66-4de3-bf42-e8e765b96e79 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6882d430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1648548607", "description": "tempest-description-1993156970"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:48.125515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:28:48.126947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:28:48.128390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:28:48.129056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:28:48.132015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:28:48.149673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:48.151596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:48.153156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:48.155300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:48.157379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:48.159793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:48.231072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:48.236786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Getting quotas for user 979116d5dca74e6d90abe23e9033107e and project bd27a33cdee44680b69336170f3739fe. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:48.372727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:28:48.375902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='420c9c97-1819-4509-85c9-f18c30e67151',volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:28:48.496531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-695cab4f-5a66-4de3-bf42-e8e765b96e79 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.750273 Nov 02 21:28:48.497659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 879/1850] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:28:47 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:48.504180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:48.504946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:48.535488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:48.535907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:48.538697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:48.558025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:48.558868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:48.559673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:48.929786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:48.941688 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-400ed8ab-4a6d-40a4-9746-9654ea9f46a5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1395 microversion: 2.1 time: 0.441952 Nov 02 21:28:48.953547 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 880/1851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:48 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1395 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:48.983678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:48.985128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:48.996525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:48.997377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:49.005027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:49.006624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:49.007355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:49.007883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:49.085388 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2839e51-a1de-4605-8c30-d140caf0bac7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.925544 Nov 02 21:28:49.086573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 972/1852] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:28:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:28:49.096871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:49.102288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:49.128381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:49.129643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:49.130331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:49.133018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:49.134409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:49.138893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:49.315315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:49.338813 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-65e4ea22-dbb6-4191-b52f-341659dc148e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1277 microversion: 2.1 time: 0.379152 Nov 02 21:28:49.339374 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 881/1853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:48 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:49.362710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74cecff2-f9a2-476c-8101-24ccbc759f5e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68960c10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:49.449804 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-74cecff2-f9a2-476c-8101-24ccbc759f5e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.109000 Nov 02 21:28:49.450030 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 882/1854] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:49 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:49.466627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7b3c682a-c405-42cf-9a61-c37906156271 req-98ad0df5-87d2-4d26-beb4-87664a582919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28ddcf2-a014-4745-93ff-66fe0528efe4", "tag": "8a35a194-cd0c-493e-9661-56c1a33f5eb7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:49.502861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b3c682a-c405-42cf-9a61-c37906156271 req-98ad0df5-87d2-4d26-beb4-87664a582919 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:49.503988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b3c682a-c405-42cf-9a61-c37906156271 req-98ad0df5-87d2-4d26-beb4-87664a582919 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:49.504609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b3c682a-c405-42cf-9a61-c37906156271 req-98ad0df5-87d2-4d26-beb4-87664a582919 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:49.523962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7b3c682a-c405-42cf-9a61-c37906156271 req-98ad0df5-87d2-4d26-beb4-87664a582919 service nova] Creating event network-changed:8a35a194-cd0c-493e-9661-56c1a33f5eb7 for instance c28ddcf2-a014-4745-93ff-66fe0528efe4 on n-h1-860863-4 Nov 02 21:28:49.533673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7b3c682a-c405-42cf-9a61-c37906156271 req-98ad0df5-87d2-4d26-beb4-87664a582919 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073942 Nov 02 21:28:49.537939 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 883/1855] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:49.556380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae1a86f3-a294-458b-b22c-c16f3381e068 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b68836940>, body: {"security_group_rule": {"parent_group_id": "12d330a9-3655-4aea-ad8b-13276bfc140a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:50.102733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:50.117123 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed5193b6-c3a3-47b3-8095-742484a2a9f0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 1.027259 Nov 02 21:28:50.134097 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 973/1856] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:49 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:50.145338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3774efa-db02-4fec-bdcb-75e445bb2974 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:50.146040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3774efa-db02-4fec-bdcb-75e445bb2974 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:50.170011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:50.268544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3774efa-db02-4fec-bdcb-75e445bb2974 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:50.278923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3774efa-db02-4fec-bdcb-75e445bb2974 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:50.282579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3774efa-db02-4fec-bdcb-75e445bb2974 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:50.283755 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3774efa-db02-4fec-bdcb-75e445bb2974 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1104 microversion: 2.25 time: 0.148410 Nov 02 21:28:50.286844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 974/1857] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:28:50 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1104 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:28:50.298799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-619258c3-8dca-48c0-a50e-90ffba823cca req-1de26ddf-da81-4a30-899c-07a34531646a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed1b872-ec5d-49a1-8377-e5ae331eb050", "name": "network-vif-unplugged", "status": "completed", "tag": "be8e2db3-3686-4477-9908-a126ccc17a17"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:50.321694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-619258c3-8dca-48c0-a50e-90ffba823cca req-1de26ddf-da81-4a30-899c-07a34531646a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:50.329136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-619258c3-8dca-48c0-a50e-90ffba823cca req-1de26ddf-da81-4a30-899c-07a34531646a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:50.330507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-619258c3-8dca-48c0-a50e-90ffba823cca req-1de26ddf-da81-4a30-899c-07a34531646a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:50.357217 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-619258c3-8dca-48c0-a50e-90ffba823cca req-1de26ddf-da81-4a30-899c-07a34531646a service nova] Creating event network-vif-unplugged:be8e2db3-3686-4477-9908-a126ccc17a17 for instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 on n-h2-860863-4 Nov 02 21:28:50.393714 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-619258c3-8dca-48c0-a50e-90ffba823cca req-1de26ddf-da81-4a30-899c-07a34531646a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093900 Nov 02 21:28:50.397226 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 975/1858] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:50.405987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd39ed64-61d2-40e2-a287-2db2dc2b8ab3"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:50.413695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:50.420763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:50.421295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:50.421980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:50.422894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:50.423902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:50.424532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:50.789310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:50.862526 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae1a86f3-a294-458b-b22c-c16f3381e068 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.323101 Nov 02 21:28:50.863981 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 884/1859] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:28:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:50.870521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:50.871460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:50.878453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:50.878827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:50.879267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:50.879964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:50.880418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:50.880881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:51.436734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:51.464595 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c26fc24e-495e-420f-907c-0c42e24ff641 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1395 microversion: 2.1 time: 0.597307 Nov 02 21:28:51.478077 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 885/1860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:50 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1395 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:51.486042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:51.488094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:51.501425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:51.502733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:51.503188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:51.503931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:51.504384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:51.504809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:51.514404 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14808efa-0692-47d6-ae3e-df0dd8a19248 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.115672 Nov 02 21:28:51.515099 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 976/1861] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:28:50 2022] POST /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:51.526474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b33fb30f-5bcd-4a4d-b0ff-3d8a54b24fe4 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d11d040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:51.590525 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b33fb30f-5bcd-4a4d-b0ff-3d8a54b24fe4 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.073605 Nov 02 21:28:51.601893 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 977/1862] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:51 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:51.617942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-57145e38-2781-4c56-9e28-6c5682ce18cd tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Action: 'create', calling method: .version_select at 0x7f9b6d13bf70>, body: {"security_group_rule": {"parent_group_id": "12d330a9-3655-4aea-ad8b-13276bfc140a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:52.142313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:52.169709 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ed11e42-db9c-4693-8724-bf7ad75f60d8 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.690139 Nov 02 21:28:52.189531 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 886/1863] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:51 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:52.201560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:52.204525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:52.212627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:52.213471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:52.214114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:52.215450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:52.216777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:52.217462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:52.499435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:52.523263 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d30fcff8-8edd-423c-85f6-1eea98bdf38f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.328897 Nov 02 21:28:52.527705 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 887/1864] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:52 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:52.540545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:52.541472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:52.561867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:52.562579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:52.563192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:52.564309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:52.566073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:52.566691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:52.673220 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-57145e38-2781-4c56-9e28-6c5682ce18cd tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.069871 Nov 02 21:28:52.674350 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 978/1865] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:28:51 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:52.686275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:52.687199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:52.702245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:52.702739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:52.703378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:52.707754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:52.708495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:52.709537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:53.063639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:53.079467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:53.081570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:53.083524 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1082cc41-9f98-4841-a8a2-7156341ab96e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1233 microversion: 2.25 time: 0.553236 Nov 02 21:28:53.101201 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 888/1866] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:28:52 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1233 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:28:53.122861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eccc82a6-6eb1-4904-b051-324c78981cc3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6883ec10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:53.258396 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eccc82a6-6eb1-4904-b051-324c78981cc3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.153329 Nov 02 21:28:53.261621 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 889/1867] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:53 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:53.278803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f93bbd15-970b-4026-803c-9753ee802e5f tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b687ca9d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:53.546115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:53.571813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25f76b60-6777-46b3-a926-fc31848e5de9 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1395 microversion: 2.1 time: 0.889526 Nov 02 21:28:53.573053 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 979/1868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:52 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1395 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:53.586788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:53.587944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:53.603044 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f93bbd15-970b-4026-803c-9753ee802e5f tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/12d330a9-3655-4aea-ad8b-13276bfc140a" status: 200 len: 665 microversion: 2.1 time: 0.338659 Nov 02 21:28:53.603635 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 890/1869] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:28:53 2022] GET /compute/v2.1/os-security-groups/12d330a9-3655-4aea-ad8b-13276bfc140a => generated 665 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:53.604594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:53.605815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:53.607463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:53.608277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:53.609233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:53.614138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:53.617416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:53.618861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:53.624390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:53.628893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:53.628893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:53.628893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:53.628893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:53.629310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:53.683025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:54.385678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:54.405315 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f87ec7b-fa68-465f-87a4-d38337f24274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.829181 Nov 02 21:28:54.420423 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 980/1870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:53 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:54.429039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c96ec976-af02-4f6c-a1ea-f338f57ac8da tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b6882c280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:54.599576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:54.609776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5371d263-420f-48f4-a7e4-9430c84baeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 1.005073 Nov 02 21:28:54.611015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 891/1871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:53 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:54.617184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a2dbca95-39d3-4ff6-a9fb-eb4bdf830d07 req-32fc98be-51cd-489a-b60c-2b73f729d966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86c3828-5255-496f-b756-65a49cfc9cfb", "name": "network-vif-plugged", "status": "completed", "tag": "905eed9b-20b1-4629-a3a7-3a45b44eab21"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:54.637493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a2dbca95-39d3-4ff6-a9fb-eb4bdf830d07 req-32fc98be-51cd-489a-b60c-2b73f729d966 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:54.638298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a2dbca95-39d3-4ff6-a9fb-eb4bdf830d07 req-32fc98be-51cd-489a-b60c-2b73f729d966 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:54.639216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a2dbca95-39d3-4ff6-a9fb-eb4bdf830d07 req-32fc98be-51cd-489a-b60c-2b73f729d966 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:54.656655 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a2dbca95-39d3-4ff6-a9fb-eb4bdf830d07 req-32fc98be-51cd-489a-b60c-2b73f729d966 service nova] Creating event network-vif-plugged:905eed9b-20b1-4629-a3a7-3a45b44eab21 for instance b86c3828-5255-496f-b756-65a49cfc9cfb on n-h2-860863-4 Nov 02 21:28:54.662940 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a2dbca95-39d3-4ff6-a9fb-eb4bdf830d07 req-32fc98be-51cd-489a-b60c-2b73f729d966 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050027 Nov 02 21:28:54.664714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 892/1872] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:54.671982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:54.673024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:54.681187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:54.682085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:54.682744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:54.683640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:54.684539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:54.685228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:54.841488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:54.860097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:54.861873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:54.863426 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-530b0628-8ecb-42f2-9361-c8630795f44c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1251 microversion: 2.25 time: 0.196966 Nov 02 21:28:54.866470 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 893/1873] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:28:54 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1251 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:28:54.872723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7dbde26e-2d1b-4be2-8d28-5ad0a1ae4a46 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687ca280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:54.973753 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7dbde26e-2d1b-4be2-8d28-5ad0a1ae4a46 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.106004 Nov 02 21:28:54.974556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 894/1874] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:54 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:54.979881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:54.989398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:55.005293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:55.012478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:55.012478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:55.012478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:55.012478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:55.012899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:55.401734 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c96ec976-af02-4f6c-a1ea-f338f57ac8da tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/ae58e50e-fe42-47b2-bac7-bc0c98db7e21" status: 202 len: 0 microversion: 2.1 time: 0.979750 Nov 02 21:28:55.409316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:55.411130 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 981/1875] 10.222.0.25 () {58 vars in 1287 bytes} [Wed Nov 2 21:28:54 2022] DELETE /compute/v2.1/os-security-group-rules/ae58e50e-fe42-47b2-bac7-bc0c98db7e21 => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:28:55.419369 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-035caf20-0ad1-4fde-8b30-29ccc402aff2 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1395 microversion: 2.1 time: 0.443039 Nov 02 21:28:55.422033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc2ef6e8-d0ef-4cec-82ff-b9a44ca07b93 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b687c7550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:55.441522 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 895/1876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:54 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1395 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:55.455133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:55.456212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:55.470377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:55.477182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:55.478169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:55.479579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:55.481324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:55.482488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:56.052589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:56.065585 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-198f98ed-0547-469d-9007-31c2ed12131b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.622745 Nov 02 21:28:56.066486 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 896/1877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:55 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:56.078235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:56.078772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:56.094906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:56.095411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:56.095868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:56.096600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:56.097299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:56.101290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:56.332888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=14 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:56.857400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:56.875865 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8fa47991-c8e4-41dc-996d-55dd2ed5bb9f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.804962 Nov 02 21:28:56.877314 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 897/1878] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:56 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:56.885114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc2ef6e8-d0ef-4cec-82ff-b9a44ca07b93 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/12d330a9-3655-4aea-ad8b-13276bfc140a" status: 202 len: 0 microversion: 2.1 time: 1.472326 Nov 02 21:28:56.889443 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 982/1879] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:28:55 2022] DELETE /compute/v2.1/os-security-groups/12d330a9-3655-4aea-ad8b-13276bfc140a => generated 0 bytes in 1478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:28:56.915375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc2dc349-ed1e-45e8-bf89-674b3cd7dc2e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687df1f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:56.926863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:56.932107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:56.960794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:56.966848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:56.966848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:56.966848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:56.966848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:56.967254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:57.019411 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc2dc349-ed1e-45e8-bf89-674b3cd7dc2e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.128636 Nov 02 21:28:57.020006 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 983/1880] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:56 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:57.034808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bfb208ad-2b09-4055-bf71-8c679b5b602b req-1d754cbb-3bfb-4486-a97a-cad22085b44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "221549fd-857c-4d49-a920-83630b845538", "tag": "9b35c9b8-b7d7-446b-b58d-51f56e732f51"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:57.072438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bfb208ad-2b09-4055-bf71-8c679b5b602b req-1d754cbb-3bfb-4486-a97a-cad22085b44b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:57.076365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bfb208ad-2b09-4055-bf71-8c679b5b602b req-1d754cbb-3bfb-4486-a97a-cad22085b44b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:57.077056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bfb208ad-2b09-4055-bf71-8c679b5b602b req-1d754cbb-3bfb-4486-a97a-cad22085b44b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:57.103533 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bfb208ad-2b09-4055-bf71-8c679b5b602b req-1d754cbb-3bfb-4486-a97a-cad22085b44b service nova] Creating event network-changed:9b35c9b8-b7d7-446b-b58d-51f56e732f51 for instance 221549fd-857c-4d49-a920-83630b845538 on n-h2-860863-4 Nov 02 21:28:57.114168 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bfb208ad-2b09-4055-bf71-8c679b5b602b req-1d754cbb-3bfb-4486-a97a-cad22085b44b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092234 Nov 02 21:28:57.117445 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 984/1881] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:57.131228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:57.133308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:57.152974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:57.154062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:57.154741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:57.155701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:57.156398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:57.159020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:57.568990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:57.590664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:57.594665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:57.599445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:57.610924 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70d7175b-2be7-436a-af14-930ff00315d4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1395 microversion: 2.1 time: 0.491943 Nov 02 21:28:57.612658 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db4458ed-01da-47ba-bd2d-c4c358a58ba5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1293 microversion: 2.25 time: 0.733865 Nov 02 21:28:57.613526 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 898/1882] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:28:56 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1293 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:28:57.633944 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 985/1883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:57 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1395 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:57.649930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4ab8903-a0df-4e1b-81ca-67ee7aebd7a7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b6883e310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:57.732211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-e4ab8903-a0df-4e1b-81ca-67ee7aebd7a7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:28:57.732954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-e4ab8903-a0df-4e1b-81ca-67ee7aebd7a7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Neutron security group b385c4d4-e67c-4065-ba95-eca4c5294581 not found {{(pid=121039) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:28:57.734465 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e4ab8903-a0df-4e1b-81ca-67ee7aebd7a7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] HTTP exception thrown: Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist Nov 02 21:28:57.734465 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-bcd6b035-acb7-4a0c-bd37-df784ba61d0d'] Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4ab8903-a0df-4e1b-81ca-67ee7aebd7a7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Request method failure captured: Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-security-groups/b385c4d4-e67c-4065-ba95-eca4c5294581 HTTP/1.1 Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuD7Et3BxCkc4loxv6febrm61TYaz7Bv3y6XEI0rVjRlKvkeYeOWr0O2pIHzKWnJCQs_lHy_EjX5xvLQ_aMARDurccqk1LubpiJzZpPtRy8YUDZyP660RejPQuibsvc5wZ87i3UpFLwZ64o7Xif0BqBnxF-vThPYQaexvMIbgtiXISA Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ce423c495479416f99a6e3351079eb45 Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1389086117 Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:28:57.769946 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ce423c495479416f99a6e3351079eb45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce423c495479416f99a6e3351079eb45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ce423c495479416f99a6e3351079eb45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ce423c495479416f99a6e3351079eb45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1389086117 Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ce423c495479416f99a6e3351079eb45 Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1389086117 Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupRulesTestJSON-1389086117-project Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 2d56d280638c49a49298612645aa194e Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1389086117-project Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: exception: Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-bcd6b035-acb7-4a0c-bd37-df784ba61d0d'] Nov 02 21:28:57.772493 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b385c4d4-e67c-4065-ba95-eca4c5294581'} Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:28:57.773597 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd6b035-acb7-4a0c-bd37-df784ba61d0d'] Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:28:57.775542 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd6b035-acb7-4a0c-bd37-df784ba61d0d'] Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd6b035-acb7-4a0c-bd37-df784ba61d0d'] Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:57.777057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bcd6b035-acb7-4a0c-bd37-df784ba61d0d'] Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4ab8903-a0df-4e1b-81ca-67ee7aebd7a7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Returning 404 to user: Security group b385c4d4-e67c-4065-ba95-eca4c5294581 does not exist Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-bcd6b035-acb7-4a0c-bd37-df784ba61d0d'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4ab8903-a0df-4e1b-81ca-67ee7aebd7a7 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b385c4d4-e67c-4065-ba95-eca4c5294581" status: 404 len: 194 microversion: 2.1 time: 0.158080 Nov 02 21:28:57.778744 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 899/1884] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:28:57 2022] DELETE /compute/v2.1/os-security-groups/b385c4d4-e67c-4065-ba95-eca4c5294581 => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:28:57.784070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:57.784727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:57.807935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:57.808443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:57.808892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:57.809789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:57.810246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:57.810973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:57.820313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:57.889591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-252912256", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:57.997169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:28:58.179089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:28:58.711691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:28:58.736523 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9542e1e1-7034-48dd-8f66-3aae08bf45ea tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.953912 Nov 02 21:28:58.737624 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 900/1885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:57 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:58.766629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-68d64e62-4ff3-465b-880e-4d0ba585c779 req-dee14728-f10d-42a3-8198-51425883764f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28ddcf2-a014-4745-93ff-66fe0528efe4", "name": "network-vif-plugged", "status": "completed", "tag": "8a35a194-cd0c-493e-9661-56c1a33f5eb7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:58.780761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-68d64e62-4ff3-465b-880e-4d0ba585c779 req-dee14728-f10d-42a3-8198-51425883764f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:58.782038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-68d64e62-4ff3-465b-880e-4d0ba585c779 req-dee14728-f10d-42a3-8198-51425883764f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:58.782638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-68d64e62-4ff3-465b-880e-4d0ba585c779 req-dee14728-f10d-42a3-8198-51425883764f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:58.798524 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-68d64e62-4ff3-465b-880e-4d0ba585c779 req-dee14728-f10d-42a3-8198-51425883764f service nova] Creating event network-vif-plugged:8a35a194-cd0c-493e-9661-56c1a33f5eb7 for instance c28ddcf2-a014-4745-93ff-66fe0528efe4 on n-h1-860863-4 Nov 02 21:28:58.809595 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-68d64e62-4ff3-465b-880e-4d0ba585c779 req-dee14728-f10d-42a3-8198-51425883764f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065675 Nov 02 21:28:58.811081 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 901/1886] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:28:58.825153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-575a9727-b3dd-4d52-8f16-c01cba2302a4 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b689ef9d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:59.023515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:28:59.024066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:28:59.024556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:28:59.025064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:28:59.025556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:28:59.051640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:59.052251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:59.053956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:59.058113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:59.058607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:59.059590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:59.112367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Getting quotas for project 255043a6d5ca4541bb9d597a70075391. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:28:59.120845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Getting quotas for user d5e45337c25e4cd7b72cf2f6b2b2277a and project 255043a6d5ca4541bb9d597a70075391. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:28:59.138659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:28:59.141912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:28:59.331957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1d710fa-7d78-4108-af1b-e336ea55d619 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695743 Nov 02 21:28:59.336431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 986/1887] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:28:59.348035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:59.350246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:28:59.366240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:59.367183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:59.369726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:59.370722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:59.373644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:59.374460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:59.744267 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-575a9727-b3dd-4d52-8f16-c01cba2302a4 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/0b6bbeb0-586c-4eae-88fa-b30341ff6b5f" status: 202 len: 0 microversion: 2.1 time: 0.931648 Nov 02 21:28:59.745614 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 902/1888] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:28:58 2022] DELETE /compute/v2.1/os-security-groups/0b6bbeb0-586c-4eae-88fa-b30341ff6b5f => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:28:59.751865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b49d26e6-1a58-4530-88e8-5d33cba0243e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687c91f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:28:59.837254 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b49d26e6-1a58-4530-88e8-5d33cba0243e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.090333 Nov 02 21:28:59.840423 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 903/1889] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:28:59 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:28:59.917991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c6d289ab-1db9-4062-9b9d-3e4cdb4eefb8 req-2caaf8a6-0ace-465b-aeae-0a88218fd134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e33e1d-76d6-4011-8810-dec200b78844", "name": "network-vif-unplugged", "status": "completed", "tag": "86827113-650e-49b8-abdc-ca4ae487e196"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:28:59.962464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c6d289ab-1db9-4062-9b9d-3e4cdb4eefb8 req-2caaf8a6-0ace-465b-aeae-0a88218fd134 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:28:59.964124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c6d289ab-1db9-4062-9b9d-3e4cdb4eefb8 req-2caaf8a6-0ace-465b-aeae-0a88218fd134 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:28:59.965128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c6d289ab-1db9-4062-9b9d-3e4cdb4eefb8 req-2caaf8a6-0ace-465b-aeae-0a88218fd134 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:28:59.974339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:00.027309 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c4682f1-07c4-4db1-ac85-cdfad6fdf9a1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.686594 Nov 02 21:29:00.031815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 987/1890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:28:59 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:00.077306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:00.078819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:00.079667 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c6d289ab-1db9-4062-9b9d-3e4cdb4eefb8 req-2caaf8a6-0ace-465b-aeae-0a88218fd134 service nova] Creating event network-vif-unplugged:86827113-650e-49b8-abdc-ca4ae487e196 for instance 07e33e1d-76d6-4011-8810-dec200b78844 on n-h1-860863-4 Nov 02 21:29:00.099249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:00.101075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:00.101880 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c6d289ab-1db9-4062-9b9d-3e4cdb4eefb8 req-2caaf8a6-0ace-465b-aeae-0a88218fd134 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.253756 Nov 02 21:29:00.103109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:00.106689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:00.107205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:00.107407 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 904/1891] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:00.107657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:00.124910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:00.127172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:00.148421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:00.150015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:00.151108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:00.152661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:00.153806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:00.154896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:00.503681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:00.516995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:00.519485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:00.521129 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-373784d9-1f74-4cf0-acc3-f9a5024152a7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1293 microversion: 2.25 time: 0.480757 Nov 02 21:29:00.538424 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 988/1892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:00 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1293 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:00.548305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bbadb0b-23a3-458f-b809-e9ff00e35d2a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:00.549353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1bbadb0b-23a3-458f-b809-e9ff00e35d2a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:00.552102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:00.561127 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7bd6f696-fb6d-41a5-ab90-0fb4b24125c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1395 microversion: 2.1 time: 0.451650 Nov 02 21:29:00.573339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 905/1893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:00 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1395 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:00.578409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-031d7c92-b641-425e-bd2b-204cd6ea6c51 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b689608b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:00.699312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1bbadb0b-23a3-458f-b809-e9ff00e35d2a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:00.699312 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1bbadb0b-23a3-458f-b809-e9ff00e35d2a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1216 microversion: 2.1 time: 0.136244 Nov 02 21:29:00.699312 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 989/1894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:00 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1216 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:00.699312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:00.699816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:00.699816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:00.699816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:00.699816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:00.700172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:00.700172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:00.700172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:01.072944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:01.081894 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5da1460b-cf99-448f-8b0b-c0b8fa9be414 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.402696 Nov 02 21:29:01.086441 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 990/1895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:00 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:01.096554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7409494e-f5ae-4037-bf3f-e4bd6b613c47 req-673162b1-ddec-4777-b2ed-43f8fc0ad95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb5e4b93-d4db-4859-a8ac-e0536deae4bd", "tag": "365a8627-274c-4996-98fc-e94e1e7c8ff3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:01.143825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7409494e-f5ae-4037-bf3f-e4bd6b613c47 req-673162b1-ddec-4777-b2ed-43f8fc0ad95f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:01.144627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7409494e-f5ae-4037-bf3f-e4bd6b613c47 req-673162b1-ddec-4777-b2ed-43f8fc0ad95f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:01.145287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7409494e-f5ae-4037-bf3f-e4bd6b613c47 req-673162b1-ddec-4777-b2ed-43f8fc0ad95f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:01.159777 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7409494e-f5ae-4037-bf3f-e4bd6b613c47 req-673162b1-ddec-4777-b2ed-43f8fc0ad95f service nova] Creating event network-changed:365a8627-274c-4996-98fc-e94e1e7c8ff3 for instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd on n-h1-860863-4 Nov 02 21:29:01.173221 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7409494e-f5ae-4037-bf3f-e4bd6b613c47 req-673162b1-ddec-4777-b2ed-43f8fc0ad95f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082403 Nov 02 21:29:01.174789 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 991/1896] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:01.180690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70350a83-2297-4deb-a6d1-614e5f5ae4c0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687c7550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:01.266292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70350a83-2297-4deb-a6d1-614e5f5ae4c0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.090218 Nov 02 21:29:01.278701 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 992/1897] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:01 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:01.290598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:01.290598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:01.333095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:01.334993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:01.337825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:01.338974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:01.340287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:01.341078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:01.503454 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-031d7c92-b641-425e-bd2b-204cd6ea6c51 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e332fdf1-d9a9-4019-891a-c97ce16be490" status: 202 len: 0 microversion: 2.1 time: 0.928784 Nov 02 21:29:01.505259 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 906/1898] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:29:00 2022] DELETE /compute/v2.1/os-security-groups/e332fdf1-d9a9-4019-891a-c97ce16be490 => generated 0 bytes in 931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:29:01.512340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f3950a1c-3d69-4c6a-8983-ca4f20a3da40 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b6d23d820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:01.731909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:01.755150 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e8190c6-a205-46ff-934a-5e90a9b2ae27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.473514 Nov 02 21:29:01.755336 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 993/1899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:01 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:01.767764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:01.767764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:01.779258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:01.780260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:01.781116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:01.782036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:01.783001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:01.783441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.078228 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f3950a1c-3d69-4c6a-8983-ca4f20a3da40 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/8c448951-1ac0-4d44-b7f0-61334372a264" status: 202 len: 0 microversion: 2.1 time: 0.569988 Nov 02 21:29:02.079221 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 907/1900] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:29:01 2022] DELETE /compute/v2.1/os-security-groups/8c448951-1ac0-4d44-b7f0-61334372a264 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:29:02.084831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:02.086106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:02.087923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:02.096088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.100583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.100583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.100583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.100583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.101015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.122852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:02.126832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:02.129239 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd2a067e-9ad6-473b-b4e7-93a7f84511c2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1293 microversion: 2.25 time: 0.369626 Nov 02 21:29:02.129239 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 994/1901] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:01 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:02.149008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:02.152816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:02.163908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.164827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.165488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.166684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.167298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.167899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.323549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:02.342948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2cb31d1f-5240-4530-b0a4-195c86fb7fe1 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1220 microversion: 2.1 time: 0.212815 Nov 02 21:29:02.344079 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 995/1902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:02 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1220 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:02.349134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-07ab3bd0-93b1-48fe-91fb-6b4d014a175e tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b687e8d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:02.480656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:02.491853 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1532f3b-9ac2-4a3f-bfd4-f1cbb83bfc51 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1577 microversion: 2.1 time: 0.411294 Nov 02 21:29:02.507425 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 908/1903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:02 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1577 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:02.524038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:02.525391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:02.535430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.536665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.537873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.538853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.539800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.540409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.849410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:02.854506 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-07ab3bd0-93b1-48fe-91fb-6b4d014a175e tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/331d0fdf-e522-4e6c-9377-294fd65df69e" status: 202 len: 0 microversion: 2.1 time: 0.508797 Nov 02 21:29:02.855114 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 996/1904] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:29:02 2022] DELETE /compute/v2.1/os-security-groups/331d0fdf-e522-4e6c-9377-294fd65df69e => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:29:02.858275 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c8788cd-cc6b-46db-8347-67c985411262 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.347134 Nov 02 21:29:02.858275 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 909/1905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:02 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:02.862102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-9bcba20e-4b84-4697-80b0-f450591a110c req-2ea70601-8fda-4c5e-b7b2-f25de61d9ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e33e1d-76d6-4011-8810-dec200b78844", "tag": "86827113-650e-49b8-abdc-ca4ae487e196"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:02.863538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd5fe2f2-4d1c-43db-b8e2-ff66117f40db tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6882c790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:02.874325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9bcba20e-4b84-4697-80b0-f450591a110c req-2ea70601-8fda-4c5e-b7b2-f25de61d9ee1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.877457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9bcba20e-4b84-4697-80b0-f450591a110c req-2ea70601-8fda-4c5e-b7b2-f25de61d9ee1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.877457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9bcba20e-4b84-4697-80b0-f450591a110c req-2ea70601-8fda-4c5e-b7b2-f25de61d9ee1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.890589 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-9bcba20e-4b84-4697-80b0-f450591a110c req-2ea70601-8fda-4c5e-b7b2-f25de61d9ee1 service nova] Creating event network-changed:86827113-650e-49b8-abdc-ca4ae487e196 for instance 07e33e1d-76d6-4011-8810-dec200b78844 on n-h1-860863-4 Nov 02 21:29:02.908960 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-9bcba20e-4b84-4697-80b0-f450591a110c req-2ea70601-8fda-4c5e-b7b2-f25de61d9ee1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046201 Nov 02 21:29:02.911241 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 910/1906] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:02.918825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:02.919357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:02.929881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.929881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.929881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.929881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:02.930321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:02.931061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:02.952741 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd5fe2f2-4d1c-43db-b8e2-ff66117f40db tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.092787 Nov 02 21:29:02.953963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 997/1907] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:02 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:02.961186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:02.961186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:03.011210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:03.023134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:03.026725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:03.027810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:03.028972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:03.029599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:03.343494 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85773a0b-9739-46ee-8f2b-5374afee4228 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.430594 Nov 02 21:29:03.344409 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 911/1908] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:29:02 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4/os-interface => generated 285 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:03.349347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-51cff7bd-4265-43d0-b449-77e217addec9 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] Calling method '.version_select at 0x7f9b688368b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:04.213186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:04.234653 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ff7f43c-27dd-488d-bde1-2be073892661 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 1.277614 Nov 02 21:29:04.249245 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 998/1909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:02 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:04.261855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:04.266784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:04.294416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:04.297301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:04.301642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:04.303972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:04.304519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:04.307175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:04.960819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:04.978994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:04.980592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:04.984066 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff522582-8f8b-43fe-9be4-6e5d925395b7 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1293 microversion: 2.25 time: 0.742318 Nov 02 21:29:04.986751 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 999/1910] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:04 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1293 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:05.002870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:05.005437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:05.025448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:05.026241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:05.027246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:05.033366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:05.034100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:05.034701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:05.101746 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-51cff7bd-4265-43d0-b449-77e217addec9 tempest-SecurityGroupRulesTestJSON-1389086117 tempest-SecurityGroupRulesTestJSON-1389086117-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/585c9524-7eed-43b4-80cb-e78645c647d0" status: 202 len: 0 microversion: 2.1 time: 1.754400 Nov 02 21:29:05.103134 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 912/1911] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:29:03 2022] DELETE /compute/v2.1/os-security-groups/585c9524-7eed-43b4-80cb-e78645c647d0 => generated 0 bytes in 1758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:29:05.121074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:05.122098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:05.137233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:05.138168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:05.139888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:05.140800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:05.142193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:05.148243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:05.258782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:05.271151 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2250848-5a40-4314-8c60-0d2a36d68290 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1274 microversion: 2.1 time: 0.282710 Nov 02 21:29:05.275254 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1000/1912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:04 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:05.288411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2893dd29-20c7-4a98-9c24-f524ee83e1cc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d110040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:05.375681 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2893dd29-20c7-4a98-9c24-f524ee83e1cc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.097991 Nov 02 21:29:05.384798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1001/1913] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:05 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:05.384798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:05.393668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:05.405803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:05.406323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:05.406774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:05.407719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:05.408182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:05.408617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:05.479765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:05.488973 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5333f61a-0962-430a-b022-d31f6a38a889 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.380624 Nov 02 21:29:05.521746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 913/1914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:05 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:05.719372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:05.736857 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1245d530-6214-4954-b9b2-0bc1be7806b8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.353753 Nov 02 21:29:05.738243 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1002/1915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:05 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:05.999499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-52e17670-b8be-42bd-a9a6-4c3ebd018fb2 req-bf4dd96d-4ba3-4b88-9618-774a94236b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221549fd-857c-4d49-a920-83630b845538", "name": "network-vif-plugged", "status": "completed", "tag": "9b35c9b8-b7d7-446b-b58d-51f56e732f51"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:06.014387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:06.015568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:06.026257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-52e17670-b8be-42bd-a9a6-4c3ebd018fb2 req-bf4dd96d-4ba3-4b88-9618-774a94236b1b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.026747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-52e17670-b8be-42bd-a9a6-4c3ebd018fb2 req-bf4dd96d-4ba3-4b88-9618-774a94236b1b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.027183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-52e17670-b8be-42bd-a9a6-4c3ebd018fb2 req-bf4dd96d-4ba3-4b88-9618-774a94236b1b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.037494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.041795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.046293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.047158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.047649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.054513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.065784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-52e17670-b8be-42bd-a9a6-4c3ebd018fb2 req-bf4dd96d-4ba3-4b88-9618-774a94236b1b service nova] Creating event network-vif-plugged:9b35c9b8-b7d7-446b-b58d-51f56e732f51 for instance 221549fd-857c-4d49-a920-83630b845538 on n-h2-860863-4 Nov 02 21:29:06.078848 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-52e17670-b8be-42bd-a9a6-4c3ebd018fb2 req-bf4dd96d-4ba3-4b88-9618-774a94236b1b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087025 Nov 02 21:29:06.079360 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 914/1916] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:29:06.102418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:06.105649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:06.116149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.120753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.121537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.151012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.152029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.155168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.594560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:06.612959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:06.617814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:06.622470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:06.624796 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96885afe-a19a-4ecc-a636-40d9cd74eb3b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1293 microversion: 2.25 time: 0.614414 Nov 02 21:29:06.627354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1003/1917] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:06 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1293 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:29:06.634997 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f5ce78f-05b6-4995-8dad-aee2c844b5c0 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1577 microversion: 2.1 time: 0.549359 Nov 02 21:29:06.645869 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 915/1918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:06 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1577 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:06.662162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:06.662376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1677108c-91dc-475f-a188-27928b24b432 req-1c44c8f9-ce18-4702-82bf-97bc324569e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28ddcf2-a014-4745-93ff-66fe0528efe4", "tag": "8a35a194-cd0c-493e-9661-56c1a33f5eb7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:06.663286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:06.670857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.671734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.672452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.673447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.674211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.680517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.694278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1677108c-91dc-475f-a188-27928b24b432 req-1c44c8f9-ce18-4702-82bf-97bc324569e6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.694815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1677108c-91dc-475f-a188-27928b24b432 req-1c44c8f9-ce18-4702-82bf-97bc324569e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.695255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1677108c-91dc-475f-a188-27928b24b432 req-1c44c8f9-ce18-4702-82bf-97bc324569e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.739807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1677108c-91dc-475f-a188-27928b24b432 req-1c44c8f9-ce18-4702-82bf-97bc324569e6 service nova] Creating event network-changed:8a35a194-cd0c-493e-9661-56c1a33f5eb7 for instance c28ddcf2-a014-4745-93ff-66fe0528efe4 on n-h1-860863-4 Nov 02 21:29:06.761602 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1677108c-91dc-475f-a188-27928b24b432 req-1c44c8f9-ce18-4702-82bf-97bc324569e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132934 Nov 02 21:29:06.767583 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1004/1919] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:06.786697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ae2b7be-1886-4b88-965c-a9c7589b3e7c tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687c73a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:06.916180 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ae2b7be-1886-4b88-965c-a9c7589b3e7c tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.146651 Nov 02 21:29:06.916758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1005/1920] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:06 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:06.924213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:06.930780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:06.946548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.947421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.948836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:06.952612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:06.953334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:06.953971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:07.125333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:07.137471 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1607edee-ede6-4081-9ed4-6278f978be35 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.489288 Nov 02 21:29:07.138526 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 916/1921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:06 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:07.143705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:07.144683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:07.152707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:07.159361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:07.159361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:07.159361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:07.159361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:07.160154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:07.554598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:07.571881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-399531e0-c785-4030-a522-352670cb5c01 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1317 microversion: 2.1 time: 0.653325 Nov 02 21:29:07.585446 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1006/1922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:06 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:07.748919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:07.772965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:07.773519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05328c3e-a7f6-4977-b80f-5e912a69fff7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.631356 Nov 02 21:29:07.773519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 917/1923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:07 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:07.792370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:07.806808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:07.807305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:07.807853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:07.808674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:07.809227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:07.809742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:07.934079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e349493e-e8e4-455d-98ba-5402f2e99206 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b689608b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:07.999323 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e349493e-e8e4-455d-98ba-5402f2e99206 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.071403 Nov 02 21:29:08.000084 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 918/1924] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:07 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:08.026885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:08.036310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:08.039534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:08.040501 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee57d39f-599e-435e-bff6-ee01343c8bb4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1293 microversion: 2.25 time: 0.368947 Nov 02 21:29:08.041700 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1007/1925] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:07 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:08.182499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:08.183118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:08.197405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.198330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.199009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:08.200366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.200977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.201640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:08.448622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:08.458352 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5435990f-0fa9-495e-92e8-32a8361ea641 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.280362 Nov 02 21:29:08.473624 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 919/1926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:08 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:08.608706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:08.608706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:08.613261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.613977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.614914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:08.620802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.621523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.622134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:08.799611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:08.800543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:08.807855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.819934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.819934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:08.819934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.819934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.820417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:08.866740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:08.871832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:08.876830 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-869eac68-2f9d-4d23-8fd8-d5569e6eca82 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1467 microversion: 2.1 time: 0.283224 Nov 02 21:29:08.893307 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1008/1927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:08 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:08.928156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:08.932506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:08.953475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.956531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.957239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:08.960733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:08.983205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:08.984261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:09.090328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:09.235245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:09.254315 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6ea7d201-6e8a-4cc7-971d-ac6d0ccc6cfc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.458810 Nov 02 21:29:09.271322 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 920/1928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:08 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:09.271322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b0b8059-749e-459b-948e-b1361a10dce3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6893f0d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:09.309098 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e297681-c316-4e46-b047-2c3d731a04a1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1618 microversion: 2.1 time: 0.389931 Nov 02 21:29:09.325535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1009/1929] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:08 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1618 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:09.346291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:09.346291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:09.350590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b0b8059-749e-459b-948e-b1361a10dce3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.091786 Nov 02 21:29:09.351420 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 921/1930] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:09 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:09.362102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:09.362865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:09.363877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:09.364794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:09.370191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:09.371580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:09.393442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f3be38d2-1bf7-4da8-8d0b-28e68e2bc712 req-552fb312-343b-4f24-95f8-e9b1ede239a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe6914ac-9e4d-461b-bc1d-eac050f58374", "tag": "e978550d-f6af-44d1-96d5-b560c099450f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:09.411050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f3be38d2-1bf7-4da8-8d0b-28e68e2bc712 req-552fb312-343b-4f24-95f8-e9b1ede239a4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:09.417973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f3be38d2-1bf7-4da8-8d0b-28e68e2bc712 req-552fb312-343b-4f24-95f8-e9b1ede239a4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:09.418135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f3be38d2-1bf7-4da8-8d0b-28e68e2bc712 req-552fb312-343b-4f24-95f8-e9b1ede239a4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:09.435978 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f3be38d2-1bf7-4da8-8d0b-28e68e2bc712 req-552fb312-343b-4f24-95f8-e9b1ede239a4 service nova] Creating event network-changed:e978550d-f6af-44d1-96d5-b560c099450f for instance fe6914ac-9e4d-461b-bc1d-eac050f58374 on n-h1-860863-4 Nov 02 21:29:09.468822 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f3be38d2-1bf7-4da8-8d0b-28e68e2bc712 req-552fb312-343b-4f24-95f8-e9b1ede239a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056495 Nov 02 21:29:09.477308 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 922/1931] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:09.486797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:09.486797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:09.493957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:09.494729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:09.495593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:09.498909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:09.500806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:09.502346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:09.861011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:09.876876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:09.888552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:09.897425 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19ee67df-6cbc-45e8-b404-7ac905e05ac6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.563226 Nov 02 21:29:09.898811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1010/1932] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:09 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:09.906368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1161678222", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["4e28f9f5-f825-43fe-9a55-c3f78710a2d4"]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:10.018550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:29:10.298464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:10.307411 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1c5ea7e6-bfb2-4ffc-b333-7d727e303400 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.828393 Nov 02 21:29:10.307993 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 923/1933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:09 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:10.325865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:10.326760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:10.332979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:10.338847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:10.338847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:10.338847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:10.338847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:10.339223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:10.655528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:29:10.656322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:29:10.657042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:29:10.657631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:29:10.658221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:29:10.678654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:10.697764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:10.701281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:10.701281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:10.701281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:10.701281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:10.701713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:10.726853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:10.735640 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f310d551-9eeb-4ec9-a7e8-120b4e6c4370 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.413457 Nov 02 21:29:10.742987 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 924/1934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:10 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:10.749760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-07c9c9b4-e518-4cb5-99ad-deae4709e9e7 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b688365e0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:10.773302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:10.790407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:10.851688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:29:10.856948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-07c9c9b4-e518-4cb5-99ad-deae4709e9e7 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.112414 Nov 02 21:29:10.857841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:29:10.858095 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 925/1935] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:10 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:10.923739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:10.924353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:10.935455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:10.943539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:10.943539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:10.943539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:10.943539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:10.947918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:11.037589 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0b85827-e7e0-4526-9a93-d9f7c7604d34 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129393 Nov 02 21:29:11.038298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1011/1936] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:29:11.044087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11c04332-7a7e-43f4-8798-db499fbb8a09 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:11.044986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11c04332-7a7e-43f4-8798-db499fbb8a09 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:11.707945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11c04332-7a7e-43f4-8798-db499fbb8a09 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:11.735668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11c04332-7a7e-43f4-8798-db499fbb8a09 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1217 microversion: 2.1 time: 0.694013 Nov 02 21:29:11.738516 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1012/1937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:11 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1217 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:11.760200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:11.764007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:11.797728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:11.800838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:11.803611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:11.806474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:11.810795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:11.811730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.128767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:12.142327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:12.145881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:12.148232 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1c5077b8-605b-42b2-ab33-fd22b6729168 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 1.228271 Nov 02 21:29:12.149377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 926/1938] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:10 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:29:12.155588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:12.156529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:12.181620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.183228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.184962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.186114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.186935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.187714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.230365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:12.241539 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9431173-b7df-4b37-8fdf-75799b104f85 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.500347 Nov 02 21:29:12.242850 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1013/1939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:11 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:12.247936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d949d4a-f61d-4c4c-b111-4b7da1359511 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687e8ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:12.319341 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d949d4a-f61d-4c4c-b111-4b7da1359511 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.074124 Nov 02 21:29:12.331315 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1014/1940] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:12 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:12.336485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:12.337081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:12.349596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.349596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.349596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.349596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.354090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.354090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.410401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:29:12.461158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:12.476514 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d33b6691-da70-452a-89f7-2f397746028f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.324895 Nov 02 21:29:12.479380 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 927/1941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:12 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:12.762482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:12.764115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:12.781656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.793136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:12.793382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.798837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.799635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.804193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.805642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.850917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:12.875709 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-769265e4-100d-44b7-9d15-7e244b89610d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 204 len: 0 microversion: 2.1 time: 0.543022 Nov 02 21:29:12.881371 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1015/1942] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:29:12 2022] DELETE /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:12.887402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:12.888193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:12.898202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.899060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.899724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.900685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:12.901424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:12.905218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:12.952491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:12.960838 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-685abe07-456d-4d1b-a6cc-7b3d8489fcdd tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1213 microversion: 2.1 time: 0.203079 Nov 02 21:29:12.983665 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 928/1943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:12 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1213 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:13.175332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:13.176052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:13.186165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:13.189207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:13.191982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:13.195684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:13.196267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:13.197267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:13.292027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:13.309274 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc14ce8e-e759-4de8-b43a-d1190c6f6611 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1551 microversion: 2.1 time: 0.426376 Nov 02 21:29:13.328681 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1016/1944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:12 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1551 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:13.353964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:13.354606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:13.389496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:13.390851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:13.394584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:13.397791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:13.399243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:13.400740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:13.752530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:13.767322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:13.768961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:13.770120 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5d4a6a86-b1ba-4745-b486-a1b3e5b87f2c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.598665 Nov 02 21:29:13.770690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 929/1945] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:13 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:29:13.810691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9080f2d0-da61-4594-977a-9547a3be5f4f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687f9670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:13.869426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:13.878803 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-785bdeef-e9ec-4f95-a48d-fb6c78e24231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.552296 Nov 02 21:29:13.884680 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1017/1946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:13 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:13.897757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:13.898412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:13.921609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:13.921609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:13.921609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:13.923672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:13.923672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:13.927129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:13.950597 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9080f2d0-da61-4594-977a-9547a3be5f4f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.152560 Nov 02 21:29:13.951593 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 930/1947] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:13 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:13.995563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:13.996181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:14.004738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.005254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.006343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:14.007389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.007853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.013274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:14.147534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:14.158284 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8395c0ea-044e-456f-9606-13f7677b2b54 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1269 microversion: 2.1 time: 0.166343 Nov 02 21:29:14.159546 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 931/1948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:13 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:14.254350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:14.268117 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-12d8ed26-e93b-489a-a9b7-0b9e250e576d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.382226 Nov 02 21:29:14.269073 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1018/1949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:13 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:14.343763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:14.344335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:14.371177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.371690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.372142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:14.388393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.389263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.389727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:14.597389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:14.620536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bde5c3e2-d558-4747-bba7-fd5d968aeb0b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1551 microversion: 2.1 time: 0.277468 Nov 02 21:29:14.621699 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 932/1950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:14 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1551 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:14.801002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:14.803264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:14.817186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.817730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.819046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:14.819753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.820442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.820871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:14.901670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:14.904384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:14.913069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.913828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.914519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:14.915530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:14.916305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:14.917062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:15.080756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:15.095014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:15.101043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:15.101043 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88b44eab-e861-4344-a6ac-39df7116479f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.301039 Nov 02 21:29:15.116900 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1019/1951] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:14 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:15.138250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-769affd7-316e-4dca-9597-34f38b2adf0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b688064c0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:15.245468 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-769affd7-316e-4dca-9597-34f38b2adf0d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.123989 Nov 02 21:29:15.246214 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1020/1952] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:15 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:15.257020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:15.261608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:15.274387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:15.275692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:15.276512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:15.277473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:15.278388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:15.279003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:15.292922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:15.306081 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34c4d8c3-9020-422b-887d-4ec73014180c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.408216 Nov 02 21:29:15.307339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 933/1953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:14 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:15.315952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:15.319122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:15.331993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:15.334543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:15.336152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:15.340369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:15.341125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:15.342121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:15.444652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:15.468627 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5e9f406-0356-4241-bd69-c5ee5ec8577c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1277 microversion: 2.1 time: 0.210410 Nov 02 21:29:15.469884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1021/1954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:15 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:15.648269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:15.648881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:15.666082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:15.666919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:15.667660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:15.668462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:15.668880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:15.674277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:15.864851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:15.887704 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e3a3d86-ee1b-49a7-a45a-a725ee84a823 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.578051 Nov 02 21:29:15.925574 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 934/1955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:15 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:15.975686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:15.985928 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85036cbb-65ac-47b1-be9c-e65b77d3c89e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1551 microversion: 2.1 time: 0.343410 Nov 02 21:29:15.997726 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1022/1956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:15 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1551 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:16.125521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:16.128962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:16.131141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:16.149921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.154371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.161043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.162625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.164030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.165337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.262462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bba80879-4d55-4c56-8094-a429bdf1ddaf tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687dfd30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:16.331090 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bba80879-4d55-4c56-8094-a429bdf1ddaf tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1454 microversion: 2.1 time: 0.072453 Nov 02 21:29:16.332147 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1023/1957] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:16 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:16.337716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:16.347998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:16.370340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.372999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.375412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.378786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.379330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.379708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.630706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:16.648542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:16.650111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:16.651611 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ffc0381a-b1b6-480f-bd71-7790d0fe42dc tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.530772 Nov 02 21:29:16.652421 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 935/1958] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:16 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:16.657446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:16.670235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:16.689349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.690573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.691279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.692288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.693072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.693835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.849080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:16.869566 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-76d8fed8-e967-4001-9395-47c3a1597de6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1275 microversion: 2.1 time: 0.215827 Nov 02 21:29:16.885193 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 936/1959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:16 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:16.917644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:16.918311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:16.921737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:16.924747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.925512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.926212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.927172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:16.928076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:16.928708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:16.932749 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-177a9182-fd3b-44b5-a457-83c074db212c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.599298 Nov 02 21:29:16.937474 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1024/1960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:16 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:17.032745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:17.036430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:17.052535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.055268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.056152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.057796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.058623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.059306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.246175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:17.264119 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0f2af99a-571e-4c18-b93a-95eae21ab949 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1509 microversion: 2.1 time: 0.241703 Nov 02 21:29:17.268073 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1025/1961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:17 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:17.347802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9be33a82-f4fd-413c-9251-b79d9e8ef596 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68ffd5e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:17.429781 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9be33a82-f4fd-413c-9251-b79d9e8ef596 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1463 microversion: 2.1 time: 0.081155 Nov 02 21:29:17.433489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1026/1962] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:17 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1463 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:17.446294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d01370d7-c056-4a3e-aea2-1941650f402f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6882f940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:17.537990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d01370d7-c056-4a3e-aea2-1941650f402f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 200 len: 1463 microversion: 2.1 time: 0.095794 Nov 02 21:29:17.538608 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1027/1963] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:17 2022] GET /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 1463 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:17.569519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:17.571264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:17.589298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.591794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.592480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.595987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.600397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.601823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.614166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:17.640723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e0a8bce-f80e-4c5a-b9c8-a12ec1990e58 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1716 microversion: 2.1 time: 0.725643 Nov 02 21:29:17.641403 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 937/1964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:16 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1716 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:17.677771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e6d8112e-c1a5-4ff0-b230-a1884587702d req-7e520614-cc7d-4277-a028-82d2de3ee68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ff1b00-bb4f-4926-8659-5aaca6904bfe", "name": "network-vif-deleted", "tag": "a63c88e6-e754-4fa9-a998-ed6d9afd0916"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:17.707726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e6d8112e-c1a5-4ff0-b230-a1884587702d req-7e520614-cc7d-4277-a028-82d2de3ee68f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.712177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e6d8112e-c1a5-4ff0-b230-a1884587702d req-7e520614-cc7d-4277-a028-82d2de3ee68f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.712803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e6d8112e-c1a5-4ff0-b230-a1884587702d req-7e520614-cc7d-4277-a028-82d2de3ee68f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.738166 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e6d8112e-c1a5-4ff0-b230-a1884587702d req-7e520614-cc7d-4277-a028-82d2de3ee68f service nova] Creating event network-vif-deleted:a63c88e6-e754-4fa9-a998-ed6d9afd0916 for instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe on n-h1-860863-4 Nov 02 21:29:17.750888 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e6d8112e-c1a5-4ff0-b230-a1884587702d req-7e520614-cc7d-4277-a028-82d2de3ee68f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096920 Nov 02 21:29:17.755246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 938/1965] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:17.769844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:17.774493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:17.788461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.791199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.793389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.794244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.795732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.798089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.915026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:17.926885 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47a2fadd-320e-4b56-a47b-c2443d375bbc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1481 microversion: 2.1 time: 0.375571 Nov 02 21:29:17.930119 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1028/1966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:17 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1481 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:17.946993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:17.951952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:17.963507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.964040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.967033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:17.967789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:17.968260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:17.968694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.298946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:18.308446 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e65a30cb-1e45-4941-86ee-9eeea5189900 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.376470 Nov 02 21:29:18.326849 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1029/1967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:17 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:18.357126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0bf802cc-32fc-4939-8f43-6541642c3f71 req-ba0ab840-0fe9-4d59-b147-760c9aef3a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6914ac-9e4d-461b-bc1d-eac050f58374", "name": "network-vif-plugged", "status": "completed", "tag": "e978550d-f6af-44d1-96d5-b560c099450f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:18.376063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0bf802cc-32fc-4939-8f43-6541642c3f71 req-ba0ab840-0fe9-4d59-b147-760c9aef3a9e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.377115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0bf802cc-32fc-4939-8f43-6541642c3f71 req-ba0ab840-0fe9-4d59-b147-760c9aef3a9e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.377719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0bf802cc-32fc-4939-8f43-6541642c3f71 req-ba0ab840-0fe9-4d59-b147-760c9aef3a9e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.435369 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0bf802cc-32fc-4939-8f43-6541642c3f71 req-ba0ab840-0fe9-4d59-b147-760c9aef3a9e service nova] Creating event network-vif-plugged:e978550d-f6af-44d1-96d5-b560c099450f for instance fe6914ac-9e4d-461b-bc1d-eac050f58374 on n-h1-860863-4 Nov 02 21:29:18.446426 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0bf802cc-32fc-4939-8f43-6541642c3f71 req-ba0ab840-0fe9-4d59-b147-760c9aef3a9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116799 Nov 02 21:29:18.448057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1030/1968] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:18.463842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:18.470753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:18.481588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:18.496395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:18.504970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:18.507377 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-310595c9-cd9e-430e-b19b-4cfd6cbcba49 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.744419 Nov 02 21:29:18.510187 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 939/1969] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:17 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:18.531185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:18.532086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:18.533317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.535385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.539001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.544443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.546107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.546727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.556552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:18.557744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.559999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.560488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.563835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.564320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.569269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.761196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:18.782095 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed73b9d4-ab4b-4415-a524-2f8fc3455abc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1344 microversion: 2.1 time: 0.269830 Nov 02 21:29:18.784467 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 940/1970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:18 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1344 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:18.800337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:18.803668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:18.829952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.830796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.831406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.837775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.838589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.839238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.936513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:18.947123 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3105985-eae6-4792-97be-5d28ed3fea94 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1316 microversion: 2.1 time: 0.497643 Nov 02 21:29:18.948583 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1031/1971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:18 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:18.966678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:18.967699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:18.973945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.975265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.975992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:18.977070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:18.977697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:18.978311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.164741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:19.173783 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5be96c3a-159d-41a0-b874-7285c85e8493 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1706 microversion: 2.1 time: 0.388133 Nov 02 21:29:19.174597 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 941/1972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:18 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1706 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:19.198789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-309546dd-233f-4621-a8b4-115b0607d9eb tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '.version_select at 0x7f9b6d1e5280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:19.202298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-309546dd-233f-4621-a8b4-115b0607d9eb tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.202786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-309546dd-233f-4621-a8b4-115b0607d9eb tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.203226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-309546dd-233f-4621-a8b4-115b0607d9eb tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.225628 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-309546dd-233f-4621-a8b4-115b0607d9eb tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.030303 Nov 02 21:29:19.232812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:19.238004 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 942/1973] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:29:19 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:19.244096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:19.245072 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6da8908f-3c21-47af-94ec-d4734da4befb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1468 microversion: 2.1 time: 0.290407 Nov 02 21:29:19.246224 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1032/1974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:18 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:19.249495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:19.270061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.273543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1694438347"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:19.273728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.274812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.276887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.277539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.277945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:19.280233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.291599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.291599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.291599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.291599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.292130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.292130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.897838 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fbea8a2a-8ffa-41fe-b875-7675e5275165 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1857 microversion: 2.1 time: 0.658419 Nov 02 21:29:19.936678 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce5f14a9-a673-4b0c-bb78-ded0f0d87580 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "POST /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050/action" status: 202 len: 0 microversion: 2.1 time: 0.668692 Nov 02 21:29:19.937952 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 943/1975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:19 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1857 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:19.947293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1033/1976] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:29:19 2022] POST /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:29:19.955751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:19.960241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:19.961568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:19.966107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:19.985416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.985919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.987840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.988508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.989007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.989445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.990680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.991048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.991498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:19.995602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:19.996078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:19.996579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:20.377490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:20.390290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:20.395842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:20.398109 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5e0b149-f26b-4c56-bf0c-36c4afd97052 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.449275 Nov 02 21:29:20.401586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1034/1977] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:19 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:20.418101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:20.419052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:20.425840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:20.426566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:20.427199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:20.428633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:20.429332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:20.434508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:20.470939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:20.479762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed9bc33c-87a3-426c-b39b-d7e7601bdf0b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.540313 Nov 02 21:29:20.493322 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 944/1978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:19 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:20.493322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:20.493322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:20.497480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:20.498389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:20.512238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:20.515291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:20.517679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:20.518446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:20.605272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:20.617169 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2f831c6-e7d3-43ad-9574-07f0a22cea29 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1344 microversion: 2.1 time: 0.213537 Nov 02 21:29:20.617356 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1035/1979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:20 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:20.628326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d918bc8-5804-436c-b783-ffeab6dec2f0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68806820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:20.701573 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d918bc8-5804-436c-b783-ffeab6dec2f0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1455 microversion: 2.1 time: 0.083236 Nov 02 21:29:20.703760 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1036/1980] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:20 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:20.711297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:20.714176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:20.720206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:20.721889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:20.725210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:20.725210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:20.725210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:20.726128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:20.726128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.107926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34665fea-32f7-4d9b-b217-80e2440cf56f tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1857 microversion: 2.1 time: 0.625019 Nov 02 21:29:21.109587 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 945/1981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:20 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1857 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:21.137511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-638ee7f1-4cf1-4fbd-95cb-f9f1a699beb7 req-9965cd2b-335e-4c13-bb2a-10be5cbcf469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7846a733-f1ef-4257-9bb0-7de4347b3dbe", "tag": "a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:21.165247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-638ee7f1-4cf1-4fbd-95cb-f9f1a699beb7 req-9965cd2b-335e-4c13-bb2a-10be5cbcf469 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.165997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-638ee7f1-4cf1-4fbd-95cb-f9f1a699beb7 req-9965cd2b-335e-4c13-bb2a-10be5cbcf469 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.167304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-638ee7f1-4cf1-4fbd-95cb-f9f1a699beb7 req-9965cd2b-335e-4c13-bb2a-10be5cbcf469 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.208996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-638ee7f1-4cf1-4fbd-95cb-f9f1a699beb7 req-9965cd2b-335e-4c13-bb2a-10be5cbcf469 service nova] Creating event network-changed:a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59 for instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe on n-h2-860863-4 Nov 02 21:29:21.218319 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-638ee7f1-4cf1-4fbd-95cb-f9f1a699beb7 req-9965cd2b-335e-4c13-bb2a-10be5cbcf469 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094082 Nov 02 21:29:21.227031 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 946/1982] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:21.239624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1fd4affa-2b9b-4f65-a995-186dc1efbcfa req-5f67d295-577c-4fe5-bd48-e3369d2811c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5e4b93-d4db-4859-a8ac-e0536deae4bd", "name": "network-vif-plugged", "status": "completed", "tag": "365a8627-274c-4996-98fc-e94e1e7c8ff3"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:21.276616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1fd4affa-2b9b-4f65-a995-186dc1efbcfa req-5f67d295-577c-4fe5-bd48-e3369d2811c0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.276616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1fd4affa-2b9b-4f65-a995-186dc1efbcfa req-5f67d295-577c-4fe5-bd48-e3369d2811c0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.276616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1fd4affa-2b9b-4f65-a995-186dc1efbcfa req-5f67d295-577c-4fe5-bd48-e3369d2811c0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.299437 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1fd4affa-2b9b-4f65-a995-186dc1efbcfa req-5f67d295-577c-4fe5-bd48-e3369d2811c0 service nova] Creating event network-vif-plugged:365a8627-274c-4996-98fc-e94e1e7c8ff3 for instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd on n-h1-860863-4 Nov 02 21:29:21.306792 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1fd4affa-2b9b-4f65-a995-186dc1efbcfa req-5f67d295-577c-4fe5-bd48-e3369d2811c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077826 Nov 02 21:29:21.307393 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 947/1983] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:21.314106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:21.314705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:21.323272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.337989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.339913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.340676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.341362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.341946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.373949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:21.385071 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-01a3e624-80e1-46ac-91ca-cf0ef72df1ec tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1466 microversion: 2.1 time: 0.681564 Nov 02 21:29:21.401374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1037/1984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:20 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1466 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:21.434788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:21.435756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:21.446070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.452334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.452903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.453810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.454350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.454842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.516418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:21.519874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lazy-loading 'services' on Instance uuid 07e33e1d-76d6-4011-8810-dec200b78844 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:29:21.713335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:21.825363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf169542-c668-4a54-bc08-b1c08f7570d2 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments/b0eb3ce0-2714-4482-ac29-f6f6d2b423e2" status: 202 len: 0 microversion: 2.1 time: 0.515988 Nov 02 21:29:21.826339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 948/1985] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:29:21 2022] DELETE /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments/b0eb3ce0-2714-4482-ac29-f6f6d2b423e2 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:29:21.855966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-758677892", "metadata": {"image_type": "test"}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:21.863189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:21.877324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.877820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.878409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.881987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.882658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.883429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.942359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:21.951623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:21.951840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Getting quotas for project 255043a6d5ca4541bb9d597a70075391. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:21.957210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:21.966379 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6456e56e-9592-4574-b293-de7c489de69f tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.537067 Nov 02 21:29:21.967490 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1038/1986] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:21 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:21.972307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:21.976180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:21.982554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.983175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.987478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.994135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:21.994644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:21.995223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:21.999879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Getting quotas for user d5e45337c25e4cd7b72cf2f6b2b2277a and project 255043a6d5ca4541bb9d597a70075391. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:22.241703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:22.250338 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-844f7514-9373-44ba-ac70-1084967a1871 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.281567 Nov 02 21:29:22.250931 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1039/1987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:21 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:22.269736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:22.270665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:22.277615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:22.278326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:22.278975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:22.279761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:22.280347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:22.280866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:22.367455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:22.378060 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e9f2d4a-1815-416a-9eed-fdf5a1b5b054 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1344 microversion: 2.1 time: 0.125435 Nov 02 21:29:22.380127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1040/1988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:22 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:22.387036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a955fdc3-db1e-4ba5-9850-306cf931957f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6879a040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:22.446430 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a955fdc3-db1e-4ba5-9850-306cf931957f tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1455 microversion: 2.1 time: 0.064082 Nov 02 21:29:22.447625 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1041/1989] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:22 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:22.454387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:22.457041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:22.465222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:22.466028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:22.466710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:22.467644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:22.468295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:22.468966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:22.505269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-073fc010-92bd-4394-b92d-2606d76d4eab tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055588 Nov 02 21:29:22.506391 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1042/1990] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:29:22 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:22.636364 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b7b96d3-ff48-4b62-880c-f7409fa5a279 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "POST /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374/action" status: 202 len: 0 microversion: 2.1 time: 0.808179 Nov 02 21:29:22.637107 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 949/1991] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:29:21 2022] POST /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:29:22.648489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e62533a-3c23-4915-9e98-81a0c833dd2f tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b696e6310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:22.722796 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e62533a-3c23-4915-9e98-81a0c833dd2f tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 200 len: 1423 microversion: 2.1 time: 0.078578 Nov 02 21:29:22.723656 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1043/1992] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:22 2022] GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:22.997893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:22.998908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:23.015320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.020758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.020758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.020758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.020758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.021335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.175578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:23.187052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:23.187547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:23.188921 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb259ceb-9a5b-4c31-87ed-32457205b143 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1281 microversion: 2.25 time: 0.196057 Nov 02 21:29:23.201426 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 950/1993] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:22 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:23.277394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:23.279995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:23.286986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.287597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.288286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.289243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.290260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.290891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.347566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c497774c-2c09-4fd1-b620-b7477e06994e req-4d1df8aa-e9c5-4df5-a308-45cc15bd3ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86c3828-5255-496f-b756-65a49cfc9cfb", "name": "network-vif-unplugged", "status": "completed", "tag": "905eed9b-20b1-4629-a3a7-3a45b44eab21"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:23.359338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c497774c-2c09-4fd1-b620-b7477e06994e req-4d1df8aa-e9c5-4df5-a308-45cc15bd3ca1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.360083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c497774c-2c09-4fd1-b620-b7477e06994e req-4d1df8aa-e9c5-4df5-a308-45cc15bd3ca1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.360714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c497774c-2c09-4fd1-b620-b7477e06994e req-4d1df8aa-e9c5-4df5-a308-45cc15bd3ca1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.398363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c497774c-2c09-4fd1-b620-b7477e06994e req-4d1df8aa-e9c5-4df5-a308-45cc15bd3ca1 service nova] Creating event network-vif-unplugged:905eed9b-20b1-4629-a3a7-3a45b44eab21 for instance b86c3828-5255-496f-b756-65a49cfc9cfb on n-h2-860863-4 Nov 02 21:29:23.410198 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c497774c-2c09-4fd1-b620-b7477e06994e req-4d1df8aa-e9c5-4df5-a308-45cc15bd3ca1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074800 Nov 02 21:29:23.412039 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 951/1994] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:23.428152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:23.429053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:23.443602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.446271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.449032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.453714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.454629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.454629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.575466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:23.588233 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa5cb6d5-3e73-4c93-b801-c90e344788ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1344 microversion: 2.1 time: 0.172990 Nov 02 21:29:23.589595 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 952/1995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:23 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:23.594673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:23.613740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f6bc5fd-6db9-470b-b8d4-371bba36ff36 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.333529 Nov 02 21:29:23.615324 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1044/1996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:23 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:23.616069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-49e4d1b5-5f99-4747-9916-8a7dd8b480aa tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687c9790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:23.621919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:23.624692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:23.655165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.657154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.657825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.659655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:23.662671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:23.663439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:23.709367 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-49e4d1b5-5f99-4747-9916-8a7dd8b480aa tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1455 microversion: 2.1 time: 0.117833 Nov 02 21:29:23.710594 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 953/1997] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:23 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:23.737184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a61e3e3a-17fc-4608-8a50-724ca8ba277e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120122 Nov 02 21:29:23.738172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1045/1998] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:29:23 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:23.740124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fd1ab45c-f4c6-490c-b9f3-82df68684a0c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b688fd670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:23.811130 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fd1ab45c-f4c6-490c-b9f3-82df68684a0c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 200 len: 1423 microversion: 2.1 time: 0.075195 Nov 02 21:29:23.812090 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 954/1999] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:23 2022] GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 1423 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:24.218539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:24.218539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:24.230680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:24.231172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:24.231629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:24.232391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:24.232851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:24.233298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:24.580264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:24.594131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:24.595584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:24.596751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4fe8c73e-c8f1-4c78-8dde-6ab00896ae33 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1476 microversion: 2.25 time: 0.383602 Nov 02 21:29:24.607248 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1046/2000] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:24 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:29:24.613653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:24.613791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:24.624747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:24.625977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:24.626956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:24.627952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:24.628629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:24.629365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:24.717719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:24.719385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:24.720159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:24.720786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'fault' on Instance uuid c9ff1b00-bb4f-4926-8659-5aaca6904bfe {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:29:24.831649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:24.848334 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e3b6a9f-1451-4203-a46f-b0cbb0c18dff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1349 microversion: 2.1 time: 0.240576 Nov 02 21:29:24.854529 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 955/2001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:24 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1349 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:24.871000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:24.872333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:24.899263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:24.900203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:24.904359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:24.908109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:24.911536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:24.913137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.142549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:25.143428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:25.155299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.155934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.156385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.157139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.157599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.161123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.265875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:25.275471 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a12af0e1-6d00-4457-bb12-5dc3527ca1d5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.419280 Nov 02 21:29:25.276423 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 956/2002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:24 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:25.282243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ceb9cd3d-33a3-4f62-9525-529e3614183a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68799a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:25.370274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ceb9cd3d-33a3-4f62-9525-529e3614183a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1455 microversion: 2.1 time: 0.079238 Nov 02 21:29:25.370274 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 957/2003] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:25 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:25.378054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:25.388515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:25.424394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.431810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.438361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.438361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.438361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.438361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.520162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid bb5e4b93-d4db-4859-a8ac-e0536deae4bd {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:29:25.556297 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-974bc6bf-4c7e-463b-958b-2b1ef812e721 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192002 Nov 02 21:29:25.557192 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 958/2004] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:29:25 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:25.560220 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4504b308-9dc7-49fd-b3e4-84ea79a381d2 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1969 microversion: 2.25 time: 0.928075 Nov 02 21:29:25.563301 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1047/2005] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:24 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1969 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:25.569907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7209f5ed-862d-48a0-8f2b-462adce556b0 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6883e790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:25.596075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:25.601879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:25.617023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.618923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.619561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.620470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.622076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.624963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.659679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7209f5ed-862d-48a0-8f2b-462adce556b0 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 200 len: 1423 microversion: 2.1 time: 0.098353 Nov 02 21:29:25.674438 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 959/2006] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:25 2022] GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:25.879789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid bb5e4b93-d4db-4859-a8ac-e0536deae4bd {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:29:25.882050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:25.882778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:25.888280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:25.895210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.895712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.896242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.902282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.903389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.904309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.918664 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f782fa94-6445-49f3-be5d-7b057c6784bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1969 microversion: 2.25 time: 0.329519 Nov 02 21:29:25.919255 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1048/2007] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:25 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:25.948623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:25.953137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.953876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.954704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.955953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:25.956712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:25.958121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:25.992964 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d8dcbed6-c29b-4e74-a772-540fa6fed657 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051184 Nov 02 21:29:25.994021 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1049/2008] 10.222.0.25 () {60 vars in 1217 bytes} [Wed Nov 2 21:29:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:29:26.004552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:26.004552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:26.004552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:26.004552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'fault' on Instance uuid c9ff1b00-bb4f-4926-8659-5aaca6904bfe {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:29:26.015694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": "auto"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:26.020708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:26.038198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:26.039461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:26.040295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:26.041398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:26.042061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:26.043044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:26.064464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:26.079305 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dd859d5e-213c-4629-9246-ea84864a89fc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 200 len: 1349 microversion: 2.1 time: 0.202543 Nov 02 21:29:26.083304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 960/2009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:25 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 1349 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:26.090529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'flavor' on Instance uuid bb5e4b93-d4db-4859-a8ac-e0536deae4bd {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:29:26.130264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121040) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:29:26.306285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:26.307050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:26.327823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:26.333007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:26.334176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:26.341241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:26.341982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:26.342599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:26.604641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:26.616723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9fc7187c-f6ec-4167-8d16-c9552c5f04c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.315022 Nov 02 21:29:26.617013 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 961/2010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:26 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:26.636319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-335d2e2d-6e0c-426c-b239-2a89a085719e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6878e280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:26.772335 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-335d2e2d-6e0c-426c-b239-2a89a085719e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1455 microversion: 2.1 time: 0.145663 Nov 02 21:29:26.773263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 962/2011] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:26 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:26.788543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:26.793519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:26.821961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:26.822301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:26.822745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:26.826317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:26.826993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:26.827453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:26.938135 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9bcc8b27-b6c1-4de7-a2b2-fa6de93c3de3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162415 Nov 02 21:29:26.938799 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 963/2012] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:29:26 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:26.960575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-78a3c02d-3f20-4e15-be23-e4903c46e5b3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6d102550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:27.377744 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-78a3c02d-3f20-4e15-be23-e4903c46e5b3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 200 len: 1423 microversion: 2.1 time: 0.421966 Nov 02 21:29:27.378752 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 964/2013] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:26 2022] GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 1423 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:27.389330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:27.390098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:27.409990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:27.410570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:27.411023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:27.412883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:27.413578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:27.419338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:27.454658 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe HTTP/1.1 Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:29:27.458572 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:27.460737 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'c9ff1b00-bb4f-4926-8659-5aaca6904bfe'} Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:29:27.461773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:27.463266 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:27.464583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:29:27.464583 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5caf10bb-fe96-4de1-b1e5-3ad72a7dfcf1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 404 len: 111 microversion: 2.1 time: 0.081328 Nov 02 21:29:27.479683 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 965/2014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:27 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:29:27.642391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:27.643807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:27.651971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:27.653353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:27.654258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:27.655174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:27.656432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:27.657077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:27.916674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:27.936291 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8372d940-c7c5-4cdd-beab-9c306b9de25c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.296021 Nov 02 21:29:27.953007 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 966/2015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:27 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:27.961824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:27.969233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:28.009685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:28.010418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:28.010919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:28.011922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:28.012574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:28.017937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:28.051854 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe/os-volume_attachments HTTP/1.1 Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:29:28.062277 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:28.064214 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': 'c9ff1b00-bb4f-4926-8659-5aaca6904bfe'} Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:29:28.065076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:29:28.066434 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:29:28.070575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:29:28.072601 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1393e447-4590-4059-b6f1-9a7e3d784300 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.129627 Nov 02 21:29:28.077448 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 967/2016] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:29:27 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe/os-volume_attachments => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:29:28.085730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0d17e27-2f08-4033-b58e-a6cd3a8c31a0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68791040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:29.608374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19f67b50-6694-4f62-8008-e42504b9c8e7 tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd/action" status: 202 len: 0 microversion: 2.25 time: 3.600588 Nov 02 21:29:29.609741 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1050/2017] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:29:26 2022] POST /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd/action => generated 0 bytes in 3603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:29:29.618046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:29.631062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:29.663293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:29.663789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:29.664230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:29.665522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:29.665522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:29.665851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:29.786033 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca035690-2cc9-410f-9426-618df08fc2fa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175112 Nov 02 21:29:29.801307 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1051/2018] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:29:29 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:29.813679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c104fb10-06bd-4b24-9fc8-a1397830b6ac tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6874ec10>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:35.970115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:37.997778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=63 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:38.035227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:39.662861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=63 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:39.781030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:43.918345 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e0d17e27-2f08-4033-b58e-a6cd3a8c31a0 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1455 microversion: 2.1 time: 15.839588 Nov 02 21:29:43.918964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 968/2019] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:28 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1455 bytes in 15841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:43.928987 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c104fb10-06bd-4b24-9fc8-a1397830b6ac tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 200 len: 1432 microversion: 2.1 time: 14.119318 Nov 02 21:29:43.928987 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1052/2020] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:29 2022] GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 1432 bytes in 14121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:43.929570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1315630634", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "67c3f76f-7a17-4f1f-a61d-9ec78598dc27"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:43.929698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:43.929850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:43.936593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:43.941917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:43.941917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:43.941917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:43.941917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:43.942312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:43.981232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] validate_networks() for [('67c3f76f-7a17-4f1f-a61d-9ec78598dc27', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:29:44.145294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:44.153848 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f45e28f-778c-4e73-a6f9-b9656e2aab5f tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.230015 Nov 02 21:29:44.165089 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1053/2021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:43 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:44.206129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-de74bb69-bb05-492a-b859-f9f92f460782 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Action: 'create', calling method: .version_select at 0x7f9b6874ed30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2080245176", "policies": ["affinity"]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:44.224719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-de74bb69-bb05-492a-b859-f9f92f460782 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:44.230120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-de74bb69-bb05-492a-b859-f9f92f460782 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:44.348174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-de74bb69-bb05-492a-b859-f9f92f460782 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:44.352695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-de74bb69-bb05-492a-b859-f9f92f460782 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:44.369387 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-de74bb69-bb05-492a-b859-f9f92f460782 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.213872 Nov 02 21:29:44.370172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1054/2022] 10.222.0.25 () {60 vars in 1174 bytes} [Wed Nov 2 21:29:44 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:44.374645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9a4ad661-876c-48c3-a47c-b705556636d3 req-7a681f28-ed66-4efe-8b5b-42771b82b271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed1b872-ec5d-49a1-8377-e5ae331eb050", "name": "network-vif-plugged", "status": "completed", "tag": "be8e2db3-3686-4477-9908-a126ccc17a17"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:44.386049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9a4ad661-876c-48c3-a47c-b705556636d3 req-7a681f28-ed66-4efe-8b5b-42771b82b271 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.392424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9a4ad661-876c-48c3-a47c-b705556636d3 req-7a681f28-ed66-4efe-8b5b-42771b82b271 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.392424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9a4ad661-876c-48c3-a47c-b705556636d3 req-7a681f28-ed66-4efe-8b5b-42771b82b271 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.397440 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9a4ad661-876c-48c3-a47c-b705556636d3 req-7a681f28-ed66-4efe-8b5b-42771b82b271 service nova] Creating event network-vif-plugged:be8e2db3-3686-4477-9908-a126ccc17a17 for instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 on n-h2-860863-4 Nov 02 21:29:44.402489 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9a4ad661-876c-48c3-a47c-b705556636d3 req-7a681f28-ed66-4efe-8b5b-42771b82b271 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 Nov 02 21:29:44.403323 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1055/2023] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:44.408251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:44.408977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:44.415324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.415815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.416252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.417380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.417511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.417906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.443977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:29:44.444365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:29:44.444846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:29:44.445301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:29:44.445707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:29:44.461407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.461407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.461407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.461407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.461894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.461894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.476413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:44.481652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for user 1cb7808dc9e54e86811e0b7ad1cec847 and project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:44.494777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:29:44.497111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:29:44.554877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:44.562948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:44.564387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:44.565554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a034f0b-c7f8-45e8-bcd7-e8b613d8ec5b tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1486 microversion: 2.25 time: 0.161180 Nov 02 21:29:44.566117 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1056/2024] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:44 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1486 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:44.570693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:44.576134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:44.578578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.579061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.579494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.580225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.580677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.581135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.606522 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f42d3633-0578-49e8-93db-10ca081ecd46 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686437 Nov 02 21:29:44.607464 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 969/2025] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:29:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:29:44.612555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-87373a9a-a1de-426a-b80e-5eaa46a5b804 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6875adc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:44.616549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0ac6ad4-cd40-43a2-ab04-c5d9032a1371 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049377 Nov 02 21:29:44.618412 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1057/2026] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:29:44 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:29:44.623477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5914b2b5-4f0a-4ea7-92e3-c8d846734b70 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Action: 'create', calling method: .version_select at 0x7f9b68744ca0>, body: {"server_group": {"name": "tempest-server-group-1705917683", "policies": ["affinity"]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:44.648145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5914b2b5-4f0a-4ea7-92e3-c8d846734b70 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:44.657148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5914b2b5-4f0a-4ea7-92e3-c8d846734b70 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:44.679067 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-87373a9a-a1de-426a-b80e-5eaa46a5b804 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 200 len: 1432 microversion: 2.1 time: 0.070322 Nov 02 21:29:44.679841 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 970/2027] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:44 2022] GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 1432 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:44.692421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86434467-a34f-4535-9649-9c772b438b5d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:44.693797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86434467-a34f-4535-9649-9c772b438b5d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:44.758535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86434467-a34f-4535-9649-9c772b438b5d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:44.767370 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86434467-a34f-4535-9649-9c772b438b5d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c" status: 200 len: 1215 microversion: 2.1 time: 0.086539 Nov 02 21:29:44.768128 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 971/2028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:44 2022] GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:44.784190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:44.787149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:44.796003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.796628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.797216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.798404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:44.799456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:44.800519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:44.803997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5914b2b5-4f0a-4ea7-92e3-c8d846734b70 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:44.811626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5914b2b5-4f0a-4ea7-92e3-c8d846734b70 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:44.827206 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5914b2b5-4f0a-4ea7-92e3-c8d846734b70 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.208407 Nov 02 21:29:44.835137 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1058/2029] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 21:29:44 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:44.840274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b40a01e-71d8-40af-9086-0ee4b77ab47c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:44.840788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b40a01e-71d8-40af-9086-0ee4b77ab47c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:44.858477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b40a01e-71d8-40af-9086-0ee4b77ab47c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:29:44.998502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:45.008437 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5bf373c2-289b-44df-ba2d-3c96f74adaf3 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1466 microversion: 2.1 time: 0.229775 Nov 02 21:29:45.020359 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 972/2030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:44 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1466 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:45.020359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e858d3f9-cda6-4533-9527-2c2f46555c45 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Action: 'create', calling method: .version_select at 0x7f9b6874de50>, body: {"server_group": {"name": "tempest-server-group-1705917683", "policies": ["affinity"]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:45.032960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e858d3f9-cda6-4533-9527-2c2f46555c45 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:45.038729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e858d3f9-cda6-4533-9527-2c2f46555c45 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:45.163726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e858d3f9-cda6-4533-9527-2c2f46555c45 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:45.168584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e858d3f9-cda6-4533-9527-2c2f46555c45 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:45.181435 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e858d3f9-cda6-4533-9527-2c2f46555c45 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.170991 Nov 02 21:29:45.182027 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 973/2031] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 21:29:45 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:45.186437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb0da410-9ee9-43c6-a3f4-eb75a1994df4 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68766040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.232448 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb0da410-9ee9-43c6-a3f4-eb75a1994df4 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1464 microversion: 2.1 time: 0.049372 Nov 02 21:29:45.233024 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 974/2032] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1464 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:45.237510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69278cc0-5bb8-48da-8e20-a285b78c139d tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b68766f70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.283693 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69278cc0-5bb8-48da-8e20-a285b78c139d tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/612221e9-0156-4770-a8ac-3a978f4e721c" status: 200 len: 784 microversion: 2.1 time: 0.049647 Nov 02 21:29:45.288670 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 975/2033] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/images/612221e9-0156-4770-a8ac-3a978f4e721c => generated 784 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:45.289583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.290300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:45.296265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:45.296824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:45.297389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:45.298093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:45.298539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:45.298963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:45.312026 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.scheduler.client.report [None req-6b40a01e-71d8-40af-9086-0ee4b77ab47c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Deleted allocations for instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c Nov 02 21:29:45.321639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.api [None req-6b40a01e-71d8-40af-9086-0ee4b77ab47c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] Instance Mapping does not exist while attempting local delete cleanup. Nov 02 21:29:45.323032 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b40a01e-71d8-40af-9086-0ee4b77ab47c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c" status: 204 len: 0 microversion: 2.1 time: 0.486578 Nov 02 21:29:45.323652 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1059/2034] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:29:44 2022] DELETE /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:45.328812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8cbb3b78-5c78-4e1b-bb97-6ce1c8f74907 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.431873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:45.439577 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-21d0c314-1df7-4838-a18d-14fd31aaeddc tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.154149 Nov 02 21:29:45.440144 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 976/2035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:45.444521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3910761-f4e4-4425-b53d-ea54ec1fe657 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6893fee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.474643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8cbb3b78-5c78-4e1b-bb97-6ce1c8f74907 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/90fca6ef-3137-478e-90bf-761eeef6f466" status: 204 len: 0 microversion: 2.1 time: 0.149110 Nov 02 21:29:45.475187 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1060/2036] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:29:45 2022] DELETE /compute/v2.1/os-server-groups/90fca6ef-3137-478e-90bf-761eeef6f466 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:45.479761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e11a3af5-bd09-4055-bf1b-c1f50cb701b5 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.487618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e11a3af5-bd09-4055-bf1b-c1f50cb701b5 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011400 Nov 02 21:29:45.488165 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1061/2037] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:45.495024 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3910761-f4e4-4425-b53d-ea54ec1fe657 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 200 len: 1464 microversion: 2.1 time: 0.050831 Nov 02 21:29:45.495157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-413f154a-f5c5-4575-b50e-ef853f693945 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.495264 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 977/2038] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 1464 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:45.495368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-413f154a-f5c5-4575-b50e-ef853f693945 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:45.499221 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-413f154a-f5c5-4575-b50e-ef853f693945 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:29:45.499396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a670189d-798a-4b46-acb8-45bd1518c416 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-413f154a-f5c5-4575-b50e-ef853f693945 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c HTTP/1.1 Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:29:45.500844 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:29:45.503205 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7b417526-c8e6-4c50-9fce-ca4e4686c79c'} Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:29:45.504231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:45.506016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-413f154a-f5c5-4575-b50e-ef853f693945 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:29:45.507397 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-413f154a-f5c5-4575-b50e-ef853f693945 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c" status: 404 len: 111 microversion: 2.1 time: 0.013555 Nov 02 21:29:45.507397 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1062/2039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:29:45.511369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d02b5ef6-b3f9-47db-b21f-9e5c4ff75143 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b68744310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.519760 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a670189d-798a-4b46-acb8-45bd1518c416 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.025215 Nov 02 21:29:45.520658 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 978/2040] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:45.525214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:45.525951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:45.531950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:45.532434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:45.532872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:45.533598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:45.534229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:45.534834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:45.953245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:45.958688 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-23153a12-5f64-4fe7-90f6-92ba6168f5e8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 1468 microversion: 2.1 time: 0.436984 Nov 02 21:29:45.959345 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 979/2041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:45 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 1468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:45.963712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85ef9414-4ac3-48d8-ac36-af6a462fa659 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:46.051324 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85ef9414-4ac3-48d8-ac36-af6a462fa659 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/11d64fd6-55c2-4959-af21-5a5dca849c9e" status: 204 len: 0 microversion: 2.1 time: 0.091010 Nov 02 21:29:46.054495 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 980/2042] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:29:45 2022] DELETE /compute/v2.1/os-server-groups/11d64fd6-55c2-4959-af21-5a5dca849c9e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:46.058870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2040929505", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "67c3f76f-7a17-4f1f-a61d-9ec78598dc27"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:46.131962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] validate_networks() for [('67c3f76f-7a17-4f1f-a61d-9ec78598dc27', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:29:46.720039 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d02b5ef6-b3f9-47db-b21f-9e5c4ff75143 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "DELETE /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 204 len: 0 microversion: 2.1 time: 1.215533 Nov 02 21:29:46.723995 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1063/2043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:45 2022] DELETE /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 0 bytes in 1217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:46.729251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:46.729251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:46.734173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:46.735112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:46.735794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:46.736536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:46.737422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:46.738355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:46.841184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:29:46.841853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:29:46.842394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:29:46.843673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:29:46.844090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:29:46.854003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:46.854833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:46.855560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:46.856371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:46.856894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:46.857420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:46.879079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:46.885752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for user 1cb7808dc9e54e86811e0b7ad1cec847 and project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:46.901569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:29:46.903844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:29:46.943718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:46.955821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:46.958044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:46.960066 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0a514c4-90b5-4728-b3dd-6079a2b15c0d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1486 microversion: 2.25 time: 0.237831 Nov 02 21:29:46.960709 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1064/2044] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:46 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:46.966398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-07468566-7353-4006-8dc7-3fd8f92cc3d9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6875aee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:47.100830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a0ec714-a847-4cb0-80bc-94e4a513569a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042556 Nov 02 21:29:47.101577 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 981/2045] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:29:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:29:47.110167 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-07468566-7353-4006-8dc7-3fd8f92cc3d9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?changes-since=2022-11-02T21%3A27%3A43Z" status: 200 len: 1902 microversion: 2.1 time: 0.147234 Nov 02 21:29:47.112456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1eaf418-1654-4e9f-b82d-5b85e8e09471 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:47.115395 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1065/2046] 10.222.0.25 () {58 vars in 1199 bytes} [Wed Nov 2 21:29:46 2022] GET /compute/v2.1/images?changes-since=2022-11-02T21%3A27%3A43Z => generated 1902 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:47.123198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1b9e9f12-e526-43fd-9315-4a206290ca85 req-e68d43be-0501-485d-b2c2-5f97cfa2fc41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7846a733-f1ef-4257-9bb0-7de4347b3dbe", "name": "network-vif-plugged", "status": "completed", "tag": "a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59"}, {"server_uuid": "fe6914ac-9e4d-461b-bc1d-eac050f58374", "name": "network-vif-plugged", "status": "completed", "tag": "e978550d-f6af-44d1-96d5-b560c099450f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:47.141174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1b9e9f12-e526-43fd-9315-4a206290ca85 req-e68d43be-0501-485d-b2c2-5f97cfa2fc41 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:47.141777 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1eaf418-1654-4e9f-b82d-5b85e8e09471 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033785 Nov 02 21:29:47.142189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1b9e9f12-e526-43fd-9315-4a206290ca85 req-e68d43be-0501-485d-b2c2-5f97cfa2fc41 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:47.143622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1b9e9f12-e526-43fd-9315-4a206290ca85 req-e68d43be-0501-485d-b2c2-5f97cfa2fc41 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:47.154643 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 982/2047] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:29:47 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:47.160283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:47.161313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:47.165560 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1b9e9f12-e526-43fd-9315-4a206290ca85 req-e68d43be-0501-485d-b2c2-5f97cfa2fc41 service nova] Creating event network-vif-plugged:a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59 for instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe on n-h2-860863-4 Nov 02 21:29:47.166243 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1b9e9f12-e526-43fd-9315-4a206290ca85 req-e68d43be-0501-485d-b2c2-5f97cfa2fc41 service nova] Creating event network-vif-plugged:e978550d-f6af-44d1-96d5-b560c099450f for instance fe6914ac-9e4d-461b-bc1d-eac050f58374 on n-h1-860863-4 Nov 02 21:29:47.180200 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1b9e9f12-e526-43fd-9315-4a206290ca85 req-e68d43be-0501-485d-b2c2-5f97cfa2fc41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063090 Nov 02 21:29:47.181049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:47.181538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:47.182836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:47.185221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:47.185851 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1066/2048] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:47.195690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-265ad981-86df-41c9-a351-f169d74b17f4 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6882f940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:47.201125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:47.203125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:47.236244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-265ad981-86df-41c9-a351-f169d74b17f4 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] HTTP exception thrown: Image not found. Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-265ad981-86df-41c9-a351-f169d74b17f4 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Request method failure captured: Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 HTTP/1.1 Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuEYMX_-5Qy9oaJuEP5QuwHdkiuLuIbYN9uEI_OW8qWWv-7LnSkLVwjdLp55F1wSHu0MXoWiXYMc_of6wvhOsGsl0NumL7_dtGe4Y6-pDH-UQc_MCa6jlujT1yFQPORhg_cd7Hp3QDmB8mPtg-yVq-DLAlwS44QsoBbpukTKM5dF8rE Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 255043a6d5ca4541bb9d597a70075391 Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:29:47.240423 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_255043a6d5ca4541bb9d597a70075391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 255043a6d5ca4541bb9d597a70075391 Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerTestJSON-1891881214-project Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: d5e45337c25e4cd7b72cf2f6b2b2277a Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerTestJSON-1891881214-project Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '181b446e-381b-45c9-bff4-08078c9e04b2'} Nov 02 21:29:47.247187 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:29:47.248613 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 181b446e-381b-45c9-bff4-08078c9e04b2 Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:29:47.250272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 181b446e-381b-45c9-bff4-08078c9e04b2 could not be found. Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:29:47.252234 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-265ad981-86df-41c9-a351-f169d74b17f4 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:29:47.254550 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-265ad981-86df-41c9-a351-f169d74b17f4 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 404 len: 62 microversion: 2.1 time: 0.055255 Nov 02 21:29:47.256572 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1067/2049] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:47 2022] GET /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:29:47.263429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a17d7a56-f14e-458b-b46a-9eb23e4b7eb3 req-19f04181-4958-4ee3-9292-ce7ddfafeb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5e4b93-d4db-4859-a8ac-e0536deae4bd", "name": "network-vif-unplugged", "status": "completed", "tag": "365a8627-274c-4996-98fc-e94e1e7c8ff3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:47.278490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a17d7a56-f14e-458b-b46a-9eb23e4b7eb3 req-19f04181-4958-4ee3-9292-ce7ddfafeb93 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:47.280587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a17d7a56-f14e-458b-b46a-9eb23e4b7eb3 req-19f04181-4958-4ee3-9292-ce7ddfafeb93 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:47.281116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a17d7a56-f14e-458b-b46a-9eb23e4b7eb3 req-19f04181-4958-4ee3-9292-ce7ddfafeb93 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:47.305018 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a17d7a56-f14e-458b-b46a-9eb23e4b7eb3 req-19f04181-4958-4ee3-9292-ce7ddfafeb93 service nova] Creating event network-vif-unplugged:365a8627-274c-4996-98fc-e94e1e7c8ff3 for instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd on n-h1-860863-4 Nov 02 21:29:47.310371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a17d7a56-f14e-458b-b46a-9eb23e4b7eb3 req-19f04181-4958-4ee3-9292-ce7ddfafeb93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065369 Nov 02 21:29:47.311331 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1068/2050] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:47.317395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5172688b-1355-4872-9790-36351d9be5e3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:47.318710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5172688b-1355-4872-9790-36351d9be5e3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:47.439427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5172688b-1355-4872-9790-36351d9be5e3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:47.448697 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5172688b-1355-4872-9790-36351d9be5e3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1215 microversion: 2.1 time: 0.135488 Nov 02 21:29:47.449639 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1069/2051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:47 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:47.455744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0127f58c-76f8-4b1b-ab6c-48bc080e7600 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68748790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:47.525983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:47.540522 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-291ace9a-6e92-49d8-84e1-67a650623ae9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.387889 Nov 02 21:29:47.541381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 983/2052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:47 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:47.546997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-456d2253-f875-4fed-89f2-7be459505cf7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Action: 'create', calling method: .version_select at 0x7f9b68791b80>, body: {"server_group": {"name": "tempest-server-group-292270830", "policies": ["affinity"]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:47.555390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0127f58c-76f8-4b1b-ab6c-48bc080e7600 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1941835252" status: 200 len: 485 microversion: 2.1 time: 0.104163 Nov 02 21:29:47.556426 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1070/2053] 10.222.0.25 () {58 vars in 1231 bytes} [Wed Nov 2 21:29:47 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1941835252 => generated 485 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:47.562128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-738319869"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:47.564595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:47.573082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:47.573620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:47.575049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:47.576282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:47.577477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:47.578412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:47.579321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-456d2253-f875-4fed-89f2-7be459505cf7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:47.587563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-456d2253-f875-4fed-89f2-7be459505cf7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:47.698150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:47.707902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-456d2253-f875-4fed-89f2-7be459505cf7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:47.719420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-456d2253-f875-4fed-89f2-7be459505cf7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:47.751114 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-456d2253-f875-4fed-89f2-7be459505cf7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.200775 Nov 02 21:29:47.751114 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 984/2054] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 21:29:47 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:47.752263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0a295e3-88f7-4671-a3f0-0bf33c44c63d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6878e550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.067189 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a0a295e3-88f7-4671-a3f0-0bf33c44c63d tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?server=6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 957 microversion: 2.1 time: 0.321814 Nov 02 21:29:48.068988 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 985/2055] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 21:29:47 2022] GET /compute/v2.1/images?server=6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 957 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:48.073771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c88c166-1f87-4817-91f8-d9d1a7e05401 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.199591 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98078145-ad7e-465f-9f01-23826e093590 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "POST /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374/action" status: 202 len: 0 microversion: 2.1 time: 0.639662 Nov 02 21:29:48.202276 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1071/2056] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:29:47 2022] POST /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 21:29:48.215006 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c88c166-1f87-4817-91f8-d9d1a7e05401 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/41bfe890-185a-41ef-a8c7-891c17fcf33b" status: 204 len: 0 microversion: 2.1 time: 0.144997 Nov 02 21:29:48.217892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.218061 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 986/2057] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:29:48 2022] DELETE /compute/v2.1/os-server-groups/41bfe890-185a-41ef-a8c7-891c17fcf33b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:48.219434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:48.225728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-146690b9-0c39-4529-81ee-b94c22cc8ac3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687918b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.241949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:48.245705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:48.246401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:48.246854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:48.248780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:48.249302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:48.250454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:48.307321 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-146690b9-0c39-4529-81ee-b94c22cc8ac3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 484 microversion: 2.1 time: 0.087537 Nov 02 21:29:48.308258 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 987/2058] 10.222.0.25 () {58 vars in 1317 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb => generated 484 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:48.315543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-209d4d0c-9df4-4fe5-bff7-8898caad2956 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b687ca550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.372963 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-209d4d0c-9df4-4fe5-bff7-8898caad2956 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.063095 Nov 02 21:29:48.373805 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 988/2059] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:48.379376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-082b0e0c-0507-4e60-8023-3188c9e1cac5 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.391600 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-082b0e0c-0507-4e60-8023-3188c9e1cac5 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016500 Nov 02 21:29:48.392438 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 989/2060] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:48.398346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1f405af-a71f-4a31-8277-91122094c585 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6874d4c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.514948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1f405af-a71f-4a31-8277-91122094c585 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 484 microversion: 2.1 time: 0.121126 Nov 02 21:29:48.515546 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 990/2061] 10.222.0.25 () {58 vars in 1303 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:48.551220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:48.558344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b41cea9a-efc1-404f-95ab-54bda9fc35a1 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Action: 'create', calling method: .version_select at 0x7f9b6874d670>, body: {"server_group": {"name": "tempest-server-group-1482924095", "policies": ["anti-affinity"]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:48.563987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:48.566294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:48.577942 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-412828df-6ac4-4174-aaca-9256394d62f2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1486 microversion: 2.25 time: 0.372045 Nov 02 21:29:48.579464 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1072/2062] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1486 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:48.585394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.586637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:48.606122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:48.606769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:48.608188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:48.609359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:48.609924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:48.610590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:48.621790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b41cea9a-efc1-404f-95ab-54bda9fc35a1 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:48.628133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b41cea9a-efc1-404f-95ab-54bda9fc35a1 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:48.691302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:48.700954 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0d84c4f-9ece-487a-9c75-128772aa9312 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1219 microversion: 2.1 time: 0.120190 Nov 02 21:29:48.701748 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1073/2063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:48.705928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd5655bb-2784-4d83-ae76-4708aa1f0aa9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6874e700>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.763304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b41cea9a-efc1-404f-95ab-54bda9fc35a1 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:48.769009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b41cea9a-efc1-404f-95ab-54bda9fc35a1 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_groups'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:48.785325 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b41cea9a-efc1-404f-95ab-54bda9fc35a1 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.266984 Nov 02 21:29:48.792893 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 991/2064] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 21:29:48 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:48.807569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.808210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:48.818385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:48.819309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:48.819754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:48.820969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:48.821921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:48.822374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:48.848765 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd5655bb-2784-4d83-ae76-4708aa1f0aa9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.146065 Nov 02 21:29:48.862420 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1074/2065] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:48.868502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83570dcc-6a23-41d9-9f87-362ac67012c7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:48.994835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:49.003833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-80c86cf3-be9e-468f-8aa9-bf4e62e5a2ec tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1317 microversion: 2.1 time: 0.215941 Nov 02 21:29:49.004548 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 992/2066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:48 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:49.010054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a28c247-b33b-4a0e-9e4e-07f697ac431e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68762c10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.024601 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83570dcc-6a23-41d9-9f87-362ac67012c7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ebba3001-4178-44e1-acf7-95c9faa8b4d0" status: 204 len: 0 microversion: 2.1 time: 0.160718 Nov 02 21:29:49.025460 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1075/2067] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:29:48 2022] DELETE /compute/v2.1/os-server-groups/ebba3001-4178-44e1-acf7-95c9faa8b4d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:49.040493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb7ff7c6-c4e4-4d30-8c6b-9b56c0fe5955 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.057289 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb7ff7c6-c4e4-4d30-8c6b-9b56c0fe5955 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.021809 Nov 02 21:29:49.057856 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1076/2068] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:29:49.095416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a28c247-b33b-4a0e-9e4e-07f697ac431e tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.088889 Nov 02 21:29:49.096016 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 993/2069] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:49.120777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14531eda-5771-4367-8034-b14793933d33 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6882faf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.122828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1710959188", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "3bc24a8a-02ed-47e4-b622-9227de039c70"}]}, "os:scheduler_hints": {"group": "1201da8f-cb4e-4628-b2e8-883808919411"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:49.219697 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14531eda-5771-4367-8034-b14793933d33 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.102611 Nov 02 21:29:49.221018 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1077/2070] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:49.226085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] validate_networks() for [('3bc24a8a-02ed-47e4-b622-9227de039c70', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:29:49.232018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f6900e79-3222-4aab-bdba-acd8854a5c51 req-29683dbd-3d71-4296-838d-e3c9927feb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6914ac-9e4d-461b-bc1d-eac050f58374", "name": "network-vif-unplugged", "status": "completed", "tag": "e978550d-f6af-44d1-96d5-b560c099450f"}, {"server_uuid": "6ed1b872-ec5d-49a1-8377-e5ae331eb050", "name": "network-vif-unplugged", "status": "completed", "tag": "be8e2db3-3686-4477-9908-a126ccc17a17"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:49.237096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f6900e79-3222-4aab-bdba-acd8854a5c51 req-29683dbd-3d71-4296-838d-e3c9927feb79 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:49.237774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f6900e79-3222-4aab-bdba-acd8854a5c51 req-29683dbd-3d71-4296-838d-e3c9927feb79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:49.238190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f6900e79-3222-4aab-bdba-acd8854a5c51 req-29683dbd-3d71-4296-838d-e3c9927feb79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:49.253933 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f6900e79-3222-4aab-bdba-acd8854a5c51 req-29683dbd-3d71-4296-838d-e3c9927feb79 service nova] Creating event network-vif-unplugged:e978550d-f6af-44d1-96d5-b560c099450f for instance fe6914ac-9e4d-461b-bc1d-eac050f58374 on n-h1-860863-4 Nov 02 21:29:49.254926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f6900e79-3222-4aab-bdba-acd8854a5c51 req-29683dbd-3d71-4296-838d-e3c9927feb79 service nova] Creating event network-vif-unplugged:be8e2db3-3686-4477-9908-a126ccc17a17 for instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 on n-h2-860863-4 Nov 02 21:29:49.263800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f6900e79-3222-4aab-bdba-acd8854a5c51 req-29683dbd-3d71-4296-838d-e3c9927feb79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.041465 Nov 02 21:29:49.264664 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1078/2071] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:49.273463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ebc521e-24cc-4247-acc6-9ee9012a9f80 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6874e160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.386269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ebc521e-24cc-4247-acc6-9ee9012a9f80 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/detail?changes-since=2022-11-02T21%3A27%3A38Z" status: 200 len: 6334 microversion: 2.1 time: 0.116997 Nov 02 21:29:49.386858 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1079/2072] 10.222.0.25 () {58 vars in 1220 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-02T21%3A27%3A38Z => generated 6334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:49.391733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9750b32c-f9ba-4e4c-b6e8-d614404664f7 req-b25f2172-037e-4568-9ed7-10d6300c9a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb5e4b93-d4db-4859-a8ac-e0536deae4bd", "tag": "365a8627-274c-4996-98fc-e94e1e7c8ff3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:49.411063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9750b32c-f9ba-4e4c-b6e8-d614404664f7 req-b25f2172-037e-4568-9ed7-10d6300c9a87 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:49.411926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9750b32c-f9ba-4e4c-b6e8-d614404664f7 req-b25f2172-037e-4568-9ed7-10d6300c9a87 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:49.412694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9750b32c-f9ba-4e4c-b6e8-d614404664f7 req-b25f2172-037e-4568-9ed7-10d6300c9a87 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:49.424173 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9750b32c-f9ba-4e4c-b6e8-d614404664f7 req-b25f2172-037e-4568-9ed7-10d6300c9a87 service nova] Creating event network-changed:365a8627-274c-4996-98fc-e94e1e7c8ff3 for instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd on n-h1-860863-4 Nov 02 21:29:49.430487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9750b32c-f9ba-4e4c-b6e8-d614404664f7 req-b25f2172-037e-4568-9ed7-10d6300c9a87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042164 Nov 02 21:29:49.431967 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1080/2073] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:49.438524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d4c4493-e45a-4fd5-84f6-7c379c7426b7 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6d152940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.497772 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d4c4493-e45a-4fd5-84f6-7c379c7426b7 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.063599 Nov 02 21:29:49.498396 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1081/2074] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:49.503484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b9258c6-3a70-4efe-8cbb-9ee7f69a3c61 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6882fe50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.561972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b9258c6-3a70-4efe-8cbb-9ee7f69a3c61 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1941835252" status: 200 len: 665 microversion: 2.1 time: 0.062268 Nov 02 21:29:49.563747 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1082/2075] 10.222.0.25 () {58 vars in 1252 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1941835252 => generated 665 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:49.580508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ec02190-6705-4b4a-abfe-c2b5a6e85ca4 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d153f70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.641087 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ec02190-6705-4b4a-abfe-c2b5a6e85ca4 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1466 microversion: 2.1 time: 0.065273 Nov 02 21:29:49.641739 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1083/2076] 10.222.0.25 () {58 vars in 1338 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fv2.1%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb => generated 1466 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:49.650419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:49.651430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:49.659421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:49.660488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:49.661610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:49.662655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:49.663603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:49.664260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:49.835547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:29:49.837959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:29:49.838557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:29:49.839047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:29:49.839554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:29:49.869066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:49.869610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:49.870063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:49.871484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:49.871988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:49.872579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:49.892894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:49.898727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:49.919008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:29:49.921413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:29:50.000515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:50.023381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:50.030656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:50.033249 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e16b99d8-5f50-406b-8088-f03c8e104356 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1486 microversion: 2.25 time: 0.390093 Nov 02 21:29:50.034703 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1084/2077] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:49 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1486 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:50.041446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9d76f80-8c99-4b6e-8666-2685e9ef757c tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6882faf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.076803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:50.099877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:50.141156 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9d76f80-8c99-4b6e-8666-2685e9ef757c tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1466 microversion: 2.1 time: 0.088786 Nov 02 21:29:50.141156 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1085/2078] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.25%2Fcompute%2Fservers%2Fb86c3828-5255-496f-b756-65a49cfc9cfb => generated 1466 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:50.141156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.141156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:50.148741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:50.149412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:50.150385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:50.153817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:50.154471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:50.154916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:50.226651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:50.235750 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be39a4ea-fce9-4c30-b5d0-f5a093724849 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1267 microversion: 2.1 time: 0.106139 Nov 02 21:29:50.236687 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1086/2079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:50.252625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:50.253574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Getting quotas for user 0cd2ca9919154f28837486376da7d73c and project 8f848b2b2c0641e5802dab6599eca64a. Resources: {'server_group_members'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:50.259518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.260232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:50.266389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:50.266882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:50.267337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:50.268046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:50.268495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:50.268953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:50.281414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf511a66-878b-47ba-bb1a-741c35794fa4 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163190 Nov 02 21:29:50.282318 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 994/2080] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:29:50.287034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e98ccd2-095b-4550-b94b-b7dee442d76a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68762550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.427674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:50.434060 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e98ccd2-095b-4550-b94b-b7dee442d76a tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.150526 Nov 02 21:29:50.434893 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 995/2081] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:50.438582 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6d0d44e-bc2b-4f9f-9ae4-331dd6622fd0 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1467 microversion: 2.1 time: 0.184068 Nov 02 21:29:50.439613 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1087/2082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1467 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:50.442180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48732348-b488-4840-a20a-f41c84a7bafa tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.443072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48732348-b488-4840-a20a-f41c84a7bafa tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:50.459160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98f962c8-1e36-4301-9373-b3a21a9315b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d152f70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.552839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48732348-b488-4840-a20a-f41c84a7bafa tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:50.561496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48732348-b488-4840-a20a-f41c84a7bafa tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1213 microversion: 2.1 time: 0.124159 Nov 02 21:29:50.562279 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 996/2083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:50.574093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.586700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:50.586979 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98f962c8-1e36-4301-9373-b3a21a9315b8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.119762 Nov 02 21:29:50.586979 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1088/2084] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:50.586979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05c71360-6d69-491b-b62c-ce3a61e30501 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6882f790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.597900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:50.600887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:50.607252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:50.607252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:50.607252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:50.607252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:50.672263 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05c71360-6d69-491b-b62c-ce3a61e30501 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.094700 Nov 02 21:29:50.675027 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1089/2085] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:50.689576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c140ed9c-7377-4d17-90d8-b57c2c139ba8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6d1529d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.765813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c140ed9c-7377-4d17-90d8-b57c2c139ba8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/612221e9-0156-4770-a8ac-3a978f4e721c" status: 200 len: 784 microversion: 2.1 time: 0.089187 Nov 02 21:29:50.766600 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1090/2086] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/images/612221e9-0156-4770-a8ac-3a978f4e721c => generated 784 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:50.782856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab1edc5b-beed-4eeb-8260-8020ffb905e3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b68744820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.847657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab1edc5b-beed-4eeb-8260-8020ffb905e3 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.068611 Nov 02 21:29:50.848555 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1091/2087] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:29:50.870564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4576473-f28a-4486-b14a-9417d35762b9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6874e670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:50.896790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a52df72f-bfaa-423a-8e20-97dedb2e7da1 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1618 microversion: 2.1 time: 0.329248 Nov 02 21:29:50.896790 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 997/2088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:50 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1618 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:51.065478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:51.066055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:51.074483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:51.080256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:51.080709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:51.085749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:51.086226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:51.086665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:51.363886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:51.375498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:51.378804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:51.381050 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-753e8404-4372-4b78-9cd0-51a0084c0a66 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1486 microversion: 2.25 time: 0.318828 Nov 02 21:29:51.385105 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 998/2089] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:51 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1486 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:29:51.389512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2130143699", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4e28f9f5-f825-43fe-9a55-c3f78710a2d4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:51.421872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:52.295508 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a4576473-f28a-4486-b14a-9417d35762b9 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d" status: 204 len: 0 microversion: 2.1 time: 1.434484 Nov 02 21:29:52.296772 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1092/2090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:50 2022] DELETE /compute/v2.1/images/98a15987-1240-413f-806d-3130ade38a3d => generated 0 bytes in 1437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:29:52.304104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:52.305554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:52.315521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:52.321856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:52.322600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:52.323499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:52.324123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:52.327729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:52.341456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:29:52.676577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:52.748744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46dc5753-a53e-4a18-9ec0-4ea26034e602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1315 microversion: 2.1 time: 0.411933 Nov 02 21:29:52.748744 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1093/2091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:52 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:52.748744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:52.748744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:52.748744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:52.750311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:52.750311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:52.750311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:52.750311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:52.751451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:52.798491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:29:52.799643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:29:52.800193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:29:52.800951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:29:52.803964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:29:52.822675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:52.825823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:52.826315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:52.827711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:52.828158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:52.830413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:52.863370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:29:52.872634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Getting quotas for user 13d73455e6ba4e029cce74544fc1d663 and project de0e0bc22cb946efa6f61db40562cd65. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:29:52.900513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:52.916795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:29:52.920421 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2533db6-3c81-4ac9-a695-ef3154fc1cb8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1265 microversion: 2.1 time: 0.204193 Nov 02 21:29:52.922319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1094/2092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:52 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:52.926510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:29:52.946456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5e4ca8a-89c0-48cd-b0b8-c9e6f109aab6 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6d1531f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:53.003389 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5e4ca8a-89c0-48cd-b0b8-c9e6f109aab6 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.079036 Nov 02 21:29:53.012754 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1095/2093] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:52 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:53.012754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:53.016162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:53.016941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Searching by: {'deleted': False, 'project_id': '78183deb86b94bc9ae6519ca914a917d'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:29:53.026613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:53.027104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:53.027567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:53.028361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:53.029006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:53.029493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:53.059764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:29:53.092513 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-524a37ef-98eb-431b-bf9c-df31f8efda2e tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.086420 Nov 02 21:29:53.093402 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1096/2094] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:29:53 2022] GET /compute/v2.1/servers => generated 334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:53.098555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-667216cc-96cd-4a07-a765-367b938a89bc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6879aaf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:53.738798 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-79ad6612-767a-40dc-bc4a-495e6ccad6b5 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.356076 Nov 02 21:29:53.741777 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 999/2095] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:29:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:29:53.761564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:53.763178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:53.799466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:53.799466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:53.799466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:53.804506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:53.807176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:53.807695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:54.411150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:54.422369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:54.423825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:54.425044 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b789362a-7fca-4a03-8460-0e4236ae3793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1486 microversion: 2.25 time: 0.681548 Nov 02 21:29:54.426095 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1000/2096] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:53 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1486 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:54.431294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f7488644-9788-4202-90a5-f8c0c4ba6dfd req-38571528-74ec-4415-9fb5-08c5819065f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6914ac-9e4d-461b-bc1d-eac050f58374", "name": "network-vif-plugged", "status": "completed", "tag": "e978550d-f6af-44d1-96d5-b560c099450f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:54.443635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f7488644-9788-4202-90a5-f8c0c4ba6dfd req-38571528-74ec-4415-9fb5-08c5819065f4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:54.444283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f7488644-9788-4202-90a5-f8c0c4ba6dfd req-38571528-74ec-4415-9fb5-08c5819065f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:54.444782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f7488644-9788-4202-90a5-f8c0c4ba6dfd req-38571528-74ec-4415-9fb5-08c5819065f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:54.456906 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f7488644-9788-4202-90a5-f8c0c4ba6dfd req-38571528-74ec-4415-9fb5-08c5819065f4 service nova] Creating event network-vif-plugged:e978550d-f6af-44d1-96d5-b560c099450f for instance fe6914ac-9e4d-461b-bc1d-eac050f58374 on n-h1-860863-4 Nov 02 21:29:54.463817 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f7488644-9788-4202-90a5-f8c0c4ba6dfd req-38571528-74ec-4415-9fb5-08c5819065f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035813 Nov 02 21:29:54.464756 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1001/2097] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:54.471735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:54.479336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:54.480986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Searching by: {'deleted': False, 'project_id': '78183deb86b94bc9ae6519ca914a917d'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:29:54.492136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:54.492136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:54.492136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:54.492136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:54.492571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:54.492571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:54.559041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:29:54.635720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:54.645429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:54.647200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:54.647701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:54.793408 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f803d58-6c6c-4a9b-af03-b958de42a78a tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.327164 Nov 02 21:29:54.795440 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1002/2098] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:29:54 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:54.805653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:54.807046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:54.823609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:54.824785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:54.826182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:54.827329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:54.828361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:54.829026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:55.063151 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-667216cc-96cd-4a07-a765-367b938a89bc tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9" status: 204 len: 0 microversion: 2.1 time: 1.967357 Nov 02 21:29:55.063151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1097/2099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:53 2022] DELETE /compute/v2.1/images/ca44f623-7b83-4344-ba51-286d44afc2a9 => generated 0 bytes in 1969 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:55.069005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:55.069833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:55.077633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:55.078368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:55.079275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:55.080295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:55.080754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:55.081236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:55.091323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:55.200955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:55.207967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:55.216225 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f340286e-c719-46e4-b7b7-cab04eae9fed tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1315 microversion: 2.1 time: 0.420748 Nov 02 21:29:55.229322 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1003/2100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:54 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:55.236701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:55.237518 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17e004b7-a9c2-4073-b7e2-b94efeb92acf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1221 microversion: 2.1 time: 0.173395 Nov 02 21:29:55.237711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:55.242570 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1098/2101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:55 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:55.260997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:55.260997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:55.260997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:55.260997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:55.261432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:55.261432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:55.265079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e8a2f02-6365-41cb-989f-1bb49153c634 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b687e8d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:55.370684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:55.408232 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-07288ced-c9ba-4922-ae62-f447c9477575 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1283 microversion: 2.1 time: 0.177643 Nov 02 21:29:55.413854 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1004/2102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:55 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:55.434347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-36f0d2b1-0346-497d-a608-67a3e7ac221d req-e2a2780d-1951-4590-a37f-849b36b53b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e208b785-f6ec-4e99-9692-130e9c74a740", "tag": "d7965ac2-508e-4056-b5e9-8d693844259f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:29:55.460327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-36f0d2b1-0346-497d-a608-67a3e7ac221d req-e2a2780d-1951-4590-a37f-849b36b53b8c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:55.461256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-36f0d2b1-0346-497d-a608-67a3e7ac221d req-e2a2780d-1951-4590-a37f-849b36b53b8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:55.462020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-36f0d2b1-0346-497d-a608-67a3e7ac221d req-e2a2780d-1951-4590-a37f-849b36b53b8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:55.479808 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-36f0d2b1-0346-497d-a608-67a3e7ac221d req-e2a2780d-1951-4590-a37f-849b36b53b8c service nova] Creating event network-changed:d7965ac2-508e-4056-b5e9-8d693844259f for instance e208b785-f6ec-4e99-9692-130e9c74a740 on n-h1-860863-4 Nov 02 21:29:55.485127 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-36f0d2b1-0346-497d-a608-67a3e7ac221d req-e2a2780d-1951-4590-a37f-849b36b53b8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062561 Nov 02 21:29:55.486056 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1005/2103] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:55.492638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fad27c9a-de4b-4a84-84f5-048109f2a824 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:55.502634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fad27c9a-de4b-4a84-84f5-048109f2a824 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014956 Nov 02 21:29:55.517203 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1006/2104] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:29:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:29:55.517203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4852a4a-b1a7-485b-873f-0280823819ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6878ac10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:57.139248 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b4852a4a-b1a7-485b-873f-0280823819ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e" status: 204 len: 0 microversion: 2.1 time: 1.634742 Nov 02 21:29:57.142708 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1007/2105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:55 2022] DELETE /compute/v2.1/images/7fff86eb-e2ce-4be4-884f-edf4c3f5220e => generated 0 bytes in 1636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:57.146165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:57.149279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:57.171188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.173251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.177294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:57.180288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.180288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.180288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:57.185184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e8a2f02-6365-41cb-989f-1bb49153c634 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 1.940530 Nov 02 21:29:57.187186 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1099/2106] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:55 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:57.192989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:57.193772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:57.212706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.213833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.215810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:57.217336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.218010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.220409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:57.295044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:29:57.454091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=20 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:57.746613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:57.753918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4f48503-8b52-4348-8c4e-501596c7a368 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 204 len: 0 microversion: 2.1 time: 0.564895 Nov 02 21:29:57.755122 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1100/2107] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:29:57 2022] DELETE /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:57.755481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:57.763536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:57.766970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:57.767282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:57.768207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91dc3762-8d6c-4691-aed3-2595095db4b6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1476 microversion: 2.25 time: 0.626960 Nov 02 21:29:57.769171 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1008/2108] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:57 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1476 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:57.779419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.780074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:57.780697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:57.781193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.783293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:57.789780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.801304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.803059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:57.810025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.810521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.811373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:57.815265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:57.815814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:57.819843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:58.111138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:58.122971 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8d4e778-6642-4bc0-8420-c7c801a660c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1269 microversion: 2.1 time: 0.352696 Nov 02 21:29:58.149598 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1009/2109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:57 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1269 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:58.154200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:58.154823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:58.187182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:58.188246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:58.189478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:58.193548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:58.194460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:58.196212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:58.426580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:58.460967 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26619604-ba04-41af-8240-9904d785cd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1315 microversion: 2.1 time: 0.703613 Nov 02 21:29:58.465037 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1101/2110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:57 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:58.479568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:58.481877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:58.490752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:58.491555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:58.492177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:58.493137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:58.493789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:58.494772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:58.572795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:29:58.604650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:58.614756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:29:58.626556 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b6ec457f-156e-43f7-9909-64fd2b258188 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1313 microversion: 2.1 time: 0.478105 Nov 02 21:29:58.627443 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1010/2111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:58 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:58.645228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:58.647158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:58.672920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:58.674940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:58.675785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:58.680558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:58.681698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:58.682656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:59.054855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:29:59.068436 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15a23581-e8b5-4d66-8aaf-4641b883eaee tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1702 microversion: 2.1 time: 0.439576 Nov 02 21:29:59.077098 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1011/2112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:29:58 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1702 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:29:59.082557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d3a85c6-f5ab-4ea0-ad5a-a937aff66ffb tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '.version_select at 0x7f9b687c9820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:59.088281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d3a85c6-f5ab-4ea0-ad5a-a937aff66ffb tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:59.105889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d3a85c6-f5ab-4ea0-ad5a-a937aff66ffb tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:59.105889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d3a85c6-f5ab-4ea0-ad5a-a937aff66ffb tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:59.115604 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d3a85c6-f5ab-4ea0-ad5a-a937aff66ffb tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 3200 microversion: 2.25 time: 0.036832 Nov 02 21:29:59.121821 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1012/2113] 10.222.0.25 () {60 vars in 1184 bytes} [Wed Nov 2 21:29:59 2022] GET /compute/v2.1/os-migrations => generated 3200 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:29:59.126992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fac9708b-4cc9-4dcd-a7e9-d727797ddca9 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b687043a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:59.240273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33bc31ee-a234-4a87-b122-a8a93fbabe64 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 204 len: 0 microversion: 2.1 time: 0.772243 Nov 02 21:29:59.241589 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1102/2114] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:29:58 2022] DELETE /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 0 bytes in 776 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:29:59.260265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:29:59.264793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:29:59.296385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:59.300038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:59.300038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:29:59.303165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:29:59.305083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:29:59.305911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:00.211121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] Lazy-loading 'services' on Instance uuid bb5e4b93-d4db-4859-a8ac-e0536deae4bd {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:00.246596 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52b88b81-0047-4b99-aeed-f021c5c9c2bf tempest-LiveAutoBlockMigrationV225Test-443840714 tempest-LiveAutoBlockMigrationV225Test-443840714-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1969 microversion: 2.25 time: 1.001579 Nov 02 21:30:00.247838 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1103/2115] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:29:59 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1969 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:00.257253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:00.263120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:00.277010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:00.278503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:00.279246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:00.281729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:00.282991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:00.284429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:00.423123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:00.436899 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a6494ab-5e0f-4334-a2f1-83917d8045ee tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1275 microversion: 2.1 time: 0.187351 Nov 02 21:30:00.454701 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1104/2116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:00 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:00.466829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:00.467981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:00.479983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:00.483594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:00.483594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:00.483594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:00.483594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:00.483989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:01.188632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:01.216907 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1dd62331-5e4a-44ad-867d-9bf8220f40a8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1474 microversion: 2.1 time: 0.758643 Nov 02 21:30:01.222542 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1105/2117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:00 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1474 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:01.238428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:01.241648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:01.260023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:01.262611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:01.264415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:01.266737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:01.270732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:01.271189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:01.604293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:01.616827 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65ba3e17-6f39-4c6a-91cb-f74d5d3d2408 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1315 microversion: 2.1 time: 0.389387 Nov 02 21:30:01.617445 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1106/2118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:01 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:01.635402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:01.646398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:01.660306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:01.661661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:01.662614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:01.663238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:01.672422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:01.673373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:02.220855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:02.230980 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8306b44c-38e6-4f2b-a068-526082772d6f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1313 microversion: 2.1 time: 0.605642 Nov 02 21:30:02.235009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1107/2119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:01 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:02.240540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:02.244828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:02.263019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:02.267711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:02.267711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:02.267711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:02.267711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:02.268105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:02.440327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:02.453558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b05eaf65-c7b4-4db4-8254-fedf69b8bd48 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1635 microversion: 2.1 time: 0.213005 Nov 02 21:30:02.465139 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1108/2120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:02 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1635 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:02.481066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:02.487931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:02.502798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:02.505825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:02.507836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:02.521174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:02.523255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:02.524421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:02.866854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:03.041943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:03.325267 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe1d2203-39a1-4ede-8e78-5458c98ee285 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 204 len: 0 microversion: 2.25 time: 0.854511 Nov 02 21:30:03.330922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1109/2121] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:30:02 2022] DELETE /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 0 bytes in 875 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:30:03.340881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9ac17647-418e-4a4c-8947-d28168696eec req-7035d1d1-2cdd-403c-88e8-1b2552dadf5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9612702d-827c-497c-b497-873f61a1b5da", "tag": "0f01d0f0-a7a7-4e5c-b791-bd319063ab5f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:03.377604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ac17647-418e-4a4c-8947-d28168696eec req-7035d1d1-2cdd-403c-88e8-1b2552dadf5e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:03.381659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ac17647-418e-4a4c-8947-d28168696eec req-7035d1d1-2cdd-403c-88e8-1b2552dadf5e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:03.383907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ac17647-418e-4a4c-8947-d28168696eec req-7035d1d1-2cdd-403c-88e8-1b2552dadf5e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:03.452262 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9ac17647-418e-4a4c-8947-d28168696eec req-7035d1d1-2cdd-403c-88e8-1b2552dadf5e service nova] Creating event network-changed:0f01d0f0-a7a7-4e5c-b791-bd319063ab5f for instance 9612702d-827c-497c-b497-873f61a1b5da on n-h1-860863-4 Nov 02 21:30:03.463610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9ac17647-418e-4a4c-8947-d28168696eec req-7035d1d1-2cdd-403c-88e8-1b2552dadf5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130585 Nov 02 21:30:03.466438 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1110/2122] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:03.482955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-35985a83-b6b9-4b47-b630-26bab33f222b req-bcf2d139-edb3-4708-b2ef-e490d4c962bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e208b785-f6ec-4e99-9692-130e9c74a740", "name": "network-vif-plugged", "status": "completed", "tag": "d7965ac2-508e-4056-b5e9-8d693844259f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:03.531068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-35985a83-b6b9-4b47-b630-26bab33f222b req-bcf2d139-edb3-4708-b2ef-e490d4c962bf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:03.532309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-35985a83-b6b9-4b47-b630-26bab33f222b req-bcf2d139-edb3-4708-b2ef-e490d4c962bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:03.532975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-35985a83-b6b9-4b47-b630-26bab33f222b req-bcf2d139-edb3-4708-b2ef-e490d4c962bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:03.559653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:03.566116 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-35985a83-b6b9-4b47-b630-26bab33f222b req-bcf2d139-edb3-4708-b2ef-e490d4c962bf service nova] Creating event network-vif-plugged:d7965ac2-508e-4056-b5e9-8d693844259f for instance e208b785-f6ec-4e99-9692-130e9c74a740 on n-h1-860863-4 Nov 02 21:30:03.574788 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-35985a83-b6b9-4b47-b630-26bab33f222b req-bcf2d139-edb3-4708-b2ef-e490d4c962bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103713 Nov 02 21:30:03.579773 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1111/2123] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:03.593719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:03.594732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:03.610989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:03.620244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:03.621018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:03.621801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:03.622278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:03.623671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.001478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:04.023347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14fc4d21-9d42-4c02-abb4-df6533559ef6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1317 microversion: 2.1 time: 0.437610 Nov 02 21:30:04.024132 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1112/2124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:03 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:04.040252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:04.041987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:04.066191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:04.067020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:04.068183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.072815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:04.078206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:04.078206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.155911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:04.158787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:04.159335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.161675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lazy-loading 'fault' on Instance uuid b86c3828-5255-496f-b756-65a49cfc9cfb {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:04.349374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:04.349374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-280b83af-518d-4451-b32c-92b4b8f5a373 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 200 len: 1308 microversion: 2.1 time: 0.262937 Nov 02 21:30:04.349374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1113/2125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:04 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:04.349374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:04.353405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:04.353405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:04.353405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:04.353405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.354649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:04.354649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:04.354649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.505716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:04.619214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:04.641891 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d09d151e-075d-472d-9c10-ac5fb1dd95a8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1315 microversion: 2.1 time: 0.336639 Nov 02 21:30:04.641891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1114/2126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:04 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:04.642193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=62 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:04.642321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:04.642321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:04.642321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:04.642321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:04.642733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.642733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:04.642733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:04.642733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:04.929839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:04.945744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-21ff073f-fa5f-412e-8939-2e75ad3570c3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1313 microversion: 2.1 time: 0.316301 Nov 02 21:30:04.963319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1115/2127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:04 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:04.974136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:04.983355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:05.014486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:05.015716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:05.016387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:05.017680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:05.018457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:05.019082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:05.828759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:05.840167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:05.841702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:05.842893 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c229549-9a30-41ae-a222-8a019c93b0db tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1482 microversion: 2.25 time: 0.875265 Nov 02 21:30:05.843452 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1116/2128] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:04 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1482 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:05.873946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3605d373-f52b-4030-bdf4-41856bbb4d48 req-9728b229-45f9-4005-bc32-820400180734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28ddcf2-a014-4745-93ff-66fe0528efe4", "name": "network-vif-deleted", "tag": "8a35a194-cd0c-493e-9661-56c1a33f5eb7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:05.945357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3605d373-f52b-4030-bdf4-41856bbb4d48 req-9728b229-45f9-4005-bc32-820400180734 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:05.948541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3605d373-f52b-4030-bdf4-41856bbb4d48 req-9728b229-45f9-4005-bc32-820400180734 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:05.949286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3605d373-f52b-4030-bdf4-41856bbb4d48 req-9728b229-45f9-4005-bc32-820400180734 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:05.950981 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fac9708b-4cc9-4dcd-a7e9-d727797ddca9 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 6.827378 Nov 02 21:30:05.957250 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1013/2129] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:29:59 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 6829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:05.961440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:05.965196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:05.988966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:05.998072 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3605d373-f52b-4030-bdf4-41856bbb4d48 req-9728b229-45f9-4005-bc32-820400180734 service nova] Creating event network-vif-deleted:8a35a194-cd0c-493e-9661-56c1a33f5eb7 for instance c28ddcf2-a014-4745-93ff-66fe0528efe4 on n-h1-860863-4 Nov 02 21:30:06.010420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.013142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.013986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.014480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.014926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.015205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3605d373-f52b-4030-bdf4-41856bbb4d48 req-9728b229-45f9-4005-bc32-820400180734 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167546 Nov 02 21:30:06.016190 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1117/2130] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:06.028266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:06.031405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:06.047400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.048416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.049359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.060037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.060037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.060037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.088612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.089436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.090050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.090686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lazy-loading 'fault' on Instance uuid c28ddcf2-a014-4745-93ff-66fe0528efe4 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:06.197756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18d754669364e9f92a6563aa5f4fd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78183deb86b94bc9ae6519ca914a917d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:06.208226 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b97f37a-275b-4f58-958f-c3340935864c tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 200 len: 1360 microversion: 2.1 time: 0.254420 Nov 02 21:30:06.209306 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1014/2131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:05 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 1360 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:06.243531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:06.244634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: b86c3828-5255-496f-b756-65a49cfc9cfb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:06.259206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.260310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.261360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.262415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.263207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.263974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.296150 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] HTTP exception thrown: Instance b86c3828-5255-496f-b756-65a49cfc9cfb could not be found. Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Request method failure captured: Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb HTTP/1.1 Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDJ0ifV626Sn2zdEVKol273_nRDDCAwzikoXNSPxaejmgvcFtELj34liVPp0e905zXzIDYCv20vWdf-xr4peBbrMF3l4vDPMFLX7fo-wpBFHd6W3c4HoOGXtoTM00S-B1MiBvR6OfRZFnfwAv4Xe32Uit0T0L8C79zccUnCQPCucOk Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 82b9d02c247b40dc88ed230398b0613e Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListImageFiltersTestJSON-2118504294 Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:06.297867 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListImageFiltersTestJSON-2118504294 Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 82b9d02c247b40dc88ed230398b0613e Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2118504294 Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListImageFiltersTestJSON-2118504294-project Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1f3b6eb3bdd54df39a977d90228914ac Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListImageFiltersTestJSON-2118504294-project Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b86c3828-5255-496f-b756-65a49cfc9cfb could not be found. Nov 02 21:30:06.299562 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b86c3828-5255-496f-b756-65a49cfc9cfb'} Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86c3828-5255-496f-b756-65a49cfc9cfb could not be found. Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:06.302869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86c3828-5255-496f-b756-65a49cfc9cfb could not be found. Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86c3828-5255-496f-b756-65a49cfc9cfb could not be found. Nov 02 21:30:06.313121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:06.314572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Returning 404 to user: Instance b86c3828-5255-496f-b756-65a49cfc9cfb could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:06.314572 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-998806d5-f82b-462a-904c-f64eb7915463 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb" status: 404 len: 111 microversion: 2.1 time: 0.060448 Nov 02 21:30:06.314572 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1015/2132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:06 2022] GET /compute/v2.1/servers/b86c3828-5255-496f-b756-65a49cfc9cfb => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:06.352032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:06.357202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:06.398940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:06.399770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.401427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.404203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.406861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.407657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47ed5978-9acf-4975-91e7-9159f83f4829 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1317 microversion: 2.1 time: 0.390231 Nov 02 21:30:06.409837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.410622 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1118/2133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:06 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:06.416676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7df655a8-6445-4cf9-8afc-9519c36e0e2b req-0df9df81-721b-4702-acb3-385237df30d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86c3828-5255-496f-b756-65a49cfc9cfb", "name": "network-vif-deleted", "tag": "905eed9b-20b1-4629-a3a7-3a45b44eab21"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:06.429784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.439146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7df655a8-6445-4cf9-8afc-9519c36e0e2b req-0df9df81-721b-4702-acb3-385237df30d5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.439994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7df655a8-6445-4cf9-8afc-9519c36e0e2b req-0df9df81-721b-4702-acb3-385237df30d5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.440627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7df655a8-6445-4cf9-8afc-9519c36e0e2b req-0df9df81-721b-4702-acb3-385237df30d5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.469215 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7df655a8-6445-4cf9-8afc-9519c36e0e2b req-0df9df81-721b-4702-acb3-385237df30d5 service nova] Creating event network-vif-deleted:905eed9b-20b1-4629-a3a7-3a45b44eab21 for instance b86c3828-5255-496f-b756-65a49cfc9cfb on n-h2-860863-4 Nov 02 21:30:06.483440 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7df655a8-6445-4cf9-8afc-9519c36e0e2b req-0df9df81-721b-4702-acb3-385237df30d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070279 Nov 02 21:30:06.487852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1119/2134] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:06.493444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:06.499247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:06.513099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.516658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.516658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.518447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.519684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.521363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.665240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:06.673707 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ecbecb77-bfd7-46fd-a69f-6a47939dfd9f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1500 microversion: 2.1 time: 0.362531 Nov 02 21:30:06.678378 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1016/2135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:06 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1500 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:06.702490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:06.702490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:06.702490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.702908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.711166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.712587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.713521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.714112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.770089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:06.900509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:06.909481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3830137d-c72b-4d65-ac66-d5ca05d35869 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1313 microversion: 2.1 time: 0.420159 Nov 02 21:30:06.914552 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1120/2136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:06 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:06.919714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:06.933834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:06.940265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.941078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.941710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:06.942666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:06.943450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:06.944052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.276129 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c7be621-f084-435c-bb75-c3def952f6e2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740/action" status: 202 len: 0 microversion: 2.1 time: 0.359527 Nov 02 21:30:07.279891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1121/2137] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:30:06 2022] POST /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:30:07.287522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:07.291463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:07.304382 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2ec8410-e8df-40b4-8fbe-7f374ddc7597 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 204 len: 0 microversion: 2.1 time: 0.624280 Nov 02 21:30:07.305760 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1017/2138] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:06 2022] DELETE /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:07.313579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14de1d05-1c48-4b74-9386-3c7a883bc231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b68728dc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:07.316361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.319280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.321280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.322277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.322948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.323589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.408547 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14de1d05-1c48-4b74-9386-3c7a883bc231 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.100336 Nov 02 21:30:07.410602 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1018/2139] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:07 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:07.421841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:07.424284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] [instance: c28ddcf2-a014-4745-93ff-66fe0528efe4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:07.443049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.443830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.445367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.446449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.447146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.447289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:07.448464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.460595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:07.462428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:07.465055 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-522b84de-1231-44e4-a31f-9f27bbbaaeb0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1266 microversion: 2.25 time: 0.183434 Nov 02 21:30:07.467145 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1122/2140] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:07 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:07.467989 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] HTTP exception thrown: Instance c28ddcf2-a014-4745-93ff-66fe0528efe4 could not be found. Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Request method failure captured: Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 HTTP/1.1 Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuD-z08MhLD787JnrqJ-2ForCgsG2YYCsC8tSjXCn5IBSDpgRcU76PCnBHPdR-5G2Q_vMN4xqKpaWHOTCMe5yAQaY9qUluMbrwfNmeLcX8HHL0vuZhZvzZ5Vg9u25kngLkk9vtA-n4GqZNGJv_GJQOgWuA46jEKRI--Hcce9YOq99IY Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 78183deb86b94bc9ae6519ca914a917d Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1190644536 Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:07.471052 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_78183deb86b94bc9ae6519ca914a917d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78183deb86b94bc9ae6519ca914a917d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/78183deb86b94bc9ae6519ca914a917d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/78183deb86b94bc9ae6519ca914a917d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1190644536 Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 78183deb86b94bc9ae6519ca914a917d Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1190644536 Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1190644536-project Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e18d754669364e9f92a6563aa5f4fd42 Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1190644536-project Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance c28ddcf2-a014-4745-93ff-66fe0528efe4 could not be found. Nov 02 21:30:07.472572 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'c28ddcf2-a014-4745-93ff-66fe0528efe4'} Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c28ddcf2-a014-4745-93ff-66fe0528efe4 could not be found. Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:07.474283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c28ddcf2-a014-4745-93ff-66fe0528efe4 could not be found. Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c28ddcf2-a014-4745-93ff-66fe0528efe4 could not be found. Nov 02 21:30:07.475919 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:07.479672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Returning 404 to user: Instance c28ddcf2-a014-4745-93ff-66fe0528efe4 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:07.480752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:07.481493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:07.481819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9c56523-8b1e-49af-9cd7-78032e4a6fd4 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4" status: 404 len: 111 microversion: 2.1 time: 0.068732 Nov 02 21:30:07.482935 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1019/2141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:07 2022] GET /compute/v2.1/servers/c28ddcf2-a014-4745-93ff-66fe0528efe4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:07.487952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:07.488913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:07.494954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.503391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.503391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.503663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.503663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.503663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.503663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.504078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.504181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.504283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.504384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.504384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.736114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:07.747615 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c45df8f4-67f4-4bf8-8e86-618bb0493cfd tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1505 microversion: 2.1 time: 0.278648 Nov 02 21:30:07.750251 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1123/2142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:07 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:07.770771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d9ecac5f-3a2d-4c67-9091-8d44e6f3b640 req-8527cd7c-e03f-4d9a-b450-25deda6fa940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9612702d-827c-497c-b497-873f61a1b5da", "name": "network-vif-plugged", "status": "completed", "tag": "0f01d0f0-a7a7-4e5c-b791-bd319063ab5f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:07.783744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:07.787483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d9ecac5f-3a2d-4c67-9091-8d44e6f3b640 req-8527cd7c-e03f-4d9a-b450-25deda6fa940 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.787897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d9ecac5f-3a2d-4c67-9091-8d44e6f3b640 req-8527cd7c-e03f-4d9a-b450-25deda6fa940 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.788534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d9ecac5f-3a2d-4c67-9091-8d44e6f3b640 req-8527cd7c-e03f-4d9a-b450-25deda6fa940 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.805826 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d9ecac5f-3a2d-4c67-9091-8d44e6f3b640 req-8527cd7c-e03f-4d9a-b450-25deda6fa940 service nova] Creating event network-vif-plugged:0f01d0f0-a7a7-4e5c-b791-bd319063ab5f for instance 9612702d-827c-497c-b497-873f61a1b5da on n-h1-860863-4 Nov 02 21:30:07.811895 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d9ecac5f-3a2d-4c67-9091-8d44e6f3b640 req-8527cd7c-e03f-4d9a-b450-25deda6fa940 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059526 Nov 02 21:30:07.813136 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1124/2143] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:07.820985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:07.821911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:07.828539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.829372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.830133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.831116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:07.831739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:07.832353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:07.835314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:07.843948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a97c11ea-f064-4f66-ada2-abab139eeaa8 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 1474 microversion: 2.1 time: 0.359694 Nov 02 21:30:07.845573 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1020/2144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:07 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 1474 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:07.869041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-26f1edd8-5935-4b6f-911f-f98b387fcbc5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] Calling method '.version_select at 0x7f9b68762310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:07.995962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-26f1edd8-5935-4b6f-911f-f98b387fcbc5 tempest-ServersTestJSON-1190644536 tempest-ServersTestJSON-1190644536-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051592366" status: 202 len: 0 microversion: 2.1 time: 0.149322 Nov 02 21:30:07.996911 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1021/2145] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:30:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051592366 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:30:08.008088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:08.008088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:08.013916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.014691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.015342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.016264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.016959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.017577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.241428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:08.257848 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55ccb029-f15a-49c9-996e-17d9bbeebead tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1317 microversion: 2.1 time: 0.443098 Nov 02 21:30:08.259041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1125/2146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:07 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:08.263502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f698762c-9b50-4532-ac6f-29571aa5ab97 req-ef57a1d5-d7c9-4a89-96d3-fcf3b0287591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ea659d-ac89-4edd-bd93-397b66d29507", "tag": "83428c67-afc3-4387-a7cb-836e9171f7d0"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:08.289188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f698762c-9b50-4532-ac6f-29571aa5ab97 req-ef57a1d5-d7c9-4a89-96d3-fcf3b0287591 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.289861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f698762c-9b50-4532-ac6f-29571aa5ab97 req-ef57a1d5-d7c9-4a89-96d3-fcf3b0287591 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.290472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f698762c-9b50-4532-ac6f-29571aa5ab97 req-ef57a1d5-d7c9-4a89-96d3-fcf3b0287591 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.318980 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f698762c-9b50-4532-ac6f-29571aa5ab97 req-ef57a1d5-d7c9-4a89-96d3-fcf3b0287591 service nova] Creating event network-changed:83428c67-afc3-4387-a7cb-836e9171f7d0 for instance b4ea659d-ac89-4edd-bd93-397b66d29507 on n-h1-860863-4 Nov 02 21:30:08.324248 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f698762c-9b50-4532-ac6f-29571aa5ab97 req-ef57a1d5-d7c9-4a89-96d3-fcf3b0287591 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064029 Nov 02 21:30:08.325401 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1126/2147] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:08.419581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:08.429364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5472a193-d8bc-46d5-98af-1cf20654a402 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b687b98b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:08.433290 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e7cd52da-6ce4-44eb-945a-4763c4af1951 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1313 microversion: 2.1 time: 0.434861 Nov 02 21:30:08.436239 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1022/2148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:07 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:08.499626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:08.500234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:08.517823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.517823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.517823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.517823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.518406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.518406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.540982 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5472a193-d8bc-46d5-98af-1cf20654a402 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.118451 Nov 02 21:30:08.545658 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1127/2149] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:08 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:08.634644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4c206493-a721-4a7c-abf8-ef2d8be2384a req-bb2cb4b6-2e3c-47cb-b056-885685cfefa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5e4b93-d4db-4859-a8ac-e0536deae4bd", "name": "network-vif-deleted", "tag": "365a8627-274c-4996-98fc-e94e1e7c8ff3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:08.659101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4c206493-a721-4a7c-abf8-ef2d8be2384a req-bb2cb4b6-2e3c-47cb-b056-885685cfefa5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.664740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4c206493-a721-4a7c-abf8-ef2d8be2384a req-bb2cb4b6-2e3c-47cb-b056-885685cfefa5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.672336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4c206493-a721-4a7c-abf8-ef2d8be2384a req-bb2cb4b6-2e3c-47cb-b056-885685cfefa5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.711433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4c206493-a721-4a7c-abf8-ef2d8be2384a req-bb2cb4b6-2e3c-47cb-b056-885685cfefa5 service nova] Creating event network-vif-deleted:365a8627-274c-4996-98fc-e94e1e7c8ff3 for instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd on n-h2-860863-4 Nov 02 21:30:08.727519 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4c206493-a721-4a7c-abf8-ef2d8be2384a req-bb2cb4b6-2e3c-47cb-b056-885685cfefa5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106369 Nov 02 21:30:08.729014 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1128/2150] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:30:08.759737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:08.778794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:08.780055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:08.784318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:08.817938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:08.822762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.830045 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f7cbd2df-f86d-4f55-b1c6-c516e5bbe280 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1266 microversion: 2.25 time: 0.334214 Nov 02 21:30:08.830962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.835603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.839256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.839637 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1023/2151] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:08 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:30:08.857801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.857801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.872786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:08.874541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:08.880905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.881812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.882488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:08.883565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:08.884237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:08.884874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:09.354015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:09.367783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0006a3c5-26b5-4860-81b2-aeeb9f04f2fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1505 microversion: 2.1 time: 0.596236 Nov 02 21:30:09.368505 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1129/2152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:08 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:09.389275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:09.395813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:09.414198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:09.419601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:09.423272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:09.425326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:09.427648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:09.430398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:10.756461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:10.771789 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e83a5740-c579-4025-b3e0-ad68924d85ec tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 1474 microversion: 2.1 time: 1.904657 Nov 02 21:30:10.772405 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1024/2153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:08 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 1474 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:10.796599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:10.797544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:10.808642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:10.809503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:10.810140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:10.811026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:10.811654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:10.812256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:10.874132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:10.887657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cdfbddf1-51a6-483c-b9eb-579f4105caa9 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1317 microversion: 2.1 time: 1.517109 Nov 02 21:30:10.895273 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1130/2154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:09 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1317 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:10.917701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aaadc03f-9b3d-4acb-91e5-ff9e68a94ea4 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6875aee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:11.011472 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aaadc03f-9b3d-4acb-91e5-ff9e68a94ea4 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.113138 Nov 02 21:30:11.015611 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1131/2155] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:10 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:11.037112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:11.039443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:11.062259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.063117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.063756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.064664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.070828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.071510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.113988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:11.230750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:11.247134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:11.248906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:11.253704 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae986c93-2cd1-4265-aac1-b9ffeb137275 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1266 microversion: 2.25 time: 0.234046 Nov 02 21:30:11.254481 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1132/2156] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:11 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:11.264748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:11.270093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:11.292353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.293309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.293906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:11.294370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.296993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.302206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.303187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.315673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e14ae180-572c-4d90-8dd8-e1d5ce3a76e8 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1497 microversion: 2.1 time: 0.526917 Nov 02 21:30:11.319770 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1025/2157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:10 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1497 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:11.344916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e736d42c-9d53-47f7-b945-b324bdfaeded tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:11.439286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.server_groups [None req-e736d42c-9d53-47f7-b945-b324bdfaeded tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Querying cell 8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) for 1 instances {{(pid=121039) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 21:30:11.440029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e736d42c-9d53-47f7-b945-b324bdfaeded tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.451473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e736d42c-9d53-47f7-b945-b324bdfaeded tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.452069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e736d42c-9d53-47f7-b945-b324bdfaeded tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.513585 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e736d42c-9d53-47f7-b945-b324bdfaeded tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/1201da8f-cb4e-4628-b2e8-883808919411" status: 200 len: 222 microversion: 2.1 time: 0.167128 Nov 02 21:30:11.514870 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1026/2158] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:30:11 2022] GET /compute/v2.1/os-server-groups/1201da8f-cb4e-4628-b2e8-883808919411 => generated 222 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:11.526546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:11.527309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:11.544001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.545092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.545822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.546941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.547773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.548445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.606980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:11.650930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:11.659123 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6897a61-25d3-4c41-a19a-d11668120137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1485 microversion: 2.1 time: 0.402762 Nov 02 21:30:11.663069 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1133/2159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:11 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1485 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:11.684598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:11.685603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:11.696698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.697540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.699847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.702283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:11.704087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:11.707529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:11.798103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:12.071433 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0d219323-2294-4436-b100-085232b67cd3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 204 len: 0 microversion: 2.1 time: 0.549247 Nov 02 21:30:12.074415 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1027/2160] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:11 2022] DELETE /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:30:12.107746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-18abc3e6-68c0-4d44-b9e6-8a2f6088456b req-0dae7401-2476-4492-80f0-99f4582f9378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ea659d-ac89-4edd-bd93-397b66d29507", "name": "network-vif-plugged", "status": "completed", "tag": "83428c67-afc3-4387-a7cb-836e9171f7d0"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:12.138678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-18abc3e6-68c0-4d44-b9e6-8a2f6088456b req-0dae7401-2476-4492-80f0-99f4582f9378 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.139181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-18abc3e6-68c0-4d44-b9e6-8a2f6088456b req-0dae7401-2476-4492-80f0-99f4582f9378 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.139623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-18abc3e6-68c0-4d44-b9e6-8a2f6088456b req-0dae7401-2476-4492-80f0-99f4582f9378 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.176110 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-18abc3e6-68c0-4d44-b9e6-8a2f6088456b req-0dae7401-2476-4492-80f0-99f4582f9378 service nova] Creating event network-vif-plugged:83428c67-afc3-4387-a7cb-836e9171f7d0 for instance b4ea659d-ac89-4edd-bd93-397b66d29507 on n-h1-860863-4 Nov 02 21:30:12.193007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-18abc3e6-68c0-4d44-b9e6-8a2f6088456b req-0dae7401-2476-4492-80f0-99f4582f9378 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113482 Nov 02 21:30:12.198726 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1028/2161] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:12.204253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:12.204915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:12.222522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.226512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.226512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.226512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.226512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.226967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.253768 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c498093d-ca80-487c-9f7e-46132c9eb25b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 204 len: 0 microversion: 2.1 time: 0.573011 Nov 02 21:30:12.258348 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1134/2162] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:11 2022] DELETE /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:12.266436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:12.268712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:12.284803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.289552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.289552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.289552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.289552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.290024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.431548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:12.436092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:12.446639 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9091a97d-1818-429b-9c82-6684d6768b57 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 1432 microversion: 2.1 time: 0.246497 Nov 02 21:30:12.458630 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1029/2163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:12 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 1432 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:12.470101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-12521326-2b22-4028-b021-4b4937057e27 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b68704430>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:12.552440 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-12521326-2b22-4028-b021-4b4937057e27 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.081457 Nov 02 21:30:12.552440 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1030/2164] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:12 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:12.553644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:12.554825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:12.562672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.565296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.568353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.569678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.570318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.573949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.666976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:12.676067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d6795a7-0b0b-479e-99c8-915c61092c5c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1317 microversion: 2.1 time: 0.415455 Nov 02 21:30:12.702004 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1135/2165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:12 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:12.707520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:12.711534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:12.722831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.725424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.728335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:12.729370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:12.730022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:12.738656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.098195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:13.114097 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f2803f2-ff81-4965-a485-ffd2eb49f786 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1491 microversion: 2.1 time: 0.410301 Nov 02 21:30:13.115090 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1136/2166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:12 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1491 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:13.126878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:13.128474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:13.145825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:13.159184 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7e84f55-99be-40b5-9b9a-8f0da6a3c2de tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1503 microversion: 2.1 time: 0.608980 Nov 02 21:30:13.177014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.177535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.177985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.178745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.179203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.179637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.181161 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1031/2167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:12 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1503 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:13.187115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7dce41a6-dac3-4a48-87a3-c844dcaa171e req-f6c4bc22-7352-4539-8cc7-a2a2fe2420ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed1b872-ec5d-49a1-8377-e5ae331eb050", "name": "network-vif-deleted", "tag": "be8e2db3-3686-4477-9908-a126ccc17a17"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:13.207843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7dce41a6-dac3-4a48-87a3-c844dcaa171e req-f6c4bc22-7352-4539-8cc7-a2a2fe2420ec service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.209637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7dce41a6-dac3-4a48-87a3-c844dcaa171e req-f6c4bc22-7352-4539-8cc7-a2a2fe2420ec service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.210660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7dce41a6-dac3-4a48-87a3-c844dcaa171e req-f6c4bc22-7352-4539-8cc7-a2a2fe2420ec service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.235054 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7dce41a6-dac3-4a48-87a3-c844dcaa171e req-f6c4bc22-7352-4539-8cc7-a2a2fe2420ec service nova] Creating event network-vif-deleted:be8e2db3-3686-4477-9908-a126ccc17a17 for instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 on n-h2-860863-4 Nov 02 21:30:13.243588 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7dce41a6-dac3-4a48-87a3-c844dcaa171e req-f6c4bc22-7352-4539-8cc7-a2a2fe2420ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059585 Nov 02 21:30:13.249964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1032/2168] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:13.328724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:13.341355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:13.350865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:13.358425 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-87b8ebdb-d4af-4c6a-b528-6b63180d3215 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1266 microversion: 2.25 time: 0.242249 Nov 02 21:30:13.365867 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1137/2169] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:13 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:13.482912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:13.483651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:13.499658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.511074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.511563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.512544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.513248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.513686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.565365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e6a71d4-658d-4771-a34b-48a4f617780e tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6882fb80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:13.569223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.569906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.570525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.571145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lazy-loading 'fault' on Instance uuid 6ed1b872-ec5d-49a1-8377-e5ae331eb050 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:13.646141 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e6a71d4-658d-4771-a34b-48a4f617780e tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.084145 Nov 02 21:30:13.649108 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1138/2170] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:13 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:13.683726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3b6eb3bdd54df39a977d90228914ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82b9d02c247b40dc88ed230398b0613e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:13.694113 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0773bef9-7b1c-4f03-8b09-2080ddea5b42 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 200 len: 1308 microversion: 2.1 time: 0.215497 Nov 02 21:30:13.705807 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1033/2171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:13 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:13.705948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:13.705948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:13.708873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.709684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.710291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.711336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:13.711966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:13.712573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:13.947781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:13.957763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f75ee9a-a318-4676-aacd-7ca6ce8d215b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1317 microversion: 2.1 time: 0.260059 Nov 02 21:30:13.959166 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1139/2172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:13 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:14.138454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:14.139368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:14.147388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.148564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.149324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.150215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.150839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.151461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.189053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:14.190602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:14.210215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.219917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.220847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.224832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.224832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.224832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.453689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:14.460103 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e0e0adfc-9de6-4dee-a45c-3a53d8a64bc4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1491 microversion: 2.1 time: 0.326407 Nov 02 21:30:14.476616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1034/2173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:14 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1491 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:14.477714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:14.478554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:14.490310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.491168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.491826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.492757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.493438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.494062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.530287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:14.554664 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b2b0708-72df-4f82-ba2e-b7d3e7cf2421 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1503 microversion: 2.1 time: 0.370440 Nov 02 21:30:14.560770 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1140/2174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:14 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:14.662743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-897f27a3-2d1c-4091-834e-660deed8af04 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6882f4c0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:14.701832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:14.713007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:14.729613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:14.735911 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8e12467-eb9b-44cd-8d0b-65f50227a91d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 200 len: 1266 microversion: 2.25 time: 0.269933 Nov 02 21:30:14.745214 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-897f27a3-2d1c-4091-834e-660deed8af04 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.087019 Nov 02 21:30:14.745927 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1141/2175] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:14 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:14.749381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1035/2176] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:14 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:14.782093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:14.782975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] [instance: 6ed1b872-ec5d-49a1-8377-e5ae331eb050] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:14.796855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:14.798915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.799598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.800232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.801157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:14.804086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:14.804760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:14.840148 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] HTTP exception thrown: Instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 could not be found. Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Request method failure captured: Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 HTTP/1.1 Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDJ0ifV626Sn2zdEVKol273_nRDDCAwzikoXNSPxaejmgvcFtELj34liVPp0e905zXzIDYCv20vWdf-xr4peBbrMF3l4vDPMFLX7fo-wpBFHd6W3c4HoOGXtoTM00S-B1MiBvR6OfRZFnfwAv4Xe32Uit0T0L8C79zccUnCQPCucOk Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 82b9d02c247b40dc88ed230398b0613e Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListImageFiltersTestJSON-2118504294 Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:14.845868 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/82b9d02c247b40dc88ed230398b0613e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListImageFiltersTestJSON-2118504294 Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 82b9d02c247b40dc88ed230398b0613e Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2118504294 Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListImageFiltersTestJSON-2118504294-project Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1f3b6eb3bdd54df39a977d90228914ac Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListImageFiltersTestJSON-2118504294-project Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 could not be found. Nov 02 21:30:14.847731 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '6ed1b872-ec5d-49a1-8377-e5ae331eb050'} Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 could not be found. Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:14.849356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 could not be found. Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 could not be found. Nov 02 21:30:14.851020 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:14.855324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Returning 404 to user: Instance 6ed1b872-ec5d-49a1-8377-e5ae331eb050 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:14.856474 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c86c254-a139-497c-8685-8563840be8fb tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050" status: 404 len: 111 microversion: 2.1 time: 0.105823 Nov 02 21:30:14.867249 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1036/2177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:14 2022] GET /compute/v2.1/servers/6ed1b872-ec5d-49a1-8377-e5ae331eb050 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:14.872726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2621822-dd8a-439b-8945-8e0af6876111 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6879a3a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:14.984592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:14.985283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:15.000807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:15.001399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:15.004774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:15.006347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:15.007457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:15.007457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:15.458422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:15.485759 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10525652-3785-4b28-a1cd-477358bac79e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1317 microversion: 2.1 time: 0.505447 Nov 02 21:30:15.494071 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1037/2178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:14 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:15.527589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:15.528371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:15.554781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:15.555585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:15.556132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:15.557035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:15.557781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:15.558595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:15.638349 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2621822-dd8a-439b-8945-8e0af6876111 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/images/c784fa17-e2d4-441f-9933-6b566e364cd9" status: 204 len: 0 microversion: 2.1 time: 0.769853 Nov 02 21:30:15.639231 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1142/2179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:14 2022] DELETE /compute/v2.1/images/c784fa17-e2d4-441f-9933-6b566e364cd9 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:30:15.646023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:15.647503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:15.657519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:15.658014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:15.658464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:15.659246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:15.659648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:15.660079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:16.517567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:16.528261 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63e05dd4-826d-4561-80f3-ee80705fdf1b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1503 microversion: 2.1 time: 0.887813 Nov 02 21:30:16.544750 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1143/2180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:15 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1503 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:16.548624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-339cf2c6-82a4-4686-84f7-3bbeac01fe72 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b6882f1f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:16.550818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:16.566116 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1df23818-772f-4f13-8eaf-1a27402bf683 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1491 microversion: 2.1 time: 1.070611 Nov 02 21:30:16.566725 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1038/2181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:15 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1491 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:16.587507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:16.588242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: bb5e4b93-d4db-4859-a8ac-e0536deae4bd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:16.631886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:16.632404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:16.632884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:16.633784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:16.634551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:16.635034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] HTTP exception thrown: Instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd could not be found. Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Request method failure captured: Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd HTTP/1.1 Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYt-10l-VgMU8DIJHOYdzyhVJj25X2_hqonK4TPaVyW-4fufptvYOM_ViEzzo87LF3mmmvZ0QwdRqYtdaCqTOsnzD2EFvi1ltIS028Fxohl5sqBbL-nbj95b5jb-dbvHQInzZF-RtSOpk2FdjHSUw1NgrRNL_QxDW7mO2yuwoSanT7f0 Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:16.674829 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd27a33cdee44680b69336170f3739fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 979116d5dca74e6d90abe23e9033107e Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd could not be found. Nov 02 21:30:16.697020 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bb5e4b93-d4db-4859-a8ac-e0536deae4bd'} Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd could not be found. Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:16.697988 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd could not be found. Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd could not be found. Nov 02 21:30:16.699889 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:16.701442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Returning 404 to user: Instance bb5e4b93-d4db-4859-a8ac-e0536deae4bd could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:16.701442 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dfce7b6f-b463-436b-90e6-7af9f49216c0 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd" status: 404 len: 111 microversion: 2.25 time: 0.105707 Nov 02 21:30:16.703546 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1039/2182] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:16 2022] GET /compute/v2.1/servers/bb5e4b93-d4db-4859-a8ac-e0536deae4bd => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:30:16.725277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb6c9459-9442-4aad-b823-1bcc4bff7aaa tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b68799280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:18.022113 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-339cf2c6-82a4-4686-84f7-3bbeac01fe72 tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/images/61ba0f25-7e39-416a-ab4c-3d0d14023b62" status: 204 len: 0 microversion: 2.1 time: 1.482497 Nov 02 21:30:18.023254 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1144/2183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:16 2022] DELETE /compute/v2.1/images/61ba0f25-7e39-416a-ab4c-3d0d14023b62 => generated 0 bytes in 1484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:18.030768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:18.033372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:18.040489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:18.041037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:18.041481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:18.042307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:18.050732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:18.053285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:18.109458 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fb6c9459-9442-4aad-b823-1bcc4bff7aaa tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 1.399989 Nov 02 21:30:18.131897 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1040/2184] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:16 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:18.143344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:18.146641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:18.166403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:18.167211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:18.167849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:18.169705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:18.171028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:18.173858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:19.135414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd2ca9919154f28837486376da7d73c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f848b2b2c0641e5802dab6599eca64a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:19.146513 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-998f2a9d-c095-4254-a270-5c5e6c7674d0 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 200 len: 1298 microversion: 2.1 time: 1.013397 Nov 02 21:30:19.168942 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1041/2185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:18 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 1298 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:19.181157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:19.181778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:19.193219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:19.197642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:19.197642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:19.197642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:19.197642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:19.198212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:19.260964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:19.273081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:19.279146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:19.280782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:19.281632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'fault' on Instance uuid e208b785-f6ec-4e99-9692-130e9c74a740 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:19.283469 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11c6f6d1-84b9-480b-87a7-7a56ec11ea59 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1466 microversion: 2.1 time: 1.258984 Nov 02 21:30:19.296952 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1145/2186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:18 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1466 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:19.302859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-55fa218f-b234-40b6-8a0e-678bb4d834e7 req-193afffd-e484-417f-a75e-c06563d931fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e208b785-f6ec-4e99-9692-130e9c74a740", "name": "network-vif-deleted", "tag": "d7965ac2-508e-4056-b5e9-8d693844259f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:19.328008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-55fa218f-b234-40b6-8a0e-678bb4d834e7 req-193afffd-e484-417f-a75e-c06563d931fb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:19.329034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-55fa218f-b234-40b6-8a0e-678bb4d834e7 req-193afffd-e484-417f-a75e-c06563d931fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:19.331672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-55fa218f-b234-40b6-8a0e-678bb4d834e7 req-193afffd-e484-417f-a75e-c06563d931fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:19.403521 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-55fa218f-b234-40b6-8a0e-678bb4d834e7 req-193afffd-e484-417f-a75e-c06563d931fb service nova] Creating event network-vif-deleted:d7965ac2-508e-4056-b5e9-8d693844259f for instance e208b785-f6ec-4e99-9692-130e9c74a740 on n-h1-860863-4 Nov 02 21:30:19.416151 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-55fa218f-b234-40b6-8a0e-678bb4d834e7 req-193afffd-e484-417f-a75e-c06563d931fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126707 Nov 02 21:30:19.421353 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1146/2187] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:19.435112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9a61b47a-9af6-428e-b1e5-87684d06439b req-c445b03f-75e3-4c53-b146-d7b0d77c9768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9612702d-827c-497c-b497-873f61a1b5da", "name": "network-vif-deleted", "tag": "0f01d0f0-a7a7-4e5c-b791-bd319063ab5f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:19.438641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:19.449840 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e2a548e-0014-4272-b500-749730cceac9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1305 microversion: 2.1 time: 0.278220 Nov 02 21:30:19.462114 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1042/2188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:19 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1305 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:19.474232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91efff79-98f6-4c39-be32-bde4ebdc7d5c tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] Calling method '.version_select at 0x7f9b687315e0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:19.483573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9a61b47a-9af6-428e-b1e5-87684d06439b req-c445b03f-75e3-4c53-b146-d7b0d77c9768 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:19.484118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9a61b47a-9af6-428e-b1e5-87684d06439b req-c445b03f-75e3-4c53-b146-d7b0d77c9768 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:19.484493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9a61b47a-9af6-428e-b1e5-87684d06439b req-c445b03f-75e3-4c53-b146-d7b0d77c9768 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:19.519898 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9a61b47a-9af6-428e-b1e5-87684d06439b req-c445b03f-75e3-4c53-b146-d7b0d77c9768 service nova] Creating event network-vif-deleted:0f01d0f0-a7a7-4e5c-b791-bd319063ab5f for instance 9612702d-827c-497c-b497-873f61a1b5da on n-h1-860863-4 Nov 02 21:30:19.530982 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9a61b47a-9af6-428e-b1e5-87684d06439b req-c445b03f-75e3-4c53-b146-d7b0d77c9768 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110221 Nov 02 21:30:19.534085 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1147/2189] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:19.567898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6bfbaaa-cef6-4749-bb6b-4ebc01779d9c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6d13bca0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:20.596881 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91efff79-98f6-4c39-be32-bde4ebdc7d5c tempest-ListImageFiltersTestJSON-2118504294 tempest-ListImageFiltersTestJSON-2118504294-project] 10.222.0.25 "DELETE /compute/v2.1/images/fc93b270-3ee7-4e13-9b59-8d04d2c6ee94" status: 204 len: 0 microversion: 2.1 time: 1.140431 Nov 02 21:30:20.599234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1043/2190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:19 2022] DELETE /compute/v2.1/images/fc93b270-3ee7-4e13-9b59-8d04d2c6ee94 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:20.615225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:20.625203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:20.674784 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6bfbaaa-cef6-4749-bb6b-4ebc01779d9c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 1.136937 Nov 02 21:30:20.680043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:20.681699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:20.684016 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1148/2191] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:19 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:20.684891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:20.687125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:20.687752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:20.688389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:20.702278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:20.708082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:20.728595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:20.729118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:20.729558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:20.730304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:20.730814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:20.731244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:20.792092 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] HTTP exception thrown: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Request method failure captured: Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da HTTP/1.1 Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuE5aHwx-R4YzV871fYzMEjgLlfpXH0aXoEDzduo_fRmKkmjrdC-ZlsSBIxCOFMbCr1XDrDu4uF0wet6Ux2eyswstkCum2Hew4smp3mCUrhNxNkS1j3v6k1ah9Yz1rweCvRrVV72ufqOfkRv-Ta09sijWRuvmF1yiiSGSyPrz-8UKx4 Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:20.795152 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 0cd2ca9919154f28837486376da7d73c Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:20.797067 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9612702d-827c-497c-b497-873f61a1b5da'} Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:20.798162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:20.800454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:20.808398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Returning 404 to user: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:20.829851 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d49b82d6-0d0c-40a7-8f0b-fc4529abd0a3 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 404 len: 111 microversion: 2.1 time: 0.142363 Nov 02 21:30:20.836222 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1149/2192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:20 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:20.857161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:20.857934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:20.867784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:20.868279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:20.868718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:20.869488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:20.869940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:20.870399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:20.979896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:20.980827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:20.981578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:20.982261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'fault' on Instance uuid e208b785-f6ec-4e99-9692-130e9c74a740 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:21.125280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:21.135995 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6faeae4d-232d-4d7b-b278-bc9b3fc90132 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 200 len: 1305 microversion: 2.1 time: 0.298584 Nov 02 21:30:21.139164 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1150/2193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:20 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 1305 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:21.145712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53df0512-a36b-4dfc-b00b-601ec9b57f77 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.211051 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-862cc402-88eb-43c8-a9fe-c17dca9bfed2 tempest-ServersOnMultiNodesTest-701417474 tempest-ServersOnMultiNodesTest-701417474-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1617 microversion: 2.1 time: 0.610450 Nov 02 21:30:21.218056 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1044/2194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:20 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1617 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:21.227159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.server_groups [None req-53df0512-a36b-4dfc-b00b-601ec9b57f77 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Querying cell 8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) for 1 instances {{(pid=121040) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 21:30:21.232624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53df0512-a36b-4dfc-b00b-601ec9b57f77 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.243009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53df0512-a36b-4dfc-b00b-601ec9b57f77 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.243009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53df0512-a36b-4dfc-b00b-601ec9b57f77 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.254332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.261039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:21.280039 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53df0512-a36b-4dfc-b00b-601ec9b57f77 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.139447 Nov 02 21:30:21.292161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.298800 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1151/2195] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:30:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:21.298977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.298977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.298977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.299548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.300248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.308145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b1bfa42-c3ac-46da-be6b-80df15e1d947 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.342857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.server_groups [None req-6b1bfa42-c3ac-46da-be6b-80df15e1d947 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Querying cell 8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) for 1 instances {{(pid=121040) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 21:30:21.345499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1bfa42-c3ac-46da-be6b-80df15e1d947 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.346229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1bfa42-c3ac-46da-be6b-80df15e1d947 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.349277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1bfa42-c3ac-46da-be6b-80df15e1d947 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.352720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:21.378829 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b1bfa42-c3ac-46da-be6b-80df15e1d947 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/1201da8f-cb4e-4628-b2e8-883808919411" status: 200 len: 184 microversion: 2.1 time: 0.081862 Nov 02 21:30:21.380807 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1152/2196] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:30:21 2022] GET /compute/v2.1/os-server-groups/1201da8f-cb4e-4628-b2e8-883808919411 => generated 184 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:21.405719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.407200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:21.414774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.421320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.421320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.421320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.421320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.421780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.436793 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] HTTP exception thrown: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Request method failure captured: Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da HTTP/1.1 Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuE5aHwx-R4YzV871fYzMEjgLlfpXH0aXoEDzduo_fRmKkmjrdC-ZlsSBIxCOFMbCr1XDrDu4uF0wet6Ux2eyswstkCum2Hew4smp3mCUrhNxNkS1j3v6k1ah9Yz1rweCvRrVV72ufqOfkRv-Ta09sijWRuvmF1yiiSGSyPrz-8UKx4 Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:21.438788 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 0cd2ca9919154f28837486376da7d73c Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.440333 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9612702d-827c-497c-b497-873f61a1b5da'} Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:21.445529 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.447103 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.449051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Returning 404 to user: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:21.449051 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9eb1eab2-3402-4387-a60c-6e01d8775af7 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 404 len: 111 microversion: 2.1 time: 0.048699 Nov 02 21:30:21.449051 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1153/2197] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:21 2022] DELETE /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:21.486821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.486821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] [instance: 9612702d-827c-497c-b497-873f61a1b5da] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:21.486821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.486821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.487209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.487209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:21.487209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:21.487209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:21.494348 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] HTTP exception thrown: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Request method failure captured: Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da HTTP/1.1 Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuE5aHwx-R4YzV871fYzMEjgLlfpXH0aXoEDzduo_fRmKkmjrdC-ZlsSBIxCOFMbCr1XDrDu4uF0wet6Ux2eyswstkCum2Hew4smp3mCUrhNxNkS1j3v6k1ah9Yz1rweCvRrVV72ufqOfkRv-Ta09sijWRuvmF1yiiSGSyPrz-8UKx4 Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:21.496267 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 0cd2ca9919154f28837486376da7d73c Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.497992 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9612702d-827c-497c-b497-873f61a1b5da'} Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:21.498848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. Nov 02 21:30:21.501794 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.504736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Returning 404 to user: Instance 9612702d-827c-497c-b497-873f61a1b5da could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:21.504736 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fe5a2de-6aca-4f71-a723-e44362fdff4f tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da" status: 404 len: 111 microversion: 2.1 time: 0.051291 Nov 02 21:30:21.504736 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1154/2198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:21 2022] GET /compute/v2.1/servers/9612702d-827c-497c-b497-873f61a1b5da => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:21.508094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6791ae9-0236-4d4c-a7dc-dbbfc499300a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.515505 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e6791ae9-0236-4d4c-a7dc-dbbfc499300a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] HTTP exception thrown: Instance group ebba3001-4178-44e1-acf7-95c9faa8b4d0 could not be found. Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6791ae9-0236-4d4c-a7dc-dbbfc499300a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Request method failure captured: Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-server-groups/ebba3001-4178-44e1-acf7-95c9faa8b4d0 HTTP/1.1 Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuE5aHwx-R4YzV871fYzMEjgLlfpXH0aXoEDzduo_fRmKkmjrdC-ZlsSBIxCOFMbCr1XDrDu4uF0wet6Ux2eyswstkCum2Hew4smp3mCUrhNxNkS1j3v6k1ah9Yz1rweCvRrVV72ufqOfkRv-Ta09sijWRuvmF1yiiSGSyPrz-8UKx4 Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:21.523295 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 0cd2ca9919154f28837486376da7d73c Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance group ebba3001-4178-44e1-acf7-95c9faa8b4d0 could not be found. Nov 02 21:30:21.524900 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'ebba3001-4178-44e1-acf7-95c9faa8b4d0'} Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ebba3001-4178-44e1-acf7-95c9faa8b4d0 could not be found. Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.526352 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ebba3001-4178-44e1-acf7-95c9faa8b4d0 could not be found. Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ebba3001-4178-44e1-acf7-95c9faa8b4d0 could not be found. Nov 02 21:30:21.528457 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.530761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6791ae9-0236-4d4c-a7dc-dbbfc499300a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Returning 404 to user: Instance group ebba3001-4178-44e1-acf7-95c9faa8b4d0 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:21.530761 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e6791ae9-0236-4d4c-a7dc-dbbfc499300a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/ebba3001-4178-44e1-acf7-95c9faa8b4d0" status: 404 len: 117 microversion: 2.1 time: 0.021127 Nov 02 21:30:21.530761 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1155/2199] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:30:21 2022] DELETE /compute/v2.1/os-server-groups/ebba3001-4178-44e1-acf7-95c9faa8b4d0 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:21.536552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c432155d-5dd7-496d-a68a-57bf0fc9131b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c432155d-5dd7-496d-a68a-57bf0fc9131b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] HTTP exception thrown: Instance group 41bfe890-185a-41ef-a8c7-891c17fcf33b could not be found. Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c432155d-5dd7-496d-a68a-57bf0fc9131b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Request method failure captured: Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-server-groups/41bfe890-185a-41ef-a8c7-891c17fcf33b HTTP/1.1 Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuE5aHwx-R4YzV871fYzMEjgLlfpXH0aXoEDzduo_fRmKkmjrdC-ZlsSBIxCOFMbCr1XDrDu4uF0wet6Ux2eyswstkCum2Hew4smp3mCUrhNxNkS1j3v6k1ah9Yz1rweCvRrVV72ufqOfkRv-Ta09sijWRuvmF1yiiSGSyPrz-8UKx4 Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:21.548031 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 0cd2ca9919154f28837486376da7d73c Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance group 41bfe890-185a-41ef-a8c7-891c17fcf33b could not be found. Nov 02 21:30:21.549985 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '41bfe890-185a-41ef-a8c7-891c17fcf33b'} Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41bfe890-185a-41ef-a8c7-891c17fcf33b could not be found. Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.551219 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41bfe890-185a-41ef-a8c7-891c17fcf33b could not be found. Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41bfe890-185a-41ef-a8c7-891c17fcf33b could not be found. Nov 02 21:30:21.554941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.557528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c432155d-5dd7-496d-a68a-57bf0fc9131b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Returning 404 to user: Instance group 41bfe890-185a-41ef-a8c7-891c17fcf33b could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:21.557528 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c432155d-5dd7-496d-a68a-57bf0fc9131b tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/41bfe890-185a-41ef-a8c7-891c17fcf33b" status: 404 len: 117 microversion: 2.1 time: 0.017218 Nov 02 21:30:21.557528 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1156/2200] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:30:21 2022] DELETE /compute/v2.1/os-server-groups/41bfe890-185a-41ef-a8c7-891c17fcf33b => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:21.557528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11d9613c-2375-4d70-859a-eb385c1e8e9d tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.565470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-11d9613c-2375-4d70-859a-eb385c1e8e9d tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] HTTP exception thrown: Instance group 11d64fd6-55c2-4959-af21-5a5dca849c9e could not be found. Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11d9613c-2375-4d70-859a-eb385c1e8e9d tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Request method failure captured: Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-server-groups/11d64fd6-55c2-4959-af21-5a5dca849c9e HTTP/1.1 Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuE5aHwx-R4YzV871fYzMEjgLlfpXH0aXoEDzduo_fRmKkmjrdC-ZlsSBIxCOFMbCr1XDrDu4uF0wet6Ux2eyswstkCum2Hew4smp3mCUrhNxNkS1j3v6k1ah9Yz1rweCvRrVV72ufqOfkRv-Ta09sijWRuvmF1yiiSGSyPrz-8UKx4 Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:21.574820 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 0cd2ca9919154f28837486376da7d73c Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance group 11d64fd6-55c2-4959-af21-5a5dca849c9e could not be found. Nov 02 21:30:21.576658 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '11d64fd6-55c2-4959-af21-5a5dca849c9e'} Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 11d64fd6-55c2-4959-af21-5a5dca849c9e could not be found. Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.577576 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 11d64fd6-55c2-4959-af21-5a5dca849c9e could not be found. Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 11d64fd6-55c2-4959-af21-5a5dca849c9e could not be found. Nov 02 21:30:21.578882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.582510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11d9613c-2375-4d70-859a-eb385c1e8e9d tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Returning 404 to user: Instance group 11d64fd6-55c2-4959-af21-5a5dca849c9e could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:21.584044 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11d9613c-2375-4d70-859a-eb385c1e8e9d tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/11d64fd6-55c2-4959-af21-5a5dca849c9e" status: 404 len: 117 microversion: 2.1 time: 0.030433 Nov 02 21:30:21.601445 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1157/2201] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:30:21 2022] DELETE /compute/v2.1/os-server-groups/11d64fd6-55c2-4959-af21-5a5dca849c9e => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:21.623228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa4e1971-48ff-48e6-be9a-56b9ae131f0a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.639782 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-fa4e1971-48ff-48e6-be9a-56b9ae131f0a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] HTTP exception thrown: Instance group 90fca6ef-3137-478e-90bf-761eeef6f466 could not be found. Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa4e1971-48ff-48e6-be9a-56b9ae131f0a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Request method failure captured: Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-server-groups/90fca6ef-3137-478e-90bf-761eeef6f466 HTTP/1.1 Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuE5aHwx-R4YzV871fYzMEjgLlfpXH0aXoEDzduo_fRmKkmjrdC-ZlsSBIxCOFMbCr1XDrDu4uF0wet6Ux2eyswstkCum2Hew4smp3mCUrhNxNkS1j3v6k1ah9Yz1rweCvRrVV72ufqOfkRv-Ta09sijWRuvmF1yiiSGSyPrz-8UKx4 Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:21.641801 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8f848b2b2c0641e5802dab6599eca64a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8f848b2b2c0641e5802dab6599eca64a Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroupTestJSON-73882483 Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 0cd2ca9919154f28837486376da7d73c Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroupTestJSON-73882483-project Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance group 90fca6ef-3137-478e-90bf-761eeef6f466 could not be found. Nov 02 21:30:21.643347 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '90fca6ef-3137-478e-90bf-761eeef6f466'} Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 90fca6ef-3137-478e-90bf-761eeef6f466 could not be found. Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.644204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 90fca6ef-3137-478e-90bf-761eeef6f466 could not be found. Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 90fca6ef-3137-478e-90bf-761eeef6f466 could not be found. Nov 02 21:30:21.646742 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:21.648428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa4e1971-48ff-48e6-be9a-56b9ae131f0a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Returning 404 to user: Instance group 90fca6ef-3137-478e-90bf-761eeef6f466 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:21.648428 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa4e1971-48ff-48e6-be9a-56b9ae131f0a tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/90fca6ef-3137-478e-90bf-761eeef6f466" status: 404 len: 117 microversion: 2.1 time: 0.040700 Nov 02 21:30:21.651479 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1158/2202] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:30:21 2022] DELETE /compute/v2.1/os-server-groups/90fca6ef-3137-478e-90bf-761eeef6f466 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:21.657719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-285e7b88-24c9-420a-99e3-848c094c4110 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:21.841560 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-285e7b88-24c9-420a-99e3-848c094c4110 tempest-ServerGroupTestJSON-73882483 tempest-ServerGroupTestJSON-73882483-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/1201da8f-cb4e-4628-b2e8-883808919411" status: 204 len: 0 microversion: 2.1 time: 0.182061 Nov 02 21:30:21.841560 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1159/2203] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:30:21 2022] DELETE /compute/v2.1/os-server-groups/1201da8f-cb4e-4628-b2e8-883808919411 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:21.877275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dcd9f57c-14ba-4b10-96c6-22e53a31ffde tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b68814040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:22.011477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dcd9f57c-14ba-4b10-96c6-22e53a31ffde tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.149818 Nov 02 21:30:22.014018 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1160/2204] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:21 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:22.080643 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6be05637-3ba8-47c2-8d7b-2345896a0216 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 204 len: 0 microversion: 2.1 time: 0.834522 Nov 02 21:30:22.082959 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1045/2205] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:21 2022] DELETE /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:30:22.094191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:22.095128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:22.111131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:22.114166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:22.115512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:22.117773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:22.119714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:22.120425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:22.170852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:22.172637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:22.194419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:22.199134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:22.199936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:22.202748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:22.203406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:22.208617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:22.273427 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 HTTP/1.1 Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:22.281009 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:30:22.282933 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e208b785-f6ec-4e99-9692-130e9c74a740'} Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:22.283998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:30:22.286365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:22.290349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:22.293464 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e772cd7d-1850-42eb-99c5-be44529b5be0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 404 len: 111 microversion: 2.1 time: 0.128924 Nov 02 21:30:22.306763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1046/2206] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:22 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:22.465926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:22.479321 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5dc01d05-c865-4f71-a3d7-503a78c81168 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1472 microversion: 2.1 time: 0.389861 Nov 02 21:30:22.499130 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1161/2207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:22 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:22.622841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1081122583", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "67c3f76f-7a17-4f1f-a61d-9ec78598dc27"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:22.738304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] validate_networks() for [('67c3f76f-7a17-4f1f-a61d-9ec78598dc27', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:30:23.031543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb3f15bf-b34b-4f77-8d03-fc4ee4ff3a4f tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6d145670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:23.131413 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb3f15bf-b34b-4f77-8d03-fc4ee4ff3a4f tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1428 microversion: 2.1 time: 0.106036 Nov 02 21:30:23.132048 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1162/2208] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:23 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:23.526487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:23.528300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:23.542877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:23.543816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:23.546234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:23.550093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:23.553790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:23.554558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:24.217455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:30:24.217901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:30:24.218452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:30:24.218874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:30:24.219287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:30:24.241047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:24.242709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:24.243158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:24.243927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:24.255463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:24.255463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:24.291233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:24.323760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for user 1cb7808dc9e54e86811e0b7ad1cec847 and project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:24.353758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:30:24.356979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:30:24.360622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:24.370002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:24.376662 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba5cc43f-f68f-4a7c-aa76-9e1d9dcda6c2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1472 microversion: 2.1 time: 0.869298 Nov 02 21:30:24.379038 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1163/2209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:23 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1472 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:24.395159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c92859f0-da10-446e-b2c3-27bec1599f0d tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6879a430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:24.496804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c92859f0-da10-446e-b2c3-27bec1599f0d tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1437 microversion: 2.1 time: 0.115569 Nov 02 21:30:24.497457 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1164/2210] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:24 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:24.519424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84c0dec8-4084-4d87-a1a1-59b591dc6037 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6882f790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:24.583579 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1a7e5cd-a928-470b-966a-920ec225fc7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.964235 Nov 02 21:30:24.586842 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1047/2211] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:30:24.604758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-87dba78e-e91b-411a-a78f-3cb35b93deb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:24.604758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-87dba78e-e91b-411a-a78f-3cb35b93deb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:24.605042 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84c0dec8-4084-4d87-a1a1-59b591dc6037 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 200 len: 1437 microversion: 2.1 time: 0.084859 Nov 02 21:30:24.605589 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1165/2212] 10.222.0.25 () {58 vars in 1233 bytes} [Wed Nov 2 21:30:24 2022] GET /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:24.620171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:24.627458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:24.659171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:24.663233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:24.664877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:24.671281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:24.671281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:24.672578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:24.807180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-87dba78e-e91b-411a-a78f-3cb35b93deb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:24.847493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-87dba78e-e91b-411a-a78f-3cb35b93deb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1215 microversion: 2.1 time: 0.230003 Nov 02 21:30:24.848263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1048/2213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:24 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:25.072593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:25.082790 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88ee8d9e-57f2-4f8a-b58e-2e7a3a413bad tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1479 microversion: 2.1 time: 0.465777 Nov 02 21:30:25.084127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1166/2214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:24 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1479 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:25.406032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:25.407388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:25.421595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:25.422616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:25.423268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:25.424220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:25.425132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:25.425996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:25.555972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:25.568791 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff136bbc-5e9c-4511-9482-14ff1013250c tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1430 microversion: 2.1 time: 0.167822 Nov 02 21:30:25.569715 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1049/2215] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:25 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1430 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:25.759391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c1a70aba-5616-467d-bdd3-2b3700c98477 req-7fdaccaf-fbec-44dd-b9a6-dd52f55666cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ea659d-ac89-4edd-bd93-397b66d29507", "name": "network-vif-deleted", "tag": "83428c67-afc3-4387-a7cb-836e9171f7d0"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:25.817870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c1a70aba-5616-467d-bdd3-2b3700c98477 req-7fdaccaf-fbec-44dd-b9a6-dd52f55666cd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:25.820611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c1a70aba-5616-467d-bdd3-2b3700c98477 req-7fdaccaf-fbec-44dd-b9a6-dd52f55666cd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:25.820611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c1a70aba-5616-467d-bdd3-2b3700c98477 req-7fdaccaf-fbec-44dd-b9a6-dd52f55666cd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:25.871553 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c1a70aba-5616-467d-bdd3-2b3700c98477 req-7fdaccaf-fbec-44dd-b9a6-dd52f55666cd service nova] Creating event network-vif-deleted:83428c67-afc3-4387-a7cb-836e9171f7d0 for instance b4ea659d-ac89-4edd-bd93-397b66d29507 on n-h1-860863-4 Nov 02 21:30:25.887444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da57b352-a2eb-4f41-ad55-2457866e27a7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:25.888349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da57b352-a2eb-4f41-ad55-2457866e27a7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:25.925296 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c1a70aba-5616-467d-bdd3-2b3700c98477 req-7fdaccaf-fbec-44dd-b9a6-dd52f55666cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172207 Nov 02 21:30:25.932628 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1167/2216] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:26.069466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da57b352-a2eb-4f41-ad55-2457866e27a7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:26.080155 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da57b352-a2eb-4f41-ad55-2457866e27a7 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1215 microversion: 2.1 time: 0.195857 Nov 02 21:30:26.087004 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1050/2217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:25 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:26.108382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:26.108382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:26.116874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:26.117791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:26.118349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:26.119343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:26.120887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:26.121581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:26.392649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:26.408341 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-43cea681-e73e-4a71-bfd0-161a413d1c5c tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1466 microversion: 2.1 time: 0.304552 Nov 02 21:30:26.408341 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1168/2218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:26 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1466 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:26.447502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5dbb93e8-075e-4f31-a9d8-5c8809dd8ccf tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b68731a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:26.475540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:26.476147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:26.482884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:26.483914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:26.484539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:26.485617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:26.486234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:26.486819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:26.557684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:27.319445 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d82ef39-a1c5-4a4b-b84d-b2f309de0489 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 204 len: 0 microversion: 2.25 time: 0.849165 Nov 02 21:30:27.330076 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1169/2219] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:30:26 2022] DELETE /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 21:30:27.332313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:27.337796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:27.349486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:27.350747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:27.352200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:27.355800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:27.356477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:27.358597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:27.452184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:27.453694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:27.456293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:27.456293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lazy-loading 'fault' on Instance uuid b4ea659d-ac89-4edd-bd93-397b66d29507 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:27.535212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:27.553518 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-105358c1-454e-4788-8ff8-f2a23a9e792b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 200 len: 1307 microversion: 2.1 time: 0.226709 Nov 02 21:30:27.556266 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1170/2220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:27 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:27.924139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20f48887-3854-4613-88a3-8da6e248a022 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b6d180d30>, body: {"keypair": {"name": "tempest-keypair-1671194450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOhDaXxsworzIRgfnqxv6znywaYQHVii9dPfGtj/7iXHIkeH1P0sEj3ViaORHfSwicfUJeXQvBpKDRAE5cmsmEHE5twcJ/YyetK9sDrqyFW0P5E3SP2pPxwqwzltkCuBw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:27.984731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:28.000514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-20f48887-3854-4613-88a3-8da6e248a022 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:28.022150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-20f48887-3854-4613-88a3-8da6e248a022 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:28.283892 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20f48887-3854-4613-88a3-8da6e248a022 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.726346 Nov 02 21:30:28.286425 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1171/2221] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 21:30:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 729 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:30:28.293261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:28.295219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:28.306115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:28.306115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:28.306115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:28.306115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:28.307171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:28.307171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:28.495940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:28.528639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fce24ba7-85a9-4562-9a44-c6a681ac9393 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1267 microversion: 2.1 time: 0.239348 Nov 02 21:30:28.530112 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1172/2222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:28 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:28.540608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:28.542164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:28.548504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:28.549162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:28.549723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:28.550570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:28.551134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:28.553102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:28.804741 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5dbb93e8-075e-4f31-a9d8-5c8809dd8ccf tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "DELETE /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac" status: 204 len: 0 microversion: 2.1 time: 2.367883 Nov 02 21:30:28.808769 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1051/2223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:26 2022] DELETE /compute/v2.1/images/4745abd0-6cfe-45af-890a-16790849cfac => generated 0 bytes in 2369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:28.815341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-104110d6-fc6c-45ef-bbfe-f20bdbf258c4 req-4422270b-3a21-422b-9524-88538c22055b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6914ac-9e4d-461b-bc1d-eac050f58374", "name": "network-vif-unplugged", "status": "completed", "tag": "e978550d-f6af-44d1-96d5-b560c099450f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:28.839485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-104110d6-fc6c-45ef-bbfe-f20bdbf258c4 req-4422270b-3a21-422b-9524-88538c22055b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:28.839971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-104110d6-fc6c-45ef-bbfe-f20bdbf258c4 req-4422270b-3a21-422b-9524-88538c22055b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:28.840405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-104110d6-fc6c-45ef-bbfe-f20bdbf258c4 req-4422270b-3a21-422b-9524-88538c22055b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:28.862797 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-104110d6-fc6c-45ef-bbfe-f20bdbf258c4 req-4422270b-3a21-422b-9524-88538c22055b service nova] Creating event network-vif-unplugged:e978550d-f6af-44d1-96d5-b560c099450f for instance fe6914ac-9e4d-461b-bc1d-eac050f58374 on n-h1-860863-4 Nov 02 21:30:28.871769 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-104110d6-fc6c-45ef-bbfe-f20bdbf258c4 req-4422270b-3a21-422b-9524-88538c22055b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061688 Nov 02 21:30:28.876485 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1052/2224] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:28.888914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30e944de-1266-4c91-a3c5-687ceb91d422 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6874d430>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:28.910310 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30e944de-1266-4c91-a3c5-687ceb91d422 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1671194450" status: 200 len: 513 microversion: 2.2 time: 0.028480 Nov 02 21:30:28.925693 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1053/2225] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 21:30:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1671194450 => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:28.937868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:28.946613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b4ea659d-ac89-4edd-bd93-397b66d29507] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:28.968334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:28.968962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:28.969298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:28.970012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:28.970473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:28.970899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:28.997386 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance b4ea659d-ac89-4edd-bd93-397b66d29507 could not be found. Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 HTTP/1.1 Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:28.999343 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b4ea659d-ac89-4edd-bd93-397b66d29507 could not be found. Nov 02 21:30:29.001134 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b4ea659d-ac89-4edd-bd93-397b66d29507'} Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ea659d-ac89-4edd-bd93-397b66d29507 could not be found. Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:29.002343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ea659d-ac89-4edd-bd93-397b66d29507 could not be found. Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ea659d-ac89-4edd-bd93-397b66d29507 could not be found. Nov 02 21:30:29.004796 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.007475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance b4ea659d-ac89-4edd-bd93-397b66d29507 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:29.008496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1892294f-76e9-46f7-b99c-806467659f13 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507" status: 404 len: 111 microversion: 2.1 time: 0.078199 Nov 02 21:30:29.012336 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1054/2226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:28 2022] GET /compute/v2.1/servers/b4ea659d-ac89-4edd-bd93-397b66d29507 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:29.018730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4da2a0be-75e9-46f4-b7fb-628c53945791 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '.version_select at 0x7f9b6d102e50>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:29.039924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:29.062962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4da2a0be-75e9-46f4-b7fb-628c53945791 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] HTTP exception thrown: Image not found. Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4da2a0be-75e9-46f4-b7fb-628c53945791 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Request method failure captured: Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 HTTP/1.1 Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuEYMX_-5Qy9oaJuEP5QuwHdkiuLuIbYN9uEI_OW8qWWv-7LnSkLVwjdLp55F1wSHu0MXoWiXYMc_of6wvhOsGsl0NumL7_dtGe4Y6-pDH-UQc_MCa6jlujT1yFQPORhg_cd7Hp3QDmB8mPtg-yVq-DLAlwS44QsoBbpukTKM5dF8rE Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 255043a6d5ca4541bb9d597a70075391 Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:29.065525 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_255043a6d5ca4541bb9d597a70075391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 255043a6d5ca4541bb9d597a70075391 Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesOneServerTestJSON-1891881214-project Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: d5e45337c25e4cd7b72cf2f6b2b2277a Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesOneServerTestJSON-1891881214-project Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '181b446e-381b-45c9-bff4-08078c9e04b2'} Nov 02 21:30:29.067330 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 181b446e-381b-45c9-bff4-08078c9e04b2 to delete Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:29.068393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 181b446e-381b-45c9-bff4-08078c9e04b2 could not be found. Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:29.070031 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:30:29.071851 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:29.422440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:29.422440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:29.423136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4da2a0be-75e9-46f4-b7fb-628c53945791 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:29.423136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4da2a0be-75e9-46f4-b7fb-628c53945791 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "DELETE /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2" status: 404 len: 62 microversion: 2.1 time: 0.061403 Nov 02 21:30:29.423677 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f981c44a-83de-4750-9e3c-1f57da831fb6 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1730 microversion: 2.25 time: 0.542349 Nov 02 21:30:29.428319 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1055/2227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:29 2022] DELETE /compute/v2.1/images/181b446e-381b-45c9-bff4-08078c9e04b2 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:30:29.429283 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1173/2228] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:28 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1730 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:29.429454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-be84fad8-1d58-4e7f-aa32-daaead110950 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b68836670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:29.429591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:29.429591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:29.429591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:29.429591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:29.430107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:29.430107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:29.430107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:29.430107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:29.435344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:29.435627 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-be84fad8-1d58-4e7f-aa32-daaead110950 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671194450" status: 204 len: 0 microversion: 2.2 time: 0.152846 Nov 02 21:30:29.435627 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1056/2229] 10.222.0.25 () {60 vars in 1261 bytes} [Wed Nov 2 21:30:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671194450 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:29.435627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:29.435627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:29.435627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:29.436105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:29.436105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:29.436105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:29.436105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:29.436441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:29.436441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:29.436441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:29.823423 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dbd24519-23b3-4278-9ffd-0690844360af tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 204 len: 0 microversion: 2.1 time: 0.738371 Nov 02 21:30:29.824174 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1174/2230] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:29 2022] DELETE /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 0 bytes in 740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:29.829762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88345d3c-b677-40a6-80e2-feb6feec305e tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b6879a430>, body: {"keypair": {"name": "tempest-keypair-1372034684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdXRMGeo9WPfuWt0pvMLTJyjxQjmKnJkzDUC5LK4vd9ApL09oPSn46eOuhdr1IMm2e3ePv4nrtUFvobky8OajXC3c+QXIY2dZKX6mI7WmXx36RmB/C0h0lfFUHpv45M4g=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:29.863028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-88345d3c-b677-40a6-80e2-feb6feec305e tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:29.869826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-88345d3c-b677-40a6-80e2-feb6feec305e tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:29.881032 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-95b2189b-78c6-4355-8fa7-835f92ed8855 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 204 len: 0 microversion: 2.1 time: 0.645568 Nov 02 21:30:29.882362 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1057/2231] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:29 2022] DELETE /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:29.891294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:29.893473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:29.917870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:29.919157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:29.921080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:29.927185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:29.927690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:29.929268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.005770 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88345d3c-b677-40a6-80e2-feb6feec305e tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.180229 Nov 02 21:30:30.006535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1175/2232] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 21:30:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:30:30.017166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:30.021908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:30.037715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:30.039748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:30.040265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:30.040863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.041614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:30.042068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:30.042494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.049596 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-deaa1184-7594-4a86-b0ac-993c41febce8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1285 microversion: 2.1 time: 0.165095 Nov 02 21:30:30.050990 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1058/2233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:29 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:30.057251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:30.058110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:30.065268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:30.066543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:30.067287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.068610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:30.069210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:30.074990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.492787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:30.502968 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5db9b25-7fe0-4f6a-aa29-2a6071a0e053 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1473 microversion: 2.1 time: 0.493282 Nov 02 21:30:30.503998 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1176/2234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:30 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1473 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:30.510166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a2589609-25c1-47f4-a2ba-5bd34cb12bee tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6d13b0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:30.523386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:30.533794 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-941efb80-3074-42b9-aca5-cdc968f5842a tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1472 microversion: 2.1 time: 0.479237 Nov 02 21:30:30.535490 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1059/2235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:30 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:30.542119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:30.542897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:30.553341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:30.554523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:30.555286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.556317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:30.557031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:30.557599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.612757 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a2589609-25c1-47f4-a2ba-5bd34cb12bee tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372034684" status: 204 len: 0 microversion: 2.2 time: 0.106148 Nov 02 21:30:30.614260 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1177/2236] 10.222.0.25 () {60 vars in 1261 bytes} [Wed Nov 2 21:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372034684 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:30.621601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-405392f3-ec7c-41ac-ae93-9287d7d66e42 req-0baf0f59-3a86-4fa5-95b0-c3860167f730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec0e4c5-b974-4e97-b40d-8b54b4d85558", "name": "network-vif-deleted", "tag": "b985a751-243c-45ff-878a-a684e938c842"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:30.636854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-405392f3-ec7c-41ac-ae93-9287d7d66e42 req-0baf0f59-3a86-4fa5-95b0-c3860167f730 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:30.637376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-405392f3-ec7c-41ac-ae93-9287d7d66e42 req-0baf0f59-3a86-4fa5-95b0-c3860167f730 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:30.637814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-405392f3-ec7c-41ac-ae93-9287d7d66e42 req-0baf0f59-3a86-4fa5-95b0-c3860167f730 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:30.650656 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-405392f3-ec7c-41ac-ae93-9287d7d66e42 req-0baf0f59-3a86-4fa5-95b0-c3860167f730 service nova] Creating event network-vif-deleted:b985a751-243c-45ff-878a-a684e938c842 for instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 on n-h2-860863-4 Nov 02 21:30:30.661936 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-405392f3-ec7c-41ac-ae93-9287d7d66e42 req-0baf0f59-3a86-4fa5-95b0-c3860167f730 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045263 Nov 02 21:30:30.662861 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1178/2237] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:30.669120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f66b0856-12a9-42c5-a8b6-4ad86b474a42 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b6d156ee0>, body: {"keypair": {"name": "tempest-keypair-704941886", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:30.686277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:30.688610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f66b0856-12a9-42c5-a8b6-4ad86b474a42 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:30.696077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f66b0856-12a9-42c5-a8b6-4ad86b474a42 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:30.699104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:30.703319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:30.704695 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-821b034a-7e84-4712-8a84-3eca3d95d06e tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 200 len: 1664 microversion: 2.25 time: 0.167489 Nov 02 21:30:30.718856 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1060/2238] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:30 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:30.822898 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f66b0856-12a9-42c5-a8b6-4ad86b474a42 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.158574 Nov 02 21:30:30.823697 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1179/2239] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 21:30:30 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 160 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:30:30.837082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-778bd0be-6d58-4d1e-b5e2-3d22ca46d786 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b68728940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:30.966351 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-778bd0be-6d58-4d1e-b5e2-3d22ca46d786 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-704941886" status: 204 len: 0 microversion: 2.2 time: 0.135371 Nov 02 21:30:30.966949 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1061/2240] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 21:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-704941886 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:30.980098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-251cfbad-83b8-4bff-a4ce-64b64c298528 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b687b98b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1824665341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwUz5089Pw5FkXwyC4LLbve1XuhfAEwO38D8sQ/e+Ajbd3ulOAMHxubyCstchtltZK8LTIE10IS3RAULqzrubU0go3fV+YU4Rk8ivm6iRS2CIgalrHBy7dogZ8DDsRgIw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:31.037073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-251cfbad-83b8-4bff-a4ce-64b64c298528 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:31.043134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-251cfbad-83b8-4bff-a4ce-64b64c298528 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:31.076560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-582391987", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f1a27830-c4e6-4f86-894e-5e8eaac191b0"}], "block_device_mapping_v2": [{"uuid": "b519a0e5-6a05-479c-a3bc-3514fa93ab89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:31.163607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] validate_networks() for [('f1a27830-c4e6-4f86-894e-5e8eaac191b0', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:30:31.186578 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-251cfbad-83b8-4bff-a4ce-64b64c298528 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.211058 Nov 02 21:30:31.187748 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1180/2241] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 21:30:30 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 21:30:31.205979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:31.208885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:31.219176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:31.222182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:31.222182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:31.222182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:31.222182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:31.222787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:31.726197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:31.739100 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-13fc2955-e4af-449f-87ba-91d347ca91aa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1273 microversion: 2.1 time: 0.539661 Nov 02 21:30:31.740043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1181/2242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:31 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1273 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:31.746639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8e3ca5b-df32-42a7-a6d5-d69abfaab728 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b6d1565e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-579356616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWHy4lcXNjppsePq3ZzJutpsG0bu6loDtCmrRhhB3V6w0pbiSdTMkiEyxDahhZkFdYMKvJ5OLMVxHeqcT/DljxJ1ArvDfUWa/yx0hustGWKnLEXqz7cHwhyCnkX910TvA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:31.774324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f8e3ca5b-df32-42a7-a6d5-d69abfaab728 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:31.781222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f8e3ca5b-df32-42a7-a6d5-d69abfaab728 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:31.926720 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8e3ca5b-df32-42a7-a6d5-d69abfaab728 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.185266 Nov 02 21:30:31.928067 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1182/2243] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 21:30:31 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:30:31.945710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:31.946645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:31.960308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:31.961248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:31.962077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:31.963119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:31.964273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:31.964972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:32.454968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:32.466363 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e2f7468-7f8e-485a-87b5-03a45dab8fe4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1473 microversion: 2.1 time: 0.527298 Nov 02 21:30:32.466955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1183/2244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:31 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1473 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:32.479650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:32.480306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:32.513780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:32.513780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:32.513780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:32.513780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:32.514322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:32.516003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:32.698627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:30:32.699288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:30:32.699521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:30:32.700133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:30:32.701177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:30:32.714072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:32.714805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:32.715373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:32.717332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:32.717958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:32.719076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:32.753838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:32.763402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Getting quotas for user 9f705bbaa94a4a7d8e5bba79214bb359 and project 31580ceeb77c4656a314af62ac3d35c7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:32.853397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:30:32.856309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b519a0e5-6a05-479c-a3bc-3514fa93ab89',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:30:32.923870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:32.947961 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab284531-8223-4d44-9a78-54238f1c47a2 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1472 microversion: 2.1 time: 0.476999 Nov 02 21:30:32.948554 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1184/2245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:32 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1472 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:32.953488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:32.954879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 9ec0e4c5-b974-4e97-b40d-8b54b4d85558] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:32.969882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:32.970388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:32.971087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:32.972240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:32.972835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:32.974427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:32.992854 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] HTTP exception thrown: Instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 could not be found. Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Request method failure captured: Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 HTTP/1.1 Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-10l-VgMU8DIJHOYdzyhVJj25X2_hqonK4TPaVyW-4fufptvYOM_ViEzzo87LF3mmmvZ0QwdRqYtdaCqTOsnzD2EFvi1ltIS028Fxohl5sqBbL-nbj95b5jb-dbvHQInzZF-RtSOpk2FdjHSUw1NgrRNL_QxDW7mO2yuwoSanT7f0 Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:32.994661 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd27a33cdee44680b69336170f3739fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 979116d5dca74e6d90abe23e9033107e Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 could not be found. Nov 02 21:30:32.995696 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9ec0e4c5-b974-4e97-b40d-8b54b4d85558'} Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 could not be found. Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:32.996387 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 could not be found. Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 could not be found. Nov 02 21:30:32.997871 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:32.998693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Returning 404 to user: Instance 9ec0e4c5-b974-4e97-b40d-8b54b4d85558 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:32.998693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b16e00e-3804-4de5-87c2-6f3e1cbfa9fa tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558" status: 404 len: 111 microversion: 2.25 time: 0.046516 Nov 02 21:30:32.998693 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1185/2246] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:32 2022] GET /compute/v2.1/servers/9ec0e4c5-b974-4e97-b40d-8b54b4d85558 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:30:33.005372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c587bbc-3583-4683-ac45-cbb21489c807 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b6878d8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1738287755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfFhWGg2JQeNzkDHXcdY7fx6V6f5tG3LOVMyeI+IfjF7q8lUxhmWGhUFr2Y47q4qm8h7Yo8M/2/vmksHdK6r0qxAjcFFDerze2FZjqvYMe4Ln8b9Cno+ylHR3qpuWRYzw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:33.031349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6c587bbc-3583-4683-ac45-cbb21489c807 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:33.052681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6c587bbc-3583-4683-ac45-cbb21489c807 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:33.152972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c587bbc-3583-4683-ac45-cbb21489c807 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.153290 Nov 02 21:30:33.156195 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1186/2247] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 21:30:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:30:33.162528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-72fa61ea-469a-45ae-b622-b1d090adef91 req-6f304746-393e-4689-9a62-105065b77bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7846a733-f1ef-4257-9bb0-7de4347b3dbe", "name": "network-vif-unplugged", "status": "completed", "tag": "a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:33.177703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-72fa61ea-469a-45ae-b622-b1d090adef91 req-6f304746-393e-4689-9a62-105065b77bc2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.178262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-72fa61ea-469a-45ae-b622-b1d090adef91 req-6f304746-393e-4689-9a62-105065b77bc2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.178695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-72fa61ea-469a-45ae-b622-b1d090adef91 req-6f304746-393e-4689-9a62-105065b77bc2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.192272 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-72fa61ea-469a-45ae-b622-b1d090adef91 req-6f304746-393e-4689-9a62-105065b77bc2 service nova] Creating event network-vif-unplugged:a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59 for instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe on n-h2-860863-4 Nov 02 21:30:33.198791 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-72fa61ea-469a-45ae-b622-b1d090adef91 req-6f304746-393e-4689-9a62-105065b77bc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040685 Nov 02 21:30:33.199456 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1187/2248] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:33.205502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:33.206259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:33.209744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:33.213852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.214487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.215092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.216046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.216727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.217378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.240217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:33.457875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:33.476231 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c37e902-b28c-4ca9-83bc-d4a47ee30dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 0.275454 Nov 02 21:30:33.476836 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1188/2249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:33 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:33.498057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b6702ba-1aa6-4fca-a49c-18aa345a5879 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '.version_select at 0x7f9b6878d790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:33.548627 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-563e0144-ccff-4f09-9df7-6432ff347241 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.475927 Nov 02 21:30:33.558125 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1062/2250] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:30:33.564045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e4221b5-b2f3-4754-93d0-c890fcfae17e tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6875a3a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:33.584360 n-d-860863-4 devstack@n-api.service[121039]: WARNING oslo_db.sqlalchemy.utils [None req-7e4221b5-b2f3-4754-93d0-c890fcfae17e tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 21:30:33.600459 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e4221b5-b2f3-4754-93d0-c890fcfae17e tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.041088 Nov 02 21:30:33.610556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1063/2251] 10.222.0.25 () {60 vars in 1177 bytes} [Wed Nov 2 21:30:33 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:33.611783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b6702ba-1aa6-4fca-a49c-18aa345a5879 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492343248" status: 204 len: 0 microversion: 2.25 time: 0.117944 Nov 02 21:30:33.611783 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1189/2252] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492343248 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:30:33.620361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dd838184-6bc5-4dad-974b-8f85747a3f3b req-19d8b71c-aaf3-498c-95a0-38ab07c36daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7846a733-f1ef-4257-9bb0-7de4347b3dbe", "name": "network-vif-deleted", "tag": "a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:33.631352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:33.633580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:33.639402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dd838184-6bc5-4dad-974b-8f85747a3f3b req-19d8b71c-aaf3-498c-95a0-38ab07c36daa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.640179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dd838184-6bc5-4dad-974b-8f85747a3f3b req-19d8b71c-aaf3-498c-95a0-38ab07c36daa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.640762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dd838184-6bc5-4dad-974b-8f85747a3f3b req-19d8b71c-aaf3-498c-95a0-38ab07c36daa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.648396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.661734 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dd838184-6bc5-4dad-974b-8f85747a3f3b req-19d8b71c-aaf3-498c-95a0-38ab07c36daa service nova] Creating event network-vif-deleted:a4b7eed6-c5d6-4d4b-b3a9-47e09afcdd59 for instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe on n-h2-860863-4 Nov 02 21:30:33.668481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.670651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.674678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.674678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.677977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.690942 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dd838184-6bc5-4dad-974b-8f85747a3f3b req-19d8b71c-aaf3-498c-95a0-38ab07c36daa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079000 Nov 02 21:30:33.699639 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1064/2253] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:33.711526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0043f874-d78a-444f-8bc0-a72a6f5cdeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:33.714556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0043f874-d78a-444f-8bc0-a72a6f5cdeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:33.721518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:33.790370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.791144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.792610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.793544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lazy-loading 'fault' on Instance uuid 7846a733-f1ef-4257-9bb0-7de4347b3dbe {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:33.929840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0043f874-d78a-444f-8bc0-a72a6f5cdeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:33.938886 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0043f874-d78a-444f-8bc0-a72a6f5cdeb4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1052 microversion: 2.1 time: 0.241909 Nov 02 21:30:33.940675 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1065/2254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:33 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1052 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:33.960268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a240e485-ad15-4887-affc-0adaf4a9a9e2 req-4a31e0f4-3f00-4f6e-bcf8-5f8773599b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe6914ac-9e4d-461b-bc1d-eac050f58374", "name": "network-vif-deleted", "tag": "e978550d-f6af-44d1-96d5-b560c099450f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:33.981097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a240e485-ad15-4887-affc-0adaf4a9a9e2 req-4a31e0f4-3f00-4f6e-bcf8-5f8773599b49 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:33.981679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a240e485-ad15-4887-affc-0adaf4a9a9e2 req-4a31e0f4-3f00-4f6e-bcf8-5f8773599b49 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:33.982106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a240e485-ad15-4887-affc-0adaf4a9a9e2 req-4a31e0f4-3f00-4f6e-bcf8-5f8773599b49 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:33.989690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:34.024279 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a240e485-ad15-4887-affc-0adaf4a9a9e2 req-4a31e0f4-3f00-4f6e-bcf8-5f8773599b49 service nova] Creating event network-vif-deleted:e978550d-f6af-44d1-96d5-b560c099450f for instance fe6914ac-9e4d-461b-bc1d-eac050f58374 on n-h1-860863-4 Nov 02 21:30:34.032679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a240e485-ad15-4887-affc-0adaf4a9a9e2 req-4a31e0f4-3f00-4f6e-bcf8-5f8773599b49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089419 Nov 02 21:30:34.033657 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1066/2255] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:34.039897 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf0ac311-74df-4250-8f28-1be116162555 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 200 len: 1307 microversion: 2.1 time: 0.404098 Nov 02 21:30:34.042912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-73f3284a-4526-4a70-81d8-201cf6270443 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6875adc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.051321 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1190/2256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:33 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 1307 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:34.069079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.072969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:34.103130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:34.103654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:34.104105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:34.104834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:34.105337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:34.105774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:34.149115 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-73f3284a-4526-4a70-81d8-201cf6270443 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1738287755" status: 204 len: 0 microversion: 2.2 time: 0.113651 Nov 02 21:30:34.149871 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1067/2257] 10.222.0.25 () {60 vars in 1321 bytes} [Wed Nov 2 21:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1738287755 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:34.159590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74f65763-9d18-433b-8b5c-962d48f8fcb7 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b68727820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.213028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:34.214574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:34.215366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:34.216065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lazy-loading 'fault' on Instance uuid fe6914ac-9e4d-461b-bc1d-eac050f58374 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:34.303878 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-74f65763-9d18-433b-8b5c-962d48f8fcb7 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-579356616" status: 204 len: 0 microversion: 2.2 time: 0.149255 Nov 02 21:30:34.305147 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1068/2258] 10.222.0.25 () {60 vars in 1318 bytes} [Wed Nov 2 21:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-579356616 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:34.313926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc8d854b-b64b-4ebe-ba2c-bb9ff8eccfe7 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b68716a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.463693 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc8d854b-b64b-4ebe-ba2c-bb9ff8eccfe7 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1824665341" status: 204 len: 0 microversion: 2.2 time: 0.154520 Nov 02 21:30:34.464694 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1069/2259] 10.222.0.25 () {60 vars in 1321 bytes} [Wed Nov 2 21:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1824665341 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:30:34.478590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c171ec94-02b0-4ad6-aa57-e41dfe108ed3 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b68724700>, body: {"keypair": {"name": "tempest-keypair-2063150274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcf3UVeSjaHqXloRNubRGNVRXqLNBJyMxc4uesGc1KbUxk041r0ODnZzWwlIEemQGs2aGVuJIJ+7uoZQdGqOSOInsvP6yQJxOwlpjdGrk8tkYZzpY9Dg+wRWCSslSjP9A=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:34.542028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c171ec94-02b0-4ad6-aa57-e41dfe108ed3 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:34.557274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c171ec94-02b0-4ad6-aa57-e41dfe108ed3 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:34.721087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e45337c25e4cd7b72cf2f6b2b2277a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255043a6d5ca4541bb9d597a70075391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:34.725564 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c171ec94-02b0-4ad6-aa57-e41dfe108ed3 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.247107 Nov 02 21:30:34.725564 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1070/2260] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Nov 2 21:30:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:30:34.731378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.734585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:34.738359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-42bfb54b-b9a9-4427-83a6-6a0e56fa5295 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 200 len: 1306 microversion: 2.1 time: 0.684799 Nov 02 21:30:34.739203 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1191/2261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:34 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 1306 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:34.748501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:34.749412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:34.749955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:34.750948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:34.752145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:34.753043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:34.754136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7646d90-87c8-490a-952d-7ef479a39955 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6878dc10>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.775409 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7646d90-87c8-490a-952d-7ef479a39955 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-2063150274" status: 200 len: 513 microversion: 2.2 time: 0.032718 Nov 02 21:30:34.776845 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1192/2262] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 21:30:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2063150274 => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:34.793815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d14ca988-8067-4e1a-8d74-7adc7743b17b tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6d180dc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.803458 n-d-860863-4 devstack@n-api.service[121040]: WARNING oslo_db.sqlalchemy.utils [None req-d14ca988-8067-4e1a-8d74-7adc7743b17b tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 21:30:34.815571 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d14ca988-8067-4e1a-8d74-7adc7743b17b tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.028345 Nov 02 21:30:34.818773 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1193/2263] 10.222.0.25 () {60 vars in 1177 bytes} [Wed Nov 2 21:30:34 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:34.833656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0401ce22-4c75-41f6-9eeb-6e9a8f4fffe9 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6d153160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.977305 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0401ce22-4c75-41f6-9eeb-6e9a8f4fffe9 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063150274" status: 204 len: 0 microversion: 2.2 time: 0.148734 Nov 02 21:30:34.978370 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1194/2264] 10.222.0.25 () {60 vars in 1261 bytes} [Wed Nov 2 21:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063150274 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:34.986218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ceb2151-54a9-4f71-bd2c-526bfb37f885 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:34.987034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ceb2151-54a9-4f71-bd2c-526bfb37f885 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:35.111561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ceb2151-54a9-4f71-bd2c-526bfb37f885 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:35.119764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ceb2151-54a9-4f71-bd2c-526bfb37f885 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1052 microversion: 2.1 time: 0.140161 Nov 02 21:30:35.130612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1195/2265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:34 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1052 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:35.135898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Action: 'create', calling method: .version_select at 0x7f9b6d11e430>, body: {"keypair": {"name": "tempest-keypair-1902903215", "type": "x509"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:35.160300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:35.173361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:35.177611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:35.192269 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa246422-5122-43e7-b6de-e53e5888a6a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 0.464785 Nov 02 21:30:35.193676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.processutils [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmppacnh0md/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppacnh0md/temp.key -subj /CN=4eeae8183adc4fb09fd1cff01404a919 -extensions v3_req_client {{(pid=121040) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 21:30:35.195611 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1071/2266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:34 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:35.207245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:35.208698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 7846a733-f1ef-4257-9bb0-7de4347b3dbe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:35.214978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.215458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.216087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:35.216836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.217327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.217751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:35.244634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe could not be found. Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe HTTP/1.1 Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:35.246558 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe could not be found. Nov 02 21:30:35.247652 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '7846a733-f1ef-4257-9bb0-7de4347b3dbe'} Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe could not be found. Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:35.248264 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe could not be found. Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe could not be found. Nov 02 21:30:35.249345 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:35.250193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance 7846a733-f1ef-4257-9bb0-7de4347b3dbe could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:35.250193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2027db6-29bd-4a79-92f7-9b116fcb9277 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe" status: 404 len: 111 microversion: 2.1 time: 0.051355 Nov 02 21:30:35.250193 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1072/2267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:35 2022] GET /compute/v2.1/servers/7846a733-f1ef-4257-9bb0-7de4347b3dbe => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:35.257523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:35.258072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:35.268184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.268898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.269549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:35.271288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.271964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.273628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:35.336892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:35.494862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.processutils [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmppacnh0md/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmppacnh0md/temp.key -subj /CN=4eeae8183adc4fb09fd1cff01404a919 -extensions v3_req_client" returned: 0 in 0.300s {{(pid=121040) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 21:30:35.497236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.processutils [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmppacnh0md/temp.key -password pass: {{(pid=121040) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 21:30:35.564239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.processutils [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] CMD "openssl pkcs12 -export -inkey /tmp/tmppacnh0md/temp.key -password pass:" returned: 0 in 0.066s {{(pid=121040) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 21:30:35.714741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:35.726511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-569faa8a-e522-4ac3-af6b-b576592ec398 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 204 len: 0 microversion: 2.1 time: 0.472755 Nov 02 21:30:35.727550 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1073/2268] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:35 2022] DELETE /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:35.733333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:35.734269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Getting quotas for user 4eeae8183adc4fb09fd1cff01404a919 and project 0976a7be1fe8472aaad37d3f478700b5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:35.735389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:35.743509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.744403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.745248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:35.746258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.746855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.747494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:35.769348 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89706680-72a0-417f-aca2-dfadd5f1d40f tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.636733 Nov 02 21:30:35.778380 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1196/2269] 10.222.0.25 () {62 vars in 1198 bytes} [Wed Nov 2 21:30:35 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 647 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:35.789972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:35.791005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:35.791875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:35.800605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.801371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.802304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:35.803321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:35.804878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:35.806577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.011814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:36.021285 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df749a44-2d48-4b8e-8598-d0e7dfd4c6b7 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1473 microversion: 2.1 time: 0.241232 Nov 02 21:30:36.021992 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1197/2270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:35 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1473 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:36.026788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:36.027482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] [instance: fe6914ac-9e4d-461b-bc1d-eac050f58374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:36.036047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.036796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.037267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.038154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.038759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.039524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.055937 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] HTTP exception thrown: Instance fe6914ac-9e4d-461b-bc1d-eac050f58374 could not be found. Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Request method failure captured: Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 HTTP/1.1 Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuEYMX_-5Qy9oaJuEP5QuwHdkiuLuIbYN9uEI_OW8qWWv-7LnSkLVwjdLp55F1wSHu0MXoWiXYMc_of6wvhOsGsl0NumL7_dtGe4Y6-pDH-UQc_MCa6jlujT1yFQPORhg_cd7Hp3QDmB8mPtg-yVq-DLAlwS44QsoBbpukTKM5dF8rE Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 255043a6d5ca4541bb9d597a70075391 Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:36.058052 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_255043a6d5ca4541bb9d597a70075391"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/255043a6d5ca4541bb9d597a70075391"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 255043a6d5ca4541bb9d597a70075391 Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1891881214 Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesOneServerTestJSON-1891881214-project Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: d5e45337c25e4cd7b72cf2f6b2b2277a Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesOneServerTestJSON-1891881214-project Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance fe6914ac-9e4d-461b-bc1d-eac050f58374 could not be found. Nov 02 21:30:36.059110 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'fe6914ac-9e4d-461b-bc1d-eac050f58374'} Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe6914ac-9e4d-461b-bc1d-eac050f58374 could not be found. Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:36.059766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe6914ac-9e4d-461b-bc1d-eac050f58374 could not be found. Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe6914ac-9e4d-461b-bc1d-eac050f58374 could not be found. Nov 02 21:30:36.060685 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:36.066599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] Returning 404 to user: Instance fe6914ac-9e4d-461b-bc1d-eac050f58374 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:36.066599 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6936e4fc-7546-4c0c-a9c4-676b38580b62 tempest-ImagesOneServerTestJSON-1891881214 tempest-ImagesOneServerTestJSON-1891881214-project] 10.222.0.25 "GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374" status: 404 len: 111 microversion: 2.1 time: 0.037755 Nov 02 21:30:36.066599 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1198/2271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:36 2022] GET /compute/v2.1/servers/fe6914ac-9e4d-461b-bc1d-eac050f58374 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:36.069132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-973aea31-c110-448a-9097-ef30d51fb3a1 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b695088b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:36.100645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-973aea31-c110-448a-9097-ef30d51fb3a1 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs/tempest-keypair-1902903215" status: 200 len: 1534 microversion: 2.2 time: 0.035895 Nov 02 21:30:36.101890 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1199/2272] 10.222.0.25 () {60 vars in 1258 bytes} [Wed Nov 2 21:30:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1902903215 => generated 1534 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:36.108808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-79693029-453d-4df6-9e55-960a41408ed5 req-8be7d653-b470-44fa-8020-4f68bcefbcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215e245d-4a95-4290-8fe6-4254c8f2cea9", "tag": "f41895c4-2ac3-4ebd-a940-d92bb8f69363"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:36.126998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-79693029-453d-4df6-9e55-960a41408ed5 req-8be7d653-b470-44fa-8020-4f68bcefbcda service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.127626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-79693029-453d-4df6-9e55-960a41408ed5 req-8be7d653-b470-44fa-8020-4f68bcefbcda service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.128874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-79693029-453d-4df6-9e55-960a41408ed5 req-8be7d653-b470-44fa-8020-4f68bcefbcda service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.143631 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-79693029-453d-4df6-9e55-960a41408ed5 req-8be7d653-b470-44fa-8020-4f68bcefbcda service nova] Creating event network-changed:f41895c4-2ac3-4ebd-a940-d92bb8f69363 for instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 on n-h2-860863-4 Nov 02 21:30:36.154666 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-79693029-453d-4df6-9e55-960a41408ed5 req-8be7d653-b470-44fa-8020-4f68bcefbcda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049333 Nov 02 21:30:36.155967 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1200/2273] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:36.164787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2fc619f-97f7-4496-ae7d-c59271fb214c tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b6d180a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:36.169695 n-d-860863-4 devstack@n-api.service[121040]: WARNING oslo_db.sqlalchemy.utils [None req-e2fc619f-97f7-4496-ae7d-c59271fb214c tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 21:30:36.181253 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2fc619f-97f7-4496-ae7d-c59271fb214c tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.023547 Nov 02 21:30:36.181957 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1201/2274] 10.222.0.25 () {60 vars in 1177 bytes} [Wed Nov 2 21:30:36 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:36.186984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:36.188223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:36.196570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.197816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.198633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.199562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.200227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.200752 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe509d4f-fe4f-4921-af83-0b1b80b5a793 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 204 len: 0 microversion: 2.25 time: 0.471039 Nov 02 21:30:36.201030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.203202 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1074/2275] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:30:35 2022] DELETE /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:30:36.213839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-049ff6e5-faa4-4c73-9482-0caa2ca4ca79 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] Calling method '.version_select at 0x7f9b68762ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:36.303951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:36.317315 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-62ee8cfc-b945-4e72-a867-8c4b12d78a8f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1150 microversion: 2.1 time: 0.133252 Nov 02 21:30:36.318691 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1202/2276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:36 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:36.341100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:36.342166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:36.356452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.357200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.358443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.359793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.360362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.363602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.387942 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-049ff6e5-faa4-4c73-9482-0caa2ca4ca79 tempest-KeyPairsV22TestJSON-334837112 tempest-KeyPairsV22TestJSON-334837112-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902903215" status: 204 len: 0 microversion: 2.2 time: 0.181254 Nov 02 21:30:36.388747 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1075/2277] 10.222.0.25 () {60 vars in 1261 bytes} [Wed Nov 2 21:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902903215 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:36.406943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:36.411837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:36.454800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.458416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.460471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.462722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:36.467074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:36.470793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:36.843317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:36.843869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:36.853900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:36.855361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:36.859427 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a85967b-516d-48df-99a7-1bf35ccfd7b5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 0.469105 Nov 02 21:30:36.860109 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1076/2278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:36 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:36.862957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee9bc0f0-506f-4c3c-95b3-dc592ec8178d tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1547 microversion: 2.25 time: 0.542150 Nov 02 21:30:36.867010 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1203/2279] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:36 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1547 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:37.048456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:37.049113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:37.058398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.059392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.061342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:37.062367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.063031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.063785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:37.351278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:37.355529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:37.357910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:37.362761 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-626f5db0-106f-4a2a-bc06-b609b432cae6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1473 microversion: 2.1 time: 0.319542 Nov 02 21:30:37.363713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1077/2280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:37 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:37.379825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.381041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.381705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:37.382576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.383067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.383500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:37.481770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:37.513079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4695565c-4ea0-452c-94d7-b3aafcca3c0d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1168 microversion: 2.1 time: 0.165689 Nov 02 21:30:37.514411 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1204/2281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:37 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1168 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:37.892094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:37.892733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:37.911508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:37.917231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:37.926330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.926833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.927277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:37.938840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.939677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.940208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.940654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:37.941016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.941613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:37.951147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:37.952009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:37.952592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:38.343903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:38.360385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:38.365420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:38.374015 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08b12321-e0cf-42f3-9203-609406fbb208 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1547 microversion: 2.25 time: 0.485696 Nov 02 21:30:38.376043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1205/2282] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:37 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1547 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:38.401252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5b1135de-9ae4-4c11-8ff8-792d94b79a91 req-380d71d1-3b82-4db8-8c0f-51e3d52fd5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221549fd-857c-4d49-a920-83630b845538", "name": "network-vif-deleted", "tag": "9b35c9b8-b7d7-446b-b58d-51f56e732f51"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:38.459317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b1135de-9ae4-4c11-8ff8-792d94b79a91 req-380d71d1-3b82-4db8-8c0f-51e3d52fd5b1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:38.461135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b1135de-9ae4-4c11-8ff8-792d94b79a91 req-380d71d1-3b82-4db8-8c0f-51e3d52fd5b1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:38.465083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b1135de-9ae4-4c11-8ff8-792d94b79a91 req-380d71d1-3b82-4db8-8c0f-51e3d52fd5b1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:38.520227 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5b1135de-9ae4-4c11-8ff8-792d94b79a91 req-380d71d1-3b82-4db8-8c0f-51e3d52fd5b1 service nova] Creating event network-vif-deleted:9b35c9b8-b7d7-446b-b58d-51f56e732f51 for instance 221549fd-857c-4d49-a920-83630b845538 on n-h2-860863-4 Nov 02 21:30:38.564489 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5b1135de-9ae4-4c11-8ff8-792d94b79a91 req-380d71d1-3b82-4db8-8c0f-51e3d52fd5b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173579 Nov 02 21:30:38.582003 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1206/2283] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:38.599823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:38.620244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:38.642489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:38.643354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:38.648909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:38.651065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:38.652687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:38.656527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:39.045942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:39.068502 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dca6e525-b4f0-41bf-a0de-c27b965cb767 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 200 len: 1431 microversion: 2.1 time: 0.482142 Nov 02 21:30:39.074295 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1207/2284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:38 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 1431 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:39.100620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:39.105416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:39.128433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:39.131111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:39.132822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:39.133905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:39.135715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:39.139872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:39.277180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:39.290790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-33198f04-9358-48e8-b591-7174b9a2106e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 1.411186 Nov 02 21:30:39.308004 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1078/2285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:37 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:39.407646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:39.408211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:39.425136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:39.429260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:39.430680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:39.430798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:39.431537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:39.437058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:39.439382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:39.451754 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e174ef0-d662-46a8-98fc-d56a2f493247 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1168 microversion: 2.1 time: 0.375643 Nov 02 21:30:39.452782 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1208/2286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:39 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1168 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:40.000163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:40.015411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:40.016916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:40.026681 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d7484dd-cc9f-4c08-80d3-9fdee63c9d57 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1547 microversion: 2.25 time: 0.623803 Nov 02 21:30:40.027472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1079/2287] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:39 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1547 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:40.095989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:40.097340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 221549fd-857c-4d49-a920-83630b845538] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:40.114339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.117883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.120160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:40.121315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.125673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.127514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:40.172527 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance 221549fd-857c-4d49-a920-83630b845538 could not be found. Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 HTTP/1.1 Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:40.183526 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 221549fd-857c-4d49-a920-83630b845538 could not be found. Nov 02 21:30:40.184593 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '221549fd-857c-4d49-a920-83630b845538'} Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 221549fd-857c-4d49-a920-83630b845538 could not be found. Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:40.185226 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221549fd-857c-4d49-a920-83630b845538 could not be found. Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221549fd-857c-4d49-a920-83630b845538 could not be found. Nov 02 21:30:40.186383 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:40.190062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance 221549fd-857c-4d49-a920-83630b845538 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:40.195158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03827a0b-e4c8-4b1b-8d3c-2a1b99e1b9a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538" status: 404 len: 111 microversion: 2.1 time: 0.104813 Nov 02 21:30:40.196319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1209/2288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:40 2022] GET /compute/v2.1/servers/221549fd-857c-4d49-a920-83630b845538 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:40.206204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:40.206993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:40.220262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.222871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.230102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:40.231151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.231806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.232667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:40.298056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:40.303507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:40.313781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:40.314425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:40.322100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.322603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.328108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:40.336165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.336694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.339832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:40.844368 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9143f9a9-61e6-4661-b56b-f14ce090e274 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d" status: 204 len: 0 microversion: 2.1 time: 0.643657 Nov 02 21:30:40.846365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1080/2289] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:40 2022] DELETE /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:40.856788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:40.858617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:40.882159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.882663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.888719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:40.889911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:40.891183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:40.893413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:42.155337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:42.176618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8bd2ef67-10ae-4ea0-bd58-59c6f66f104d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 1.866050 Nov 02 21:30:42.177267 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1210/2290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:40 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:42.203548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:42.204424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:42.222535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:42.223587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:42.224039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:42.226516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:42.226516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:42.226516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:42.310717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:42.739849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:42.792184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c20ffbc-6575-48df-8389-63dd34c4e728 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 204 len: 0 microversion: 2.1 time: 0.604841 Nov 02 21:30:42.792811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1211/2291] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:42 2022] DELETE /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:42.798672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:42.799103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:42.817861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:42.818555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:42.819024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:42.819769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:42.820223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:42.820665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:42.877337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:42.880074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:42.880816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:42.881489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lazy-loading 'fault' on Instance uuid c0a35e18-355f-4fc3-ab55-c9546c8bfb42 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:42.982418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:42.992691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:42.998032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:43.000179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:43.001658 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b966feb5-0c44-470b-ac34-88c430dd4b3c tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 200 len: 1351 microversion: 2.25 time: 0.205599 Nov 02 21:30:43.025328 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1212/2292] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:42 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 1351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:43.026203 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5d3b5869-0770-49c3-a4fa-2c19a6036cf3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1210 microversion: 2.1 time: 2.177771 Nov 02 21:30:43.027318 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1081/2293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:40 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1210 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:43.031812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b908f210-b3ad-4c73-8bbe-c51e11f52120 req-061fe3df-dc7a-4e90-afe0-67ad403ba90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a35e18-355f-4fc3-ab55-c9546c8bfb42", "name": "network-vif-deleted", "tag": "97b6314e-b34f-4ab8-93c1-efdbbe8346b3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:43.034916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:43.037349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:43.057412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b908f210-b3ad-4c73-8bbe-c51e11f52120 req-061fe3df-dc7a-4e90-afe0-67ad403ba90b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:43.057601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:43.057902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b908f210-b3ad-4c73-8bbe-c51e11f52120 req-061fe3df-dc7a-4e90-afe0-67ad403ba90b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:43.058004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:43.058340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b908f210-b3ad-4c73-8bbe-c51e11f52120 req-061fe3df-dc7a-4e90-afe0-67ad403ba90b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:43.058437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:43.064278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:43.064438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:43.066126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:43.067681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:43.075771 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b908f210-b3ad-4c73-8bbe-c51e11f52120 req-061fe3df-dc7a-4e90-afe0-67ad403ba90b service nova] Creating event network-vif-deleted:97b6314e-b34f-4ab8-93c1-efdbbe8346b3 for instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 on n-h2-860863-4 Nov 02 21:30:43.082563 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b908f210-b3ad-4c73-8bbe-c51e11f52120 req-061fe3df-dc7a-4e90-afe0-67ad403ba90b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054475 Nov 02 21:30:43.084616 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1213/2294] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:43.378576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Calling method '.version_select at 0x7f9b6d2baee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:43.412040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:43.412547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:43.413023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:43.415991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:43.418954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:43.419416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:43.498182 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6d1a527-7947-415d-9627-42c9a81246f8 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] 10.222.0.25 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.411333 Nov 02 21:30:43.499638 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1214/2295] 10.222.0.25 () {58 vars in 1122 bytes} [Wed Nov 2 21:30:43 2022] GET /compute/v2.1/limits => generated 511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:43.516164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:43.519336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:43.553288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:43.554923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:43.558160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:43.558948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:43.559427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:43.571918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:43.818523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:43.834723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e605305-05db-407c-953e-c4c2cb4a418b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d" status: 200 len: 1474 microversion: 2.1 time: 0.806179 Nov 02 21:30:43.835964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1082/2296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:43 2022] GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d => generated 1474 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:43.855837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-180999904", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:44.022010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:30:44.398621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:44.412825 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99112bbe-4bad-4c21-8166-34c0e0f96a09 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 0.911662 Nov 02 21:30:44.414105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1215/2297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:43 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:44.432262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:44.433319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: c0a35e18-355f-4fc3-ab55-c9546c8bfb42] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:44.443880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:44.444920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:44.445582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:44.446554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:44.447190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:44.447801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:44.481004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] HTTP exception thrown: Instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 could not be found. Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Request method failure captured: Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 HTTP/1.1 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-10l-VgMU8DIJHOYdzyhVJj25X2_hqonK4TPaVyW-4fufptvYOM_ViEzzo87LF3mmmvZ0QwdRqYtdaCqTOsnzD2EFvi1ltIS028Fxohl5sqBbL-nbj95b5jb-dbvHQInzZF-RtSOpk2FdjHSUw1NgrRNL_QxDW7mO2yuwoSanT7f0 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd27a33cdee44680b69336170f3739fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 979116d5dca74e6d90abe23e9033107e Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 could not be found. Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'c0a35e18-355f-4fc3-ab55-c9546c8bfb42'} Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 could not be found. Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 could not be found. Nov 02 21:30:44.484666 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 could not be found. Nov 02 21:30:44.487765 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.495331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Returning 404 to user: Instance c0a35e18-355f-4fc3-ab55-c9546c8bfb42 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:44.503312 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-18dbce7d-2f64-42d2-b534-990bce53f745 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42" status: 404 len: 111 microversion: 2.25 time: 0.075583 Nov 02 21:30:44.503312 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1216/2298] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:44 2022] GET /compute/v2.1/servers/c0a35e18-355f-4fc3-ab55-c9546c8bfb42 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:30:44.507392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:44.508265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:44.517451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:44.519443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:44.520268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:44.520900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:44.521831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:44.522686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:44.523690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:44.577937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=22 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:44.836438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Getting quotas for project cda09773e0264f6e822f1fc47d3a236a. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:44.858357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Getting quotas for user 4e4d0948931c41adb840f4ff29721e65 and project cda09773e0264f6e822f1fc47d3a236a. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:44.911364 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Request method failure captured: Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 1751 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGCuGv33nxO98ytm712ckhhnvGebgV9mNK4Gc4U29S-d9qcqqDtM71jDfkMqQZE3lOnVVxtl4uoBpzQT0zzElaI-dp_fmMSXgV-WzvB8P0KZ-ixDgDbg-szcugVuCUCRQWZU3MXHno-SUqkLX_IBpHZ-UzXulHEZwBW00DLYpxY81I Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: cda09773e0264f6e822f1fc47d3a236a Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-187484410 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cda09773e0264f6e822f1fc47d3a236a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cda09773e0264f6e822f1fc47d3a236a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cda09773e0264f6e822f1fc47d3a236a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cda09773e0264f6e822f1fc47d3a236a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-187484410 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: cda09773e0264f6e822f1fc47d3a236a Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-187484410 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-187484410-project Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e4d0948931c41adb840f4ff29721e65 Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-187484410-project Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-180999904", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:44.913706 n-d-860863-4 devstack@n-api.service[121039]: exception: Maximum number of metadata items exceeds 128 Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-180999904', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:30:44.915759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 02 21:30:44.918529 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:44.927971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:44.929105 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6ab1208f-3471-4e81-a469-505dcde44173 tempest-AbsoluteLimitsNegativeTestJSON-187484410 tempest-AbsoluteLimitsNegativeTestJSON-187484410-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.091979 Nov 02 21:30:44.930150 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1083/2299] 10.222.0.25 () {60 vars in 1148 bytes} [Wed Nov 2 21:30:43 2022] POST /compute/v2.1/servers => generated 87 bytes in 1093 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:30:44.935155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:44.940785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:44.955408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:44.956108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:44.961652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:44.962821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:44.963444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:44.964034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:45.034277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:45.258189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:45.270039 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-371a5e85-54fd-41fd-81be-4e498d3ed2ee tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1210 microversion: 2.1 time: 0.769175 Nov 02 21:30:45.271078 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1217/2300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:44 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1210 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:45.296245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:45.298724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:45.305352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:45.306143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:45.307009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:45.309408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:45.310139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:45.310734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:45.565053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-458c6c01-d83d-419e-9aef-8273708527d5 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "DELETE /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 204 len: 0 microversion: 2.25 time: 0.633388 Nov 02 21:30:45.565912 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1084/2301] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:30:44 2022] DELETE /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:30:45.573308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:45.576602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:45.609283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:45.610132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:45.610807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:45.611802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:45.612748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:45.614080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:46.068668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:46.083384 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bb54d8e4-4596-4c08-a66a-04d64e7c64a3 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d" status: 200 len: 1432 microversion: 2.1 time: 0.793713 Nov 02 21:30:46.093085 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1218/2302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:45 2022] GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d => generated 1432 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:46.097493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:46.104043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:46.117613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:46.118112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:46.118615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:46.122884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:46.124052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:46.125137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:46.751125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:46.768440 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-20f5fadf-f88d-4ccd-92d5-ebaafb16bea4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 1.199046 Nov 02 21:30:46.770943 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1085/2303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:45 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:46.783877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8ad17bc8-6ace-4511-8409-ab22a4bc182d req-94e93f50-8cc1-42e3-8211-5d6837d324f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41aafd7d-7290-4d69-9aea-e0a65ae42c38", "tag": "5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:46.822192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8ad17bc8-6ace-4511-8409-ab22a4bc182d req-94e93f50-8cc1-42e3-8211-5d6837d324f6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:46.831849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8ad17bc8-6ace-4511-8409-ab22a4bc182d req-94e93f50-8cc1-42e3-8211-5d6837d324f6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:46.833715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8ad17bc8-6ace-4511-8409-ab22a4bc182d req-94e93f50-8cc1-42e3-8211-5d6837d324f6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:46.876961 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8ad17bc8-6ace-4511-8409-ab22a4bc182d req-94e93f50-8cc1-42e3-8211-5d6837d324f6 service nova] Creating event network-changed:5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02 for instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 on n-h1-860863-4 Nov 02 21:30:46.892671 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8ad17bc8-6ace-4511-8409-ab22a4bc182d req-94e93f50-8cc1-42e3-8211-5d6837d324f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115984 Nov 02 21:30:46.893916 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1086/2304] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:46.912691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-10db4017-6fe6-48e0-a24a-3ea3477da51f req-87debbcc-6f4e-4a8d-a4cc-ba01255dfba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215e245d-4a95-4290-8fe6-4254c8f2cea9", "name": "network-vif-plugged", "status": "completed", "tag": "f41895c4-2ac3-4ebd-a940-d92bb8f69363"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:46.951272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-10db4017-6fe6-48e0-a24a-3ea3477da51f req-87debbcc-6f4e-4a8d-a4cc-ba01255dfba6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:46.951845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-10db4017-6fe6-48e0-a24a-3ea3477da51f req-87debbcc-6f4e-4a8d-a4cc-ba01255dfba6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:46.952279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-10db4017-6fe6-48e0-a24a-3ea3477da51f req-87debbcc-6f4e-4a8d-a4cc-ba01255dfba6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:46.970180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:46.985785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:46.996582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:46.996794 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-10db4017-6fe6-48e0-a24a-3ea3477da51f req-87debbcc-6f4e-4a8d-a4cc-ba01255dfba6 service nova] Creating event network-vif-plugged:f41895c4-2ac3-4ebd-a940-d92bb8f69363 for instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 on n-h2-860863-4 Nov 02 21:30:46.998738 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5be8e6d6-869d-4d10-9910-864aeaa531d9 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1563 microversion: 2.25 time: 0.912840 Nov 02 21:30:47.010047 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1219/2305] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:46 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1563 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:47.010047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:47.010047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:47.031979 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-10db4017-6fe6-48e0-a24a-3ea3477da51f req-87debbcc-6f4e-4a8d-a4cc-ba01255dfba6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134514 Nov 02 21:30:47.053842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:47.054956 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1087/2306] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:47.057756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:47.062290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:47.063519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:47.075514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:47.078304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c607d57d-d338-4d6b-afd1-b78c81544af9 req-46470951-afa7-4596-9581-2134021b3a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c881bde-f1ab-4c45-a6dd-42020aea198d", "name": "network-vif-deleted", "tag": "242c0afd-9bc4-4ea2-be71-4509c923baa6"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:47.079554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:47.143507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c607d57d-d338-4d6b-afd1-b78c81544af9 req-46470951-afa7-4596-9581-2134021b3a11 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:47.147582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c607d57d-d338-4d6b-afd1-b78c81544af9 req-46470951-afa7-4596-9581-2134021b3a11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:47.151898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c607d57d-d338-4d6b-afd1-b78c81544af9 req-46470951-afa7-4596-9581-2134021b3a11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:47.181342 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c607d57d-d338-4d6b-afd1-b78c81544af9 req-46470951-afa7-4596-9581-2134021b3a11 service nova] Creating event network-vif-deleted:242c0afd-9bc4-4ea2-be71-4509c923baa6 for instance 5c881bde-f1ab-4c45-a6dd-42020aea198d on n-h1-860863-4 Nov 02 21:30:47.197161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c607d57d-d338-4d6b-afd1-b78c81544af9 req-46470951-afa7-4596-9581-2134021b3a11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141320 Nov 02 21:30:47.206810 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1088/2307] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:47.221724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:47.227053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:47.244998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=1,nova_api:UPDATE=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:47.265508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:47.265790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:47.266249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:47.266998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:47.272145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:47.272648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:47.392480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:47.393178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:47.395953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:47.396919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lazy-loading 'fault' on Instance uuid 5c881bde-f1ab-4c45-a6dd-42020aea198d {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:48.171367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:48.211518 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a2a7a4f-74f0-4ce1-830f-21ee7b5b1c23 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d" status: 200 len: 1309 microversion: 2.1 time: 1.002629 Nov 02 21:30:48.214712 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1089/2308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:47 2022] GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d => generated 1309 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:48.227185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:48.231265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:48.251797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:48.254671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:48.256809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:48.257792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:48.260532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:48.263062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:48.382423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:48.423139 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-68f38403-69fa-4c63-9aaa-a6adaaec8106 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1210 microversion: 2.1 time: 1.421428 Nov 02 21:30:48.428810 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1220/2309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:46 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1210 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:48.440811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:48.441068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:48.449075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:48.449863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:48.451522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:48.452425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:48.455902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:48.456732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:48.702951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:48.717383 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f7f75a2-2bd8-4352-bc77-5e445425d5ec tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1315 microversion: 2.1 time: 0.499357 Nov 02 21:30:48.721505 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1090/2310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:48 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:48.913796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:48.932986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:48.941310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:48.942748 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a367909c-d3ff-4305-a8f6-5a18ea95f2b2 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1563 microversion: 2.25 time: 0.511094 Nov 02 21:30:48.966816 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1221/2311] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:48 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1563 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:49.248268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:49.249802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 5c881bde-f1ab-4c45-a6dd-42020aea198d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:49.270736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.272792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.276441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.281367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.281910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.282541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.335376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-23747ee2-1b9d-44b8-8733-c15090ff7774 req-2b33dac2-f9ee-4ac6-a923-3a3accb3b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00475509-983d-47f1-a9c9-30f182d29331", "name": "network-vif-deleted", "tag": "5f11fb95-f5af-4521-8a52-4f12e5237f3e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:49.336916 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance 5c881bde-f1ab-4c45-a6dd-42020aea198d could not be found. Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d HTTP/1.1 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 5c881bde-f1ab-4c45-a6dd-42020aea198d could not be found. Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '5c881bde-f1ab-4c45-a6dd-42020aea198d'} Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c881bde-f1ab-4c45-a6dd-42020aea198d could not be found. Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c881bde-f1ab-4c45-a6dd-42020aea198d could not be found. Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:49.342932 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.346935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:49.346935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:49.346935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:49.346935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:49.346935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:49.346935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c881bde-f1ab-4c45-a6dd-42020aea198d could not be found. Nov 02 21:30:49.346935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.350131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance 5c881bde-f1ab-4c45-a6dd-42020aea198d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:49.353086 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2f0ee84-f7e7-46fd-85ac-00f54de219cf tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d" status: 404 len: 111 microversion: 2.1 time: 0.115620 Nov 02 21:30:49.357249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-23747ee2-1b9d-44b8-8733-c15090ff7774 req-2b33dac2-f9ee-4ac6-a923-3a3accb3b9c1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.365467 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1091/2312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:49 2022] GET /compute/v2.1/servers/5c881bde-f1ab-4c45-a6dd-42020aea198d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:49.385471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-23747ee2-1b9d-44b8-8733-c15090ff7774 req-2b33dac2-f9ee-4ac6-a923-3a3accb3b9c1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.385471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-23747ee2-1b9d-44b8-8733-c15090ff7774 req-2b33dac2-f9ee-4ac6-a923-3a3accb3b9c1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.386096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:49.386096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 00475509-983d-47f1-a9c9-30f182d29331] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:49.399139 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-23747ee2-1b9d-44b8-8733-c15090ff7774 req-2b33dac2-f9ee-4ac6-a923-3a3accb3b9c1 service nova] Creating event network-vif-deleted:5f11fb95-f5af-4521-8a52-4f12e5237f3e for instance 00475509-983d-47f1-a9c9-30f182d29331 on n-h2-860863-4 Nov 02 21:30:49.411819 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-23747ee2-1b9d-44b8-8733-c15090ff7774 req-2b33dac2-f9ee-4ac6-a923-3a3accb3b9c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080849 Nov 02 21:30:49.416952 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1222/2313] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:49.417604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.418655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.420130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.425466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.426686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.427143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.466958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:49.467212 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance 00475509-983d-47f1-a9c9-30f182d29331 could not be found. Nov 02 21:30:49.472555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 HTTP/1.1 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 00475509-983d-47f1-a9c9-30f182d29331 could not be found. Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '00475509-983d-47f1-a9c9-30f182d29331'} Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00475509-983d-47f1-a9c9-30f182d29331 could not be found. Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00475509-983d-47f1-a9c9-30f182d29331 could not be found. Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:49.474428 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00475509-983d-47f1-a9c9-30f182d29331 could not be found. Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance 00475509-983d-47f1-a9c9-30f182d29331 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:49.484749 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4289d573-3f0b-4275-a3ab-8fa08e2bb73e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331" status: 404 len: 111 microversion: 2.1 time: 0.110430 Nov 02 21:30:49.486278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.486278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.486278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.486912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.487500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.488071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.491118 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1092/2314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:49 2022] GET /compute/v2.1/servers/00475509-983d-47f1-a9c9-30f182d29331 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:30:49.509076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-830fb62b-5ede-485a-911b-b8feeed21a00 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:49.692500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-830fb62b-5ede-485a-911b-b8feeed21a00 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/35583db5-9d7d-49be-a89e-efecc8c8a4ef" status: 204 len: 0 microversion: 2.1 time: 0.199672 Nov 02 21:30:49.693277 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1093/2315] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:30:49 2022] DELETE /compute/v2.1/os-server-groups/35583db5-9d7d-49be-a89e-efecc8c8a4ef => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:49.701899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:49.702677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:49.733880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.741233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.745877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.746948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:49.747621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:49.748230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:49.851612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:49.933357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:49.951276 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6dc187bd-5528-459a-8dbd-3cc16d95079e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1210 microversion: 2.1 time: 0.485855 Nov 02 21:30:49.952329 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1223/2316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:49 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1210 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:49.979780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:49.980504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:49.997086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:50.003473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:50.004596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:50.006264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:50.007215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:50.007686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:50.355558 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-76137be8-82d6-4af5-aeea-5a074bdb918b tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8" status: 204 len: 0 microversion: 2.1 time: 0.655873 Nov 02 21:30:50.359293 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1094/2317] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:49 2022] DELETE /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:30:50.380843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:50.392498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:50.406294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:50.406852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:50.407350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:50.408083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:50.410637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:50.411449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:50.515440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:50.528234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:50.540769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '979116d5dca74e6d90abe23e9033107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd27a33cdee44680b69336170f3739fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:50.548988 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a406524-5009-400d-b531-10175908e53a tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 200 len: 1521 microversion: 2.25 time: 0.188219 Nov 02 21:30:50.551324 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1095/2318] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:50 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:30:50.558124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:50.560752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:50.579521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:50.580548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:50.580650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:50.581442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:50.584869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:50.585813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:50.634866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:30:50.635054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:50.644991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:50.645244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b58bc86b-2110-4dd0-ab46-77b21a34d2ac tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1500 microversion: 2.1 time: 0.677068 Nov 02 21:30:50.651565 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1224/2319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:49 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1500 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:51.060100 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97867602-d2ec-46b1-9bb2-465ac34562c1 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 204 len: 0 microversion: 2.1 time: 0.507056 Nov 02 21:30:51.061659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1096/2320] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:30:50 2022] DELETE /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:30:51.071918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7a0e8281-2ff0-43a8-8133-0d184f6247f6 req-04edb180-03da-40c3-96d3-95e2deea05e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95785582-f8b6-4b0e-8939-cba2ddb6fe80", "name": "network-vif-deleted", "tag": "6e1dd69a-dd9f-47e1-8de2-606043e416cd"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:51.092099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a0e8281-2ff0-43a8-8133-0d184f6247f6 req-04edb180-03da-40c3-96d3-95e2deea05e3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:51.096208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a0e8281-2ff0-43a8-8133-0d184f6247f6 req-04edb180-03da-40c3-96d3-95e2deea05e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:51.097319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a0e8281-2ff0-43a8-8133-0d184f6247f6 req-04edb180-03da-40c3-96d3-95e2deea05e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:51.126664 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7a0e8281-2ff0-43a8-8133-0d184f6247f6 req-04edb180-03da-40c3-96d3-95e2deea05e3 service nova] Creating event network-vif-deleted:6e1dd69a-dd9f-47e1-8de2-606043e416cd for instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 on n-h2-860863-4 Nov 02 21:30:51.137770 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7a0e8281-2ff0-43a8-8133-0d184f6247f6 req-04edb180-03da-40c3-96d3-95e2deea05e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072516 Nov 02 21:30:51.140589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1097/2321] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:51.164264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:51.168541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:51.250875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:51.254873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:51.255358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:51.264027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:51.266737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:51.267229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:51.430455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'flavor' on Instance uuid 215e245d-4a95-4290-8fe6-4254c8f2cea9 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:51.492438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-766353364", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "4d056cf3-2cf4-488a-ac62-ebd040361946"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:51.759320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] validate_networks() for [('4d056cf3-2cf4-488a-ac62-ebd040361946', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:30:52.529881 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8e91688-0a4b-45b8-893b-3401dd80d9fa tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9/action" status: 202 len: 0 microversion: 2.1 time: 1.361405 Nov 02 21:30:52.538025 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1098/2322] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:30:51 2022] POST /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9/action => generated 0 bytes in 1395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:30:52.564706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:52.575668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:52.601026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:52.601026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:52.601026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:52.601026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:52.612739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:52.614140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:53.411817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=36 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:53.441255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:30:53.946673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:53.962235 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98ae051b-9ceb-4613-af4a-3fe3ebd07ae0 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 1.416567 Nov 02 21:30:53.966496 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1099/2323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:52 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:53.979242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:53.981440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:53.999040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.002941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.004162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.016498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.016498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.016498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.242614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:30:54.248728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:30:54.248728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:30:54.248728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:30:54.248728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:30:54.262499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.263222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.263838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.264863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.265508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.266091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.305249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Getting quotas for project f4220305b3ee4058b8a08d8aa5a45488. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:30:54.315751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Getting quotas for user 52d8d6530c0d47398b1ffb58db0da2ae and project f4220305b3ee4058b8a08d8aa5a45488. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:30:54.345592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:30:54.349047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:30:54.534682 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-978645d5-4e85-42c6-9a2c-59ec24e8a739 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.880445 Nov 02 21:30:54.543823 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1225/2324] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:30:54.549713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:54.550815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] [instance: 95785582-f8b6-4b0e-8939-cba2ddb6fe80] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:54.558916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.559790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.560451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.561443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.562101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.562732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.599023 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] HTTP exception thrown: Instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 could not be found. Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Request method failure captured: Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 HTTP/1.1 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYt-10l-VgMU8DIJHOYdzyhVJj25X2_hqonK4TPaVyW-4fufptvYOM_ViEzzo87LF3mmmvZ0QwdRqYtdaCqTOsnzD2EFvi1ltIS028Fxohl5sqBbL-nbj95b5jb-dbvHQInzZF-RtSOpk2FdjHSUw1NgrRNL_QxDW7mO2yuwoSanT7f0 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd27a33cdee44680b69336170f3739fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd27a33cdee44680b69336170f3739fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: bd27a33cdee44680b69336170f3739fe Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628 Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 979116d5dca74e6d90abe23e9033107e Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1076954628-project Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 could not be found. Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '95785582-f8b6-4b0e-8939-cba2ddb6fe80'} Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 could not be found. Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 could not be found. Nov 02 21:30:54.601042 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 could not be found. Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] Returning 404 to user: Instance 95785582-f8b6-4b0e-8939-cba2ddb6fe80 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-673f7893-3fd3-4ba8-8e1f-18aa01de28c4 tempest-LiveAutoBlockMigrationV225Test-1076954628 tempest-LiveAutoBlockMigrationV225Test-1076954628-project] 10.222.0.25 "GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80" status: 404 len: 111 microversion: 2.25 time: 0.058059 Nov 02 21:30:54.609835 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1226/2325] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:30:54 2022] GET /compute/v2.1/servers/95785582-f8b6-4b0e-8939-cba2ddb6fe80 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:30:54.619654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:54.620714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:54.630625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.631489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.632300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.635689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:54.635689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:54.635689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:54.697932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:54.708083 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fc0df67-9a18-441b-ba44-c5dfbeb2e463 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8" status: 200 len: 1474 microversion: 2.1 time: 0.740207 Nov 02 21:30:54.712954 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1100/2326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:53 2022] GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 => generated 1474 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:54.726913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae4099b8-d4d4-4e7d-87d2-86c5372273e3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:54.727785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae4099b8-d4d4-4e7d-87d2-86c5372273e3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:55.083707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae4099b8-d4d4-4e7d-87d2-86c5372273e3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:55.102222 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae4099b8-d4d4-4e7d-87d2-86c5372273e3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1216 microversion: 2.1 time: 0.386230 Nov 02 21:30:55.104040 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1101/2327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:54 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1216 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:55.117900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:55.128662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:55.131914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:55.132581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:55.133242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:55.134118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:55.134716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:55.135343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:55.534776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:55.563954 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-051af74a-db5f-4ee8-884f-960da889faee tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.952486 Nov 02 21:30:55.571000 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1227/2328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:54 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:55.610069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:55.633715 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-af112a3b-6ee8-443f-869d-1f7cc4ebab9c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 0.526753 Nov 02 21:30:55.635232 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1102/2329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:55 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:55.740068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:55.740875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:55.747551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:55.755546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:55.756286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:55.757326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:55.757967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:55.758628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:56.125705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c35b4ae7-0ec2-4076-856f-76d5b3595bcd tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:56.126920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c35b4ae7-0ec2-4076-856f-76d5b3595bcd tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:56.706065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c35b4ae7-0ec2-4076-856f-76d5b3595bcd tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:56.723377 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c35b4ae7-0ec2-4076-856f-76d5b3595bcd tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1216 microversion: 2.1 time: 0.600666 Nov 02 21:30:56.757034 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1103/2330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:56 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1216 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:56.775757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:56.778135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:56.831249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:56.834433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:56.837343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:56.839654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:56.840280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:56.843275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:58.018664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:58.034728 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-016ef572-d93c-436c-a9a3-684c6978d88e tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8" status: 200 len: 1474 microversion: 2.1 time: 2.295876 Nov 02 21:30:58.036450 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1228/2331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:55 2022] GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 => generated 1474 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:58.052367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9ef61dd9-7998-4fd3-b179-e3b1a2a97146 req-3e63b799-19c0-4eb0-8153-a39c97f49c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e6d441-91f0-416d-b6ca-6b1a1645252b", "name": "network-vif-deleted", "tag": "dc9c66a9-effe-43b7-be0f-926f7c85d53b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:58.089789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:58.107520 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cea40b7d-8ef9-4bcf-9dd6-a367a55a1aaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 1.346270 Nov 02 21:30:58.121900 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1104/2332] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:56 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:58.136848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:58.137772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:58.145227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:58.145469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ef61dd9-7998-4fd3-b179-e3b1a2a97146 req-3e63b799-19c0-4eb0-8153-a39c97f49c84 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:58.146106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:58.146755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:58.147662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:58.147766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ef61dd9-7998-4fd3-b179-e3b1a2a97146 req-3e63b799-19c0-4eb0-8153-a39c97f49c84 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:58.148157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ef61dd9-7998-4fd3-b179-e3b1a2a97146 req-3e63b799-19c0-4eb0-8153-a39c97f49c84 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:58.148675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:58.149406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:58.179623 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9ef61dd9-7998-4fd3-b179-e3b1a2a97146 req-3e63b799-19c0-4eb0-8153-a39c97f49c84 service nova] Creating event network-vif-deleted:dc9c66a9-effe-43b7-be0f-926f7c85d53b for instance f5e6d441-91f0-416d-b6ca-6b1a1645252b on n-h1-860863-4 Nov 02 21:30:58.189619 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9ef61dd9-7998-4fd3-b179-e3b1a2a97146 req-3e63b799-19c0-4eb0-8153-a39c97f49c84 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150843 Nov 02 21:30:58.190700 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1229/2333] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:58.198803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ada5bc03-03f8-429c-95ef-037809a12099 req-fa7a8998-588c-4bff-bff6-91a067dcf4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8", "name": "network-vif-deleted", "tag": "32289bf3-b7fb-4c7f-91d1-920db5bfd078"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:58.227904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ada5bc03-03f8-429c-95ef-037809a12099 req-fa7a8998-588c-4bff-bff6-91a067dcf4d4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:58.228974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ada5bc03-03f8-429c-95ef-037809a12099 req-fa7a8998-588c-4bff-bff6-91a067dcf4d4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:58.229765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ada5bc03-03f8-429c-95ef-037809a12099 req-fa7a8998-588c-4bff-bff6-91a067dcf4d4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:58.266558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ada5bc03-03f8-429c-95ef-037809a12099 req-fa7a8998-588c-4bff-bff6-91a067dcf4d4 service nova] Creating event network-vif-deleted:32289bf3-b7fb-4c7f-91d1-920db5bfd078 for instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 on n-h1-860863-4 Nov 02 21:30:58.280511 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ada5bc03-03f8-429c-95ef-037809a12099 req-fa7a8998-588c-4bff-bff6-91a067dcf4d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085742 Nov 02 21:30:58.285601 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1230/2334] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:30:58.314017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:58.318100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:58.343177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:58.344116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:58.346797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:58.349076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:58.350116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:58.351082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:58.694528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:58.713294 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3cb5d5e6-d508-4d4b-b971-dc2fc181b692 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1268 microversion: 2.1 time: 0.415282 Nov 02 21:30:58.716872 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1231/2335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:58 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1268 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:59.067890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:59.070078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:59.096528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:59.100194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:59.100848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:59.104656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:59.104656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:59.105171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:59.106301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:59.125542 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ba0b543-f3b6-4ac0-a600-bca5acf98a26 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 1.001886 Nov 02 21:30:59.126798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1105/2336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:58 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:30:59.143650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:59.145857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:59.153809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:59.154627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:59.156496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:59.157486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:59.158181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:59.158815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:59.250935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:59.251950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:59.252593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:59.253723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lazy-loading 'fault' on Instance uuid b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:30:59.434910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:59.508721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f35e801-ab06-4ac4-93dc-7ae6feff69c4 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8" status: 200 len: 1308 microversion: 2.1 time: 0.443028 Nov 02 21:30:59.524961 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1232/2337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:59 2022] GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:59.764484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:59.783469 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c19e085-1c22-438d-b70a-1d2c7faa20b3 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.647570 Nov 02 21:30:59.791732 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1106/2338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:59 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:30:59.807988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:30:59.809356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:30:59.828825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:59.829613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:59.830513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:59.833522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:30:59.836954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:30:59.837800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:30:59.896170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2110094112", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b4726632-ac93-4a1f-8349-9b723bbb1016"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:30:59.965564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:30:59.993282 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c10b0c77-9ae0-4b05-8289-3b130a4429c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1286 microversion: 2.1 time: 0.194574 Nov 02 21:30:59.996706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1107/2339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:30:59 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1286 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:00.018346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:31:00.160813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:00.167571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:00.212257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:00.216115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:00.217980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:00.220100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:00.223340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:00.228823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:00.716380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:00.726068 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e760e957-b6ec-4f88-a0c6-333d8bd5278c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 0.576188 Nov 02 21:31:00.726659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1108/2340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:00 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:00.752405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:00.753502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:00.771723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:00.772480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:00.773111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:00.775255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:00.776550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:00.777922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:00.814820 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 could not be found. Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 HTTP/1.1 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 could not be found. Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8'} Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 could not be found. Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 could not be found. Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:00.820791 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 could not be found. Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d569447-effd-4d68-9cfb-16db9c12bee2 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8" status: 404 len: 111 microversion: 2.1 time: 0.086949 Nov 02 21:31:00.835568 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1109/2341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:00 2022] GET /compute/v2.1/servers/b7956cbf-f8d6-4a81-93dd-f9a4ef6cdde8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:00.842410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:00.843263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:00.859847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:00.862346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:00.865721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:00.866889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:00.867485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:00.873410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:01.203403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:31:01.204855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:31:01.205508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:31:01.205920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:31:01.206332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:31:01.221273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:01.223966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:01.223966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:01.223966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:01.223966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:01.229232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:01.271543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:31:01.294067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:31:01.325016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:31:01.334373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:31:01.479694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:01.490047 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-80fc2585-7ef2-40d3-afdc-795af09ce602 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.658317 Nov 02 21:31:01.494581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1110/2342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:00 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:01.499983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:01.500764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: f5e6d441-91f0-416d-b6ca-6b1a1645252b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:01.523930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:01.524594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:01.529745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:01.535910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:01.535910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:01.535910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:01.552429 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance f5e6d441-91f0-416d-b6ca-6b1a1645252b could not be found. Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b HTTP/1.1 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f5e6d441-91f0-416d-b6ca-6b1a1645252b could not be found. Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f5e6d441-91f0-416d-b6ca-6b1a1645252b'} Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e6d441-91f0-416d-b6ca-6b1a1645252b could not be found. Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e6d441-91f0-416d-b6ca-6b1a1645252b could not be found. Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:01.561530 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e6d441-91f0-416d-b6ca-6b1a1645252b could not be found. Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance f5e6d441-91f0-416d-b6ca-6b1a1645252b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ecfd7d73-bc25-41e5-b2da-13916fc8578a tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b" status: 404 len: 111 microversion: 2.1 time: 0.067253 Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1111/2343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:01 2022] GET /compute/v2.1/servers/f5e6d441-91f0-416d-b6ca-6b1a1645252b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:01.572499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:01.574542 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-028086d9-e6ff-4655-b5ab-c0ce97c5fe5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.056726 Nov 02 21:31:01.582320 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1233/2344] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:30:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:31:01.584490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:01.584819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:01.587193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-791ee704-01a9-4e93-bee5-01bb6241c9b6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:01.587858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:01.588728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:01.589495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:01.592781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:01.783391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-791ee704-01a9-4e93-bee5-01bb6241c9b6 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/2946cc9c-f0a4-427b-ade8-829394505904" status: 204 len: 0 microversion: 2.1 time: 0.206865 Nov 02 21:31:01.784692 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1234/2345] 10.222.0.25 () {58 vars in 1266 bytes} [Wed Nov 2 21:31:01 2022] DELETE /compute/v2.1/os-server-groups/2946cc9c-f0a4-427b-ade8-829394505904 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:31:01.792059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76524eb4-9ea0-4d0a-b869-c57690a55bb2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:01.794520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-76524eb4-9ea0-4d0a-b869-c57690a55bb2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:02.207762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-76524eb4-9ea0-4d0a-b869-c57690a55bb2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:02.231963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76524eb4-9ea0-4d0a-b869-c57690a55bb2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1193 microversion: 2.1 time: 0.445440 Nov 02 21:31:02.237041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1235/2346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:01 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1193 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:02.239470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:02.248691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:02.277759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.278302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.278757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.279492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.279954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.280467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.318215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:02.331017 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd0a1e91-0cc9-46b3-bb69-1b4f02e468ad tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 0.765767 Nov 02 21:31:02.331623 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1112/2347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:01 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:02.355525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:02.361103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:02.368908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.369666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.373451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.373451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.373451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.373451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.426244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:31:02.429983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:02.774387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:02.789286 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea5afec0-182b-4fef-b106-2812655e6d3d tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 0.549793 Nov 02 21:31:02.809178 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1236/2348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:02 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:02.823034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:02.824092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:02.834260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.837775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.838526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.842045 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5980f521-30f1-4658-972e-2e3867e99b70 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 204 len: 0 microversion: 2.1 time: 0.496050 Nov 02 21:31:02.842665 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1113/2349] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:31:02 2022] DELETE /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:31:02.844301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.855758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.855891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:02.856563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.858223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:02.875683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.876193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.877742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.881978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:02.882541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:02.882997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:02.890295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:03.639095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:03.655638 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-01eba849-7562-4ca1-8802-07b3bdc9bd45 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.844006 Nov 02 21:31:03.669335 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1237/2350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:02 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:03.679140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:03.679999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:03.686380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:03.687070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:03.687649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:03.688489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:03.689117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:03.689726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:04.076981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:04.076981 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b5f9bca-5b71-4b30-b817-c5c8e0d31547 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1197 microversion: 2.1 time: 0.201356 Nov 02 21:31:04.076981 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1238/2351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:03 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:04.079470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:04.080474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:04.080474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:04.080474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:04.080474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:04.080474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:04.080474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:04.081153 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-04607165-5cb2-447a-a66d-478cdda10e66 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1473 microversion: 2.1 time: 1.045294 Nov 02 21:31:04.081153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1114/2352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:02 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1473 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:04.081378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:04.081378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47b03652-761c-4584-b9c9-e0872de34496 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Calling method '.version_select at 0x7f9b6875ab80>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-47b03652-761c-4584-b9c9-e0872de34496 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-47b03652-761c-4584-b9c9-e0872de34496 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Neutron security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 not found {{(pid=121039) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-47b03652-761c-4584-b9c9-e0872de34496 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] HTTP exception thrown: Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-97d03552-1db8-4ea4-afd4-bed91cbc0dc6'] Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47b03652-761c-4584-b9c9-e0872de34496 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Request method failure captured: Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-security-groups/e8c70c96-2ad8-4bcc-9181-48c8380c32f7 HTTP/1.1 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGXdgb7mYxzYvfh3jOQeFpLhwHuhyNSrMFvnGx5eudECX63-wyQ4WHN2Sb_dy2N7rDxzYyTWYD2ZPcOi5oTxcF-g0hGjasPt3bQe9rFMGi6rUGsBhxI-2izd6N_0cbMz4inivCzBi_MuSFIIpoi5G2TemTk0jfY5Mf61PBNwZjWsOU Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: fa467cb02fd042b083d0fc93e2180911 Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: exception: Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-97d03552-1db8-4ea4-afd4-bed91cbc0dc6'] Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e8c70c96-2ad8-4bcc-9181-48c8380c32f7'} Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:04.081709 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97d03552-1db8-4ea4-afd4-bed91cbc0dc6'] Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97d03552-1db8-4ea4-afd4-bed91cbc0dc6'] Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97d03552-1db8-4ea4-afd4-bed91cbc0dc6'] Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97d03552-1db8-4ea4-afd4-bed91cbc0dc6'] Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47b03652-761c-4584-b9c9-e0872de34496 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Returning 404 to user: Security group e8c70c96-2ad8-4bcc-9181-48c8380c32f7 does not exist Nov 02 21:31:04.089630 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-97d03552-1db8-4ea4-afd4-bed91cbc0dc6'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47b03652-761c-4584-b9c9-e0872de34496 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/e8c70c96-2ad8-4bcc-9181-48c8380c32f7" status: 404 len: 194 microversion: 2.1 time: 0.134933 Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1115/2353] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:31:03 2022] DELETE /compute/v2.1/os-security-groups/e8c70c96-2ad8-4bcc-9181-48c8380c32f7 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:04.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:04.288289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:04.304269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d15ecd5-b72e-4202-bccf-b6ef62b3dbaa tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 0.423270 Nov 02 21:31:04.308209 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1239/2354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:03 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:04.315899 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-692a88d7-dd84-445f-8218-a40477c1df37 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006064 Nov 02 21:31:04.317750 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1240/2355] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 21:31:04 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 21:31:04.331140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d3df6cf-aac6-4b38-8cc5-129b949f2a3b tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Calling method '.version_select at 0x7f9b6d2bf8b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:04.396636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:04.407268 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-149a0268-6378-4bf6-9024-9a1046e66dac tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 0.371854 Nov 02 21:31:04.407863 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1116/2356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:04 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:04.683262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:04.686093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:04.743774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:04.750260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:04.754317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:04.761784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:04.765964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:04.766434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:05.070284 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d3df6cf-aac6-4b38-8cc5-129b949f2a3b tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.747690 Nov 02 21:31:05.079738 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1241/2357] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:31:04 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:05.084516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:05.085296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:05.093681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:05.094177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:05.094621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:05.095332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:05.095790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:05.096225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:05.217633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:05.231082 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-66032e70-14ae-4803-8e84-59a880d0240c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1245 microversion: 2.1 time: 0.158754 Nov 02 21:31:05.246871 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1242/2358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:05 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:05.273536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:05.274697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:05.299301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:05.304638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:05.305313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:05.306088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:05.306561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:05.306994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:05.344731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:05.358863 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd6db773-9c67-48c2-8b09-6a9c9df71f16 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.679790 Nov 02 21:31:05.361088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1117/2359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:04 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:05.382186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb0ea5fc-54b8-412d-b4f0-ef255d823696 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Calling method '.version_select at 0x7f9b6893f820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:06.100397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:06.114776 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d5d6db80-e706-41cc-b32d-332fdf83a4ae tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1473 microversion: 2.1 time: 0.866287 Nov 02 21:31:06.136152 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1243/2360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:05 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1473 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:06.143448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:06.147925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:06.167518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:06.168245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:06.168890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:06.174610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:06.175412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:06.179624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:06.311196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-fb0ea5fc-54b8-412d-b4f0-ef255d823696 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:31:06.314712 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-fb0ea5fc-54b8-412d-b4f0-ef255d823696 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 02 21:31:06.314712 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-a11c653d-c4a4-45fa-9e0e-bf2f722ed752'] Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb0ea5fc-54b8-412d-b4f0-ef255d823696 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Request method failure captured: Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-security-groups/fc01676d-1cfe-4901-8371-58eb8890af57 HTTP/1.1 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGXdgb7mYxzYvfh3jOQeFpLhwHuhyNSrMFvnGx5eudECX63-wyQ4WHN2Sb_dy2N7rDxzYyTWYD2ZPcOi5oTxcF-g0hGjasPt3bQe9rFMGi6rUGsBhxI-2izd6N_0cbMz4inivCzBi_MuSFIIpoi5G2TemTk0jfY5Mf61PBNwZjWsOU Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: fa467cb02fd042b083d0fc93e2180911 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: exception: Insufficient rights for removing default security group. Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-a11c653d-c4a4-45fa-9e0e-bf2f722ed752'] Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'fc01676d-1cfe-4901-8371-58eb8890af57'} Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:31:06.315790 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a11c653d-c4a4-45fa-9e0e-bf2f722ed752'] Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a11c653d-c4a4-45fa-9e0e-bf2f722ed752'] Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a11c653d-c4a4-45fa-9e0e-bf2f722ed752'] Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a11c653d-c4a4-45fa-9e0e-bf2f722ed752'] Nov 02 21:31:06.321283 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:06.335695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb0ea5fc-54b8-412d-b4f0-ef255d823696 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 02 21:31:06.335695 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-a11c653d-c4a4-45fa-9e0e-bf2f722ed752'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:06.336907 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fb0ea5fc-54b8-412d-b4f0-ef255d823696 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/fc01676d-1cfe-4901-8371-58eb8890af57" status: 400 len: 182 microversion: 2.1 time: 0.974646 Nov 02 21:31:06.343425 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1118/2361] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:31:05 2022] DELETE /compute/v2.1/os-security-groups/fc01676d-1cfe-4901-8371-58eb8890af57 => generated 182 bytes in 977 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:31:06.356503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:06.357912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:06.369195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:06.372217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:06.372217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:06.385012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:06.387776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:06.390834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:06.721461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:07.140508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:07.151640 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecffcafd-ec0a-41b7-9778-145b65dfbb66 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 1.014655 Nov 02 21:31:07.157278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1244/2362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:06 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:07.180479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9be57e65-03c6-4b2f-bc2e-029b655dc04e req-0fe130f7-3b4f-4908-b6b8-cf962af6c2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41aafd7d-7290-4d69-9aea-e0a65ae42c38", "name": "network-vif-plugged", "status": "completed", "tag": "5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:07.187102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:07.205819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9be57e65-03c6-4b2f-bc2e-029b655dc04e req-0fe130f7-3b4f-4908-b6b8-cf962af6c2b5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.207639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9be57e65-03c6-4b2f-bc2e-029b655dc04e req-0fe130f7-3b4f-4908-b6b8-cf962af6c2b5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.208384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9be57e65-03c6-4b2f-bc2e-029b655dc04e req-0fe130f7-3b4f-4908-b6b8-cf962af6c2b5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.211373 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0002a57-c472-4769-aeb8-2e60fb24298a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 0.870101 Nov 02 21:31:07.219007 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1119/2363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:06 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:07.219007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:07.226879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:07.240735 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9be57e65-03c6-4b2f-bc2e-029b655dc04e req-0fe130f7-3b4f-4908-b6b8-cf962af6c2b5 service nova] Creating event network-vif-plugged:5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02 for instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 on n-h1-860863-4 Nov 02 21:31:07.252321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.254740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.255401 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9be57e65-03c6-4b2f-bc2e-029b655dc04e req-0fe130f7-3b4f-4908-b6b8-cf962af6c2b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093539 Nov 02 21:31:07.255531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.256401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.257515 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1245/2364] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:07.260158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.260746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.265810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41ad3741-a622-480d-911f-180f83fd0151 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Calling method '.version_select at 0x7f9b6930e040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:07.348919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-41ad3741-a622-480d-911f-180f83fd0151 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:31:07.354367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-41ad3741-a622-480d-911f-180f83fd0151 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Neutron security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:31:07.354367 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-41ad3741-a622-480d-911f-180f83fd0151 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] HTTP exception thrown: Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist Nov 02 21:31:07.354367 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-82e5c9dd-0f43-4683-b415-25516416d94b'] Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41ad3741-a622-480d-911f-180f83fd0151 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Request method failure captured: Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-security-groups/cb36a112-bb76-4780-bd69-c9ec31f3ebc9 HTTP/1.1 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGXdgb7mYxzYvfh3jOQeFpLhwHuhyNSrMFvnGx5eudECX63-wyQ4WHN2Sb_dy2N7rDxzYyTWYD2ZPcOi5oTxcF-g0hGjasPt3bQe9rFMGi6rUGsBhxI-2izd6N_0cbMz4inivCzBi_MuSFIIpoi5G2TemTk0jfY5Mf61PBNwZjWsOU Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: fa467cb02fd042b083d0fc93e2180911 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-82e5c9dd-0f43-4683-b415-25516416d94b'] Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'cb36a112-bb76-4780-bd69-c9ec31f3ebc9'} Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:31:07.360118 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82e5c9dd-0f43-4683-b415-25516416d94b'] Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82e5c9dd-0f43-4683-b415-25516416d94b'] Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82e5c9dd-0f43-4683-b415-25516416d94b'] Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82e5c9dd-0f43-4683-b415-25516416d94b'] Nov 02 21:31:07.364391 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:07.368317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41ad3741-a622-480d-911f-180f83fd0151 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Returning 404 to user: Security group cb36a112-bb76-4780-bd69-c9ec31f3ebc9 does not exist Nov 02 21:31:07.368317 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-82e5c9dd-0f43-4683-b415-25516416d94b'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:07.369660 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41ad3741-a622-480d-911f-180f83fd0151 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/cb36a112-bb76-4780-bd69-c9ec31f3ebc9" status: 404 len: 194 microversion: 2.1 time: 0.110584 Nov 02 21:31:07.371926 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1246/2365] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:31:07 2022] GET /compute/v2.1/os-security-groups/cb36a112-bb76-4780-bd69-c9ec31f3ebc9 => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:07.385494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:07.404241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:07.441951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.442558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.443026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.443796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.446499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.447116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.631249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:07.646272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-317be850-35b6-4aee-b389-e695e38c2431 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1251 microversion: 2.1 time: 0.431993 Nov 02 21:31:07.654197 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1120/2366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:07 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1251 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:07.669130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-94922863-2c1c-4905-9ff6-644313d2e4b8 req-04c02408-db52-42c4-b5b8-215d945f5373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206fce9d-d241-48ff-b838-eb382c6b5539", "tag": "0567d308-138e-4200-b363-020f228f3b17"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:07.700570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94922863-2c1c-4905-9ff6-644313d2e4b8 req-04c02408-db52-42c4-b5b8-215d945f5373 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.701389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94922863-2c1c-4905-9ff6-644313d2e4b8 req-04c02408-db52-42c4-b5b8-215d945f5373 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.702036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94922863-2c1c-4905-9ff6-644313d2e4b8 req-04c02408-db52-42c4-b5b8-215d945f5373 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.762864 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-94922863-2c1c-4905-9ff6-644313d2e4b8 req-04c02408-db52-42c4-b5b8-215d945f5373 service nova] Creating event network-changed:0567d308-138e-4200-b363-020f228f3b17 for instance 206fce9d-d241-48ff-b838-eb382c6b5539 on n-h1-860863-4 Nov 02 21:31:07.775166 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-94922863-2c1c-4905-9ff6-644313d2e4b8 req-04c02408-db52-42c4-b5b8-215d945f5373 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117843 Nov 02 21:31:07.776233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1121/2367] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:07.786318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-94755e29-e7d8-41c4-9902-e779dd8bbe4a req-926da164-b6e5-4eba-b2a7-2fec8cd395ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e28f9f5-f825-43fe-9a55-c3f78710a2d4", "name": "network-vif-deleted", "tag": "0ea99f46-5715-446d-b6e9-95445fbfd48f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:07.808606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94755e29-e7d8-41c4-9902-e779dd8bbe4a req-926da164-b6e5-4eba-b2a7-2fec8cd395ff service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.809537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94755e29-e7d8-41c4-9902-e779dd8bbe4a req-926da164-b6e5-4eba-b2a7-2fec8cd395ff service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.810816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94755e29-e7d8-41c4-9902-e779dd8bbe4a req-926da164-b6e5-4eba-b2a7-2fec8cd395ff service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.865492 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-94755e29-e7d8-41c4-9902-e779dd8bbe4a req-926da164-b6e5-4eba-b2a7-2fec8cd395ff service nova] Creating event network-vif-deleted:0ea99f46-5715-446d-b6e9-95445fbfd48f for instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 on n-h1-860863-4 Nov 02 21:31:07.893021 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-94755e29-e7d8-41c4-9902-e779dd8bbe4a req-926da164-b6e5-4eba-b2a7-2fec8cd395ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111337 Nov 02 21:31:07.893021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1122/2368] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:07.897102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:07.898138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:07.928479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.929132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.929599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:07.930360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:07.930836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:07.931256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:08.032851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:08.033563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:08.034160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:08.034774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lazy-loading 'fault' on Instance uuid 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:31:08.393191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13d73455e6ba4e029cce74544fc1d663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0e0bc22cb946efa6f61db40562cd65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:08.408447 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-929b8124-cf44-42b7-8a6b-51870c421819 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 200 len: 1307 microversion: 2.1 time: 0.516611 Nov 02 21:31:08.410061 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1123/2369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:07 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 1307 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:08.416416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1431352-34c8-430c-998a-f62e57fd29a5 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Action: 'update', calling method: .version_select at 0x7f9b689163a0>, body: {"security_group": {"name": "tempest-sg-904637326", "description": "tempest-description-1853753473"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:08.490747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-f1431352-34c8-430c-998a-f62e57fd29a5 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:31:08.493568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-f1431352-34c8-430c-998a-f62e57fd29a5 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Neutron security group c76c0a66-9ec8-4fd2-8204-9962985ced50 not found {{(pid=121039) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:31:08.493568 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f1431352-34c8-430c-998a-f62e57fd29a5 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] HTTP exception thrown: Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist Nov 02 21:31:08.493568 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-29ffbcf5-5a4f-4986-92f9-c8d7c054a156'] Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1431352-34c8-430c-998a-f62e57fd29a5 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Request method failure captured: Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/os-security-groups/c76c0a66-9ec8-4fd2-8204-9962985ced50 HTTP/1.1 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 101 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGXdgb7mYxzYvfh3jOQeFpLhwHuhyNSrMFvnGx5eudECX63-wyQ4WHN2Sb_dy2N7rDxzYyTWYD2ZPcOi5oTxcF-g0hGjasPt3bQe9rFMGi6rUGsBhxI-2izd6N_0cbMz4inivCzBi_MuSFIIpoi5G2TemTk0jfY5Mf61PBNwZjWsOU Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b0b8241f09844edda3bcc46a8a7552e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b0b8241f09844edda3bcc46a8a7552e5 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-928356103 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: fa467cb02fd042b083d0fc93e2180911 Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-928356103-project Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: {"security_group": {"name": "tempest-sg-904637326", "description": "tempest-description-1853753473"}} Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: exception: Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-29ffbcf5-5a4f-4986-92f9-c8d7c054a156'] Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'c76c0a66-9ec8-4fd2-8204-9962985ced50', 'body': {'security_group': {'name': 'tempest-sg-904637326', 'description': 'tempest-description-1853753473'}}} Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:31:08.504797 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29ffbcf5-5a4f-4986-92f9-c8d7c054a156'] Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29ffbcf5-5a4f-4986-92f9-c8d7c054a156'] Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29ffbcf5-5a4f-4986-92f9-c8d7c054a156'] Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-29ffbcf5-5a4f-4986-92f9-c8d7c054a156'] Nov 02 21:31:08.508045 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:08.514433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1431352-34c8-430c-998a-f62e57fd29a5 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] Returning 404 to user: Security group c76c0a66-9ec8-4fd2-8204-9962985ced50 does not exist Nov 02 21:31:08.514433 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-29ffbcf5-5a4f-4986-92f9-c8d7c054a156'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:08.515899 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1431352-34c8-430c-998a-f62e57fd29a5 tempest-SecurityGroupsNegativeTestJSON-928356103 tempest-SecurityGroupsNegativeTestJSON-928356103-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/c76c0a66-9ec8-4fd2-8204-9962985ced50" status: 404 len: 194 microversion: 2.1 time: 0.104490 Nov 02 21:31:08.522242 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1124/2370] 10.222.0.25 () {60 vars in 1290 bytes} [Wed Nov 2 21:31:08 2022] PUT /compute/v2.1/os-security-groups/c76c0a66-9ec8-4fd2-8204-9962985ced50 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:08.530739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:08.533749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:08.550991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:08.551872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:08.552952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:08.557536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:08.562574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:08.568898 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c067718e-f626-4562-a7a1-1c23d5413c88 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 1.195442 Nov 02 21:31:08.570338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:08.570338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:08.589315 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1247/2371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:07 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:08.603249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:08.621912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:08.629183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:08.634446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:08.635207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:08.646221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:08.647072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:08.651244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:09.272347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:09.283160 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83ed4c1c-7075-47c9-8dfa-ca8e93685fe1 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 0.757535 Nov 02 21:31:09.293054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1125/2372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:08 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:09.298688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:09.299581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:09.311400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:09.323815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:09.324619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:09.328226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:09.329580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:09.329968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:09.330613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:09.435473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:09.454319 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2ea51f8-6e7e-44a3-96c7-3205b62e52df tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 0.855122 Nov 02 21:31:09.459070 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1248/2373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:08 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:09.464201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:09.479944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] [instance: 4e28f9f5-f825-43fe-9a55-c3f78710a2d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:09.497432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:09.497938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:09.501492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:09.502253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:09.502731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:09.503174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:09.531019 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] HTTP exception thrown: Instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 could not be found. Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Request method failure captured: Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 HTTP/1.1 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuChB7qVf7T2Sr085LGv0JePRmRz7kWBjRittEUV1L5K7Yl3Za3ZdgRJNFE7pIbtC7O_xkdXqxhz9F2SeWluPU2gDKD3L7ONjdj3nf1SsaMd7v4ViGS8gueAiwpWPOoYipdIY3Ya2aQ_M6zqzSMhLP1hpon80_Bm3cHIldOIy242UwE Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/de0e0bc22cb946efa6f61db40562cd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: de0e0bc22cb946efa6f61db40562cd65 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1702677790 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 13d73455e6ba4e029cce74544fc1d663 Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersOnMultiNodesTest-1702677790-project Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 could not be found. Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4e28f9f5-f825-43fe-9a55-c3f78710a2d4'} Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 could not be found. Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 could not be found. Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:09.541105 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 could not be found. Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] Returning 404 to user: Instance 4e28f9f5-f825-43fe-9a55-c3f78710a2d4 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:09.545652 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db00a90c-5622-4e09-94fc-bdccc0137595 tempest-ServersOnMultiNodesTest-1702677790 tempest-ServersOnMultiNodesTest-1702677790-project] 10.222.0.25 "GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4" status: 404 len: 111 microversion: 2.1 time: 0.082457 Nov 02 21:31:09.565122 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1249/2374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:09 2022] GET /compute/v2.1/servers/4e28f9f5-f825-43fe-9a55-c3f78710a2d4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:09.602565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:09.603457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:09.624258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:09.625229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:09.627316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:09.630390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:09.630842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:09.631291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:09.981071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:09.989497 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ec2a6a5-cee3-4398-bdb1-657b94da5d34 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1293 microversion: 2.1 time: 0.694820 Nov 02 21:31:09.996997 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1126/2375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:09 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1293 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:10.293230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:10.307339 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c73d58f0-24c5-45e8-a3c9-9c48d3b5c07c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.714073 Nov 02 21:31:10.308212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:10.315112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:10.325309 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1250/2376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:09 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:10.337004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:10.337004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:10.337004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:10.337004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:10.339447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:10.340746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:10.479654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:10.485999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:10.502163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:10.504702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:10.521619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:10.521619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:10.521619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:10.521839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:10.522147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:11.143219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:11.158696 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2791da37-66cc-4e42-96bc-24cffb9b059a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 0.854879 Nov 02 21:31:11.159891 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1127/2377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:10 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:11.162367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:11.171350 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38b0fcf0-d340-4d2f-b16f-0cfa9ae9b451 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1198 microversion: 2.1 time: 0.695566 Nov 02 21:31:11.176309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:11.177043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1251/2378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:10 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1198 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:11.177878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:11.196274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:11.196918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:11.197402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:11.198367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:11.198998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:11.204864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:11.330742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:11.331463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:11.334493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:11.345045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:11.346622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:11.351801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:11.352481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:11.352993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:11.357200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:11.702759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:11.726144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6cac67d2-868c-4662-9348-61ed5ba0b206 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1293 microversion: 2.1 time: 0.564988 Nov 02 21:31:11.727176 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1128/2379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:11 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1293 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:11.847239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:11.869739 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8e606c5-093d-4878-a152-0f12d6551090 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.542974 Nov 02 21:31:11.882176 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1252/2380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:11 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:12.186391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:12.187318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:12.194812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:12.195648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:12.196521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:12.197444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:12.198083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:12.198661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:12.200667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:12.201533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:12.212317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:12.212904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:12.213396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:12.215346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:12.215855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:12.216300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:12.224217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:12.977060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:12.982826 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4390335d-27d2-491f-af77-2b87dbbc5035 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 0.800310 Nov 02 21:31:12.983429 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1129/2381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:12 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:13.000758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:13.001488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:13.016635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:13.017179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:13.017635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:13.018368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:13.018825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:13.019509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:13.228074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:13.255804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-785c88d3-8f39-443f-b9c2-654de9b69031 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1379 microversion: 2.1 time: 1.059052 Nov 02 21:31:13.257158 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1253/2382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:12 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1379 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:13.263765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7edb072a-14f7-4ce5-8cc0-587af88b7410 req-46975915-f1b3-4d7e-8552-4edc2c7cd392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d52c05f-47cb-4f31-ba15-8925b5d357a8", "tag": "ee8ea9d5-2781-435f-8035-a1efad0ea968"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:13.278212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7edb072a-14f7-4ce5-8cc0-587af88b7410 req-46975915-f1b3-4d7e-8552-4edc2c7cd392 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:13.279962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7edb072a-14f7-4ce5-8cc0-587af88b7410 req-46975915-f1b3-4d7e-8552-4edc2c7cd392 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:13.280632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7edb072a-14f7-4ce5-8cc0-587af88b7410 req-46975915-f1b3-4d7e-8552-4edc2c7cd392 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:13.314953 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7edb072a-14f7-4ce5-8cc0-587af88b7410 req-46975915-f1b3-4d7e-8552-4edc2c7cd392 service nova] Creating event network-changed:ee8ea9d5-2781-435f-8035-a1efad0ea968 for instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 on n-h2-860863-4 Nov 02 21:31:13.321955 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7edb072a-14f7-4ce5-8cc0-587af88b7410 req-46975915-f1b3-4d7e-8552-4edc2c7cd392 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063260 Nov 02 21:31:13.323209 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1254/2383] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:13.336484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:13.337692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:13.355687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:13.356433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:13.357111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:13.358243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:13.358913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:13.359605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:13.616736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:13.661538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3312aa3e-83c3-42b9-98a5-1683252da3cd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1293 microversion: 2.1 time: 0.650422 Nov 02 21:31:13.662833 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1130/2384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:12 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1293 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:13.993492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:14.014783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1701b13a-2eb0-4af4-bcdd-963d351d3389 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 0.689786 Nov 02 21:31:14.034261 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1255/2385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:13 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:14.063426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:14.064181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:14.085948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.089745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.090244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:14.092236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.092685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.094466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:14.169669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:14.170913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:14.179374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.186399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.189908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:14.193647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.194336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.196903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:14.637998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:14.651723 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0aa28926-5102-43e2-baf3-59afaecdeb5a tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 0.612733 Nov 02 21:31:14.652325 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1256/2386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:14 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:14.693240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:14.693870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:14.715431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.718516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.719128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:14.719444 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a4c6718d-ff1a-4965-9324-699be64a32fd tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1530 microversion: 2.1 time: 1.055476 Nov 02 21:31:14.720425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.720745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.723285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:14.727543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1131/2387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:13 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1530 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:14.747941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:14.748488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:14.764211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.767462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.767462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:14.770133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:14.783895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:14.784389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:15.856883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:15.860053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63151e7e-d147-4679-8b6e-0c6dfbcac67d tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1530 microversion: 2.1 time: 1.116295 Nov 02 21:31:15.862122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1132/2388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:14 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1530 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:15.867724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ed7ccd4c-965e-4a96-8797-7a5222651bba req-893719f2-6c78-4291-a197-da2e7f122179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206fce9d-d241-48ff-b838-eb382c6b5539", "name": "network-vif-plugged", "status": "completed", "tag": "0567d308-138e-4200-b363-020f228f3b17"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:15.885752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:15.895399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ed7ccd4c-965e-4a96-8797-7a5222651bba req-893719f2-6c78-4291-a197-da2e7f122179 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:15.899455 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-538ab8a2-3ef6-4fc4-ac3b-044a68443a5d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1293 microversion: 2.1 time: 1.212523 Nov 02 21:31:15.900234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ed7ccd4c-965e-4a96-8797-7a5222651bba req-893719f2-6c78-4291-a197-da2e7f122179 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:15.900859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ed7ccd4c-965e-4a96-8797-7a5222651bba req-893719f2-6c78-4291-a197-da2e7f122179 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:15.905214 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1257/2389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:14 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1293 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:15.923327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:15.924770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:15.930166 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ed7ccd4c-965e-4a96-8797-7a5222651bba req-893719f2-6c78-4291-a197-da2e7f122179 service nova] Creating event network-vif-plugged:0567d308-138e-4200-b363-020f228f3b17 for instance 206fce9d-d241-48ff-b838-eb382c6b5539 on n-h1-860863-4 Nov 02 21:31:15.944921 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ed7ccd4c-965e-4a96-8797-7a5222651bba req-893719f2-6c78-4291-a197-da2e7f122179 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078532 Nov 02 21:31:15.944921 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1133/2390] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:15.947336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:15.947873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:15.948329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:15.949496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:15.952677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:15.953416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:15.953824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:15.955238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:15.969414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:15.972054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:15.974986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:15.975958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:15.976612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:15.981866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:16.401970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:16.414280 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6520de9c-8fdc-44b2-b6e5-a8c9d6c22643 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1316 microversion: 2.1 time: 0.469718 Nov 02 21:31:16.414835 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1134/2391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:15 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:16.827043 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a410977-fe47-452f-8ee7-4c83025bc3dc tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] 10.222.0.25 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.408969 Nov 02 21:31:16.827577 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1135/2392] 10.222.0.25 () {58 vars in 1128 bytes} [Wed Nov 2 21:31:16 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 21:31:16.832004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:16.843041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:16.843815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:16.844267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:16.845053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:16.845836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:16.846260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:16.874777 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b750e363-307a-4ec0-b1dc-18931f7234f0 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046158 Nov 02 21:31:16.884053 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1136/2393] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:31:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:16.889337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d39124a2-e7b0-4bd0-8fc0-63cb0b35bc91 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Calling method '.version_select at 0x7f9b686c45e0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:16.918174 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d39124a2-e7b0-4bd0-8fc0-63cb0b35bc91 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] HTTP exception thrown: Image not found. Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d39124a2-e7b0-4bd0-8fc0-63cb0b35bc91 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Request method failure captured: Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGjTw5HZeCEPbFugTyRY2FkPSEVm0EPnTIDCdzfbQsw-oc-yVUNvyhTrx805yRqV0UDP44-okjJ8nAxZIPFf4Av7DBQBgwM9Ov4g1lVADj8GhlhNL3Lk_HlbkAcTCRvS1GaV3ITRVxm6w42Mjz8YyrT2jYk6EAVGKJVfR0xVRTJKP8 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1508cc832964448597844d0d343b9515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1508cc832964448597844d0d343b9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 19705f93d88249838f8c040c6d2f4cb7 Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: exception: Image not found. Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '-1'} Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:16.924033 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d39124a2-e7b0-4bd0-8fc0-63cb0b35bc91 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Returning 404 to user: Image not found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d39124a2-e7b0-4bd0-8fc0-63cb0b35bc91 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] 10.222.0.25 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.036199 Nov 02 21:31:16.930422 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1137/2394] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 21:31:16 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:31:16.935891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:16.936559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-4", "block_migration": false, "disk_over_commit": false}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:16.939197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:16.944757 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1967519b-2ed2-4a7d-80a7-2305ba57e137 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1506 microversion: 2.1 time: 1.037933 Nov 02 21:31:16.945400 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1258/2395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:15 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1506 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:16.948157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:16.948815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:16.949426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:16.952741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:16.952741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:16.952741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:16.976083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:16.976712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:16.986058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:16.986447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:16.987301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:16.988426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lazy-loading 'flavor' on Instance uuid 41aafd7d-7290-4d69-9aea-e0a65ae42c38 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:31:16.995373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:16.996047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:16.996581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:17.016280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Going to try to live migrate instance to n-h2-860863-4 {{(pid=121039) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 21:31:17.037875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:17.462509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:17.470451 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d8092a3-b7f1-47f7-a901-b6da10094ce8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1293 microversion: 2.1 time: 0.509712 Nov 02 21:31:17.471233 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1259/2396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:16 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1293 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:17.476747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce20dcd4-0807-488b-9f61-b0514d3a5ac2 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Calling method '.version_select at 0x7f9b6d180ca0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:17.505108 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ce20dcd4-0807-488b-9f61-b0514d3a5ac2 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] HTTP exception thrown: Image not found. Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce20dcd4-0807-488b-9f61-b0514d3a5ac2 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Request method failure captured: Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/images/1f113fcf-53fb-4763-9586-3334dccb2a1j HTTP/1.1 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGjTw5HZeCEPbFugTyRY2FkPSEVm0EPnTIDCdzfbQsw-oc-yVUNvyhTrx805yRqV0UDP44-okjJ8nAxZIPFf4Av7DBQBgwM9Ov4g1lVADj8GhlhNL3Lk_HlbkAcTCRvS1GaV3ITRVxm6w42Mjz8YyrT2jYk6EAVGKJVfR0xVRTJKP8 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1508cc832964448597844d0d343b9515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1508cc832964448597844d0d343b9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 19705f93d88249838f8c040c6d2f4cb7 Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1f113fcf-53fb-4763-9586-3334dccb2a1j'} Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1f113fcf-53fb-4763-9586-3334dccb2a1j to delete Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f113fcf-53fb-4763-9586-3334dccb2a1j could not be found. Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:17.507805 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce20dcd4-0807-488b-9f61-b0514d3a5ac2 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce20dcd4-0807-488b-9f61-b0514d3a5ac2 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] 10.222.0.25 "DELETE /compute/v2.1/images/1f113fcf-53fb-4763-9586-3334dccb2a1j" status: 404 len: 62 microversion: 2.1 time: 0.037191 Nov 02 21:31:17.511767 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1260/2397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:17 2022] DELETE /compute/v2.1/images/1f113fcf-53fb-4763-9586-3334dccb2a1j => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:31:17.519682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:17.519682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:17.529018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:17.529687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:17.530143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:17.531780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:17.532253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:17.532766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:17.935316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:17.948403 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7d2a22b-61ef-482a-9212-49173fbc59af tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1506 microversion: 2.1 time: 0.435551 Nov 02 21:31:17.952259 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1261/2398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:17 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:17.972844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-941cc2b9-cf2c-4ae8-95b6-985caaa6febd tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Calling method '.version_select at 0x7f9b6878daf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:17.995101 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-941cc2b9-cf2c-4ae8-95b6-985caaa6febd tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] HTTP exception thrown: Image not found. Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-941cc2b9-cf2c-4ae8-95b6-985caaa6febd tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Request method failure captured: Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/images/55d542dd-39fe-4a5a-913c-4a17bbda3fd91 HTTP/1.1 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGjTw5HZeCEPbFugTyRY2FkPSEVm0EPnTIDCdzfbQsw-oc-yVUNvyhTrx805yRqV0UDP44-okjJ8nAxZIPFf4Av7DBQBgwM9Ov4g1lVADj8GhlhNL3Lk_HlbkAcTCRvS1GaV3ITRVxm6w42Mjz8YyrT2jYk6EAVGKJVfR0xVRTJKP8 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1508cc832964448597844d0d343b9515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1508cc832964448597844d0d343b9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 19705f93d88249838f8c040c6d2f4cb7 Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '55d542dd-39fe-4a5a-913c-4a17bbda3fd91'} Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 55d542dd-39fe-4a5a-913c-4a17bbda3fd91 to delete Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 55d542dd-39fe-4a5a-913c-4a17bbda3fd91 could not be found. Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:17.997174 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.003272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-941cc2b9-cf2c-4ae8-95b6-985caaa6febd tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:18.009167 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-941cc2b9-cf2c-4ae8-95b6-985caaa6febd tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] 10.222.0.25 "DELETE /compute/v2.1/images/55d542dd-39fe-4a5a-913c-4a17bbda3fd91" status: 404 len: 62 microversion: 2.1 time: 0.046126 Nov 02 21:31:18.010475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1262/2399] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:31:17 2022] DELETE /compute/v2.1/images/55d542dd-39fe-4a5a-913c-4a17bbda3fd91 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:31:18.262662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55f0417e-884a-4239-bf04-7f027ce72ad2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Action: 'create', calling method: .version_select at 0x7f9b6930ef70>, body: {"keypair": {"name": "tempest-keypair-1178693684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSt3wA4V6kmG2IAx2wp79jRQMP5Pt1dKdjt2LZu66YUNxkqfWkboFH74PcnQsdje2sVYpTSPLybCsB5/ZjtD5MzZ/IaU9FyOrEz9thdQA1SFCDw9b0dhTNo9Vew7f0COQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:18.283622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-55f0417e-884a-4239-bf04-7f027ce72ad2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Getting quotas for project b48783c740e441c8ad56aed0b3ad95ec. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:31:18.290762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-55f0417e-884a-4239-bf04-7f027ce72ad2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Getting quotas for user e76ee5464ca941dab091f128d471431d and project b48783c740e441c8ad56aed0b3ad95ec. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:31:18.462359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55f0417e-884a-4239-bf04-7f027ce72ad2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.448620 Nov 02 21:31:18.463150 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1263/2400] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:31:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:18.477804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:18.478611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:18.485553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:18.486396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:18.486746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:18.487632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:18.489028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:18.489532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:18.823627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:18.836755 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6f9845a-31af-4112-9319-5e62c7a9b8c8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1527 microversion: 2.1 time: 0.372353 Nov 02 21:31:18.838529 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1264/2401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:18 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1527 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:18.844609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:18.845455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:18.856594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:18.857211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:18.858517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:18.859542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:18.860188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:18.861043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:18.901865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:18.903481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-947d4498-42d0-42bc-aede-47644b7d13c7 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539/os-instance-actions/req-978645d5-4e85-42c6-9a2c-59ec24e8a739" status: 200 len: 313 microversion: 2.1 time: 0.063776 Nov 02 21:31:18.904572 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1265/2402] 10.222.0.25 () {58 vars in 1419 bytes} [Wed Nov 2 21:31:18 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539/os-instance-actions/req-978645d5-4e85-42c6-9a2c-59ec24e8a739 => generated 313 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:18.914434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c486d1aa-4d1e-49de-a198-89324f585642 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Calling method '.version_select at 0x7f9b6d156430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:18.942988 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c486d1aa-4d1e-49de-a198-89324f585642 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] HTTP exception thrown: Image not found. Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c486d1aa-4d1e-49de-a198-89324f585642 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Request method failure captured: Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/images/tempest-invalid-9548820 HTTP/1.1 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGjTw5HZeCEPbFugTyRY2FkPSEVm0EPnTIDCdzfbQsw-oc-yVUNvyhTrx805yRqV0UDP44-okjJ8nAxZIPFf4Av7DBQBgwM9Ov4g1lVADj8GhlhNL3Lk_HlbkAcTCRvS1GaV3ITRVxm6w42Mjz8YyrT2jYk6EAVGKJVfR0xVRTJKP8 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1508cc832964448597844d0d343b9515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1508cc832964448597844d0d343b9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 19705f93d88249838f8c040c6d2f4cb7 Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'tempest-invalid-9548820'} Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-9548820 to delete Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-9548820 could not be found. Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.944888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:31:18.948477 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:18.950635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c486d1aa-4d1e-49de-a198-89324f585642 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:18.951365 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c486d1aa-4d1e-49de-a198-89324f585642 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] 10.222.0.25 "DELETE /compute/v2.1/images/tempest-invalid-9548820" status: 404 len: 62 microversion: 2.1 time: 0.044709 Nov 02 21:31:18.952234 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1266/2403] 10.222.0.25 () {58 vars in 1197 bytes} [Wed Nov 2 21:31:18 2022] DELETE /compute/v2.1/images/tempest-invalid-9548820 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:31:18.960037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:18.960869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:18.969860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:18.970354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:18.970792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:18.971499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:18.971956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:18.973121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:19.281987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:19.294155 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ce96af9-3dd8-467d-bfc3-bc7ecdeb2bb5 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1293 microversion: 2.1 time: 0.339807 Nov 02 21:31:19.312404 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1267/2404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:18 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1293 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:19.319879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:19.323307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:19.333361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:19.334104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:19.334800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:19.336822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:19.336822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:19.337332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:19.729215 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-776351ad-def7-40ae-b199-7d01322eeeff tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "POST /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539/action" status: 202 len: 0 microversion: 2.1 time: 0.411101 Nov 02 21:31:19.731414 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1268/2405] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:31:19 2022] POST /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:31:19.743973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f85320a-49ee-4b00-bf28-14a334b74a86 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Calling method '.version_select at 0x7f9b6d11de50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:19.790611 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9f85320a-49ee-4b00-bf28-14a334b74a86 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] HTTP exception thrown: Image not found. Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f85320a-49ee-4b00-bf28-14a334b74a86 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Request method failure captured: Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/images/6ad95e73-decc-4643-ad7f-7c97748d08c2 HTTP/1.1 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGjTw5HZeCEPbFugTyRY2FkPSEVm0EPnTIDCdzfbQsw-oc-yVUNvyhTrx805yRqV0UDP44-okjJ8nAxZIPFf4Av7DBQBgwM9Ov4g1lVADj8GhlhNL3Lk_HlbkAcTCRvS1GaV3ITRVxm6w42Mjz8YyrT2jYk6EAVGKJVfR0xVRTJKP8 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1508cc832964448597844d0d343b9515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1508cc832964448597844d0d343b9515"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1508cc832964448597844d0d343b9515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1508cc832964448597844d0d343b9515 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 19705f93d88249838f8c040c6d2f4cb7 Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1783743654-project Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: exception: Image not found. Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '6ad95e73-decc-4643-ad7f-7c97748d08c2'} Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ad95e73-decc-4643-ad7f-7c97748d08c2 to delete Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ad95e73-decc-4643-ad7f-7c97748d08c2 could not be found. Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:19.792916 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 21:31:19.796887 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:31:19.802784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f85320a-49ee-4b00-bf28-14a334b74a86 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] Returning 404 to user: Image not found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:19.805079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f85320a-49ee-4b00-bf28-14a334b74a86 tempest-ImagesDeleteNegativeTestJSON-1783743654 tempest-ImagesDeleteNegativeTestJSON-1783743654-project] 10.222.0.25 "DELETE /compute/v2.1/images/6ad95e73-decc-4643-ad7f-7c97748d08c2" status: 404 len: 62 microversion: 2.1 time: 0.069363 Nov 02 21:31:19.808061 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1269/2406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:19 2022] DELETE /compute/v2.1/images/6ad95e73-decc-4643-ad7f-7c97748d08c2 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:31:19.848155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f98053e9-1706-4a91-9219-c96c9f3159cf req-270c6164-420a-483f-a18a-eaf9fc05252a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52c05f-47cb-4f31-ba15-8925b5d357a8", "name": "network-vif-plugged", "status": "completed", "tag": "ee8ea9d5-2781-435f-8035-a1efad0ea968"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:19.908990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f98053e9-1706-4a91-9219-c96c9f3159cf req-270c6164-420a-483f-a18a-eaf9fc05252a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:19.909527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f98053e9-1706-4a91-9219-c96c9f3159cf req-270c6164-420a-483f-a18a-eaf9fc05252a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:19.918973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f98053e9-1706-4a91-9219-c96c9f3159cf req-270c6164-420a-483f-a18a-eaf9fc05252a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:19.965398 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f98053e9-1706-4a91-9219-c96c9f3159cf req-270c6164-420a-483f-a18a-eaf9fc05252a service nova] Creating event network-vif-plugged:ee8ea9d5-2781-435f-8035-a1efad0ea968 for instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 on n-h2-860863-4 Nov 02 21:31:19.977476 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f98053e9-1706-4a91-9219-c96c9f3159cf req-270c6164-420a-483f-a18a-eaf9fc05252a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166927 Nov 02 21:31:19.979065 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1270/2407] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:19.996003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:19.996003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:20.004462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:20.006124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:20.006778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:20.010337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:20.013407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:20.014109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:20.631861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:20.649602 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-42682bb9-f1fc-43fc-9beb-2be0edcfe6b2 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1508 microversion: 2.1 time: 0.668664 Nov 02 21:31:20.650439 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1271/2408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:19 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1508 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:20.664871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:20.665762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:20.674199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:20.674867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:20.677340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:20.678262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:20.688673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:20.690047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:21.169090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:21.183020 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b1c06e9-b21d-457e-9863-9f63661a2fb9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.529505 Nov 02 21:31:21.185955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1272/2409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:20 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:21.193142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:21.195933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:21.210871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:21.217067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:21.217067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:21.217067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:21.217067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:21.217067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:21.433220 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a5d29c44-bb66-4144-a5ce-54e3f10d11ea tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38/action" status: 202 len: 0 microversion: 2.1 time: 4.509168 Nov 02 21:31:21.434677 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1138/2410] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:31:16 2022] POST /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38/action => generated 0 bytes in 4512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:31:21.445235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:21.446202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:21.485757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:21.486634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:21.488820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:21.492487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:21.493231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:21.494051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:21.775357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:21.795166 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf0d9343-e7db-4fc2-8b92-9b9e840e7b55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1293 microversion: 2.1 time: 0.606617 Nov 02 21:31:21.798589 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1273/2411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:21 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1293 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:21.820776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:21.821853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:21.838068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:21.841137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:21.842034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:21.846933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:21.846933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:21.849630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:22.362269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:22.375949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:22.388794 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7120b8c6-f95a-4deb-845c-34964f9c13db tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.949463 Nov 02 21:31:22.390686 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a176290c-c044-4293-988d-36481ea9949d tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1508 microversion: 2.1 time: 0.588480 Nov 02 21:31:22.390823 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1139/2412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:21 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:22.393240 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1274/2413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:21 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:22.396117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6674977e-def0-443a-a7d3-a91bd88a16c1 req-ea66a79a-1328-44da-99c9-b37c491ff139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215e245d-4a95-4290-8fe6-4254c8f2cea9", "name": "network-vif-plugged", "status": "completed", "tag": "f41895c4-2ac3-4ebd-a940-d92bb8f69363"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:22.407182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6674977e-def0-443a-a7d3-a91bd88a16c1 req-ea66a79a-1328-44da-99c9-b37c491ff139 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:22.407758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:22.408048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6674977e-def0-443a-a7d3-a91bd88a16c1 req-ea66a79a-1328-44da-99c9-b37c491ff139 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:22.408680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6674977e-def0-443a-a7d3-a91bd88a16c1 req-ea66a79a-1328-44da-99c9-b37c491ff139 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:22.412643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:22.422496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6674977e-def0-443a-a7d3-a91bd88a16c1 req-ea66a79a-1328-44da-99c9-b37c491ff139 service nova] Creating event network-vif-plugged:f41895c4-2ac3-4ebd-a940-d92bb8f69363 for instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 on n-h2-860863-4 Nov 02 21:31:22.429771 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6674977e-def0-443a-a7d3-a91bd88a16c1 req-ea66a79a-1328-44da-99c9-b37c491ff139 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037794 Nov 02 21:31:22.432430 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1140/2414] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:22.459642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:22.466372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:22.466872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:22.467606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:22.468092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:22.468518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:22.824580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:22.827863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:22.860113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:22.860361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:22.861725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:22.865307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:22.866130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:22.867454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:23.578630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:23.594932 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b37f5891-da1c-4422-9f4a-cb536aa2de80 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1474 microversion: 2.1 time: 0.775047 Nov 02 21:31:23.595131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:23.607254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3608a8f-fd71-4c7d-ab20-f4eff3562299 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 1.211469 Nov 02 21:31:23.612561 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1275/2415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:22 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:23.623050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:23.623159 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1141/2416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:22 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1474 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:23.624029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:23.642242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:23.642944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:23.643603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:23.645752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:23.648459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:23.651343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:23.667861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:23.669390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:23.697442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:23.702363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:23.703092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:23.707874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:23.708749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:23.711226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:24.300626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:24.314422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-684650e5-08aa-4668-be69-7ea3b6c7eda8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.699893 Nov 02 21:31:24.315696 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1276/2417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:23 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:24.332476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1414480166", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:24.427730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:31:24.515999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:24.530197 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-724f72b7-1daf-4035-8de6-5e355550eeb3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1506 microversion: 2.1 time: 0.904274 Nov 02 21:31:24.531892 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1142/2418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:23 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1506 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:25.233311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1799644027", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:25.327768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:31:26.062222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:31:26.063273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:31:26.064086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:31:26.064645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:31:26.065350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:31:26.087933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.088819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.089439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.090415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.092354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.092970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.139616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:31:26.151645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for user 64f57cf5139c4937b8158f8d9aef011b and project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:31:26.186382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:31:26.189651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:31:26.332886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:31:26.333487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:31:26.333892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:31:26.334302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:31:26.334712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:31:26.351827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.352322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.355678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.356504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.356998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.365692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.372023 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a878e3cc-3d89-47ac-ab3b-dca1e1813cc8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838689 Nov 02 21:31:26.379686 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1143/2419] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:31:26.388642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '.version_select at 0x7f9b6893f670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:26.389286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:26.404498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:31:26.415693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.416201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.421971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.424100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.429672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.429672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.433050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:31:26.487045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:31:26.487721 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f78e0e37-f26e-4235-9f91-62a0dee8f4d3 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.107610 Nov 02 21:31:26.487721 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1144/2420] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 21:31:26 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539/os-instance-actions => generated 611 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:26.490635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: aff5f2b8-21b9-4190-99dc-ce1881b75760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:31:26.492351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:26.495075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:26.502576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.503825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.504574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.505359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.505874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.506442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.741912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:26.748512 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b52b0511-8a01-419d-b514-9a757be59191 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.431028 Nov 02 21:31:26.750383 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69f60e44-7335-4bde-a463-0e4d94260ec0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.262668 Nov 02 21:31:26.751232 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1277/2421] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:31:26.763504 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1145/2422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:26 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:26.769938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:26.771232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:26.775634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6bf77154-1b7a-4c78-a97f-c463f9d2a54a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:26.776556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6bf77154-1b7a-4c78-a97f-c463f9d2a54a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:26.792918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.797334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.798364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.801275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.805486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.806259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.914254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bf77154-1b7a-4c78-a97f-c463f9d2a54a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:26.922797 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6bf77154-1b7a-4c78-a97f-c463f9d2a54a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1213 microversion: 2.1 time: 0.157732 Nov 02 21:31:26.923785 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1146/2423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:26 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1213 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:26.942177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:26.942693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:26.971037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.971544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.971989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:26.972768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:26.973359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:26.973798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:27.081322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:31:27.509800 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-832eabf5-9731-4583-8290-015c55e608ae tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "DELETE /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 204 len: 0 microversion: 2.1 time: 0.583376 Nov 02 21:31:27.510950 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1147/2424] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:31:26 2022] DELETE /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:31:27.517964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4db5e34-be62-4ac7-a38f-7eda1bb10be1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:27.519735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4db5e34-be62-4ac7-a38f-7eda1bb10be1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: aff5f2b8-21b9-4190-99dc-ce1881b75760] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:27.572314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4db5e34-be62-4ac7-a38f-7eda1bb10be1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: aff5f2b8-21b9-4190-99dc-ce1881b75760] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:31:27.622185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:27.634578 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc27382d-7877-4884-a755-a9070081ca5a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.879976 Nov 02 21:31:27.635908 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1278/2425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:26 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:27.640983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:27.641789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:27.649695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:27.650597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:27.651045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:27.651763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:27.652238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:27.652862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:28.172528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:28.186956 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f743bb0d-a1b7-4064-9b67-9811116ff539 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1512 microversion: 2.1 time: 0.549730 Nov 02 21:31:28.195401 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1279/2426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:27 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:28.241225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:28.242031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:28.262747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:28.265600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:28.267336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:28.271024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:28.273152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:28.273664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:28.327827 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.api [None req-e4db5e34-be62-4ac7-a38f-7eda1bb10be1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: aff5f2b8-21b9-4190-99dc-ce1881b75760] Instance Mapping does not exist while attempting local delete cleanup. Nov 02 21:31:28.329154 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4db5e34-be62-4ac7-a38f-7eda1bb10be1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760" status: 204 len: 0 microversion: 2.1 time: 0.816542 Nov 02 21:31:28.329841 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1148/2427] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:31:27 2022] DELETE /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:31:28.342909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:28.343579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:28.358026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:28.361953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:28.362423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:28.365217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:28.365944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:28.366111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:28.594493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:28.604720 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-efafa82c-34a9-4c6b-91ad-b403331a4392 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1217 microversion: 2.1 time: 0.273753 Nov 02 21:31:28.612448 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1149/2428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:28 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:28.631672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4b28438-6094-4238-ae3e-2e30c85ae0c6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:28.632289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b4b28438-6094-4238-ae3e-2e30c85ae0c6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: aff5f2b8-21b9-4190-99dc-ce1881b75760] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:28.651610 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b4b28438-6094-4238-ae3e-2e30c85ae0c6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4b28438-6094-4238-ae3e-2e30c85ae0c6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760 HTTP/1.1 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'aff5f2b8-21b9-4190-99dc-ce1881b75760'} Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:28.653459 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:28.656816 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:28.656816 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:28.656816 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:28.656816 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:31:28.656816 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:28.658063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4b28438-6094-4238-ae3e-2e30c85ae0c6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:28.659093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b4b28438-6094-4238-ae3e-2e30c85ae0c6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760" status: 404 len: 111 microversion: 2.1 time: 0.040627 Nov 02 21:31:28.661823 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1150/2429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:28 2022] GET /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:28.670339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:28.673266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:28.687971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:28.700158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:28.700158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:28.700158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:28.700158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:28.700158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:28.769999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:28.790629 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1d6df36-d1c1-46f6-9d41-48aa5a6c0a07 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.593238 Nov 02 21:31:28.792638 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1280/2430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:28 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:28.930877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1385246136", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b4726632-ac93-4a1f-8349-9b723bbb1016"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:29.116082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:29.163585 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bfbef746-d44a-4d26-8982-5c921b380255 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.496865 Nov 02 21:31:29.164450 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1151/2431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:28 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:29.216383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:29.217032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:29.229300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:29.231784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:29.234129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:29.234893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:29.235364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:29.235819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:29.680645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:29.699118 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-70f394b3-f6ca-4367-ab84-820edf7917c5 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1512 microversion: 2.1 time: 0.483686 Nov 02 21:31:29.699811 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1152/2432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:29 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:29.708450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:29.709518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:29.725972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:29.729181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:29.732490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:29.733543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:29.736101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:29.736725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:29.777158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:29.916016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:29.929832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d3ce1335-f3bd-4e33-a9b8-29bd6331ac57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1265 microversion: 2.1 time: 0.228000 Nov 02 21:31:29.932677 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1153/2433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:29 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:29.942660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:29.954703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:29.972587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:29.978171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:29.983486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:29.985758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:29.990074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:29.995282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:30.220288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:30.259020 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-453523e3-bfd4-4657-a626-7c0a5db570ae tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.304879 Nov 02 21:31:30.260042 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1154/2434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:29 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:30.266385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:30.267280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:30.285343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:30.287315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:30.288036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:30.292853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:30.294616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:30.295491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:31.130526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:31.140590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5df02f85-9b7b-47d9-80e8-eae1dea3725b tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.879164 Nov 02 21:31:31.151705 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1155/2435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:30 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:31.158775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:31.168178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:31.174459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:31.174964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:31.175470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:31.182192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:31.182890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:31.183489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:31.343979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52d8d6530c0d47398b1ffb58db0da2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4220305b3ee4058b8a08d8aa5a45488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:31.375795 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9494cd6b-f475-47c5-b881-3ffad9a6fa86 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 200 len: 1301 microversion: 2.1 time: 0.222635 Nov 02 21:31:31.379078 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1156/2436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:31 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 1301 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:31.387321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:31.388201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:31.396641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:31.397293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:31.398619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:31.399430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:31.400105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:31.407322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:31.654715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:31.676577 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2d0dde67-c48e-48cd-af20-62434d970fe2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1271 microversion: 2.1 time: 0.296116 Nov 02 21:31:31.706203 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1157/2437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:31 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:31.717348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-4e936dab-1f10-4095-a550-97c6a0809d79 req-5cdd42f1-aa22-42b7-92a8-50147acb5177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206fce9d-d241-48ff-b838-eb382c6b5539", "name": "network-vif-deleted", "tag": "0567d308-138e-4200-b363-020f228f3b17"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:31.741718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4e936dab-1f10-4095-a550-97c6a0809d79 req-5cdd42f1-aa22-42b7-92a8-50147acb5177 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:31.742220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4e936dab-1f10-4095-a550-97c6a0809d79 req-5cdd42f1-aa22-42b7-92a8-50147acb5177 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:31.742776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4e936dab-1f10-4095-a550-97c6a0809d79 req-5cdd42f1-aa22-42b7-92a8-50147acb5177 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:31.796644 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-4e936dab-1f10-4095-a550-97c6a0809d79 req-5cdd42f1-aa22-42b7-92a8-50147acb5177 service nova] Creating event network-vif-deleted:0567d308-138e-4200-b363-020f228f3b17 for instance 206fce9d-d241-48ff-b838-eb382c6b5539 on n-h1-860863-4 Nov 02 21:31:31.812981 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-4e936dab-1f10-4095-a550-97c6a0809d79 req-5cdd42f1-aa22-42b7-92a8-50147acb5177 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103877 Nov 02 21:31:31.812981 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1158/2438] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:31.846365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:31.848970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:31.862326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:31.868661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:31.869652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:31.870419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:31.871195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:31.871655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:32.535801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:32.551741 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf0df7ea-1109-4b47-9bd6-230c90712060 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.728930 Nov 02 21:31:32.553246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1159/2439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:31 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:32.558966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:32.560882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:32.569302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:32.570987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:32.571655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:32.572269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:32.573175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:32.573785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:32.574631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:32.927047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:32.946886 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ce268226-3e6f-44eb-a77b-a6e8908780e6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.392295 Nov 02 21:31:32.948029 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1160/2440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:32 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:32.952877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:32.958249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] [instance: 206fce9d-d241-48ff-b838-eb382c6b5539] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:32.978316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:32.979066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:32.979707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:32.980581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:32.981231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:32.981815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:33.007094 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] HTTP exception thrown: Instance 206fce9d-d241-48ff-b838-eb382c6b5539 could not be found. Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Request method failure captured: Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 HTTP/1.1 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGKMoexzLEcFRhE4aFrBM4qAtTEi3805E8q9DU0vr5TSYmWKUCMmR_545VPvu15BZbCj6LVwlzRXFpIdHBnimQWohegn4rsYJih9kVU-PSj1EgQOHVxddH_phfYj-8OzJGaRwYBpkY1bCTEl6bMzXx4e5aNusHO4dFi9CAvPa2ZrGo Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: f4220305b3ee4058b8a08d8aa5a45488 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-InstanceActionsTestJSON-1383070964 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f4220305b3ee4058b8a08d8aa5a45488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4220305b3ee4058b8a08d8aa5a45488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f4220305b3ee4058b8a08d8aa5a45488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4220305b3ee4058b8a08d8aa5a45488"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-InstanceActionsTestJSON-1383070964 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: f4220305b3ee4058b8a08d8aa5a45488 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1383070964 Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-InstanceActionsTestJSON-1383070964-project Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 52d8d6530c0d47398b1ffb58db0da2ae Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-InstanceActionsTestJSON-1383070964-project Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 206fce9d-d241-48ff-b838-eb382c6b5539 could not be found. Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '206fce9d-d241-48ff-b838-eb382c6b5539'} Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206fce9d-d241-48ff-b838-eb382c6b5539 could not be found. Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206fce9d-d241-48ff-b838-eb382c6b5539 could not be found. Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:31:33.009295 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206fce9d-d241-48ff-b838-eb382c6b5539 could not be found. Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] Returning 404 to user: Instance 206fce9d-d241-48ff-b838-eb382c6b5539 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36515349-f26f-434a-a7bf-440cf6a15957 tempest-InstanceActionsTestJSON-1383070964 tempest-InstanceActionsTestJSON-1383070964-project] 10.222.0.25 "GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539" status: 404 len: 111 microversion: 2.1 time: 0.061790 Nov 02 21:31:33.017962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1161/2441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:32 2022] GET /compute/v2.1/servers/206fce9d-d241-48ff-b838-eb382c6b5539 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:31:33.037206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:33.041008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:33.062093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:33.062538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:33.063205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:33.069186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:33.070067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:33.070707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:33.428402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:33.442837 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-168b72f4-adf7-42c5-b6dd-230c0663555c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1271 microversion: 2.1 time: 0.429898 Nov 02 21:31:33.463937 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1162/2442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:33 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1271 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:33.580557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:33.582416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:33.594350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:33.597136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:33.598993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:33.602168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:33.603922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:33.604635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:34.111005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:34.121723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19376fc2-7672-4591-b271-e7e58559ff3a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.549288 Nov 02 21:31:34.147519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1163/2443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:33 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:34.158577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:34.167715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:34.186663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:34.193719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:34.194329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:34.195096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:34.195568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:34.195992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:34.532346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:34.541924 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-64d17a1a-f9e8-48e2-8ea5-14e8c6e12117 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.392560 Nov 02 21:31:34.565703 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1164/2444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:34 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:34.576274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:34.577100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:34.598457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:34.599125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:34.599873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:34.600546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:34.604046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:34.604700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:34.914012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:34.931596 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59eea5fe-d888-43cc-844e-63ab29517722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1271 microversion: 2.1 time: 0.364602 Nov 02 21:31:34.932761 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1165/2445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:34 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1271 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:35.153547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:35.155063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:35.171301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:35.177808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:35.179703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:35.182773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:35.183441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:35.185855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:35.681635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:35.693748 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0667d71-da9f-4271-afaa-412d5b5e7dc8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.542635 Nov 02 21:31:35.696534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1166/2446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:35 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:35.710171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:35.777307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:35.777307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:35.777307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:35.777307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:35.777307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:35.777307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:35.777307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:36.116024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:36.219913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:36.239204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc0c27e4-1b76-4388-b087-7b0c5c7c0157 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.537841 Nov 02 21:31:36.244798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1167/2447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:35 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:36.267786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:36.271467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:36.302474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:36.316525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:36.316525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:36.316525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:36.316525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:36.316525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:36.393062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:36.464833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:37.182519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:37.197355 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1918b77e-1768-42f1-ab1b-49eb651b01ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.947608 Nov 02 21:31:37.201570 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1168/2448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:36 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:37.215652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:37.216664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:37.232246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:37.236896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:37.237998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:37.240556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:37.242381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:37.244314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:37.852754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:38.104181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:38.122545 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f934f72-1b3d-47c1-9922-622733011594 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.919491 Nov 02 21:31:38.159167 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1169/2449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:37 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:38.165479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:38.166109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:38.186647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:38.188131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:38.194569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:38.195727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:38.196366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:38.196993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:38.667906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:38.693065 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30561e64-012b-4026-81cd-7f57fc97510c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.532834 Nov 02 21:31:38.694257 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1170/2450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:38 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:38.708999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:38.710062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:38.738760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:38.742081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:38.744227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:38.745025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:38.746358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:38.746802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:38.783082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:38.812251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:39.002294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:39.252639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:39.270590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1191041a-ae67-46d2-98cc-24706806f144 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.569453 Nov 02 21:31:39.286682 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1171/2451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:38 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:39.293867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:39.295011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:39.304148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:39.304958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:39.305597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:39.306782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:39.307384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:39.307959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:40.145239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:40.158951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-235af747-59ae-455c-a35a-541a7126bf0e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.871136 Nov 02 21:31:40.162094 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1172/2452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:39 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:40.169057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:40.170024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:40.179762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:40.184315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:40.185073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:40.186286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:40.192881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:40.192881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:40.686274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:40.714591 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97d26b39-1fa3-4512-ac01-0181d592fb27 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.550770 Nov 02 21:31:40.719837 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1173/2453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:40 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:40.742961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:40.743638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:40.761628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:40.762449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:40.762951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:40.763880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:40.764338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:40.765087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:41.390193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:41.408981 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ff6a012-ce38-4275-9323-fa01aad12ab6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.689737 Nov 02 21:31:41.410922 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1174/2454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:40 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:41.415915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:41.416560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:41.423589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:41.424808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:41.424808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:41.426158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:41.426830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:41.427278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:41.836299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:41.846334 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1e58a43-811c-4458-a152-2f74ac2ffa24 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.434337 Nov 02 21:31:41.848677 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1175/2455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:41 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:41.857846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:41.858724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:41.888722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:41.894405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:41.894994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:41.896555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:41.899149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:41.899841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:42.353064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:42.359834 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eae17ea1-21a8-41c8-a147-057a8c90bdfa tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.509538 Nov 02 21:31:42.363921 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1176/2456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:41 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:42.372262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7d134e3f-fced-4807-a185-ded2ca581966 req-3c80bea5-0a15-4f25-b9af-debe029d1e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af801d7-895e-4005-8df7-5c8e47eba467", "tag": "081b5980-608f-454c-9129-5e3e9c6aa74e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:42.382750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7d134e3f-fced-4807-a185-ded2ca581966 req-3c80bea5-0a15-4f25-b9af-debe029d1e64 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:42.383615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7d134e3f-fced-4807-a185-ded2ca581966 req-3c80bea5-0a15-4f25-b9af-debe029d1e64 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:42.384237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7d134e3f-fced-4807-a185-ded2ca581966 req-3c80bea5-0a15-4f25-b9af-debe029d1e64 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:42.414649 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7d134e3f-fced-4807-a185-ded2ca581966 req-3c80bea5-0a15-4f25-b9af-debe029d1e64 service nova] Creating event network-changed:081b5980-608f-454c-9129-5e3e9c6aa74e for instance 6af801d7-895e-4005-8df7-5c8e47eba467 on n-h1-860863-4 Nov 02 21:31:42.432094 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7d134e3f-fced-4807-a185-ded2ca581966 req-3c80bea5-0a15-4f25-b9af-debe029d1e64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066638 Nov 02 21:31:42.433441 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1177/2457] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:42.439955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:42.441065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:42.450676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:42.451180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:42.451776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:42.456504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:42.456695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:42.457165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:42.752084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:42.782415 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-611f3753-e567-4955-89d9-8ca059678266 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.344264 Nov 02 21:31:42.784753 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1178/2458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:42 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:42.874592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:42.880441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:42.892457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:42.894675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:42.901265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:42.901265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:42.901265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:42.901265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:43.207954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:43.216994 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-76e60460-2caa-487d-a40b-8c3210b891af tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.346863 Nov 02 21:31:43.233110 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1179/2459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:42 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:43.386150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:43.387379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:43.402630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:43.404659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:43.405571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:43.409367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:43.410610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:43.412296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:43.919853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:43.936606 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5cb4704b-0af3-4cc0-9d54-230efea46aea tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.554741 Nov 02 21:31:43.940165 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1180/2460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:43 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:43.950646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:43.955324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:44.005871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:44.006957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:44.011066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:44.013899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:44.016066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:44.019405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:44.308262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:44.321511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f9f8d2b-c3e2-4bc0-be7a-e8e1d6d3dda1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.377116 Nov 02 21:31:44.335247 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1181/2461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:43 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:44.348897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:44.355529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:44.358241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:44.359210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:44.360574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:44.362099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:44.363409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:44.364178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:44.641218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:44.657138 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf3a94fc-f790-4d03-83ba-b758f4c4f5d0 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.314651 Nov 02 21:31:44.657757 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1182/2462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:44 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:44.697158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-975db116-056a-4830-92c8-58818b355bdc req-9d33c2c0-8a6d-4c36-929d-cd8876dff663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41aafd7d-7290-4d69-9aea-e0a65ae42c38", "name": "network-vif-unplugged", "status": "completed", "tag": "5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:44.721010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-975db116-056a-4830-92c8-58818b355bdc req-9d33c2c0-8a6d-4c36-929d-cd8876dff663 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:44.721010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-975db116-056a-4830-92c8-58818b355bdc req-9d33c2c0-8a6d-4c36-929d-cd8876dff663 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:44.721454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-975db116-056a-4830-92c8-58818b355bdc req-9d33c2c0-8a6d-4c36-929d-cd8876dff663 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:44.759058 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-975db116-056a-4830-92c8-58818b355bdc req-9d33c2c0-8a6d-4c36-929d-cd8876dff663 service nova] Creating event network-vif-unplugged:5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02 for instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 on n-h1-860863-4 Nov 02 21:31:44.795571 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-975db116-056a-4830-92c8-58818b355bdc req-9d33c2c0-8a6d-4c36-929d-cd8876dff663 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103719 Nov 02 21:31:44.806780 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1183/2463] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:31:44.967006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:44.968492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:44.982009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:44.983082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:44.983773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:44.985898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:44.988100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:44.988902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:45.337545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:45.357947 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f746f1eb-9696-4678-955a-ff4e8cc377f8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.396618 Nov 02 21:31:45.373763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1184/2464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:44 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:31:45.382156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:45.387528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:45.398312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:45.400923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:45.400923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:45.402008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:45.407384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:45.410950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:45.738640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:45.763790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff232cb8-00e4-49e7-a009-91933b751856 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.385877 Nov 02 21:31:45.764798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1185/2465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:45 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:45.787922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:45.788963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:45.800570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:45.808831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:45.809435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:45.811116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:45.821617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:45.822602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:46.442741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:46.454139 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9555baa-5587-42ac-a91e-94fef7e5929d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1522 microversion: 2.1 time: 0.683762 Nov 02 21:31:46.459778 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1186/2466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:45 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1522 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:46.473979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:46.476670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:46.497185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:46.501071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:46.502378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:46.507318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:46.508043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:46.511904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:46.862611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:46.872472 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3253206-810d-43f7-a5ca-a441e6e61c4e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.411326 Nov 02 21:31:46.881533 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1187/2467] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:46 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:47.178169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1556270653", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "9d0dd3a0-380b-4a40-a525-0fe93d8bf80d"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:53.089926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] validate_networks() for [('9d0dd3a0-380b-4a40-a525-0fe93d8bf80d', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:31:53.355440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:31:54.455340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:31:54.455962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:31:54.456339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:31:54.456764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:31:54.457201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:31:54.476573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:54.481762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:54.481762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:54.481762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:54.481762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:54.482565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:54.536515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Getting quotas for project bd426e6d43d44ef395ad2dca7e4e0a72. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:31:54.556785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Getting quotas for user e8dd93372e2b4a8aaa696a62ee220ab2 and project bd426e6d43d44ef395ad2dca7e4e0a72. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:31:54.579211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:31:54.583953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:31:54.648272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:31:54.649659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:31:54.650342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:31:54.650932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:31:54.653552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:31:54.672347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:54.674391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:54.677002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:54.679544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:54.680098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:54.682060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:54.712804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:31:54.731540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:31:54.776463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-919d49e0-9d14-4e07-a39f-999b16935064 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.890328 Nov 02 21:31:54.779754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:31:54.783577 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1188/2468] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:31:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 7901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:31:54.792998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:31:54.797809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:54.804065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:54.816169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:54.816978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:54.819508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:54.820530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:54.821267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:54.822034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:55.009909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8c27fb08-5293-487c-ae2f-b2c83c7e9b3e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 26.091435 Nov 02 21:31:55.010591 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1281/2469] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 26093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:31:55.036256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:55.038175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:55.056339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:55.059899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:55.063953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:55.066230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:55.070334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:55.070334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:55.125168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:55.158333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d682e34-4dfe-4e54-90f4-f92471882776 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.373417 Nov 02 21:31:55.160827 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1189/2470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:54 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:55.170895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b3908204-d91d-46b6-9b5e-113ab1913980 req-11886b7d-9011-4801-b46a-c91e22b1529c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41aafd7d-7290-4d69-9aea-e0a65ae42c38", "tag": "5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:55.187682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3908204-d91d-46b6-9b5e-113ab1913980 req-11886b7d-9011-4801-b46a-c91e22b1529c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:55.188463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3908204-d91d-46b6-9b5e-113ab1913980 req-11886b7d-9011-4801-b46a-c91e22b1529c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:55.189122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3908204-d91d-46b6-9b5e-113ab1913980 req-11886b7d-9011-4801-b46a-c91e22b1529c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:55.194816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:31:55.204136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b3908204-d91d-46b6-9b5e-113ab1913980 req-11886b7d-9011-4801-b46a-c91e22b1529c service nova] Creating event network-changed:5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02 for instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 on n-h1-860863-4 Nov 02 21:31:55.211149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b3908204-d91d-46b6-9b5e-113ab1913980 req-11886b7d-9011-4801-b46a-c91e22b1529c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048894 Nov 02 21:31:55.212581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1190/2471] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:55.218677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:55.219593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:55.228610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:55.229411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:55.230115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:55.231163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:55.231823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:55.232456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:55.742644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:55.759751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48885444-cc56-4640-ac6c-e01d977a4bfe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1504 microversion: 2.1 time: 0.739342 Nov 02 21:31:55.768627 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1282/2472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:55 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1504 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:55.837218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:55.864529 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c668d938-1bef-4de4-8424-3d888e00904c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.650192 Nov 02 21:31:55.869031 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1191/2473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:55 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:55.895388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ebedfb41-55e0-4148-b3f1-35b2d7365e74 req-f987d899-992b-4585-bedd-2af63d064fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af801d7-895e-4005-8df7-5c8e47eba467", "name": "network-vif-plugged", "status": "completed", "tag": "081b5980-608f-454c-9129-5e3e9c6aa74e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:55.943338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ebedfb41-55e0-4148-b3f1-35b2d7365e74 req-f987d899-992b-4585-bedd-2af63d064fe2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:55.951875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ebedfb41-55e0-4148-b3f1-35b2d7365e74 req-f987d899-992b-4585-bedd-2af63d064fe2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:55.952341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ebedfb41-55e0-4148-b3f1-35b2d7365e74 req-f987d899-992b-4585-bedd-2af63d064fe2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:55.975317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-675429090", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "3118d9ba-1b59-4ad5-b3d0-7ce607c67d7a"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:56.011516 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ebedfb41-55e0-4148-b3f1-35b2d7365e74 req-f987d899-992b-4585-bedd-2af63d064fe2 service nova] Creating event network-vif-plugged:081b5980-608f-454c-9129-5e3e9c6aa74e for instance 6af801d7-895e-4005-8df7-5c8e47eba467 on n-h1-860863-4 Nov 02 21:31:56.040864 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ebedfb41-55e0-4148-b3f1-35b2d7365e74 req-f987d899-992b-4585-bedd-2af63d064fe2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164340 Nov 02 21:31:56.043272 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1192/2474] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:31:56.067256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed63f4f3-3dd7-4464-97c7-9f45ae37ae66 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:56.068288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed63f4f3-3dd7-4464-97c7-9f45ae37ae66 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:56.124867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] validate_networks() for [('3118d9ba-1b59-4ad5-b3d0-7ce607c67d7a', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:31:56.314188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed63f4f3-3dd7-4464-97c7-9f45ae37ae66 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:56.344499 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed63f4f3-3dd7-4464-97c7-9f45ae37ae66 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1225 microversion: 2.1 time: 0.299931 Nov 02 21:31:56.350959 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1193/2475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:56 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1225 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:56.370398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3689e3b6-07d2-41b8-bbf3-b013009bf7e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:56.371490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3689e3b6-07d2-41b8-bbf3-b013009bf7e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:56.556721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3689e3b6-07d2-41b8-bbf3-b013009bf7e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:56.567722 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3689e3b6-07d2-41b8-bbf3-b013009bf7e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1221 microversion: 2.1 time: 0.214809 Nov 02 21:31:56.572326 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1194/2476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:56 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:56.581278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:56.588034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:56.601961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:56.603298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:56.605506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:56.606445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:56.608403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:56.609016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:57.513912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:57.526510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-651b6cbe-ace9-44dc-af0b-8fd963215cd8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1313 microversion: 2.1 time: 0.949696 Nov 02 21:31:57.530955 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1195/2477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:56 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1313 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:57.559111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:57.561390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:57.577092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:57.579672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:57.581908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:57.585397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:57.589646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:57.590352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.058502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:31:58.063558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:31:58.063558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:31:58.063558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:31:58.063558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:31:58.082519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.083122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.083736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.084915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.085410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.085849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.166403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Getting quotas for project b9777210f32a4676861f7d21919de0ea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:31:58.178639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Getting quotas for user 85f5d9be7b56449698b13ba101119b1f and project b9777210f32a4676861f7d21919de0ea. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:31:58.199970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:31:58.203455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:31:58.229245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:58.240470 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6bdf996c-890b-4154-9708-e2c010da568c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1504 microversion: 2.1 time: 0.695225 Nov 02 21:31:58.244373 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1196/2478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:57 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1504 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:58.260724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:58.264336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:58.288145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.288658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.289142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.289863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.295385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.300395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.374373 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32dee480-a61d-4bd8-b6ba-72cef145081b tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.604171 Nov 02 21:31:58.375060 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1283/2479] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:31:58.411839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:58.414705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:58.434042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.436993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.437678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.442777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.444333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.445473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.656705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:58.671516 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec40b66a-8260-4309-bf5c-17d3898f20eb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1221 microversion: 2.1 time: 0.267574 Nov 02 21:31:58.703551 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1284/2480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:58 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1221 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:58.724882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:58.725577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:58.760774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.761752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.762248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.769281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:58.769281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:58.770130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:58.827936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:58.865919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6ac965fe-6d1f-4a85-b70c-236c176d4fe6 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.618562 Nov 02 21:31:58.874919 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1197/2481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:58 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:58.882203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48eff5b4-4862-4506-9452-9f437c04164c tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:58.890597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48eff5b4-4862-4506-9452-9f437c04164c tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:59.017697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:59.045676 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46e9ed07-b5c8-4c4f-8193-7f12c9258eaa tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1273 microversion: 2.1 time: 0.340761 Nov 02 21:31:59.047991 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1285/2482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:58 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:59.059324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:59.060629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:59.068476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:59.069356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:59.070789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:59.071689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:59.072564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:59.073255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:59.095830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48eff5b4-4862-4506-9452-9f437c04164c tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:59.107485 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48eff5b4-4862-4506-9452-9f437c04164c tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1224 microversion: 2.1 time: 0.231250 Nov 02 21:31:59.109635 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1198/2483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:58 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1224 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:59.276391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:31:59.277691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:31:59.292850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:59.297000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:59.298869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:59.300402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:59.307209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:59.308011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:59.599020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:31:59.616868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be97a4a4-f942-4814-8a88-afcdf77fc9f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1463 microversion: 2.1 time: 0.567127 Nov 02 21:31:59.645883 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1286/2484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:59 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1463 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:31:59.653622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d2b99c16-32f6-4eff-a958-a11c6a246140 req-ad7a0844-8c45-4a4b-a9fa-8432230edbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215e245d-4a95-4290-8fe6-4254c8f2cea9", "name": "network-vif-unplugged", "status": "completed", "tag": "f41895c4-2ac3-4ebd-a940-d92bb8f69363"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:31:59.698100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d2b99c16-32f6-4eff-a958-a11c6a246140 req-ad7a0844-8c45-4a4b-a9fa-8432230edbb4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:31:59.700798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d2b99c16-32f6-4eff-a958-a11c6a246140 req-ad7a0844-8c45-4a4b-a9fa-8432230edbb4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:31:59.704199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d2b99c16-32f6-4eff-a958-a11c6a246140 req-ad7a0844-8c45-4a4b-a9fa-8432230edbb4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:31:59.739937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.server_external_events [req-d2b99c16-32f6-4eff-a958-a11c6a246140 req-ad7a0844-8c45-4a4b-a9fa-8432230edbb4 service nova] Unable to find a host for instance 215e245d-4a95-4290-8fe6-4254c8f2cea9. Dropping event network-vif-unplugged {{(pid=121040) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 21:31:59.755582 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d2b99c16-32f6-4eff-a958-a11c6a246140 req-ad7a0844-8c45-4a4b-a9fa-8432230edbb4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096045 Nov 02 21:31:59.762968 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1287/2485] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 112 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 21:32:00.109428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:00.110713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:00.119316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:00.120276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:00.120914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:00.121980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:00.122624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:00.123232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:00.365854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:00.401973 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d822a848-8714-4e83-8ff6-c66e9c7276ba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 200 len: 1447 microversion: 2.1 time: 1.130779 Nov 02 21:32:00.404655 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1199/2486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:59 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 1447 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:00.421497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:00.422352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:00.431173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:00.434473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:00.435122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:00.435739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:00.437181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:00.437836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:00.439350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:00.600605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:00.611628 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aaf550ed-0f55-4ffc-8116-c195c57790fb tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1277 microversion: 2.1 time: 0.205566 Nov 02 21:32:00.614443 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1200/2487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:00 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:00.630740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:00.631710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:00.641720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:00.648186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:00.648186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:00.648186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:00.648186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:00.648186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.012442 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3c0cbe8-95f6-4bb2-a49c-c96aae2bba96 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1614 microversion: 2.1 time: 1.252402 Nov 02 21:32:01.023354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1288/2488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:31:59 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1614 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:01.034625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:01.035446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:01.045108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.047935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.048604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.049691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.050738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.052994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.233500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:01.239107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:01.243538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-18f5a081-f080-460e-b447-d20e4310c9a8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.617222 Nov 02 21:32:01.256090 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1201/2489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:00 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:01.261488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:01.262398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:01.270003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.270834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.271515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.272723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.273443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.274095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.284879 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ec78dd1-a8c1-4bf5-b907-e9fd74f76633 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1279 microversion: 2.1 time: 0.267811 Nov 02 21:32:01.301668 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1289/2490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:01 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:01.316537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:01.316537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:01.343865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.344384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.344832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.345617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.346079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.346665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.379348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:01.387424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.api [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Working on deleting snapshot bb049921-565f-4c35-ad5d-036603705069 from shelved instance... Nov 02 21:32:01.461565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:01.480195 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d5c1875-c94f-4d57-b2da-35ef7b631e9a tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1220 microversion: 2.1 time: 0.222524 Nov 02 21:32:01.497365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1202/2491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:01 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1220 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:01.508294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:01.514123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:01.530600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.532105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.532733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.537952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:01.538630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:01.539254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:01.641814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '797913cfdee748ec984de6b8b16b2d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9da48f72e6f4a3789e4726d913b7818', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:01.642340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] flavor_id is None. Assuming migration. {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 21:32:01.649054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 21:32:02.349984 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ccd1bdf-5433-49d8-9dd2-277deeb51ce6 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467/action" status: 202 len: 0 microversion: 2.1 time: 0.850157 Nov 02 21:32:02.351676 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1203/2492] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:32:01 2022] POST /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467/action => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:32:02.363131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:02.363641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:02.382728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:02.383245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:02.383884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:02.384409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:02.389625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:02.390280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:02.648285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:02.664196 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5f2ed9b-2fa6-44fe-9313-434434fee5cc tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1283 microversion: 2.1 time: 0.309645 Nov 02 21:32:02.667292 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1204/2493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:02 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1283 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:02.678842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:02.680077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:02.689729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:02.691366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:02.692108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:02.693455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:02.694164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:02.694672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:03.101496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:03.115136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-942395c3-7ff7-40e8-92da-1eab0a563a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1389 microversion: 2.1 time: 0.446054 Nov 02 21:32:03.117407 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1205/2494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:02 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1389 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:03.133106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:03.133106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:03.146165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:03.146678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:03.147133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:03.147859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:03.148317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:03.149793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:04.055165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:04.063074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Doing local delete in cell 8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=121040) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 21:32:04.068795 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4dce70f5-1232-4564-8fb9-b64285cfa315 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1321 microversion: 2.1 time: 0.949360 Nov 02 21:32:04.070074 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1206/2495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:03 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1321 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:04.077353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:04.078313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:04.083972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:04.084513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:04.085009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:04.089096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:04.090017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:04.091231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:04.092163 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.api [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 21:32:04.092280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:04.092976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:04.100419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:04.113646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] deallocate_for_instance() {{(pid=121040) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 21:32:04.512039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:04.572459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:04.585223 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40323e45-2858-4ce4-8c54-f76dae9b31c8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1472 microversion: 2.1 time: 0.513573 Nov 02 21:32:04.586352 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1207/2496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:04 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1472 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:04.591226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:04.592117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:04.599344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:04.599972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:04.601059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:04.602869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:04.604170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:04.605440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:04.752091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:04.762242 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ca81c67-e56a-45ea-baa7-3d4851b9106d tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1282 microversion: 2.1 time: 0.174376 Nov 02 21:32:04.762898 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1208/2497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:04 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:04.870814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1984982199", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b6788943-0c27-4fac-906b-3c6e750ae60f"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:04.942996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] validate_networks() for [('b6788943-0c27-4fac-906b-3c6e750ae60f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:32:06.677867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:32:06.678969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:32:06.691131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:32:06.691131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:32:06.691131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:32:06.712694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:06.714396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:06.714941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:06.715939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:06.716430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:06.716915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:06.721120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Updating instance_info_cache with network_info: [] {{(pid=121040) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:32:06.739848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Getting quotas for project 94aad92d3fff4b30a401dcf079e5c9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:06.745593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Getting quotas for user f4c2b030d794456c9105b76c36fc56a6 and project 94aad92d3fff4b30a401dcf079e5c9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:06.759717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:32:06.762172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:32:07.048393 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-78d042a9-bace-4d88-9521-3c8d15ddb56b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.284270 Nov 02 21:32:07.055421 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1209/2498] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:32:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:32:07.060968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:07.061660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:07.080190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.080190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.080190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.080190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.081367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.082241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.087583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:07.352196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:07.360252 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c208bb32-4e91-49d3-bb74-d162f76f1e7d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1325 microversion: 2.1 time: 0.303367 Nov 02 21:32:07.374861 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1210/2499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:07 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:07.381101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:07.382256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:07.390717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.391283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.391658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.392744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.393739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.394547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.635897 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df3b7b72-4ab6-4b20-a5e6-ae7ef7f19118 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 204 len: 0 microversion: 2.1 time: 6.332879 Nov 02 21:32:07.636594 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1290/2500] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:01 2022] DELETE /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 0 bytes in 6334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:07.643702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:07.644363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:07.650820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.651311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.651817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.652530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.653015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.653753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.694718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:07.714225 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42f61599-499f-47a4-a6a3-0fb24376eba8 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1379 microversion: 2.1 time: 0.337481 Nov 02 21:32:07.714627 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1211/2501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:07 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1379 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:07.791583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ab0f83bb-310e-4703-9ee1-3b0a8c0e414d req-9f8f4f76-f9c9-461f-a0f6-e9ab48bee0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257129d0-76fe-4bf1-9b56-a1ee68ee35bb", "tag": "8612de66-9c72-4b20-872b-cb49dc63f450"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:07.803042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ab0f83bb-310e-4703-9ee1-3b0a8c0e414d req-9f8f4f76-f9c9-461f-a0f6-e9ab48bee0db service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.803532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ab0f83bb-310e-4703-9ee1-3b0a8c0e414d req-9f8f4f76-f9c9-461f-a0f6-e9ab48bee0db service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.803970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ab0f83bb-310e-4703-9ee1-3b0a8c0e414d req-9f8f4f76-f9c9-461f-a0f6-e9ab48bee0db service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.820094 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ab0f83bb-310e-4703-9ee1-3b0a8c0e414d req-9f8f4f76-f9c9-461f-a0f6-e9ab48bee0db service nova] Creating event network-changed:8612de66-9c72-4b20-872b-cb49dc63f450 for instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb on n-h1-860863-4 Nov 02 21:32:07.825796 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ab0f83bb-310e-4703-9ee1-3b0a8c0e414d req-9f8f4f76-f9c9-461f-a0f6-e9ab48bee0db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109930 Nov 02 21:32:07.827156 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1212/2502] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:07.833334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:07.834287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:07.841164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.841864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.842467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:07.843461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:07.844077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:07.844666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.119276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:08.148542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:08.170972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-37585785-19f8-4bf3-a3fd-8d65e2f8b761 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1321 microversion: 2.1 time: 0.533270 Nov 02 21:32:08.171572 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1291/2503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:07 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:08.192296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:08.195209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:08.212732 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-87e5cb13-210b-424d-ae0f-d6e2c8af72e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1472 microversion: 2.1 time: 0.376601 Nov 02 21:32:08.212732 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1213/2504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:07 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:08.234796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:08.235827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:08.243240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.248014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.248014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.248014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.248014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.248014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.255892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-060bb87e-3457-4de6-8a6e-b6b903fbbd06 req-8b39ef54-7ef0-4396-93c4-3e19f61f32b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e400a75-8726-4f78-a1f1-4e2c15183f2c", "tag": "850edffd-8fad-404d-a6fb-0d618b5b34ae"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:08.266496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-060bb87e-3457-4de6-8a6e-b6b903fbbd06 req-8b39ef54-7ef0-4396-93c4-3e19f61f32b4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.267214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-060bb87e-3457-4de6-8a6e-b6b903fbbd06 req-8b39ef54-7ef0-4396-93c4-3e19f61f32b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.267674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-060bb87e-3457-4de6-8a6e-b6b903fbbd06 req-8b39ef54-7ef0-4396-93c4-3e19f61f32b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.281147 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-060bb87e-3457-4de6-8a6e-b6b903fbbd06 req-8b39ef54-7ef0-4396-93c4-3e19f61f32b4 service nova] Creating event network-changed:850edffd-8fad-404d-a6fb-0d618b5b34ae for instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c on n-h1-860863-4 Nov 02 21:32:08.288303 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-060bb87e-3457-4de6-8a6e-b6b903fbbd06 req-8b39ef54-7ef0-4396-93c4-3e19f61f32b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115512 Nov 02 21:32:08.289302 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1292/2505] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:08.296034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3535b5a6-1460-424e-87a3-cea4709b51e2 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:08.297014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3535b5a6-1460-424e-87a3-cea4709b51e2 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:08.477352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3535b5a6-1460-424e-87a3-cea4709b51e2 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:08.485122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3535b5a6-1460-424e-87a3-cea4709b51e2 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:08.486569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3535b5a6-1460-424e-87a3-cea4709b51e2 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:08.488577 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3535b5a6-1460-424e-87a3-cea4709b51e2 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1259 microversion: 2.21 time: 0.197704 Nov 02 21:32:08.489176 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1293/2506] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:08 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:08.493873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:08.494486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:08.501251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.501872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.502558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.503451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.504018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.504904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.520167 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 HTTP/1.1 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '215e245d-4a95-4290-8fe6-4254c8f2cea9'} Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:08.522138 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:08.526839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ac7f963-029a-4fe9-af43-149c5bb3b995 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 404 len: 111 microversion: 2.1 time: 0.035839 Nov 02 21:32:08.527715 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1294/2507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:08 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:08.536184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df05d608-b0d3-4d8d-a729-2b60d19e9245 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '.version_select at 0x7f9b696e6820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:08.542016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df05d608-b0d3-4d8d-a729-2b60d19e9245 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.542624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df05d608-b0d3-4d8d-a729-2b60d19e9245 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.543127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df05d608-b0d3-4d8d-a729-2b60d19e9245 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.562956 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df05d608-b0d3-4d8d-a729-2b60d19e9245 tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 1949 microversion: 2.1 time: 0.030988 Nov 02 21:32:08.565245 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1295/2508] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:32:08 2022] GET /compute/v2.1/os-migrations => generated 1949 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:08.571214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:08.572600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:08.582156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.582643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.583781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.585688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.586167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.587189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.594220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:08.602939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:08.612784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3e30774-5c74-44b5-b235-f339cb57af70 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1324 microversion: 2.1 time: 0.401943 Nov 02 21:32:08.619351 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1214/2509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:08 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:08.620745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:08.621511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:08.635116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.635622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.636119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.637150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.637616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.638125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.899475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:08.909927 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20cee627-b1b9-49b3-b38e-8dcee9659af8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1325 microversion: 2.1 time: 0.342260 Nov 02 21:32:08.910105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1296/2510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:08 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:08.913355 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d31f85fc-2df7-4e9c-9521-8764341a689e tempest-LiveMigrationTest-1828043475 tempest-LiveMigrationTest-1828043475-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1530 microversion: 2.1 time: 0.297956 Nov 02 21:32:08.915646 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1215/2511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:08 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1530 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:08.929562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1982758898", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "67c3f76f-7a17-4f1f-a61d-9ec78598dc27"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:08.955283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:08.956762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:08.964412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.964911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.965384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.966513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:08.966969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:08.967869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:08.992895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] validate_networks() for [('67c3f76f-7a17-4f1f-a61d-9ec78598dc27', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:32:08.999657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:09.441451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:32:09.442884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:32:09.443412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:32:09.444058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:32:09.444676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:32:09.455266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:09.455814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:09.456256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:09.457007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:09.457637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:09.458068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:09.472099 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e816cbf5-d5f6-4dc4-a58a-939e9a6f9b7c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 204 len: 0 microversion: 2.1 time: 0.520694 Nov 02 21:32:09.474430 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1216/2512] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:08 2022] DELETE /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:09.489609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:09.490670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:09.498211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:09.499851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:09.500454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:09.501941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:09.502312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:09.503038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:09.503994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:09.510626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for user 1cb7808dc9e54e86811e0b7ad1cec847 and project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:09.528571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:32:09.529974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:32:09.724156 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edeeb66e-8915-4b7e-be7e-1f48170878db tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812967 Nov 02 21:32:09.725187 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1297/2513] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:32:09.730513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:09.731364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:09.743612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:09.744579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:09.745134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:09.750863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:09.750863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:09.750863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.142262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.152233 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-79e4085c-3070-4f82-a2f7-cb407fbe541c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1321 microversion: 2.1 time: 0.671729 Nov 02 21:32:10.152824 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1217/2514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:09 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1321 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:10.157767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:10.158464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:10.164913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.165621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.166175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.167028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.167498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.168084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.272112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.280031 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a917bbd-1381-4091-a3b8-1ca4117b058a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1472 microversion: 2.1 time: 0.553654 Nov 02 21:32:10.297887 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1298/2515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:09 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1472 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:10.301914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:10.302539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:10.308754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.309284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.309723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.310414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.310868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.311293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.444816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.454970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.473108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e71c60ec-cb4f-4b61-a0b0-17bf345a7d2f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1385 microversion: 2.1 time: 0.314483 Nov 02 21:32:10.481257 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1218/2516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:10 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1385 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:10.482841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.485238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.486708 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6c2de79-253f-4a8f-b36b-de7c2d23961a tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1311 microversion: 2.21 time: 0.190188 Nov 02 21:32:10.487647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:10.487878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1299/2517] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:10 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:10.489299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:10.493280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-422b1cbc-497a-4005-95b8-3d636c41629b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:10.494318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-422b1cbc-497a-4005-95b8-3d636c41629b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:10.505982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.513730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.513730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.513730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.513730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.513730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.567275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-422b1cbc-497a-4005-95b8-3d636c41629b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.574618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-422b1cbc-497a-4005-95b8-3d636c41629b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1215 microversion: 2.1 time: 0.085506 Nov 02 21:32:10.575465 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1300/2518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:10 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:10.580555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:10.581474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:10.589139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.589638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.590081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.590791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.591245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.591925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.708211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.720214 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14e2b2be-d825-49a1-a2d1-b3d9a7d6a3c8 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1324 microversion: 2.1 time: 0.237427 Nov 02 21:32:10.721020 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1219/2519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:10 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:10.742697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e4f6b2d8-517a-4f39-b768-f569ddcbbd9c req-3244ea6f-2637-4814-87c8-c2eb59ad5cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215e245d-4a95-4290-8fe6-4254c8f2cea9", "name": "network-vif-deleted", "tag": "f41895c4-2ac3-4ebd-a940-d92bb8f69363"}, {"name": "network-changed", "server_uuid": "19434169-ffb2-42e1-9ee8-3f8163b1a63d", "tag": "bcfbe8a3-32d3-4b1a-9386-dc6bac91dba4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:10.763826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e4f6b2d8-517a-4f39-b768-f569ddcbbd9c req-3244ea6f-2637-4814-87c8-c2eb59ad5cda service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:10.764311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e4f6b2d8-517a-4f39-b768-f569ddcbbd9c req-3244ea6f-2637-4814-87c8-c2eb59ad5cda service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:10.765140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e4f6b2d8-517a-4f39-b768-f569ddcbbd9c req-3244ea6f-2637-4814-87c8-c2eb59ad5cda service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:10.783372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.server_external_events [req-e4f6b2d8-517a-4f39-b768-f569ddcbbd9c req-3244ea6f-2637-4814-87c8-c2eb59ad5cda service nova] Unable to find a host for instance 215e245d-4a95-4290-8fe6-4254c8f2cea9. Dropping event network-vif-deleted {{(pid=121039) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 21:32:10.784659 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e4f6b2d8-517a-4f39-b768-f569ddcbbd9c req-3244ea6f-2637-4814-87c8-c2eb59ad5cda service nova] Creating event network-changed:bcfbe8a3-32d3-4b1a-9386-dc6bac91dba4 for instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d on n-h2-860863-4 Nov 02 21:32:10.788561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:10.793726 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e4f6b2d8-517a-4f39-b768-f569ddcbbd9c req-3244ea6f-2637-4814-87c8-c2eb59ad5cda service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 347 microversion: 2.1 time: 0.057495 Nov 02 21:32:10.795759 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1220/2520] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 347 bytes in 74 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 21:32:10.797410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fcc7ecf6-e4d6-4b7c-a50c-030f7265413e tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1325 microversion: 2.1 time: 0.220914 Nov 02 21:32:10.798906 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1301/2521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:10 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:11.176409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:11.177131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:11.194209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.194761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.203775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.203775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.203775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.203775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.303320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:11.303949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:11.318497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.319004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.319458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.320248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.320718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.322085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.673031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:11.681649 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9d7262e-7cdc-43a0-a28c-66dc0ffa4bdc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1321 microversion: 2.1 time: 0.509647 Nov 02 21:32:11.682416 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1221/2522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:11 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:11.688273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:11.689791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:11.697532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.698379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.699020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.699883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.700346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.700774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.739881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:11.748060 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7e056c0-65a9-41e4-9b33-57361194e417 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.448864 Nov 02 21:32:11.748669 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1302/2523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:11 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:11.754414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:11.757750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:11.769470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.773626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.774319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.775653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.776119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.777872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.847820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:11.857927 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98c78c22-7da1-41be-91de-b18d3faf20c3 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1343 microversion: 2.1 time: 0.174394 Nov 02 21:32:11.858642 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1222/2524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:11 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1343 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:11.867041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5df4a166-2857-423e-bda3-7f2fe9ebdd2d req-50f76005-9b52-4d33-ab6b-8d2f77f3f465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41aafd7d-7290-4d69-9aea-e0a65ae42c38", "name": "network-vif-deleted", "tag": "5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:11.871995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:11.879065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5df4a166-2857-423e-bda3-7f2fe9ebdd2d req-50f76005-9b52-4d33-ab6b-8d2f77f3f465 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.879817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5df4a166-2857-423e-bda3-7f2fe9ebdd2d req-50f76005-9b52-4d33-ab6b-8d2f77f3f465 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.880863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5df4a166-2857-423e-bda3-7f2fe9ebdd2d req-50f76005-9b52-4d33-ab6b-8d2f77f3f465 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.885511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:11.894983 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5df4a166-2857-423e-bda3-7f2fe9ebdd2d req-50f76005-9b52-4d33-ab6b-8d2f77f3f465 service nova] Creating event network-vif-deleted:5e5d87f5-b622-4ca0-a7d0-4d25a3b30d02 for instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 on n-h2-860863-4 Nov 02 21:32:11.900666 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5df4a166-2857-423e-bda3-7f2fe9ebdd2d req-50f76005-9b52-4d33-ab6b-8d2f77f3f465 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040721 Nov 02 21:32:11.901618 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1223/2525] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:11.907020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:11.907806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:11.921475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.922361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:11.923765 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fc085d9-34f4-4cad-8be5-74f99d700b4c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1317 microversion: 2.21 time: 0.174119 Nov 02 21:32:11.935653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.935653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.935653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.935653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.935653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.945791 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1303/2526] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:11 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:11.951457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:11.953197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:11.962755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.963585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.964217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:11.965158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:11.965978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:11.966815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:12.066247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:12.076372 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a0664c2b-fd60-4dc7-9f9a-32f7093a53e8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1211 microversion: 2.1 time: 0.173490 Nov 02 21:32:12.077715 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1224/2527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:11 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:12.083776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:12.084728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:12.091685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:12.092591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:12.093255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:12.097727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:12.097727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:12.097727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:12.394173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:12.406821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:12.414076 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b17ca66-3d8b-4804-8384-39298f3f8b6f tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1324 microversion: 2.1 time: 0.463742 Nov 02 21:32:12.414076 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1304/2528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:11 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1324 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:12.424066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5eef1dad-3cde-4c77-908a-c3d9603d6e1c tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1325 microversion: 2.1 time: 0.345003 Nov 02 21:32:12.426044 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1225/2529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:12 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:12.711655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:12.712696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:12.739524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:12.742114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:12.743387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:12.744118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:12.745187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:12.747213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:12.748864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:12.775483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:12.776171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:12.787705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:12.788524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:12.789150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:12.793430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:12.794096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:12.794678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.111184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.125753 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7a905aef-b4ba-4fed-99b4-f227cdce0a23 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1321 microversion: 2.1 time: 0.424324 Nov 02 21:32:13.126364 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1305/2530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:12 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:13.166982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.181771 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a9dd3e9-4cc0-4f4d-ac8d-78f1b51920fb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.410170 Nov 02 21:32:13.182682 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1226/2531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:12 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:13.189609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:13.190778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:13.210536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.211100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.211553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.212319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.213009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.213619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.231236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:13.267898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-91e0a35c-9979-43e9-bcaf-f312200e4864 req-420e80c3-f51e-4652-b7c8-bf22507ba30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19434169-ffb2-42e1-9ee8-3f8163b1a63d", "name": "network-vif-plugged", "status": "completed", "tag": "bcfbe8a3-32d3-4b1a-9386-dc6bac91dba4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:13.289474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-91e0a35c-9979-43e9-bcaf-f312200e4864 req-420e80c3-f51e-4652-b7c8-bf22507ba30f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.290328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-91e0a35c-9979-43e9-bcaf-f312200e4864 req-420e80c3-f51e-4652-b7c8-bf22507ba30f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.291543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-91e0a35c-9979-43e9-bcaf-f312200e4864 req-420e80c3-f51e-4652-b7c8-bf22507ba30f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.318516 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-91e0a35c-9979-43e9-bcaf-f312200e4864 req-420e80c3-f51e-4652-b7c8-bf22507ba30f service nova] Creating event network-vif-plugged:bcfbe8a3-32d3-4b1a-9386-dc6bac91dba4 for instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d on n-h2-860863-4 Nov 02 21:32:13.325926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-91e0a35c-9979-43e9-bcaf-f312200e4864 req-420e80c3-f51e-4652-b7c8-bf22507ba30f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182167 Nov 02 21:32:13.327677 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1306/2532] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:13.335798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:13.337361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:13.344539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.345416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.346324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.347732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.348508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.349211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.377794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.396426 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3754ee4a-fa06-4c23-9cb2-ba27587245cd tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1183 microversion: 2.1 time: 0.212650 Nov 02 21:32:13.400772 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1227/2533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:13 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:13.406463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:13.408295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:13.415847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.416887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.417521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.418490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.419095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.419668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.559987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.575668 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9fbb65db-8d1c-4abf-98a7-608ba78189c5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1275 microversion: 2.1 time: 0.173083 Nov 02 21:32:13.589530 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1228/2534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:13 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:13.598674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:13.600479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:13.609228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.611053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.611669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.612684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.613832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.614456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.903216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.913252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.914725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.916732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-abfb685c-6da1-4305-b3d3-9ae68debaaa8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.587576 Nov 02 21:32:13.917566 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1307/2535] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:13 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:13.944167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:13.945164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:13.952444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.959433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.960178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.961007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:13.961560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:13.962102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:13.974447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:13.982977 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf3c0821-31e5-4f7a-b3bc-e9ceaabd85dd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1324 microversion: 2.1 time: 0.392047 Nov 02 21:32:13.983816 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1229/2536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:13 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1324 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:14.155195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:14.156366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:14.161493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:14.166549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.167360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.172366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.172366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.172366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.172366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.172842 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c83ecab-37d1-4e1a-9425-e8d1355c3728 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1325 microversion: 2.1 time: 0.251844 Nov 02 21:32:14.172842 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1308/2537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:13 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1325 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:14.211993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:14.212856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:14.231147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.231796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.233822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.233822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.233822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.236817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.564624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:14.583751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04ef396f-996b-4a90-871f-19bc2645f459 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.379693 Nov 02 21:32:14.597991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:14.598969 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1309/2538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:14 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:14.605691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:14.606542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:14.609349 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-74974ef5-2bf8-4a62-bf5e-4ed99cda3f70 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1321 microversion: 2.1 time: 0.458137 Nov 02 21:32:14.619105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.619814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.620394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.621626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.630513 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1230/2539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:14 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:14.633759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.635284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.637355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:14.638198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:14.646958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.647751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.648395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.649354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.650348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.651206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.805057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:14.816652 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9d33edc-795c-40a5-bb18-e8ee1b5d23c1 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1183 microversion: 2.1 time: 0.216331 Nov 02 21:32:14.829384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1310/2540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:14 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:14.913057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:14.923997 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1fa6417-53e9-4ff4-a192-a051c290449c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.288810 Nov 02 21:32:14.926554 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1231/2541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:14 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:14.948961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:14.950346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:14.957061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.961938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.961938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:14.961938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:14.961938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:14.961938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.009166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:15.009970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:15.016520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.018557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.018557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.018850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.019636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.020295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.304619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:15.314054 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3698f4f8-c456-4ed5-8afa-c92a1a0ef8e7 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1324 microversion: 2.1 time: 0.310366 Nov 02 21:32:15.315672 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1232/2542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:15 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:15.339624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-90fcb13f-cb20-402d-b87c-0109467cbf80 req-df3588cf-5420-4c4f-a00f-3a4f68d1643d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b78481-0f54-43e0-b8d1-62577e04c750", "tag": "678167f7-31aa-4d87-86e5-6dcbdd50b090"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:15.350982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-90fcb13f-cb20-402d-b87c-0109467cbf80 req-df3588cf-5420-4c4f-a00f-3a4f68d1643d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.351701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-90fcb13f-cb20-402d-b87c-0109467cbf80 req-df3588cf-5420-4c4f-a00f-3a4f68d1643d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.352388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-90fcb13f-cb20-402d-b87c-0109467cbf80 req-df3588cf-5420-4c4f-a00f-3a4f68d1643d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.367008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-90fcb13f-cb20-402d-b87c-0109467cbf80 req-df3588cf-5420-4c4f-a00f-3a4f68d1643d service nova] Creating event network-changed:678167f7-31aa-4d87-86e5-6dcbdd50b090 for instance 84b78481-0f54-43e0-b8d1-62577e04c750 on n-h1-860863-4 Nov 02 21:32:15.367687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:15.373670 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-90fcb13f-cb20-402d-b87c-0109467cbf80 req-df3588cf-5420-4c4f-a00f-3a4f68d1643d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056149 Nov 02 21:32:15.374801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1233/2543] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:15.381981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:15.382868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:15.386394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:15.388091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:15.389416 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1a1e5462-2f5b-4475-83fe-fd798e178d07 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.444846 Nov 02 21:32:15.405003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.405003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.405003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.405003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.405003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.405003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.406114 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1311/2544] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:14 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:15.413627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-eba72795-033f-4bd2-a00b-4248d581fdcd req-2bc42ebe-f253-49db-a7be-aad46da4603b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257129d0-76fe-4bf1-9b56-a1ee68ee35bb", "name": "network-vif-plugged", "status": "completed", "tag": "8612de66-9c72-4b20-872b-cb49dc63f450"}, {"server_uuid": "7e400a75-8726-4f78-a1f1-4e2c15183f2c", "name": "network-vif-plugged", "status": "completed", "tag": "850edffd-8fad-404d-a6fb-0d618b5b34ae"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:15.433830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eba72795-033f-4bd2-a00b-4248d581fdcd req-2bc42ebe-f253-49db-a7be-aad46da4603b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.434552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eba72795-033f-4bd2-a00b-4248d581fdcd req-2bc42ebe-f253-49db-a7be-aad46da4603b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.435142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eba72795-033f-4bd2-a00b-4248d581fdcd req-2bc42ebe-f253-49db-a7be-aad46da4603b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.454232 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-eba72795-033f-4bd2-a00b-4248d581fdcd req-2bc42ebe-f253-49db-a7be-aad46da4603b service nova] Creating event network-vif-plugged:8612de66-9c72-4b20-872b-cb49dc63f450 for instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb on n-h1-860863-4 Nov 02 21:32:15.454917 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-eba72795-033f-4bd2-a00b-4248d581fdcd req-2bc42ebe-f253-49db-a7be-aad46da4603b service nova] Creating event network-vif-plugged:850edffd-8fad-404d-a6fb-0d618b5b34ae for instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c on n-h1-860863-4 Nov 02 21:32:15.463738 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-eba72795-033f-4bd2-a00b-4248d581fdcd req-2bc42ebe-f253-49db-a7be-aad46da4603b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056036 Nov 02 21:32:15.465264 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1312/2545] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:15.608051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:15.609297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:15.616660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.616863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.617348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.618133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.618693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.619257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.747896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:15.763667 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d6f45cdf-df76-4567-862d-f5b9c29b2e98 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1325 microversion: 2.1 time: 0.387460 Nov 02 21:32:15.765665 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1234/2546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:15 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:15.774216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:15.775983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:15.787188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.788228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.789118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:15.790168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:15.790699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:15.791382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.320817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.331426 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c26ee9c4-d90f-46fe-8e2b-f47825dea684 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.727554 Nov 02 21:32:16.332360 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1313/2547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:15 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:16.337882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:16.338751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:16.345615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.347213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.348105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.349405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.350069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.350681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.375533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.384392 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-016f510b-13f2-460d-a4cb-f38b5fb4576d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1321 microversion: 2.1 time: 0.617420 Nov 02 21:32:16.385524 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1235/2548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:15 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:16.391335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:16.394367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:16.404231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.404824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.405571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.406699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.407253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.407759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.422877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.433643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e6cd1d8-5fa8-408c-b3f6-cc32c6aa0c6f tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1183 microversion: 2.1 time: 0.099952 Nov 02 21:32:16.448989 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1314/2549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:16 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:16.448989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3e142a50-ff96-4d0e-88c5-05841fc2f2e7 req-eb601790-fbc3-4b74-8513-4745eec4fbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81329b61-decf-4a21-a88b-3fb5a3e4f7a9", "tag": "f1710205-2eee-461a-8f4e-b89be1e59030"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:16.455414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3e142a50-ff96-4d0e-88c5-05841fc2f2e7 req-eb601790-fbc3-4b74-8513-4745eec4fbe0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.459767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3e142a50-ff96-4d0e-88c5-05841fc2f2e7 req-eb601790-fbc3-4b74-8513-4745eec4fbe0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.459767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3e142a50-ff96-4d0e-88c5-05841fc2f2e7 req-eb601790-fbc3-4b74-8513-4745eec4fbe0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.471041 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3e142a50-ff96-4d0e-88c5-05841fc2f2e7 req-eb601790-fbc3-4b74-8513-4745eec4fbe0 service nova] Creating event network-changed:f1710205-2eee-461a-8f4e-b89be1e59030 for instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 on n-h1-860863-4 Nov 02 21:32:16.477020 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3e142a50-ff96-4d0e-88c5-05841fc2f2e7 req-eb601790-fbc3-4b74-8513-4745eec4fbe0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041374 Nov 02 21:32:16.477812 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1315/2550] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:16.483764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:16.484472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:16.491834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.492425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.492888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.500628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.500628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.500628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.514725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:16.648645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.657308 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6148cd59-e42e-42d8-a7c9-d29dcf3cfe44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.270370 Nov 02 21:32:16.657897 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1236/2551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:16 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:16.663432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:16.664437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:16.670762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.671480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.672079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.674972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.674972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.674972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.726514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:16.754139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=18 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:16.841365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.851248 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bbba58d2-9862-4c61-8816-fb7971dd9a71 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1522 microversion: 2.1 time: 0.371552 Nov 02 21:32:16.865266 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1316/2552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:16 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:16.865266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:16.865266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:16.865266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.865266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.868425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.868425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.868425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.868425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.876616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.906719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.909323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:16.910836 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa9712af-a9f4-4a78-8f30-8f7e151a398c tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.251606 Nov 02 21:32:16.912008 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1237/2553] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:16 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:16.917411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:16.918379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:16.930574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.931183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.931793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.932853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:16.936625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:16.936625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:16.966987 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] HTTP exception thrown: Action 999 not found Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Request method failure captured: Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d/os-instance-actions/999 HTTP/1.1 Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuHGoQbJ8w_jRVJ8nCD-e0zEKyMSGk2LvK_Yff8lXKJt-tTgguQZLBZ7PfNCjehyl7_58cXvPGEOXoxGuU6Nl_uanhP-Uf5uIUckR6FASdUVVnnkWtHtFPZCCUNv2mDtQuBNhKCS4fNdS-dMaaarOp-8Gb8guadiUEKbqJgjf6HPxLs Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b9777210f32a4676861f7d21919de0ea Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9777210f32a4676861f7d21919de0ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b9777210f32a4676861f7d21919de0ea Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-InstanceActionsNegativeTestJSON-1515281050-project Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 85f5d9be7b56449698b13ba101119b1f Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1515281050-project Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: exception: Action 999 not found Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': '19434169-ffb2-42e1-9ee8-3f8163b1a63d', 'id': '999'} Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 02 21:32:16.981527 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:16.984583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Returning 404 to user: Action 999 not found {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:16.984583 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8986b03-edc7-47f6-ac9f-939fdde40fab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.069781 Nov 02 21:32:16.984583 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1238/2554] 10.222.0.25 () {58 vars in 1308 bytes} [Wed Nov 2 21:32:16 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d/os-instance-actions/999 => generated 66 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:32:16.995847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8114fd04-1402-4c90-b447-bd96793e0bdd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '.version_select at 0x7f9b68bd4790>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:16.996577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8114fd04-1402-4c90-b447-bd96793e0bdd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: af7a4660-731d-4d82-88cf-6a22ca57305e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:17.003045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:17.004616 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8114fd04-1402-4c90-b447-bd96793e0bdd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] HTTP exception thrown: Instance af7a4660-731d-4d82-88cf-6a22ca57305e could not be found. Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8114fd04-1402-4c90-b447-bd96793e0bdd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Request method failure captured: Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/af7a4660-731d-4d82-88cf-6a22ca57305e/os-instance-actions HTTP/1.1 Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuHGoQbJ8w_jRVJ8nCD-e0zEKyMSGk2LvK_Yff8lXKJt-tTgguQZLBZ7PfNCjehyl7_58cXvPGEOXoxGuU6Nl_uanhP-Uf5uIUckR6FASdUVVnnkWtHtFPZCCUNv2mDtQuBNhKCS4fNdS-dMaaarOp-8Gb8guadiUEKbqJgjf6HPxLs Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b9777210f32a4676861f7d21919de0ea Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9777210f32a4676861f7d21919de0ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b9777210f32a4676861f7d21919de0ea Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-InstanceActionsNegativeTestJSON-1515281050-project Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 85f5d9be7b56449698b13ba101119b1f Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1515281050-project Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance af7a4660-731d-4d82-88cf-6a22ca57305e could not be found. Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': 'af7a4660-731d-4d82-88cf-6a22ca57305e'} Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a4660-731d-4d82-88cf-6a22ca57305e could not be found. Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:17.006513 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a4660-731d-4d82-88cf-6a22ca57305e could not be found. Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a4660-731d-4d82-88cf-6a22ca57305e could not be found. Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8114fd04-1402-4c90-b447-bd96793e0bdd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Returning 404 to user: Instance af7a4660-731d-4d82-88cf-6a22ca57305e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8114fd04-1402-4c90-b447-bd96793e0bdd tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/af7a4660-731d-4d82-88cf-6a22ca57305e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.017509 Nov 02 21:32:17.010101 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1239/2555] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 21:32:16 2022] GET /compute/v2.1/servers/af7a4660-731d-4d82-88cf-6a22ca57305e/os-instance-actions => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:17.019529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:17.020325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:17.027298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.027838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.028285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.029028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.029491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.030091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.063570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:17.093676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:17.103052 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea0bbe05-3e50-4a5b-b985-e4d2545b9364 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1325 microversion: 2.1 time: 0.250135 Nov 02 21:32:17.104248 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1317/2556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:16 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1325 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:17.358307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:17.359088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:17.365991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.367455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.367951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.368727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.369513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.370700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.531538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:17.542354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d4b88c6-8cf1-464b-9152-b59dffb9950d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.187832 Nov 02 21:32:17.542947 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1318/2557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:17 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:17.560906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:17.561575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:17.574840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.575340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.575885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.576657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.577149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.577883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.580078 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ba40c09-ae0b-4a48-aa3e-2550c1606760 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "DELETE /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 204 len: 0 microversion: 2.1 time: 0.565584 Nov 02 21:32:17.584489 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1240/2558] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:17 2022] DELETE /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:32:17.596228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:17.597166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:17.604366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.605117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.605567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.606286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.606751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.607186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.684177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:17.694531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7cf99147-88b3-4a6f-ad56-bd6602f43a83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1183 microversion: 2.1 time: 0.108679 Nov 02 21:32:17.695124 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1241/2559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:17 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:17.700127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:17.700958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:17.708128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.708904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.718888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.718888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.719083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.719474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.751255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:17.759792 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61687bea-a480-496d-b1af-3de8c03723e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1503 microversion: 2.1 time: 0.210807 Nov 02 21:32:17.760450 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1319/2560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:17 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:17.765219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:17.765830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:17.772803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.773510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.774185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.775037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:17.775634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:17.776204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:17.971319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:17.979313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:17.989844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a03c37af-a0f5-4685-9d1e-9efc3e301df1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.227878 Nov 02 21:32:17.993858 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1320/2561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:17 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:18.000215 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59880191-8ac1-49d8-ab2c-759d63691f68 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1528 microversion: 2.1 time: 0.303324 Nov 02 21:32:18.001079 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1242/2562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:17 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1528 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:18.007442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:18.008278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:18.015015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.015714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.016333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.017564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.018366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.019913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.021194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:18.021898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:18.043601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.044199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.044877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.045849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.046525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.047151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.330006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:18.341868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:18.342188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:18.346161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:18.349054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:18.350252 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7083c107-6062-44cf-b4ef-c42c84006fe8 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.347801 Nov 02 21:32:18.351323 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1243/2563] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:18 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:18.357199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:18.357815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:18.366199 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-adc08111-a44a-412e-91d5-4c36fe65efc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1503 microversion: 2.1 time: 0.368661 Nov 02 21:32:18.370267 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1321/2564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:17 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1503 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:18.394801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.396773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:18.397143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.397606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.398333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.398938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:18.400696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.401343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.413137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.415466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.415998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.418425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.418984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.420171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.481346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:18.830034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:18.845553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bbe0065e-f0c9-401d-98a3-b84b1a161b0d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1521 microversion: 2.1 time: 0.493050 Nov 02 21:32:18.857163 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1244/2565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:18 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:18.857163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:18.857163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:18.857451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.857770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.858220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.858920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.859356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.865022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.934595 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dff9b454-81d2-4265-ab4d-de64888c2520 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 204 len: 0 microversion: 2.1 time: 0.543665 Nov 02 21:32:18.938441 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1322/2566] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:18 2022] DELETE /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:18.944640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:18.946637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:18.953063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.953567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.954014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.954728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.955191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.955630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.990990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:18.991483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:18.993340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:18.993340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lazy-loading 'fault' on Instance uuid 41aafd7d-7290-4d69-9aea-e0a65ae42c38 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:19.101690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.111519 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03bb771a-13fc-490a-bf54-2342ccf55ce4 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 200 len: 1188 microversion: 2.1 time: 0.171809 Nov 02 21:32:19.112955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1323/2567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:18 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 1188 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:19.123090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:19.123839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:19.131336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.132147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.133070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.133965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.134565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.134994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.161479 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] HTTP exception thrown: Instance is not a member of specified network Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Request method failure captured: Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb/ips/invalid HTTP/1.1 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuHCffksqns-_mMOO0yfDTChnqUAU8C9FF4nyQ3mlIz-7FOxDKrOwkDqbxag8Q4KsbD-IKSspWXANkiTFfbRem8uOxwT6N_WwG98bgsQ5dBarJfHkmXmI-hmLnMA6pBiyP9WQKUIefi1NRAZ0ti6zF2mbq0STeKAPO70mdPXPQPs9vE Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: bd426e6d43d44ef395ad2dca7e4e0a72 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: bd426e6d43d44ef395ad2dca7e4e0a72 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerAddressesNegativeTestJSON-1872675383-project Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e8dd93372e2b4a8aaa696a62ee220ab2 Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1872675383-project Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance is not a member of specified network Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': '257129d0-76fe-4bf1-9b56-a1ee68ee35bb', 'id': 'invalid'} Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 02 21:32:19.169704 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.174580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Returning 404 to user: Instance is not a member of specified network {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:19.176783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0811467d-d5e4-4220-a08f-c4240162e7a2 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.060643 Nov 02 21:32:19.179314 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1324/2568] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:32:19 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb/ips/invalid => generated 91 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:32:19.184749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.189152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:19.189822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:19.196625 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c57811d-d7b8-4e47-8bb3-fbcfb1af2540 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.346261 Nov 02 21:32:19.196625 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1245/2569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:18 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:19.198870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.199026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:19.199375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.199694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:19.199809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.200569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.202698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.203447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.205885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.206116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.206564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.207852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.208312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.208744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.470854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:19.557811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.567558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.567770 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-076b0913-e115-4bb1-8a81-64a4326b170a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.372433 Nov 02 21:32:19.569706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1246/2570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:19 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:19.573648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:19.574583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:19.580255 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98308a7f-f555-4fde-9e6a-4155955849ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1509 microversion: 2.1 time: 0.398135 Nov 02 21:32:19.580826 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1325/2571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:19 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:19.582459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.588782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.588782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.588782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.588782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.588782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.589223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7f7df5c-e7fd-4ebc-9eb6-a9c59b1e599d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:19.589223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7f7df5c-e7fd-4ebc-9eb6-a9c59b1e599d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Failed to fetch instance by id 999 {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 21:32:19.589588 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e7f7df5c-e7fd-4ebc-9eb6-a9c59b1e599d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] HTTP exception thrown: Instance 999 could not be found. Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7f7df5c-e7fd-4ebc-9eb6-a9c59b1e599d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Request method failure captured: Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuHCffksqns-_mMOO0yfDTChnqUAU8C9FF4nyQ3mlIz-7FOxDKrOwkDqbxag8Q4KsbD-IKSspWXANkiTFfbRem8uOxwT6N_WwG98bgsQ5dBarJfHkmXmI-hmLnMA6pBiyP9WQKUIefi1NRAZ0ti6zF2mbq0STeKAPO70mdPXPQPs9vE Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: bd426e6d43d44ef395ad2dca7e4e0a72 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: bd426e6d43d44ef395ad2dca7e4e0a72 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerAddressesNegativeTestJSON-1872675383-project Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e8dd93372e2b4a8aaa696a62ee220ab2 Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1872675383-project Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 999 could not be found. Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': '999'} Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 21:32:19.591030 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:19.595733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7f7df5c-e7fd-4ebc-9eb6-a9c59b1e599d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Returning 404 to user: Instance 999 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:19.595733 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7f7df5c-e7fd-4ebc-9eb6-a9c59b1e599d tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007782 Nov 02 21:32:19.599304 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1326/2572] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:32:19 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:32:19.605956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:19.606736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:19.613912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.614412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.614861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.615574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.616034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.616467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.888577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5d9be7b56449698b13ba101119b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9777210f32a4676861f7d21919de0ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.897571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.898715 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-384ae61a-b6a1-4219-8a65-350d13d9f478 tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 200 len: 1528 microversion: 2.1 time: 0.328847 Nov 02 21:32:19.922104 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1247/2573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:19 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 1528 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:19.922757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.924348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:19.927165 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fea89576-eee7-430c-a659-fe24b8f7deb3 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.325376 Nov 02 21:32:19.927753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1327/2574] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:19 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:19.928714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2110885764", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bbabcbcf-5198-4d9b-b686-21ca93584dd9"}], "security_groups": [{"name": "tempest-securitygroup--1987492036"}], "key_name": "tempest-keypair-1178693684", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "be1cab10-a80e-4575-809f-660dcd47f1ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:19.933093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:19.933613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:19.943318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.944104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.944680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.945620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:19.946086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:19.947394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:19.985897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:20.206951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] validate_networks() for [('bbabcbcf-5198-4d9b-b686-21ca93584dd9', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:32:20.301223 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08b98b29-20a8-49ef-bdf4-af714f1f4216 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "DELETE /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 204 len: 0 microversion: 2.1 time: 0.371319 Nov 02 21:32:20.301602 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1328/2575] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:19 2022] DELETE /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:20.307425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:20.308137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 41aafd7d-7290-4d69-9aea-e0a65ae42c38] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:20.314922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.323648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.323648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.323648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.323648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.323648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.333901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] HTTP exception thrown: Instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 could not be found. Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Request method failure captured: Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 HTTP/1.1 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAgz3QhLPPw0_UjmFhZOjFMRk9xdxIhSKGks1k1JJpCWM_LqzV0f12FY8ARGovy11eULwIMJ2Y4_s-xaQjcgMv4FK34KGH0knzNdd_xbUrGrq6THifHH7YA9AW4MTUwY9-b_N789tL5SSweQt97ieZ-8FbxT9pKkn5-E076_3PitBg Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-LiveMigrationTest-952456683 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9f705bbaa94a4a7d8e5bba79214bb359 Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 could not be found. Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '41aafd7d-7290-4d69-9aea-e0a65ae42c38'} Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 could not be found. Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 could not be found. Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:20.336289 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:20.339965 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:20.339965 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:20.339965 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:20.339965 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:20.339965 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:20.339965 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 could not be found. Nov 02 21:32:20.339965 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:20.341816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Returning 404 to user: Instance 41aafd7d-7290-4d69-9aea-e0a65ae42c38 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:20.342886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-168702e2-b98d-42d0-81c2-24d635e99eda tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38" status: 404 len: 111 microversion: 2.1 time: 0.040204 Nov 02 21:32:20.343950 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1329/2576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:20 2022] GET /compute/v2.1/servers/41aafd7d-7290-4d69-9aea-e0a65ae42c38 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:20.353708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-98d11577-3bd3-43a0-80ef-8c19e7d4dd6d req-7296c035-e5fd-446e-ba35-0479e831c499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19434169-ffb2-42e1-9ee8-3f8163b1a63d", "name": "network-vif-deleted", "tag": "bcfbe8a3-32d3-4b1a-9386-dc6bac91dba4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:20.366088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-98d11577-3bd3-43a0-80ef-8c19e7d4dd6d req-7296c035-e5fd-446e-ba35-0479e831c499 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.367186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-98d11577-3bd3-43a0-80ef-8c19e7d4dd6d req-7296c035-e5fd-446e-ba35-0479e831c499 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.367813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-98d11577-3bd3-43a0-80ef-8c19e7d4dd6d req-7296c035-e5fd-446e-ba35-0479e831c499 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.381208 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-98d11577-3bd3-43a0-80ef-8c19e7d4dd6d req-7296c035-e5fd-446e-ba35-0479e831c499 service nova] Creating event network-vif-deleted:bcfbe8a3-32d3-4b1a-9386-dc6bac91dba4 for instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d on n-h2-860863-4 Nov 02 21:32:20.387157 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-98d11577-3bd3-43a0-80ef-8c19e7d4dd6d req-7296c035-e5fd-446e-ba35-0479e831c499 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040925 Nov 02 21:32:20.388074 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1330/2577] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:20.396855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:20.398046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:20.404995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.408203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.408876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.410005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.410829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.411486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.573564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:20.629253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:20.657141 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82e532fe-3537-4faa-bd98-c6dfe0db7011 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.266254 Nov 02 21:32:20.659171 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1331/2578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:20 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:20.684910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:20.685563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:20.698012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.698502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.698945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.700039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.700174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.701187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.706179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:20.936406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:20.943863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Getting quotas for project b48783c740e441c8ad56aed0b3ad95ec. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:20.945965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffd32da8-9089-4ab2-8f13-7a7a40568505 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1527 microversion: 2.1 time: 0.284853 Nov 02 21:32:20.946754 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1332/2579] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:20 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1527 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:20.951669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:20.952435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:20.958155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Getting quotas for user e76ee5464ca941dab091f128d471431d and project b48783c740e441c8ad56aed0b3ad95ec. Resources: dict_keys(['metadata_items']) {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:20.959071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.959559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.960027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.960735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.961350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.961786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.979640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:32:20.980474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:32:20.982001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:32:20.982687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:32:20.983355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:32:20.994623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.995265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.995820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:20.996694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:20.997244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:20.997733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.022037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Getting quotas for project b48783c740e441c8ad56aed0b3ad95ec. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:21.027457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Getting quotas for user e76ee5464ca941dab091f128d471431d and project b48783c740e441c8ad56aed0b3ad95ec. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:21.109538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:32:21.112097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be1cab10-a80e-4575-809f-660dcd47f1ab',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:32:21.178337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:21.203581 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6625285d-ed2f-4813-bb3b-6a4ba9101d7c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.255955 Nov 02 21:32:21.216990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1333/2580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:20 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:21.216990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:21.216990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:21.216990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.217411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.217501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.218325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.219101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.219682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.534839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:21.546723 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8aadf7d9-825d-4a6d-aba7-6e286cf0c589 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1509 microversion: 2.1 time: 0.337953 Nov 02 21:32:21.547620 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1334/2581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:21 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:21.555237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:21.555850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] [instance: 19434169-ffb2-42e1-9ee8-3f8163b1a63d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:21.570227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.570646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.571104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.571842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.572298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.572726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.603752 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] HTTP exception thrown: Instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d could not be found. Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Request method failure captured: Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d HTTP/1.1 Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuHGoQbJ8w_jRVJ8nCD-e0zEKyMSGk2LvK_Yff8lXKJt-tTgguQZLBZ7PfNCjehyl7_58cXvPGEOXoxGuU6Nl_uanhP-Uf5uIUckR6FASdUVVnnkWtHtFPZCCUNv2mDtQuBNhKCS4fNdS-dMaaarOp-8Gb8guadiUEKbqJgjf6HPxLs Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: b9777210f32a4676861f7d21919de0ea Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b9777210f32a4676861f7d21919de0ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b9777210f32a4676861f7d21919de0ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: b9777210f32a4676861f7d21919de0ea Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1515281050 Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-InstanceActionsNegativeTestJSON-1515281050-project Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 85f5d9be7b56449698b13ba101119b1f Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1515281050-project Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d could not be found. Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '19434169-ffb2-42e1-9ee8-3f8163b1a63d'} Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d could not be found. Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d could not be found. Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:21.605566 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d could not be found. Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] Returning 404 to user: Instance 19434169-ffb2-42e1-9ee8-3f8163b1a63d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:21.610212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35734b53-04b0-4f56-9f4e-2721842f6dab tempest-InstanceActionsNegativeTestJSON-1515281050 tempest-InstanceActionsNegativeTestJSON-1515281050-project] 10.222.0.25 "GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d" status: 404 len: 111 microversion: 2.1 time: 0.058251 Nov 02 21:32:21.611436 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1335/2582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:21 2022] GET /compute/v2.1/servers/19434169-ffb2-42e1-9ee8-3f8163b1a63d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:21.616879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:21.618487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:21.624964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.630707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.630707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.630707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.630707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.630707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.660551 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-635df998-fdc5-4248-925c-fec67109baeb tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.733955 Nov 02 21:32:21.660551 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1248/2583] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:32:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:32:21.668429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e5a1848-e07b-47f8-9db9-75b42ac0e63f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:21.672458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e5a1848-e07b-47f8-9db9-75b42ac0e63f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:21.874020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e5a1848-e07b-47f8-9db9-75b42ac0e63f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:21.882142 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e5a1848-e07b-47f8-9db9-75b42ac0e63f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1122 microversion: 2.1 time: 0.218655 Nov 02 21:32:21.889281 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1249/2584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:21 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1122 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:21.913236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:21.913749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:21.928418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.929190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.929806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:21.930688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:21.939351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:21.940395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:22.081755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:22.096909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:22.098982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:22.106050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1bc8c6f2-6493-4421-9472-98d5baed894b tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.493315 Nov 02 21:32:22.122803 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1336/2585] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:21 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:22.140268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:22.140912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:22.153146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:22.156819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:22.161450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:22.162574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:22.163269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:22.164502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:22.208999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:22.219316 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e83fc1b9-738d-44f6-8dc5-957c86debf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.329832 Nov 02 21:32:22.220128 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1250/2586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:21 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:22.234425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:22.235576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:22.252725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:22.254669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:22.257794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:22.260073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:22.262187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:22.262670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:22.416655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:22.429491 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31c551e0-faac-4838-8b5b-4380e20dbb68 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1527 microversion: 2.1 time: 0.305428 Nov 02 21:32:22.433374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1337/2587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:22 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1527 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:22.572028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:22.572661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:22.583434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:22.587795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:22.588723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:22.597537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:22.598280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:22.598741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:22.686824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:22.696261 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b761026e-b0f6-474b-8cd3-bbda25001616 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.466170 Nov 02 21:32:22.708174 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1251/2588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:22 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:22.913716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed58ee78-cab8-4adc-a32c-64e24e75f9ac tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:22.914590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed58ee78-cab8-4adc-a32c-64e24e75f9ac tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:22.956235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:22.969464 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e67c8391-c154-42b2-bac1-0677082ec2bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1509 microversion: 2.1 time: 0.399101 Nov 02 21:32:22.973956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1338/2589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:22 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1509 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:23.068346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed58ee78-cab8-4adc-a32c-64e24e75f9ac tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:23.079537 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed58ee78-cab8-4adc-a32c-64e24e75f9ac tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1122 microversion: 2.1 time: 0.175904 Nov 02 21:32:23.097281 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1252/2590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:22 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1122 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:23.139634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:23.140677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:23.149731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.150666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.151336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:23.152392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.153293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.153990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:23.317389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:23.317389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:23.321498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.326436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.333070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:23.334324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.334977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.335752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:23.856293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:23.872723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:23.874524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:23.875933 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dafbd1ac-bbf7-4aaf-951c-dcc82f1c1690 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.741313 Nov 02 21:32:23.876650 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1339/2591] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:23 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:23.898924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:23.900129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:23.923224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.923759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.924254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:23.925018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.926047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.926503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:23.927273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:23.944115 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59ab27c7-f199-4911-82cb-42718096c103 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.634350 Nov 02 21:32:23.944889 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1253/2592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:23 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:23.950077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:23.953660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:23.965896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.966652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.967258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:23.969795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:23.972284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:23.972284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.165122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:24.183759 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddf5c458-2a2b-4c05-b243-13de754bb4d6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1485 microversion: 2.1 time: 0.295481 Nov 02 21:32:24.187441 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1340/2593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:23 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1485 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:24.202076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:24.202987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:24.230343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.232341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.234201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.235294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.239597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.240483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.463094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:24.471345 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93a3b4f5-99ae-490a-9176-55c1024c17d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1467 microversion: 2.1 time: 0.282612 Nov 02 21:32:24.472151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1341/2594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:24 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1467 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:24.489955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:24.490597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:24.507451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.507451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.507923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.508641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.511999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.514015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.582312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:24.593567 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1b079db-9310-41b9-8469-a46cc47bec7e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.647417 Nov 02 21:32:24.594206 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1254/2595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:23 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:24.621261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7856efed-7b44-4125-a82c-d55874065af4 req-6d963777-cc3d-4934-a653-5bd6fa02e632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257129d0-76fe-4bf1-9b56-a1ee68ee35bb", "name": "network-vif-deleted", "tag": "8612de66-9c72-4b20-872b-cb49dc63f450"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:24.638325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7856efed-7b44-4125-a82c-d55874065af4 req-6d963777-cc3d-4934-a653-5bd6fa02e632 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.638813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7856efed-7b44-4125-a82c-d55874065af4 req-6d963777-cc3d-4934-a653-5bd6fa02e632 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.639257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7856efed-7b44-4125-a82c-d55874065af4 req-6d963777-cc3d-4934-a653-5bd6fa02e632 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.686054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:24.692840 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7856efed-7b44-4125-a82c-d55874065af4 req-6d963777-cc3d-4934-a653-5bd6fa02e632 service nova] Creating event network-vif-deleted:8612de66-9c72-4b20-872b-cb49dc63f450 for instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb on n-h1-860863-4 Nov 02 21:32:24.700498 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba4bdf0f-c79a-4a89-833a-ad812ebca207 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1220 microversion: 2.1 time: 0.210852 Nov 02 21:32:24.701758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1342/2596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:24 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1220 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:24.707643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8dc93776-bb01-406c-9a16-4f6b48f38438 req-61db8754-6a2e-485d-9e6e-d3643f64cf13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e400a75-8726-4f78-a1f1-4e2c15183f2c", "name": "network-vif-deleted", "tag": "850edffd-8fad-404d-a6fb-0d618b5b34ae"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:24.709567 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7856efed-7b44-4125-a82c-d55874065af4 req-6d963777-cc3d-4934-a653-5bd6fa02e632 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114120 Nov 02 21:32:24.713443 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1255/2597] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:24.721200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8dc93776-bb01-406c-9a16-4f6b48f38438 req-61db8754-6a2e-485d-9e6e-d3643f64cf13 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.721857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8dc93776-bb01-406c-9a16-4f6b48f38438 req-61db8754-6a2e-485d-9e6e-d3643f64cf13 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.722662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8dc93776-bb01-406c-9a16-4f6b48f38438 req-61db8754-6a2e-485d-9e6e-d3643f64cf13 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.771440 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8dc93776-bb01-406c-9a16-4f6b48f38438 req-61db8754-6a2e-485d-9e6e-d3643f64cf13 service nova] Creating event network-vif-deleted:850edffd-8fad-404d-a6fb-0d618b5b34ae for instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c on n-h1-860863-4 Nov 02 21:32:24.806943 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8dc93776-bb01-406c-9a16-4f6b48f38438 req-61db8754-6a2e-485d-9e6e-d3643f64cf13 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103550 Nov 02 21:32:24.826327 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1343/2598] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:24.909642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:24.912796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:24.933130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.935885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.936803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.945879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c9cfbb4a-a755-43a3-a9da-60d4bce16857 req-68554b2e-1128-4c33-adb0-d369fb762adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b78481-0f54-43e0-b8d1-62577e04c750", "name": "network-vif-plugged", "status": "completed", "tag": "678167f7-31aa-4d87-86e5-6dcbdd50b090"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:24.962539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.962539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.962539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:24.981871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9cfbb4a-a755-43a3-a9da-60d4bce16857 req-68554b2e-1128-4c33-adb0-d369fb762adb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:24.982533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9cfbb4a-a755-43a3-a9da-60d4bce16857 req-68554b2e-1128-4c33-adb0-d369fb762adb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:24.982986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9cfbb4a-a755-43a3-a9da-60d4bce16857 req-68554b2e-1128-4c33-adb0-d369fb762adb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.020381 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c9cfbb4a-a755-43a3-a9da-60d4bce16857 req-68554b2e-1128-4c33-adb0-d369fb762adb service nova] Creating event network-vif-plugged:678167f7-31aa-4d87-86e5-6dcbdd50b090 for instance 84b78481-0f54-43e0-b8d1-62577e04c750 on n-h1-860863-4 Nov 02 21:32:25.021267 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c9cfbb4a-a755-43a3-a9da-60d4bce16857 req-68554b2e-1128-4c33-adb0-d369fb762adb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081716 Nov 02 21:32:25.022954 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1344/2599] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:32:25.047526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:25.049900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:25.069619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.070117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.075415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.076914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.077421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.080438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.467077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:25.478238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:25.479696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:25.480852 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03fa01ce-554f-493a-930c-a423cdfc2027 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.580439 Nov 02 21:32:25.481456 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1256/2600] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:24 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:25.495943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:25.498697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:25.507262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.507765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.508411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.509347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.509959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.510533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.541120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:25.661067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:25.669545 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-838d343c-c918-4d1f-bdd5-0362d6763352 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.643146 Nov 02 21:32:25.673200 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1345/2601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:25 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:25.680810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:25.681606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:25.690423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.691720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.692506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.705375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.705375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.705375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.785514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.786377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.787627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.789488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lazy-loading 'fault' on Instance uuid 257129d0-76fe-4bf1-9b56-a1ee68ee35bb {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:25.910882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd93372e2b4a8aaa696a62ee220ab2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd426e6d43d44ef395ad2dca7e4e0a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:25.915430 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7dfcb1d-3559-4759-9001-bb7b52ba45cc tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 204 len: 0 microversion: 2.1 time: 0.432157 Nov 02 21:32:25.916600 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1257/2602] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:25 2022] DELETE /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:25.921562 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9cf090a6-2989-4752-a7a6-cd571c4c8ab6 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 200 len: 1315 microversion: 2.1 time: 0.247129 Nov 02 21:32:25.923537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:25.923920 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1346/2603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:25 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:25.924918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:25.939372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:25.951083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:25.951220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.951220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.951220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.951220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.951220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.951220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.952036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.952036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.952036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:25.952036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:25.952036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:25.952036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:26.041373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:26.045771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:26.046590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:26.047269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lazy-loading 'fault' on Instance uuid 7e400a75-8726-4f78-a1f1-4e2c15183f2c {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:26.156435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:26.169473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dd17a58e-13dd-41a5-8b78-2ee1392e0e11 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1311 microversion: 2.1 time: 0.250937 Nov 02 21:32:26.170406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1258/2604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:25 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:26.182857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:26.186091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:26.211449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:26.212509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:26.215410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:26.218064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:26.218781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:26.220231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:26.251936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:26.264865 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5e16b14-9bda-435d-9ec1-2fcb127d91fb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.339831 Nov 02 21:32:26.280650 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1347/2605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:25 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:26.286988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:26.287614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:26.303031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:26.306678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:26.307174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:26.307616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:26.308317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:26.308765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:26.309219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:26.445404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:26.464954 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7ab9925b-c28c-40eb-a871-42ec4ca458fc tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1238 microversion: 2.1 time: 0.292662 Nov 02 21:32:26.466314 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1259/2606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:26 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1238 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:26.513394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:26.514170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:26.527542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:26.532315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:26.532803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:26.537231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:26.538885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:26.539346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.245947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:27.256329 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c49f85b-3080-49f0-b020-e46aa3203316 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1666 microversion: 2.1 time: 0.982217 Nov 02 21:32:27.261911 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1348/2607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:26 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1666 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:27.273389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:27.284168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:27.287663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:27.290493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:27.299386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.300374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.301689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.302562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:27.302851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.303523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.304160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.308200 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c375ffa-b8c8-4a5a-9cbf-28f75b70fa0e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1359 microversion: 2.21 time: 0.800388 Nov 02 21:32:27.312136 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1260/2608] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:26 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1359 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:27.329998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:27.330653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] [instance: 257129d0-76fe-4bf1-9b56-a1ee68ee35bb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:27.341398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.342205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.342857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.344533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.345235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.345909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.388986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] HTTP exception thrown: Instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb could not be found. Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Request method failure captured: Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb HTTP/1.1 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuHCffksqns-_mMOO0yfDTChnqUAU8C9FF4nyQ3mlIz-7FOxDKrOwkDqbxag8Q4KsbD-IKSspWXANkiTFfbRem8uOxwT6N_WwG98bgsQ5dBarJfHkmXmI-hmLnMA6pBiyP9WQKUIefi1NRAZ0ti6zF2mbq0STeKAPO70mdPXPQPs9vE Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: bd426e6d43d44ef395ad2dca7e4e0a72 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/bd426e6d43d44ef395ad2dca7e4e0a72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: bd426e6d43d44ef395ad2dca7e4e0a72 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1872675383 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerAddressesNegativeTestJSON-1872675383-project Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e8dd93372e2b4a8aaa696a62ee220ab2 Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1872675383-project Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb could not be found. Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '257129d0-76fe-4bf1-9b56-a1ee68ee35bb'} Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb could not be found. Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb could not be found. Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:27.391179 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb could not be found. Nov 02 21:32:27.396253 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:27.399605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] Returning 404 to user: Instance 257129d0-76fe-4bf1-9b56-a1ee68ee35bb could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:27.400710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-280234bc-b521-4b73-833b-22fdb27b39d8 tempest-ServerAddressesNegativeTestJSON-1872675383 tempest-ServerAddressesNegativeTestJSON-1872675383-project] 10.222.0.25 "GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb" status: 404 len: 111 microversion: 2.1 time: 0.086566 Nov 02 21:32:27.401680 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1261/2609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:27 2022] GET /compute/v2.1/servers/257129d0-76fe-4bf1-9b56-a1ee68ee35bb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:27.406691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-756542bb-eb59-481a-8bb5-9140ebf4554e req-491393c8-d4dd-4172-a38a-f52f6a13d50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81329b61-decf-4a21-a88b-3fb5a3e4f7a9", "name": "network-vif-plugged", "status": "completed", "tag": "f1710205-2eee-461a-8f4e-b89be1e59030"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:27.421977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-756542bb-eb59-481a-8bb5-9140ebf4554e req-491393c8-d4dd-4172-a38a-f52f6a13d50f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.422711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-756542bb-eb59-481a-8bb5-9140ebf4554e req-491393c8-d4dd-4172-a38a-f52f6a13d50f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.423338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-756542bb-eb59-481a-8bb5-9140ebf4554e req-491393c8-d4dd-4172-a38a-f52f6a13d50f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.442919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-756542bb-eb59-481a-8bb5-9140ebf4554e req-491393c8-d4dd-4172-a38a-f52f6a13d50f service nova] Creating event network-vif-plugged:f1710205-2eee-461a-8f4e-b89be1e59030 for instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 on n-h1-860863-4 Nov 02 21:32:27.469407 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-756542bb-eb59-481a-8bb5-9140ebf4554e req-491393c8-d4dd-4172-a38a-f52f6a13d50f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045529 Nov 02 21:32:27.469407 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1262/2610] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:27.483763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:27.484826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:27.500797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.501635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.502607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.503536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.510753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.512307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.518743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:27.571678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.572516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.573376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.596523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lazy-loading 'fault' on Instance uuid 7e400a75-8726-4f78-a1f1-4e2c15183f2c {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:27.716071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:27.737168 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b23d01f-6444-4994-af4a-9283e142a079 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 200 len: 1311 microversion: 2.1 time: 0.263833 Nov 02 21:32:27.742429 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1263/2611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:27 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 1311 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:27.759107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:27.759816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:27.766638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.768504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.768504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.768504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.769557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.770069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.914348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:27.935750 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-850edc46-44fd-4b26-97f1-86c1d918d8ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.670817 Nov 02 21:32:27.948982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1349/2612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:27 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:27.948982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:27.948982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:27.960464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.965172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.965757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:27.967122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:27.967989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:27.971978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.007476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:28.154204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:28.170293 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-233d0431-99df-461d-b307-c0e75cb5479e tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1315 microversion: 2.1 time: 0.419954 Nov 02 21:32:28.188741 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1264/2613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:27 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:28.292190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:28.294029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:28.307586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.310196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.311624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.314173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.317098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.317779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.503766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:28.516080 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c51d7bbc-efc7-4ec5-b99e-3566c45893e7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1306 microversion: 2.1 time: 0.577359 Nov 02 21:32:28.536494 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1350/2614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:27 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1306 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:28.549132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:28.553842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:28.563778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.564503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.565237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.566694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.567360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.568006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.671670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:28.685550 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-379488a4-0a8c-466f-9136-fff9e644638e tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1666 microversion: 2.1 time: 0.397636 Nov 02 21:32:28.688777 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1265/2615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:28 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1666 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:28.768252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:28.769571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:28.779933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.781011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.781757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.784339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.790542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.793048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.843610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:28.856557 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c HTTP/1.1 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '7e400a75-8726-4f78-a1f1-4e2c15183f2c'} Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:28.858883 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:28.862608 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:28.862608 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:28.862608 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:28.862608 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:28.862608 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:28.862608 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:32:28.862608 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:28.863867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:28.864323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:28.865942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:28.866916 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e104c494-7ea0-4678-9b4a-e26bbd466b37 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 404 len: 111 microversion: 2.1 time: 0.107110 Nov 02 21:32:28.870100 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f00e5a62-3ce0-42f6-b004-58a9ff50c440 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1553 microversion: 2.21 time: 0.330373 Nov 02 21:32:28.870549 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1266/2616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:28 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:28.871028 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1351/2617] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:28 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1553 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:28.886764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a483d564-ca55-4f36-9193-61fc7137d97e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: .version_select at 0x7f9b6d29df70>, body: {"keypair": {"name": "tempest-key-1254689781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcTyU4wck9bhb2pcoA5jFD7S1IESL7qKiiOjpP9B8isX+ZnAIzFmc1Eccmqj2nySl3BEUfBtJaZMkCDlk/soFu/ACx8SS05sJPEiIumLNZjKKWIVs33MxxeGNUygK6/jw=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:28.902918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:28.903508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:28.921873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.929262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.929934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.933029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:28.938646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:28.939374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:28.940008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:28.980085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a483d564-ca55-4f36-9193-61fc7137d97e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:28.996233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a483d564-ca55-4f36-9193-61fc7137d97e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:29.030682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:29.125117 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a483d564-ca55-4f36-9193-61fc7137d97e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.246377 Nov 02 21:32:29.125746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1267/2618] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:32:28 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:29.133154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:29.133786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:29.160848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:29.161827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:29.162434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:29.163830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:29.164358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:29.164877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:29.391808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa903597-f317-46d3-bff8-9e7315a23693 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 204 len: 0 microversion: 2.21 time: 0.495918 Nov 02 21:32:29.392421 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1352/2619] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:32:28 2022] DELETE /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:32:29.399681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89225b16-87cc-41a3-a7ed-f67246d45cb2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '.version_select at 0x7f9b68dc6c10>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:29.411128 n-d-860863-4 devstack@n-api.service[121040]: WARNING oslo_db.sqlalchemy.utils [None req-89225b16-87cc-41a3-a7ed-f67246d45cb2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 21:32:29.424073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89225b16-87cc-41a3-a7ed-f67246d45cb2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.027427 Nov 02 21:32:29.424786 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1353/2620] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:32:29 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:29.435133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:29.435891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:29.455920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:29.456425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:29.457593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:29.460626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:29.461176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:29.461627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:29.672951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:29.682694 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1bcd1b8-c1ae-4c06-acab-4a974196c8dc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.555775 Nov 02 21:32:29.683647 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1268/2621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:29 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:29.689013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:29.689631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:29.696461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:29.697070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:29.697439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:29.698148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:29.698608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:29.699041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:30.030707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:30.048105 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f90620df-84d9-4249-9246-ebfc87391e11 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1500 microversion: 2.1 time: 0.620149 Nov 02 21:32:30.049201 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1354/2622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:29 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1500 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:30.054696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:30.055634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:30.068270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:30.080328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:30.084046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:30.086542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:30.088156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:30.090100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:30.134438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:30.145429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:30.152372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:30.153796 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ddb3845a-d773-457b-97f1-b892fbf7c88e tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1559 microversion: 2.21 time: 0.468528 Nov 02 21:32:30.156221 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1269/2623] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:29 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1559 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:30.173245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-726798647", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-key-1254689781", "networks": [{"uuid": "b4726632-ac93-4a1f-8349-9b723bbb1016"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:30.257290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:32:30.931121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:30.945594 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b39ac39-7127-4c3b-a393-ed929003dab7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1306 microversion: 2.1 time: 0.891426 Nov 02 21:32:30.966455 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1355/2624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:30 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1306 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:30.977320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:30.978228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:30.985994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:30.986818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:30.987529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:30.988987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:30.994294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:30.994294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:31.010910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:31.054131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:31.055975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:31.056581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:31.058114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lazy-loading 'fault' on Instance uuid 07e33e1d-76d6-4011-8810-dec200b78844 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:31.572345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:31.593755 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b314b3a0-6c50-4a0a-afae-b0eac92ec4c7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 200 len: 1324 microversion: 2.1 time: 0.625877 Nov 02 21:32:31.595824 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1356/2625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:30 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:31.611164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef195435-90e9-4611-bacd-fb4361bbf5ad tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:31.625095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef195435-90e9-4611-bacd-fb4361bbf5ad tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:31.625957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef195435-90e9-4611-bacd-fb4361bbf5ad tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:31.627673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef195435-90e9-4611-bacd-fb4361bbf5ad tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:31.859490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef195435-90e9-4611-bacd-fb4361bbf5ad tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:32:32.136017 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef195435-90e9-4611-bacd-fb4361bbf5ad tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9/action" status: 202 len: 0 microversion: 2.1 time: 0.537010 Nov 02 21:32:32.140511 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1357/2626] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:32:31 2022] POST /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:32:32.159854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0e160624-d97f-4f4e-8d08-9b2850f4fd70 req-8f2a66d1-04d5-4199-90e1-019195104e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e33e1d-76d6-4011-8810-dec200b78844", "name": "network-vif-deleted", "tag": "86827113-650e-49b8-abdc-ca4ae487e196"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:32.191985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0e160624-d97f-4f4e-8d08-9b2850f4fd70 req-8f2a66d1-04d5-4199-90e1-019195104e8e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.194117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0e160624-d97f-4f4e-8d08-9b2850f4fd70 req-8f2a66d1-04d5-4199-90e1-019195104e8e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.194597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0e160624-d97f-4f4e-8d08-9b2850f4fd70 req-8f2a66d1-04d5-4199-90e1-019195104e8e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.220311 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0e160624-d97f-4f4e-8d08-9b2850f4fd70 req-8f2a66d1-04d5-4199-90e1-019195104e8e service nova] Creating event network-vif-deleted:86827113-650e-49b8-abdc-ca4ae487e196 for instance 07e33e1d-76d6-4011-8810-dec200b78844 on n-h2-860863-4 Nov 02 21:32:32.237184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0e160624-d97f-4f4e-8d08-9b2850f4fd70 req-8f2a66d1-04d5-4199-90e1-019195104e8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093565 Nov 02 21:32:32.238580 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1358/2627] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:32.258724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:32.260461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:32.277822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.280090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.280552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.284528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.286497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.286962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.371941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:32:32.372435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:32:32.372825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:32:32.373259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:32:32.373719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:32:32.390116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.390607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.391061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.391786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.392263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.392690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.448263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:32.464692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:32.495071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:32:32.501351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:32:32.674079 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-70596bee-c901-4169-a538-b3939ab3a1eb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.516604 Nov 02 21:32:32.676499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1270/2628] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:32:32.682268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:32.683296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:32.693441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.694231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.694847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.695795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.696434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.697052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.859205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:32.874688 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-75e2994d-4322-454d-af64-c13a8a40656d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1477 microversion: 2.1 time: 0.633799 Nov 02 21:32:32.877703 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1359/2629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:32 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1477 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:32.889399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:32.890085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:32.921780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.922507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.923077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:32.923955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:32.924599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:32.925883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:33.492668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:33.502985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:33.505609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:33.507294 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2691ab8-bc26-4082-b59e-03046c61a7e5 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1559 microversion: 2.21 time: 0.829608 Nov 02 21:32:33.525249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:33.527155 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1271/2630] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:32 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1559 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:33.532993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-64fe7332-1350-445b-a601-27634f523408 req-b740804d-46d7-4043-96b0-e2d63d398c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b770f9-192e-4e5b-bc35-ff50fa086b05", "tag": "9c164165-3330-4775-880c-b1662625a664"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:33.536184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-940931c4-8084-4e2d-a871-0311586889f0 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1306 microversion: 2.1 time: 0.657129 Nov 02 21:32:33.541740 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1360/2631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:32 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1306 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:33.550315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:33.551213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:33.563377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:33.574183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:33.577693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:33.580958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:33.582153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:33.589072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-64fe7332-1350-445b-a601-27634f523408 req-b740804d-46d7-4043-96b0-e2d63d398c47 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:33.590617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-64fe7332-1350-445b-a601-27634f523408 req-b740804d-46d7-4043-96b0-e2d63d398c47 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:33.591292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-64fe7332-1350-445b-a601-27634f523408 req-b740804d-46d7-4043-96b0-e2d63d398c47 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:33.592541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:33.646662 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-64fe7332-1350-445b-a601-27634f523408 req-b740804d-46d7-4043-96b0-e2d63d398c47 service nova] Creating event network-changed:9c164165-3330-4775-880c-b1662625a664 for instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 on n-h2-860863-4 Nov 02 21:32:33.660905 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-64fe7332-1350-445b-a601-27634f523408 req-b740804d-46d7-4043-96b0-e2d63d398c47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130301 Nov 02 21:32:33.664568 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1272/2632] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:33.678539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:33.680457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: 07e33e1d-76d6-4011-8810-dec200b78844] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:33.698073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:33.698583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:33.699022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:33.700945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:33.701448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:33.706964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:33.720084 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] HTTP exception thrown: Instance 07e33e1d-76d6-4011-8810-dec200b78844 could not be found. Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Request method failure captured: Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 HTTP/1.1 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAgz3QhLPPw0_UjmFhZOjFMRk9xdxIhSKGks1k1JJpCWM_LqzV0f12FY8ARGovy11eULwIMJ2Y4_s-xaQjcgMv4FK34KGH0knzNdd_xbUrGrq6THifHH7YA9AW4MTUwY9-b_N789tL5SSweQt97ieZ-8FbxT9pKkn5-E076_3PitBg Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-LiveMigrationTest-952456683 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9f705bbaa94a4a7d8e5bba79214bb359 Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 07e33e1d-76d6-4011-8810-dec200b78844 could not be found. Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '07e33e1d-76d6-4011-8810-dec200b78844'} Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e33e1d-76d6-4011-8810-dec200b78844 could not be found. Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e33e1d-76d6-4011-8810-dec200b78844 could not be found. Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:33.722508 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e33e1d-76d6-4011-8810-dec200b78844 could not be found. Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Returning 404 to user: Instance 07e33e1d-76d6-4011-8810-dec200b78844 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:33.726089 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb08dd10-32f3-4117-b28f-9bbcbe7486af tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844" status: 404 len: 111 microversion: 2.1 time: 0.057853 Nov 02 21:32:33.728517 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1273/2633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:33 2022] GET /compute/v2.1/servers/07e33e1d-76d6-4011-8810-dec200b78844 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:33.739726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ee82f67-ab8e-478a-9025-27f89f07d47a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:33.740848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0ee82f67-ab8e-478a-9025-27f89f07d47a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:34.162613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0ee82f67-ab8e-478a-9025-27f89f07d47a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:34.172665 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ee82f67-ab8e-478a-9025-27f89f07d47a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1228 microversion: 2.1 time: 0.442596 Nov 02 21:32:34.173607 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1274/2634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:33 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1228 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:34.187653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-326e424e-3dd3-4d31-b188-9b7cb902e672 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '.version_select at 0x7f9b6d2fc310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:34.278774 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-326e424e-3dd3-4d31-b188-9b7cb902e672 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-303034782" status: 202 len: 0 microversion: 2.1 time: 0.103835 Nov 02 21:32:34.288574 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1275/2635] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-303034782 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:32:34.293967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:34.310330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:34.338862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.340854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.342127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.344528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.348816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.350109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.572104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:34.585643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5b08b9c-23ce-421b-95f5-8ac5aca76655 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 1.042430 Nov 02 21:32:34.590669 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1361/2636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:33 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:34.608863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-44bc6aaf-b6d2-494f-bf77-40a45aefa100 req-2da31ecb-889b-4bb6-b302-06e614d21182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b78481-0f54-43e0-b8d1-62577e04c750", "name": "network-vif-unplugged", "status": "completed", "tag": "678167f7-31aa-4d87-86e5-6dcbdd50b090"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:34.633498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-44bc6aaf-b6d2-494f-bf77-40a45aefa100 req-2da31ecb-889b-4bb6-b302-06e614d21182 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.634313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-44bc6aaf-b6d2-494f-bf77-40a45aefa100 req-2da31ecb-889b-4bb6-b302-06e614d21182 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.634989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-44bc6aaf-b6d2-494f-bf77-40a45aefa100 req-2da31ecb-889b-4bb6-b302-06e614d21182 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.650965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-44bc6aaf-b6d2-494f-bf77-40a45aefa100 req-2da31ecb-889b-4bb6-b302-06e614d21182 service nova] Creating event network-vif-unplugged:678167f7-31aa-4d87-86e5-6dcbdd50b090 for instance 84b78481-0f54-43e0-b8d1-62577e04c750 on n-h1-860863-4 Nov 02 21:32:34.658390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-44bc6aaf-b6d2-494f-bf77-40a45aefa100 req-2da31ecb-889b-4bb6-b302-06e614d21182 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070824 Nov 02 21:32:34.660494 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1362/2637] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:34.666953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:34.667970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:34.675379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.675994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.676900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.683091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.683091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.683091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.842755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:34.852682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:34.854874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:34.856053 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-66ec26b3-1c1d-4f44-8975-057777aa8f18 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1517 microversion: 2.21 time: 0.193750 Nov 02 21:32:34.870409 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1363/2638] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:34 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1517 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:34.895507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-09ed2f8c-00ed-43fa-9213-9b86ed4271a0 req-dbf52543-087f-4d3f-a943-175c2a737100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af801d7-895e-4005-8df7-5c8e47eba467", "name": "network-vif-unplugged", "status": "completed", "tag": "081b5980-608f-454c-9129-5e3e9c6aa74e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:34.926143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:34.938022 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e0be2727-f6d6-47c9-a4ab-d6d14c113c95 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1476 microversion: 2.1 time: 0.645889 Nov 02 21:32:34.967698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09ed2f8c-00ed-43fa-9213-9b86ed4271a0 req-dbf52543-087f-4d3f-a943-175c2a737100 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.967698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09ed2f8c-00ed-43fa-9213-9b86ed4271a0 req-dbf52543-087f-4d3f-a943-175c2a737100 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.967698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09ed2f8c-00ed-43fa-9213-9b86ed4271a0 req-dbf52543-087f-4d3f-a943-175c2a737100 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.968885 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1276/2639] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:34 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1476 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:34.970502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:34.971122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:34.978551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.979044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.979480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.980186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:34.980644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:34.981103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:34.983760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-09ed2f8c-00ed-43fa-9213-9b86ed4271a0 req-dbf52543-087f-4d3f-a943-175c2a737100 service nova] Creating event network-vif-unplugged:081b5980-608f-454c-9129-5e3e9c6aa74e for instance 6af801d7-895e-4005-8df7-5c8e47eba467 on n-h2-860863-4 Nov 02 21:32:34.998773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-09ed2f8c-00ed-43fa-9213-9b86ed4271a0 req-dbf52543-087f-4d3f-a943-175c2a737100 service nova] Instance 6af801d7-895e-4005-8df7-5c8e47eba467 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:32:35.015098 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-09ed2f8c-00ed-43fa-9213-9b86ed4271a0 req-dbf52543-087f-4d3f-a943-175c2a737100 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155876 Nov 02 21:32:35.016461 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1364/2640] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:35.202012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:35.204980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:35.217142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.218709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.220590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.221585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.222835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.224868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.382531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:35.397688 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d6d41b74-ee97-481b-b89f-6b135e0e2fbd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1306 microversion: 2.1 time: 0.430613 Nov 02 21:32:35.398638 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1277/2641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:34 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1306 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:35.423709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:35.432756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-630ba695-a577-4642-9db8-852ad2a57591 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1280 microversion: 2.1 time: 0.240262 Nov 02 21:32:35.433895 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1365/2642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:35 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:35.613454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:35.614103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:35.621146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.625905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.626448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.629935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.630481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.631883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.875811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-42f8ba8a-8671-4bdc-b0e1-52becc083449 req-ab324446-1397-4e41-82df-6644cb9b6a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b78481-0f54-43e0-b8d1-62577e04c750", "name": "network-vif-deleted", "tag": "678167f7-31aa-4d87-86e5-6dcbdd50b090"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:35.900417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-42f8ba8a-8671-4bdc-b0e1-52becc083449 req-ab324446-1397-4e41-82df-6644cb9b6a8c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.900417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-42f8ba8a-8671-4bdc-b0e1-52becc083449 req-ab324446-1397-4e41-82df-6644cb9b6a8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.900417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-42f8ba8a-8671-4bdc-b0e1-52becc083449 req-ab324446-1397-4e41-82df-6644cb9b6a8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.918191 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-42f8ba8a-8671-4bdc-b0e1-52becc083449 req-ab324446-1397-4e41-82df-6644cb9b6a8c service nova] Creating event network-vif-deleted:678167f7-31aa-4d87-86e5-6dcbdd50b090 for instance 84b78481-0f54-43e0-b8d1-62577e04c750 on n-h1-860863-4 Nov 02 21:32:35.929229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-42f8ba8a-8671-4bdc-b0e1-52becc083449 req-ab324446-1397-4e41-82df-6644cb9b6a8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052012 Nov 02 21:32:35.929229 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1366/2643] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:35.933598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:35.934595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:35.943575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.944093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.947890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:35.953168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.955032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.955742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.956995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.978797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:35.995432 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7f699237-1854-43a7-ba4b-158bc4a7fbdc tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.348844 Nov 02 21:32:35.996156 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1278/2644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:35 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:35.996786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:35.997523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:35.998178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:35.998919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lazy-loading 'fault' on Instance uuid 84b78481-0f54-43e0-b8d1-62577e04c750 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:36.006765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:36.007394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:36.033771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.036497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.037040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.037803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.038328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.038799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.089382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:36.100894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:36.102927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4c2b030d794456c9105b76c36fc56a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94aad92d3fff4b30a401dcf079e5c9ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:36.104252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69921c84-d5fa-4cba-a3dd-64b7b3d32bd0 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 200 len: 1349 microversion: 2.21 time: 0.177002 Nov 02 21:32:36.104821 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1367/2645] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:35 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 1349 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:36.330754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:36.343117 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b28f868e-e4ef-4f86-a802-1811e6a56e4b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1476 microversion: 2.1 time: 0.345848 Nov 02 21:32:36.360206 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1279/2646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:35 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:36.414920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:36.415625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:36.424662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.426601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.427278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.428480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.429122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.430584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.430686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:36.431735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:36.442169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.442674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.443629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.444500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.445006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.445460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.484955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:36.643480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:36.651729 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19339714-75cd-4c1f-b92b-af848c2c4521 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.234194 Nov 02 21:32:36.652348 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1280/2647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:36 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:36.667641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:36.667641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:36.667641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.667641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.667641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.668600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.668600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.669002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.745487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:36.757553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cfa199b8-8333-4288-9804-eb009f231018 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1298 microversion: 2.1 time: 0.102291 Nov 02 21:32:36.758267 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1281/2648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:36 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:36.882754 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b83c99b-be56-4810-ab80-472f389d2a87 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 204 len: 0 microversion: 2.1 time: 0.471602 Nov 02 21:32:36.883348 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1368/2649] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:36 2022] DELETE /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:36.891804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:36.892549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:36.899033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.899579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.900196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:36.900996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:36.901514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:36.902008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.022696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:37.023416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:37.031012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.031878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.032499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.033416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.034011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.035257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.062403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:37.070962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1fe8620e-441b-4836-a1d8-f21eaeb96da7 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1483 microversion: 2.1 time: 0.183321 Nov 02 21:32:37.072105 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1282/2650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:36 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1483 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:37.077863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-73c75714-0fe5-423a-b1f0-431613e47185 req-95812684-d375-4afd-a0c2-0b1c763cc0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af801d7-895e-4005-8df7-5c8e47eba467", "tag": "081b5980-608f-454c-9129-5e3e9c6aa74e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:37.088379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-73c75714-0fe5-423a-b1f0-431613e47185 req-95812684-d375-4afd-a0c2-0b1c763cc0c2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.089141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-73c75714-0fe5-423a-b1f0-431613e47185 req-95812684-d375-4afd-a0c2-0b1c763cc0c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.089805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-73c75714-0fe5-423a-b1f0-431613e47185 req-95812684-d375-4afd-a0c2-0b1c763cc0c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.106814 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-73c75714-0fe5-423a-b1f0-431613e47185 req-95812684-d375-4afd-a0c2-0b1c763cc0c2 service nova] Creating event network-changed:081b5980-608f-454c-9129-5e3e9c6aa74e for instance 6af801d7-895e-4005-8df7-5c8e47eba467 on n-h2-860863-4 Nov 02 21:32:37.118782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-73c75714-0fe5-423a-b1f0-431613e47185 req-95812684-d375-4afd-a0c2-0b1c763cc0c2 service nova] Instance 6af801d7-895e-4005-8df7-5c8e47eba467 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:32:37.137992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-73c75714-0fe5-423a-b1f0-431613e47185 req-95812684-d375-4afd-a0c2-0b1c763cc0c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063529 Nov 02 21:32:37.139952 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1283/2651] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:37.146489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:37.147295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:37.158100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.158759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.159289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.161316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.161902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.162754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.191699 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] HTTP exception thrown: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Request method failure captured: Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 HTTP/1.1 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuHS--YV3ggH_RvsJIet0Upye7fK7pDvNM0uIVjVxswNtAvogII94h02v1U6HGGt2ZdsP3GJtv1pwrUEK3DfXg-L0FjowelTswwuNm75ucCvEn_X5Eq969eD-pWs8okuNYRUJ9DKhiQzodeZOlvCvUtrys708tuz2WGyAqsmpvCgrrQ Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 94aad92d3fff4b30a401dcf079e5c9ac Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 94aad92d3fff4b30a401dcf079e5c9ac Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-InstanceActionsV221TestJSON-129427813-project Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f4c2b030d794456c9105b76c36fc56a6 Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-InstanceActionsV221TestJSON-129427813-project Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '84b78481-0f54-43e0-b8d1-62577e04c750'} Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.194447 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Returning 404 to user: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:37.198758 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a95ed1d-bf5c-4319-b7d5-4ca21fd4eed9 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 404 len: 111 microversion: 2.21 time: 0.056638 Nov 02 21:32:37.201116 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1284/2652] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:37 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:32:37.206941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '.version_select at 0x7f9b68b1a160>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:37.207525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:37.213569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.214357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.214803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.215848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.217386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.220362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.308551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:37.313727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ce077eaa-eb07-453f-a77d-a2dfc7320669 tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.111485 Nov 02 21:32:37.314665 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1285/2653] 10.222.0.25 () {60 vars in 1337 bytes} [Wed Nov 2 21:32:37 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750/os-instance-actions => generated 611 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:32:37.330056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:37.330831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:37.334041 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-abcdba81-dff2-4354-8aab-14aec4725d08 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.317896 Nov 02 21:32:37.340979 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1369/2654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:37 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:37.341725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.344354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.345023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.346130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.347643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.348160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.353826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:37.368373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:37.369602 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] HTTP exception thrown: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.369718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Request method failure captured: Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 HTTP/1.1 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuHS--YV3ggH_RvsJIet0Upye7fK7pDvNM0uIVjVxswNtAvogII94h02v1U6HGGt2ZdsP3GJtv1pwrUEK3DfXg-L0FjowelTswwuNm75ucCvEn_X5Eq969eD-pWs8okuNYRUJ9DKhiQzodeZOlvCvUtrys708tuz2WGyAqsmpvCgrrQ Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 94aad92d3fff4b30a401dcf079e5c9ac Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 94aad92d3fff4b30a401dcf079e5c9ac Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-InstanceActionsV221TestJSON-129427813-project Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f4c2b030d794456c9105b76c36fc56a6 Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-InstanceActionsV221TestJSON-129427813-project Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '84b78481-0f54-43e0-b8d1-62577e04c750'} Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:37.370483 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.374782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.383076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Returning 404 to user: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:37.383736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.384261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.384719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.387346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.387829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.388277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.389181 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-354083bb-b096-4b8c-84d3-19ee7b6e60fe tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "DELETE /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 404 len: 111 microversion: 2.21 time: 0.063818 Nov 02 21:32:37.391429 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1286/2655] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:32:37 2022] DELETE /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:32:37.402913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:37.410522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] [instance: 84b78481-0f54-43e0-b8d1-62577e04c750] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:37.427276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.428754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.434605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.435588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.436616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.437399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.462527 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] HTTP exception thrown: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Request method failure captured: Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 HTTP/1.1 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuHS--YV3ggH_RvsJIet0Upye7fK7pDvNM0uIVjVxswNtAvogII94h02v1U6HGGt2ZdsP3GJtv1pwrUEK3DfXg-L0FjowelTswwuNm75ucCvEn_X5Eq969eD-pWs8okuNYRUJ9DKhiQzodeZOlvCvUtrys708tuz2WGyAqsmpvCgrrQ Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 94aad92d3fff4b30a401dcf079e5c9ac Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/94aad92d3fff4b30a401dcf079e5c9ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 94aad92d3fff4b30a401dcf079e5c9ac Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-129427813 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-InstanceActionsV221TestJSON-129427813-project Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f4c2b030d794456c9105b76c36fc56a6 Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-InstanceActionsV221TestJSON-129427813-project Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '84b78481-0f54-43e0-b8d1-62577e04c750'} Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.465443 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. Nov 02 21:32:37.469249 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:37.471693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] Returning 404 to user: Instance 84b78481-0f54-43e0-b8d1-62577e04c750 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:37.472758 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a6cb855b-68a5-452d-889b-e4d49bb7c06d tempest-InstanceActionsV221TestJSON-129427813 tempest-InstanceActionsV221TestJSON-129427813-project] 10.222.0.25 "GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750" status: 404 len: 111 microversion: 2.21 time: 0.077554 Nov 02 21:32:37.474473 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1287/2656] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:37 2022] GET /compute/v2.1/servers/84b78481-0f54-43e0-b8d1-62577e04c750 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:32:37.678137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:37.679454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:37.686889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.687724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.688372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:37.691266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:37.692049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:37.693335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:38.076883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:38.077795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:38.088817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8908c278-bdd2-4bd5-8b33-0d3ef3e9808b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1476 microversion: 2.1 time: 0.726418 Nov 02 21:32:38.097022 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1370/2657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:37 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1476 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:38.097022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:38.097022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:38.106387 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e32a6a96-2c94-4907-903d-2c1dcef82da2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.433867 Nov 02 21:32:38.108283 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1288/2658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:37 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:38.116769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:38.117335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:38.117776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:38.118479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:38.118933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:38.119359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:38.280490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1bbaf89-93e2-4451-a652-3ad64ac66caf tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] Calling method '.version_select at 0x7f9b6d13a4c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:38.353289 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1bbaf89-93e2-4451-a652-3ad64ac66caf tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.243051 Nov 02 21:32:38.354017 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1289/2659] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:32:38 2022] GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8/defaults => generated 371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:38.366053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:38.367265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:38.385395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:38.385395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:38.385395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:38.385395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:38.386682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:38.387665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:38.436904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:38.447168 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd5ad769-efd2-4053-92ea-62291acb46e2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.356569 Nov 02 21:32:38.448006 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1371/2660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:38 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:38.468867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:38.469806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:38.476888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:38.477667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:38.478326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:38.479229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:38.479922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:38.480539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:38.695827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:38.707625 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-985f3ad9-67c7-4632-b1ce-8107282ec0ca tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1483 microversion: 2.1 time: 0.351068 Nov 02 21:32:38.708400 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1290/2661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:38 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1483 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:38.710023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:38.714804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-37cdfaaa-7619-4198-8b2e-0e627e6ecd5d tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] Calling method '.version_select at 0x7f9b68b1a4c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:38.727559 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86676cd0-4f77-4502-9b64-cb24a0765f12 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.262609 Nov 02 21:32:38.730859 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1372/2662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:38 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:38.805202 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-37cdfaaa-7619-4198-8b2e-0e627e6ecd5d tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8" status: 200 len: 371 microversion: 2.1 time: 0.094759 Nov 02 21:32:38.808986 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1291/2663] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:32:38 2022] GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8 => generated 371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:38.821343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-10a386a7-4a3a-46df-a352-4703ba495aca tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] Calling method '.version_select at 0x7f9b68dfb5e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:38.892552 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-10a386a7-4a3a-46df-a352-4703ba495aca tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.075028 Nov 02 21:32:38.893103 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1373/2664] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:32:38 2022] GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8/defaults => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:38.909544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f4a11de-ebe7-40a4-a492-4c0545d3d95a tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] Calling method '.version_select at 0x7f9b68b12700>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:39.016266 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f4a11de-ebe7-40a4-a492-4c0545d3d95a tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8" status: 200 len: 371 microversion: 2.1 time: 0.110587 Nov 02 21:32:39.017511 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1292/2665] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:32:38 2022] GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:39.037095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2becfe2-72a4-4d84-8822-40846c66a37a tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] Calling method '.version_select at 0x7f9b68dfb3a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:39.113863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:39.115338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:39.127002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.134487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.134487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.137250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.138237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.138929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.219049 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2becfe2-72a4-4d84-8822-40846c66a37a tempest-QuotasTestJSON-2035424379 tempest-QuotasTestJSON-2035424379-project] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8?user_id=1c96dd5462434bc7bab76eb7bae0e2da" status: 200 len: 371 microversion: 2.1 time: 0.192657 Nov 02 21:32:39.239847 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1374/2666] 10.222.0.25 () {58 vars in 1323 bytes} [Wed Nov 2 21:32:39 2022] GET /compute/v2.1/os-quota-sets/039a1f6e7e0f45959760cee17ba9e6b8?user_id=1c96dd5462434bc7bab76eb7bae0e2da => generated 371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:39.254476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:39.262753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:39.279078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.279810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.280794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.281863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.282582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.283255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.596210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:39.608763 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8457219c-02df-4efc-930f-a1a7f2c9040b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1474 microversion: 2.1 time: 0.500839 Nov 02 21:32:39.627883 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1293/2667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:39 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:39.630997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:39.634253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:39.639839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9bd0da57-e952-4906-b4d7-5665f2f05ca2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.397369 Nov 02 21:32:39.653734 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1375/2668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:39 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:39.657948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:39.662928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-147ea4b8-02c8-4ef6-a538-789a6503fac6 req-6caf6158-b587-4b89-b699-e3aad4c1cabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff58a26b-5edd-41ab-96d0-d061ce223e8e", "name": "network-vif-deleted", "tag": "58736955-93ab-4e70-ac30-4d7043597e6f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:39.678038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-147ea4b8-02c8-4ef6-a538-789a6503fac6 req-6caf6158-b587-4b89-b699-e3aad4c1cabe service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.678038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-147ea4b8-02c8-4ef6-a538-789a6503fac6 req-6caf6158-b587-4b89-b699-e3aad4c1cabe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.678038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-147ea4b8-02c8-4ef6-a538-789a6503fac6 req-6caf6158-b587-4b89-b699-e3aad4c1cabe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.691830 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-147ea4b8-02c8-4ef6-a538-789a6503fac6 req-6caf6158-b587-4b89-b699-e3aad4c1cabe service nova] Creating event network-vif-deleted:58736955-93ab-4e70-ac30-4d7043597e6f for instance ff58a26b-5edd-41ab-96d0-d061ce223e8e on n-h2-860863-4 Nov 02 21:32:39.692516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.694213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.695759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.697944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.698586 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-147ea4b8-02c8-4ef6-a538-789a6503fac6 req-6caf6158-b587-4b89-b699-e3aad4c1cabe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043156 Nov 02 21:32:39.699650 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1376/2669] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:39.702005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.702699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.734322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:39.745897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:39.771242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.773848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.775465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.776819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.778555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.779010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.905497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:39.933916 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b368be7-e141-4327-961d-e821f983fa48 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1280 microversion: 2.1 time: 0.203521 Nov 02 21:32:39.934491 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1377/2670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:39 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:39.944951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:39.954879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:39.968806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.969333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.969774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:39.973672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:39.975278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:39.977020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:40.144164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:40.153491 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e6b9ff9b-114f-4e0d-b25f-49c35fadc408 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.524173 Nov 02 21:32:40.154065 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1294/2671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:39 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:40.349883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:40.372720 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf475cd8-d452-4c0d-99e6-68acb8efb77d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.436970 Nov 02 21:32:40.373375 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1378/2672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:39 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:40.635421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:40.636242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:40.645990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:40.648731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:40.649393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:40.650289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:40.650911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:40.651515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:40.667782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:40.668850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:40.689528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:40.690467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:40.692116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:40.693258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:40.694159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:40.700479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:40.923185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:40.932973 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d35cb344-9ba0-4864-be12-dec13d1aee83 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1471 microversion: 2.1 time: 0.303239 Nov 02 21:32:40.947339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1295/2673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:40 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:40.963599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:40.964249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:40.974403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:40.974532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:40.974934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:40.975638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:40.976094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:40.976701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.016817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:41.027572 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3382a69-9f1a-41a0-9e51-7d2dc5e93b6b tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.364747 Nov 02 21:32:41.028169 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1379/2674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:40 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:41.029194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.029900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.033316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.033991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lazy-loading 'fault' on Instance uuid ff58a26b-5edd-41ab-96d0-d061ce223e8e {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:41.035085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:41.035850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:41.045516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.046234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.047014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.047935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.048573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.049220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.166705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:41.208696 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d93adf1-5cb2-48d6-94cd-3a6745d49d94 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 200 len: 1300 microversion: 2.1 time: 0.250637 Nov 02 21:32:41.229242 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1296/2675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:40 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 1300 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:41.243664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:41.244678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:41.256078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.256078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.256078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.259634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.260129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.260575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.333595 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-416879fe-fbba-48d8-ac14-c36dd1ad8e9c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467/action" status: 204 len: 0 microversion: 2.1 time: 0.300390 Nov 02 21:32:41.334592 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1380/2676] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:32:41 2022] POST /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467/action => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:41.369202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f06bd6b3-8fa7-426e-bf86-4536cbf6932f req-cdd9d765-54fd-479d-a950-3f3b973f737f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af801d7-895e-4005-8df7-5c8e47eba467", "name": "network-vif-plugged", "status": "completed", "tag": "081b5980-608f-454c-9129-5e3e9c6aa74e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:41.404283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f06bd6b3-8fa7-426e-bf86-4536cbf6932f req-cdd9d765-54fd-479d-a950-3f3b973f737f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.406252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f06bd6b3-8fa7-426e-bf86-4536cbf6932f req-cdd9d765-54fd-479d-a950-3f3b973f737f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.408266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f06bd6b3-8fa7-426e-bf86-4536cbf6932f req-cdd9d765-54fd-479d-a950-3f3b973f737f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.434057 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f06bd6b3-8fa7-426e-bf86-4536cbf6932f req-cdd9d765-54fd-479d-a950-3f3b973f737f service nova] Creating event network-vif-plugged:081b5980-608f-454c-9129-5e3e9c6aa74e for instance 6af801d7-895e-4005-8df7-5c8e47eba467 on n-h2-860863-4 Nov 02 21:32:41.441946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-f06bd6b3-8fa7-426e-bf86-4536cbf6932f req-cdd9d765-54fd-479d-a950-3f3b973f737f service nova] Instance 6af801d7-895e-4005-8df7-5c8e47eba467 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:32:41.455225 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f06bd6b3-8fa7-426e-bf86-4536cbf6932f req-cdd9d765-54fd-479d-a950-3f3b973f737f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093147 Nov 02 21:32:41.456865 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1381/2677] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:41.458821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:41.463216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:41.464198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:41.467468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f32d13ed-c4b4-4cc4-94a3-94952d9e1166 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.236725 Nov 02 21:32:41.468632 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1297/2678] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:41 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:41.475944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:41.476769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:41.484832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.485649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.487047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.488218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.489041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.489492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.489935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.491316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.491811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:41.492467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:41.492825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.493318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:41.858940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:41.865444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:41.876272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-539a80e0-b1d3-43de-9b95-860cf7e9d104 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.406213 Nov 02 21:32:41.880007 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9bdbc483-3cbb-42a9-ac24-ad53590424d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1471 microversion: 2.1 time: 0.421559 Nov 02 21:32:41.880829 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1298/2679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:41 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:41.885478 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1382/2680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:41 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1471 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:42.040262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8b2da97a-cc77-410f-bde9-20e88faa0179 req-9e8f5c14-64ff-4b73-9840-7738cbabc2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a10092-9128-4919-802d-47d26426773d", "tag": "093fd98c-8af8-4f46-a8ae-e3061b202b5f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:42.045205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:42.054272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:42.055147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:42.061907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8b2da97a-cc77-410f-bde9-20e88faa0179 req-9e8f5c14-64ff-4b73-9840-7738cbabc2fc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.065342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.072386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8b2da97a-cc77-410f-bde9-20e88faa0179 req-9e8f5c14-64ff-4b73-9840-7738cbabc2fc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.082146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.082567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8b2da97a-cc77-410f-bde9-20e88faa0179 req-9e8f5c14-64ff-4b73-9840-7738cbabc2fc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.111538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8b2da97a-cc77-410f-bde9-20e88faa0179 req-9e8f5c14-64ff-4b73-9840-7738cbabc2fc service nova] Creating event network-changed:093fd98c-8af8-4f46-a8ae-e3061b202b5f for instance b0a10092-9128-4919-802d-47d26426773d on n-h2-860863-4 Nov 02 21:32:42.126823 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8b2da97a-cc77-410f-bde9-20e88faa0179 req-9e8f5c14-64ff-4b73-9840-7738cbabc2fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090039 Nov 02 21:32:42.127669 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1299/2681] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:32:42.238572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:42.252613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: ff58a26b-5edd-41ab-96d0-d061ce223e8e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:42.277156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.277930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.282941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.282941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.282941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.282941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.299861 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] HTTP exception thrown: Instance ff58a26b-5edd-41ab-96d0-d061ce223e8e could not be found. Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Request method failure captured: Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e HTTP/1.1 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuAgz3QhLPPw0_UjmFhZOjFMRk9xdxIhSKGks1k1JJpCWM_LqzV0f12FY8ARGovy11eULwIMJ2Y4_s-xaQjcgMv4FK34KGH0knzNdd_xbUrGrq6THifHH7YA9AW4MTUwY9-b_N789tL5SSweQt97ieZ-8FbxT9pKkn5-E076_3PitBg Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-LiveMigrationTest-952456683 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9f705bbaa94a4a7d8e5bba79214bb359 Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance ff58a26b-5edd-41ab-96d0-d061ce223e8e could not be found. Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'ff58a26b-5edd-41ab-96d0-d061ce223e8e'} Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff58a26b-5edd-41ab-96d0-d061ce223e8e could not be found. Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff58a26b-5edd-41ab-96d0-d061ce223e8e could not be found. Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:42.302084 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:42.305854 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:42.305854 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:42.305854 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:42.305854 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:42.305854 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:42.305854 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff58a26b-5edd-41ab-96d0-d061ce223e8e could not be found. Nov 02 21:32:42.305854 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:32:42.308419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Returning 404 to user: Instance ff58a26b-5edd-41ab-96d0-d061ce223e8e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:42.309886 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-17746b13-aff7-4156-bd61-b0fb82fede0c tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e" status: 404 len: 111 microversion: 2.1 time: 0.078242 Nov 02 21:32:42.314005 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1300/2682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:42 2022] GET /compute/v2.1/servers/ff58a26b-5edd-41ab-96d0-d061ce223e8e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:32:42.321458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:42.322380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:42.329731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.331986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.332622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.333361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.333828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.334520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.374071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:42.434833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:42.436626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:42.445960 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-028de9af-9b68-417c-9202-70b1bec82725 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.395571 Nov 02 21:32:42.447224 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1383/2683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:42 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:42.495551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:42.496053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:42.506835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.506835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.506835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.507410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.507879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.508409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.561906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:42.750980 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-800a4ae8-3f91-4627-82dc-dafa9c122290 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 204 len: 0 microversion: 2.1 time: 0.435454 Nov 02 21:32:42.753080 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1301/2684] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:42 2022] DELETE /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:42.762065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:42.763086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:42.781655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.782338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.784303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.785805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.786482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.789291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.811144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:42.833531 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e45f6db8-6454-46c6-aedb-12ad66099b56 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.343261 Nov 02 21:32:42.838985 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1384/2685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:42 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:42.918444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:42.919178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:42.946634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.947259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.947714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:42.956843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:42.957782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:42.960826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:43.237559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:43.246927 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4b2110fe-c915-426a-b268-4da7a54d6b83 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1497 microversion: 2.1 time: 0.489138 Nov 02 21:32:43.248688 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1302/2686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:42 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1497 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:43.266033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:43.266997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:43.278273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:43.279125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:43.282647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:43.283678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:43.284408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:43.285243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:43.650776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:43.673557 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd72d213-d2dd-4040-9c55-4301b9bf4149 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.760709 Nov 02 21:32:43.677136 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1385/2687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:42 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:43.693830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:43.695855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:43.733511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:43.734456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:43.737071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:43.738284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:43.744421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:43.748877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:43.798686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:43.815381 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-18b81f16-cefb-411f-b333-59c8101ece70 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1471 microversion: 2.1 time: 0.557396 Nov 02 21:32:43.815381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1303/2688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:43 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1471 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:43.862627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:43.863516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:43.885227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:43.886619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:43.888848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:43.892032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:43.905464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:43.905464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:44.231444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:44.249162 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d67b2d6d-bc35-42e1-8ac0-e8b81cb7b8fd tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.565727 Nov 02 21:32:44.250474 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1386/2689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:43 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:44.278894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:44.279648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:44.294894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:44.296277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:44.298064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:44.300185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:44.301398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:44.302958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:44.341069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:44.361962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fb03a8c6-2748-46d0-81ad-a52244d614ad tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.501281 Nov 02 21:32:44.366295 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1304/2690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:43 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:44.738809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:44.749512 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9ea11b5-23f5-4957-bb8d-c1c475765a0a tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1497 microversion: 2.1 time: 0.477307 Nov 02 21:32:44.752993 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1387/2691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:44 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1497 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:44.838728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:44.839534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:44.844903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:44.860981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:44.863314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:44.865295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:44.866073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:44.871396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:44.871917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.012616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:45.015104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:45.026603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.027729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.028424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.028952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.030209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.030817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.211176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:45.227900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2320cc37-bdfa-4f20-ad51-bc05685fda93 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1463 microversion: 2.1 time: 0.393546 Nov 02 21:32:45.229130 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1388/2692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:44 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1463 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:45.235836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5b73515f-e739-4be0-9e90-9ec8ebc2a671 req-5f4f0c6e-8fe2-4406-b64a-d93da56fc069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22ef89e-ee93-4cdf-8518-00b2219a29d9", "name": "network-vif-deleted", "tag": "d9175032-8828-4122-af13-668346e4b744"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:45.253553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b73515f-e739-4be0-9e90-9ec8ebc2a671 req-5f4f0c6e-8fe2-4406-b64a-d93da56fc069 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.258861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b73515f-e739-4be0-9e90-9ec8ebc2a671 req-5f4f0c6e-8fe2-4406-b64a-d93da56fc069 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.259485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b73515f-e739-4be0-9e90-9ec8ebc2a671 req-5f4f0c6e-8fe2-4406-b64a-d93da56fc069 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.273668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5b73515f-e739-4be0-9e90-9ec8ebc2a671 req-5f4f0c6e-8fe2-4406-b64a-d93da56fc069 service nova] Creating event network-vif-deleted:d9175032-8828-4122-af13-668346e4b744 for instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 on n-h2-860863-4 Nov 02 21:32:45.282179 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5b73515f-e739-4be0-9e90-9ec8ebc2a671 req-5f4f0c6e-8fe2-4406-b64a-d93da56fc069 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050250 Nov 02 21:32:45.296153 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1389/2693] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:45.307301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:45.308275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:45.324692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.330555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.330555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.331038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.331704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.332290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.418703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:45.427502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-769660dc-fd7e-4fd5-8b9d-3f45c884795b tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.731794 Nov 02 21:32:45.428089 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1305/2694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:44 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:45.445528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:45.446436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:45.459456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.464716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.464716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.464716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.464716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.464716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.517913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:45.914254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-45360da0-8642-4c17-838d-c1ddc32b3101 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1614 microversion: 2.1 time: 0.614936 Nov 02 21:32:45.922992 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1390/2695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:45 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1614 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:45.933590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:45.940138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:45.966625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.966625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.966625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.966625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:45.966625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:45.966625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:45.997357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:46.011202 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c0f8cd31-caab-403c-af44-76856727de45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.582002 Nov 02 21:32:46.012170 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1306/2696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:45 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:46.029253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:46.035778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:46.059369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:46.060280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:46.063802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:46.063802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:46.063802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:46.063802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:46.150493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:46.151139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:46.155609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:46.155609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lazy-loading 'fault' on Instance uuid e22ef89e-ee93-4cdf-8518-00b2219a29d9 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:32:46.610825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f705bbaa94a4a7d8e5bba79214bb359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31580ceeb77c4656a314af62ac3d35c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:46.624381 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77419275-27e8-4905-a11b-70c338fac009 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 200 len: 1300 microversion: 2.1 time: 0.607990 Nov 02 21:32:46.625299 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1307/2697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:46 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 1300 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:46.635922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9214786b-919f-4039-8d68-8b1c0e5a1b6e tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '.version_select at 0x7f9b69c00280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:46.659309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9214786b-919f-4039-8d68-8b1c0e5a1b6e tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:46.660384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9214786b-919f-4039-8d68-8b1c0e5a1b6e tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:46.661092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9214786b-919f-4039-8d68-8b1c0e5a1b6e tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:46.672847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9214786b-919f-4039-8d68-8b1c0e5a1b6e tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.045861 Nov 02 21:32:46.673523 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1308/2698] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:32:46 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:46.679679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:46.680621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:46.688597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:46.689511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:46.690313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:46.692801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:46.693525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:46.694227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:46.816605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:46.859460 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b3b8745-f32e-4c28-a869-e9dabde84a77 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.926839 Nov 02 21:32:46.862594 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1391/2699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:45 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:46.868852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1538023318", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:47.015385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:32:47.263110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:47.273832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e67cdbf-6cbc-4c46-a7fd-3cb4820fbf36 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.598289 Nov 02 21:32:47.274826 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1309/2700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:46 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:47.279488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:47.286969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:47.288232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.288878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.289487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.290339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.290967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.291394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.453005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:32:47.453005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:32:47.453691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:32:47.454618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:32:47.455282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:32:47.477812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.480469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.485569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.489796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.489796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.490462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.547035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:47.555671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for user 64f57cf5139c4937b8158f8d9aef011b and project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:47.572759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:32:47.575654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:32:47.601932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:47.610534 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-545d4dba-bca0-4d0f-ab89-7b681005a545 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.334547 Nov 02 21:32:47.611130 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1310/2701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:47 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:47.621983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c340d80e-a9a9-431e-b0a4-beefc8fbd9fa req-40cd8b12-8a2c-4ba4-bc26-d0ba72ac1099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b770f9-192e-4e5b-bc35-ff50fa086b05", "name": "network-vif-plugged", "status": "completed", "tag": "9c164165-3330-4775-880c-b1662625a664"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:47.632810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c340d80e-a9a9-431e-b0a4-beefc8fbd9fa req-40cd8b12-8a2c-4ba4-bc26-d0ba72ac1099 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.633324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c340d80e-a9a9-431e-b0a4-beefc8fbd9fa req-40cd8b12-8a2c-4ba4-bc26-d0ba72ac1099 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.633934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c340d80e-a9a9-431e-b0a4-beefc8fbd9fa req-40cd8b12-8a2c-4ba4-bc26-d0ba72ac1099 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.648842 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c340d80e-a9a9-431e-b0a4-beefc8fbd9fa req-40cd8b12-8a2c-4ba4-bc26-d0ba72ac1099 service nova] Creating event network-vif-plugged:9c164165-3330-4775-880c-b1662625a664 for instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 on n-h2-860863-4 Nov 02 21:32:47.654629 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c340d80e-a9a9-431e-b0a4-beefc8fbd9fa req-40cd8b12-8a2c-4ba4-bc26-d0ba72ac1099 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041545 Nov 02 21:32:47.655731 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1311/2702] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:47.662911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1c1c5b2f-0db7-4c63-8f8e-a7e790e318a4 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b6d29d310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:47.738725 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f77f8fb3-1e23-403e-a258-27fc3166e3b7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874285 Nov 02 21:32:47.743132 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1392/2703] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:32:47.757545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:47.758152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] [instance: e22ef89e-ee93-4cdf-8518-00b2219a29d9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:47.781551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.781551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.783300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.783844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.784353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.794529 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1c1c5b2f-0db7-4c63-8f8e-a7e790e318a4 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8f948e40-e062-48b2-b5a0-eab29105123e" status: 200 len: 350 microversion: 2.1 time: 0.137070 Nov 02 21:32:47.794734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.804072 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1312/2704] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:32:47 2022] GET /compute/v2.1/os-volumes/8f948e40-e062-48b2-b5a0-eab29105123e => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:47.810780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ce46ed3-f867-4751-b12a-78cc39a1636e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:47.811826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ce46ed3-f867-4751-b12a-78cc39a1636e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:47.820395 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] HTTP exception thrown: Instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 could not be found. Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Request method failure captured: Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 HTTP/1.1 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuAgz3QhLPPw0_UjmFhZOjFMRk9xdxIhSKGks1k1JJpCWM_LqzV0f12FY8ARGovy11eULwIMJ2Y4_s-xaQjcgMv4FK34KGH0knzNdd_xbUrGrq6THifHH7YA9AW4MTUwY9-b_N789tL5SSweQt97ieZ-8FbxT9pKkn5-E076_3PitBg Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31580ceeb77c4656a314af62ac3d35c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-LiveMigrationTest-952456683 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 31580ceeb77c4656a314af62ac3d35c7 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-LiveMigrationTest-952456683 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9f705bbaa94a4a7d8e5bba79214bb359 Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-LiveMigrationTest-952456683-project Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 could not be found. Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e22ef89e-ee93-4cdf-8518-00b2219a29d9'} Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 could not be found. Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 could not be found. Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:32:47.822371 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:47.826882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:32:47.826882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:32:47.826882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:32:47.826882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:32:47.826882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:32:47.826882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 could not be found. Nov 02 21:32:47.826882 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:32:47.829289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] Returning 404 to user: Instance e22ef89e-ee93-4cdf-8518-00b2219a29d9 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:32:47.831832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9301b121-aec0-4491-aa01-487310b479d9 tempest-LiveMigrationTest-952456683 tempest-LiveMigrationTest-952456683-project] 10.222.0.25 "GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9" status: 404 len: 111 microversion: 2.1 time: 0.087177 Nov 02 21:32:47.836085 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1393/2705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:47 2022] GET /compute/v2.1/servers/e22ef89e-ee93-4cdf-8518-00b2219a29d9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:32:47.890414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:47.891269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:47.912344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.913320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.913949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:47.914878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:47.915713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:47.916331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:48.156412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ce46ed3-f867-4751-b12a-78cc39a1636e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:48.156412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=31 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:48.156412 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ce46ed3-f867-4751-b12a-78cc39a1636e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1213 microversion: 2.1 time: 0.297004 Nov 02 21:32:48.156412 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1313/2706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:47 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1213 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:48.297913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:48.298860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:48.305807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:48.306642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:48.307310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:48.308254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:48.308948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:48.309599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:48.407898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:48.427137 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94751e93-e0e3-4f68-bf80-9d99ee91a1e8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.544078 Nov 02 21:32:48.428037 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1394/2707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:47 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:48.607227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:48.616599 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fede0ce1-d3a4-49f5-82b2-22857ebddb17 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.322491 Nov 02 21:32:48.620401 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1314/2708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:48 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:48.634135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:48.634884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:48.641978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:48.642802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:48.643436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:48.645121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:48.645647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:48.646473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:49.164682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:49.175643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-551110a6-8fa0-43e0-a118-d34f75ad67f7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1294 microversion: 2.1 time: 0.545465 Nov 02 21:32:49.176237 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1395/2709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:48 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1294 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:49.191500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b444034-da44-4032-8a1a-b2bf4c681961 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:49.192144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b444034-da44-4032-8a1a-b2bf4c681961 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:49.335164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b444034-da44-4032-8a1a-b2bf4c681961 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:49.343145 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b444034-da44-4032-8a1a-b2bf4c681961 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1213 microversion: 2.1 time: 0.170570 Nov 02 21:32:49.343749 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1315/2710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:49 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:49.449976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:49.450588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:49.461074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:49.461575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:49.462093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:49.462804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:49.471185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:49.471969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:49.644134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:49.647442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:49.666956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:49.667717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:49.668355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:49.670218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:49.670852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:49.671841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:50.191212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:50.208243 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-794e0d67-e5a7-4ec1-848f-247131d925a5 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.568387 Nov 02 21:32:50.218645 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1316/2711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:49 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:50.225502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:50.230318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:50.254642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:50.270932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:50.271653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:50.272506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:50.273150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:50.273693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:50.468791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:50.479371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7fb0c9c9-3e9d-431f-9d62-0d4ce3b8b0a3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 1.033179 Nov 02 21:32:50.481573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1396/2712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:49 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:50.487612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:50.495749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:50.513440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:50.514481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:50.514971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:50.515698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:50.516158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:50.516586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:50.632492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:50.634099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:50.647024 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bdc891e3-2e99-4659-8fe1-277700ec732d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1484 microversion: 2.1 time: 0.426714 Nov 02 21:32:50.652007 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1317/2713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:50 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1484 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:50.652131 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-603666a0-3913-465b-a17e-4f02fd8a10b8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1265 microversion: 2.1 time: 0.164183 Nov 02 21:32:50.669205 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1397/2714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:50 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:50.680026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:50.686554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:50.700753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:50.701571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:50.703560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:50.704359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:50.704848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:50.705342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:50.856646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3bdf2656-bf30-472b-8e8c-7ba072484023 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'create', calling method: .version_select at 0x7f9b6d2fc1f0>, body: {"keypair": {"name": "tempest-keypair-834069955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuAEYaj/aaea3MzWO15KvFEniCa5i1TkKNbHPm/D9V/wShOcEeuONX0TEREb+NFO2RhOVorS0E90YIVJgf+sVDJGFlPP9u2nwsPSU2Ifa4XXnoTCmgzFtxbdN8che9bwg=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:50.884962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3bdf2656-bf30-472b-8e8c-7ba072484023 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:50.890338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3bdf2656-bf30-472b-8e8c-7ba072484023 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for user 368ab16b50f84f0d9cf6e79e039dc257 and project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:50.907766 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1911d297-59b6-4aad-81d0-409fd9fb5a55 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.231799 Nov 02 21:32:50.908807 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1398/2715] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:32:50 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:51.029214 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3bdf2656-bf30-472b-8e8c-7ba072484023 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.377489 Nov 02 21:32:51.031019 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1318/2716] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:32:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:51.263724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:51.265379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:51.292641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:51.293488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:51.295619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:51.298026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:51.303314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:51.303726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:51.327891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8586678c-0252-41cc-81b6-82d18c45835f tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b6d102ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:51.406443 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8586678c-0252-41cc-81b6-82d18c45835f tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2519a4dd-5bdd-49a8-a932-b750f0776c37" status: 200 len: 351 microversion: 2.1 time: 0.086446 Nov 02 21:32:51.407501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1319/2717] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:32:51 2022] GET /compute/v2.1/os-volumes/2519a4dd-5bdd-49a8-a932-b750f0776c37 => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:32:51.510045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:51.511056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:51.523751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:51.527843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:51.528799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:51.529907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:51.530499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:51.531038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:52.369329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:52.382868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-645cc42a-cbec-4680-be73-de70c9d79ebb tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 1.134175 Nov 02 21:32:52.400602 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1399/2718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:51 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:52.415094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-85734f8e-c350-4aaf-8af5-a1fe5eb5d873 req-0a145cda-349f-4a1a-a136-98a93a7e4900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a10092-9128-4919-802d-47d26426773d", "name": "network-vif-plugged", "status": "completed", "tag": "093fd98c-8af8-4f46-a8ae-e3061b202b5f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:52.429904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-85734f8e-c350-4aaf-8af5-a1fe5eb5d873 req-0a145cda-349f-4a1a-a136-98a93a7e4900 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:52.431136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-85734f8e-c350-4aaf-8af5-a1fe5eb5d873 req-0a145cda-349f-4a1a-a136-98a93a7e4900 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:52.432330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-85734f8e-c350-4aaf-8af5-a1fe5eb5d873 req-0a145cda-349f-4a1a-a136-98a93a7e4900 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:52.445097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:52.450396 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-85734f8e-c350-4aaf-8af5-a1fe5eb5d873 req-0a145cda-349f-4a1a-a136-98a93a7e4900 service nova] Creating event network-vif-plugged:093fd98c-8af8-4f46-a8ae-e3061b202b5f for instance b0a10092-9128-4919-802d-47d26426773d on n-h2-860863-4 Nov 02 21:32:52.459616 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-85734f8e-c350-4aaf-8af5-a1fe5eb5d873 req-0a145cda-349f-4a1a-a136-98a93a7e4900 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057408 Nov 02 21:32:52.461399 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1400/2719] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:52.463104 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-248616dd-ad5d-4b4d-a4a7-cf09befa0db0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.959647 Nov 02 21:32:52.470737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:52.471989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:52.483748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1320/2720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:51 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:52.484451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:52.485312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:52.485963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:52.486858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:52.487991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:52.488581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:52.664120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:52.679460 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-455785f2-9216-46e9-a2d5-96a0398469de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1271 microversion: 2.1 time: 0.208697 Nov 02 21:32:52.697062 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1401/2721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:52 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:52.755662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1519566233", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": "none"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:52.870137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:32:52.870448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:32:52.870921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:32:52.871504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:32:52.872277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:32:52.906321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:52.913671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:52.914539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:52.915501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:52.916614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:52.917272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:52.961263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Getting quotas for project 3b15947e74154cec8983b327331697d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:52.976737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Getting quotas for user 3eaa18f9c4854df3b5fe2a36607afc02 and project 3b15947e74154cec8983b327331697d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:53.006728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:32:53.012263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:32:53.199098 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9888737d-7d3a-4c35-ad83-2d140f3427f3 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.712259 Nov 02 21:32:53.205583 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1321/2722] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:32:53.211243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:53.211922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:53.224675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:53.225280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8aab4671-63a9-4d3f-8f11-7be7ffaf17e7 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:53.225867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:53.226091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8aab4671-63a9-4d3f-8f11-7be7ffaf17e7 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:53.226918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:53.229562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:53.231159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:53.233118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:53.624725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8aab4671-63a9-4d3f-8f11-7be7ffaf17e7 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:53.647318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8aab4671-63a9-4d3f-8f11-7be7ffaf17e7 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:53.654809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8aab4671-63a9-4d3f-8f11-7be7ffaf17e7 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:53.657073 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8aab4671-63a9-4d3f-8f11-7be7ffaf17e7 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1281 microversion: 2.47 time: 0.449041 Nov 02 21:32:53.658006 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1322/2723] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:53 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1281 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:32:53.686053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7cc426bd-f488-4501-aa07-25d3b43ee0e0 req-42202575-b1e1-4643-82fd-74e1d7c07cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b770f9-192e-4e5b-bc35-ff50fa086b05", "tag": "9c164165-3330-4775-880c-b1662625a664"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:53.722549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7cc426bd-f488-4501-aa07-25d3b43ee0e0 req-42202575-b1e1-4643-82fd-74e1d7c07cc8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:53.723065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7cc426bd-f488-4501-aa07-25d3b43ee0e0 req-42202575-b1e1-4643-82fd-74e1d7c07cc8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:53.723579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7cc426bd-f488-4501-aa07-25d3b43ee0e0 req-42202575-b1e1-4643-82fd-74e1d7c07cc8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:53.771041 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7cc426bd-f488-4501-aa07-25d3b43ee0e0 req-42202575-b1e1-4643-82fd-74e1d7c07cc8 service nova] Creating event network-changed:9c164165-3330-4775-880c-b1662625a664 for instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 on n-h2-860863-4 Nov 02 21:32:53.779221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:53.784420 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7cc426bd-f488-4501-aa07-25d3b43ee0e0 req-42202575-b1e1-4643-82fd-74e1d7c07cc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119591 Nov 02 21:32:53.786990 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1323/2724] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:53.790500 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9811fc65-15d9-4eb4-829c-6f4500ffe270 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1484 microversion: 2.1 time: 0.585689 Nov 02 21:32:53.792970 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1402/2725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:53 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1484 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:53.799054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:53.801216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:53.802021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:53.804784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:53.810057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:53.816798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:53.816798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:53.816798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:53.816798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:53.816798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:53.823170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:53.823861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:53.824318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:53.827441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:53.827970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:53.828516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:54.342342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:54.345936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:54.365902 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1a5ce1b6-cd3b-4d06-b31c-96ef69b4bc46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1328 microversion: 2.1 time: 0.567009 Nov 02 21:32:54.369891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1403/2726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:53 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1328 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:54.400294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:54.403378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:54.420287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:54.421726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:54.426444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:54.430001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:54.431825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:54.432385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:54.487031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:54.500264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3aa10ef4-a464-4b75-befb-6dd67b5f40f4 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.712032 Nov 02 21:32:54.515225 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1324/2727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:53 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:54.688255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec728108-0f8d-4ad7-a083-83af3026009a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:54.688973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec728108-0f8d-4ad7-a083-83af3026009a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:54.807740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ec728108-0f8d-4ad7-a083-83af3026009a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:54.818804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ec728108-0f8d-4ad7-a083-83af3026009a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:54.822005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ec728108-0f8d-4ad7-a083-83af3026009a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:54.827252 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec728108-0f8d-4ad7-a083-83af3026009a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1281 microversion: 2.47 time: 0.142993 Nov 02 21:32:54.828053 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1325/2728] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:54 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:32:55.146862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:55.183931 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c45fcbd2-b174-4ddb-9833-d89a4903aebd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.812662 Nov 02 21:32:55.185306 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1404/2729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:54 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:55.397408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:55.398319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:55.416601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:55.418577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:55.419506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:55.422444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:55.423773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:55.424572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:55.535946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:55.537725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:55.567006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:55.567757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:55.567997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:55.568731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:55.572379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:55.572860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:56.173988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:56.188974 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c0d1b6e5-173f-4045-b1a5-deaf3ee86522 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1510 microversion: 2.1 time: 0.798730 Nov 02 21:32:56.189497 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1326/2730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:55 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1510 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:56.229278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d662f38b-6a85-45da-9c46-ccfd385f654d tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b6874df70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:56.235605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:56.258965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69045fc9-f1b5-4de0-9172-c3a3a4a52592 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.727930 Nov 02 21:32:56.260620 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1405/2731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:55 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:56.288655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:56.289154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:56.304032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:56.304032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:56.304032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:56.304032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:56.304032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:56.304772 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d662f38b-6a85-45da-9c46-ccfd385f654d tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e6632ce1-bcd2-48e7-a0ac-8a969a18ad76" status: 200 len: 351 microversion: 2.1 time: 0.098531 Nov 02 21:32:56.304869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:56.305102 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1327/2732] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:32:56 2022] GET /compute/v2.1/os-volumes/e6632ce1-bcd2-48e7-a0ac-8a969a18ad76 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:56.314597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:56.316366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:56.332577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:56.333357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:56.334395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:56.335394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:56.336097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:56.337088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:56.621600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:56.637022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:56.638741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:56.640180 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6fa88f3b-0196-47d6-9c24-c2d45354a53e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1333 microversion: 2.47 time: 0.363359 Nov 02 21:32:56.654155 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1406/2733] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:56 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1333 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:56.672857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:56.676590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:56.686379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:56.691083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:56.691083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:56.691083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:56.691083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:56.691083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:56.959516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:56.971197 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb1fb21c-4357-49c6-adf2-ce18e116c88d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.664892 Nov 02 21:32:56.974153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1328/2734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:56 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:56.984604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-27a458d6-6c25-4f56-9b85-6bd90f67b874 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b68b55430>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:57.166946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-27a458d6-6c25-4f56-9b85-6bd90f67b874 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.191526 Nov 02 21:32:57.168115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1329/2735] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 21:32:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:57.184951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3bd5f520-79e2-49bb-a506-4b59a1d91e86 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b68bdc0d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:57.314413 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3bd5f520-79e2-49bb-a506-4b59a1d91e86 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.133243 Nov 02 21:32:57.316168 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1330/2736] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:32:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:57.321443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:57.323026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:57.330233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:57.331140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:57.331963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:57.333159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:57.333783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:57.334406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:57.517203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:57.566500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:57.607366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:57.616998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03093601-a318-4ac2-a96b-437c1f4654d7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1510 microversion: 2.1 time: 0.961438 Nov 02 21:32:57.617840 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1407/2737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:56 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1510 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:57.622726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44144c40-6a75-422d-b932-e98978230040 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b68f27550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:57.732509 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44144c40-6a75-422d-b932-e98978230040 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.113307 Nov 02 21:32:57.735352 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1408/2738] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 21:32:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:57.749463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:57.750096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:57.760539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:57.761356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:57.761571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:57.762610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:57.763605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:57.764144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:57.765285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:57.795757 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8d9f0c1-5f56-487d-a12a-9da3bfda8111 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1510 microversion: 2.1 time: 0.478129 Nov 02 21:32:57.796686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:57.799603 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1331/2739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:57 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:57.809885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:57.816701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:57.829697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:57.832150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:57.832844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:57.833852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:57.835012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:57.836099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.039920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:58.048809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:58.050746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:58.052108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac1e4265-1d65-4ea7-afe0-d0e045224b5a tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1339 microversion: 2.47 time: 0.246618 Nov 02 21:32:58.052891 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1332/2740] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:57 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:58.068817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e61323c8-010e-49db-9f40-fc5b28e97010 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b6944a310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:58.156593 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-679acf74-1c31-4abf-9ae0-ae11ebc78f95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 204 len: 0 microversion: 2.1 time: 0.419244 Nov 02 21:32:58.157542 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1409/2741] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:57 2022] DELETE /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:58.163958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:58.164968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:58.176851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:58.181147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:58.181978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.183620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:58.184788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:58.186180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.201011 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e61323c8-010e-49db-9f40-fc5b28e97010 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.146809 Nov 02 21:32:58.201974 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1333/2742] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 21:32:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:58.206817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:58.207434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:58.225066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:58.225631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:58.226083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.226810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:58.229463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:58.233100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.782804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:58.791475 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e1b1e8e-612d-4e26-b561-c60a97603555 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.632519 Nov 02 21:32:58.792253 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1410/2743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:58 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:58.796472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2d996dd-fdd7-4b4b-8f29-3e72035e9c42 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b68567040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:58.822358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:58.834949 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-591f9aab-e877-43aa-9524-c7f17165aa55 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1516 microversion: 2.1 time: 0.631305 Nov 02 21:32:58.835543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1334/2744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:58 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1516 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:58.856998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e0ccbe71-1d07-4dbf-9b26-9a454df47e33 req-3202d44c-8e11-44d7-97bf-405d9536ddcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6f276d-d362-46a3-94e9-ac8f4a4d9223", "tag": "a1f589d8-2ac3-40c4-b136-9cf3be98b245"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:58.870571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e0ccbe71-1d07-4dbf-9b26-9a454df47e33 req-3202d44c-8e11-44d7-97bf-405d9536ddcd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:58.871347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e0ccbe71-1d07-4dbf-9b26-9a454df47e33 req-3202d44c-8e11-44d7-97bf-405d9536ddcd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:58.876580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e0ccbe71-1d07-4dbf-9b26-9a454df47e33 req-3202d44c-8e11-44d7-97bf-405d9536ddcd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.888039 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e0ccbe71-1d07-4dbf-9b26-9a454df47e33 req-3202d44c-8e11-44d7-97bf-405d9536ddcd service nova] Creating event network-changed:a1f589d8-2ac3-40c4-b136-9cf3be98b245 for instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 on n-h1-860863-4 Nov 02 21:32:58.896244 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e0ccbe71-1d07-4dbf-9b26-9a454df47e33 req-3202d44c-8e11-44d7-97bf-405d9536ddcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058690 Nov 02 21:32:58.897115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1335/2745] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:58.902809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:58.904249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:58.906811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:58.910606 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2d996dd-fdd7-4b4b-8f29-3e72035e9c42 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.117448 Nov 02 21:32:58.911953 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1411/2746] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 21:32:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:58.912510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:58.913028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:58.913630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.914483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:58.915110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:58.915689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:58.929223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-040e70f0-3943-4726-abb5-52922b6ead79 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b6d2bf670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:59.041861 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-040e70f0-3943-4726-abb5-52922b6ead79 tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.119250 Nov 02 21:32:59.043417 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1412/2747] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:32:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:32:59.057106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1645454846", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abf3b988-f5ac-44d9-9b37-c74857f22c78"}], "security_groups": [{"name": "tempest-securitygroup--1728791854"}], "key_name": "tempest-keypair-834069955", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:32:59.216502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:59.226002 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-819e32f4-75f1-4890-9735-8d319747b269 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1487 microversion: 2.1 time: 0.327399 Nov 02 21:32:59.240814 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1336/2748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:58 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1487 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:59.240814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0e55b14-d8c5-4444-a41e-4fe3aa307baf tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b68799940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:59.248958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] validate_networks() for [('abf3b988-f5ac-44d9-9b37-c74857f22c78', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:32:59.330686 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0e55b14-d8c5-4444-a41e-4fe3aa307baf tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102412 Nov 02 21:32:59.331982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1337/2749] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Nov 2 21:32:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:32:59.338085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:59.339271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:59.348100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.348720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.349439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:59.350270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.350851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.351400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:59.357748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:32:59.439672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:59.449535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:59.451527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:32:59.452920 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab4ac3c2-93ff-4b45-8166-c2f428f3886e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1339 microversion: 2.47 time: 0.119642 Nov 02 21:32:59.453650 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1338/2750] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:32:59 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1339 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:32:59.459123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:59.459877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:59.466218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.466857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.467430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:59.468322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.469396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.469979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:59.506234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:32:59.773115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:32:59.773537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:32:59.774013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:32:59.774419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:32:59.774826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:32:59.783971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.784629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.785115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:59.785839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.786292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.786716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:59.797077 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8d7cc490-c493-45ff-97a8-de0dc664beaf tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 204 len: 0 microversion: 2.1 time: 0.341978 Nov 02 21:32:59.797725 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1339/2751] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:32:59 2022] DELETE /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:32:59.804034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14fcd4a6-c6ed-42ba-8a46-cb0baa5ba37d tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] Calling method '.version_select at 0x7f9b68bdcd30>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:59.806260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:32:59.812874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for user 368ab16b50f84f0d9cf6e79e039dc257 and project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:32:59.826640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:32:59.829139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:32:59.896680 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14fcd4a6-c6ed-42ba-8a46-cb0baa5ba37d tempest-VolumesTestJSON-1286232808 tempest-VolumesTestJSON-1286232808-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097746 Nov 02 21:32:59.897415 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1340/2752] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 21:32:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:32:59.902120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:32:59.902845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:32:59.913205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.914324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.914443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:32:59.916646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:32:59.916646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:32:59.916646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:00.005394 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b33483a3-89fd-45bf-978d-fab817cb1664 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.957257 Nov 02 21:33:00.006359 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1413/2753] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:32:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:33:00.011062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:00.011727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:00.018146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:00.018871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:00.019426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:00.026924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:00.026924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:00.026924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:00.056216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:00.064056 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-52ae680b-9611-4358-9be9-ea1c5e105f0a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1493 microversion: 2.1 time: 0.165650 Nov 02 21:33:00.064867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1341/2754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:32:59 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1493 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:00.071385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:00.072238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:00.078320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:00.078804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:00.079246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:00.080204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:00.080862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:00.081381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:00.350069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:00.355043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:00.359844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dca5feac-349d-4c86-b283-bf6867086167 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.352338 Nov 02 21:33:00.361734 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1414/2755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:00 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:00.369340 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7965422d-1ea6-49a0-a5b7-ab94d55ffed3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1516 microversion: 2.1 time: 0.302578 Nov 02 21:33:00.374015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25bd7d15-ca98-4719-861b-bd37133f1855 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:00.374636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-25bd7d15-ca98-4719-861b-bd37133f1855 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:00.389205 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1342/2756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:00 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1516 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:00.468512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-25bd7d15-ca98-4719-861b-bd37133f1855 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:00.476566 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25bd7d15-ca98-4719-861b-bd37133f1855 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1238 microversion: 2.1 time: 0.113192 Nov 02 21:33:00.477190 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1415/2757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:00 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1238 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:00.490895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:00.491788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:00.499182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:00.500141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:00.500903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:00.501842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:00.502501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:00.503835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:00.653355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:00.724541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:00.740119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:00.747233 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5b9514d7-f136-4d77-9bbb-0f9a0c175fae tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1339 microversion: 2.47 time: 0.263299 Nov 02 21:33:00.754035 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1343/2758] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:33:00 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:33:01.087958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:01.089211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:01.116033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:01.117391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:01.118126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:01.118952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:01.119623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:01.120811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:01.388969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:01.388969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:01.404588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:01.405138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:01.405704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:01.406357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:01.406814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:01.407249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:01.723981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:01.734986 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84bd0af1-412a-4e0d-8933-7e619afcc8be tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1493 microversion: 2.1 time: 0.649725 Nov 02 21:33:01.737277 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1416/2759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:01 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1493 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:01.748894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:01.751451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:01.765335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:01.766242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:01.767333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:01.768857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:01.770558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:01.772684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:01.945006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:01.958351 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52e7c4e7-dbc8-474c-8216-1ef0892298b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1313 microversion: 2.1 time: 0.219695 Nov 02 21:33:01.959240 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1417/2760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:01 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:01.973414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:01.974350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:01.993136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:02.008670 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a3974c36-0279-45ca-b464-f4ac03d6d5f0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.624108 Nov 02 21:33:02.013299 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1344/2761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:01 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:02.023063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.024171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.024793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.025758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.026363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.026955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.033112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-652fea2d-db72-4f9c-b5ff-57124367137c req-4a84d7aa-4e57-4582-99ee-351a4dd58252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a10092-9128-4919-802d-47d26426773d", "name": "network-vif-deleted", "tag": "093fd98c-8af8-4f46-a8ae-e3061b202b5f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:02.088779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-652fea2d-db72-4f9c-b5ff-57124367137c req-4a84d7aa-4e57-4582-99ee-351a4dd58252 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.089658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-652fea2d-db72-4f9c-b5ff-57124367137c req-4a84d7aa-4e57-4582-99ee-351a4dd58252 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.093264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-652fea2d-db72-4f9c-b5ff-57124367137c req-4a84d7aa-4e57-4582-99ee-351a4dd58252 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.110417 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-652fea2d-db72-4f9c-b5ff-57124367137c req-4a84d7aa-4e57-4582-99ee-351a4dd58252 service nova] Creating event network-vif-deleted:093fd98c-8af8-4f46-a8ae-e3061b202b5f for instance b0a10092-9128-4919-802d-47d26426773d on n-h2-860863-4 Nov 02 21:33:02.129261 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-652fea2d-db72-4f9c-b5ff-57124367137c req-4a84d7aa-4e57-4582-99ee-351a4dd58252 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109490 Nov 02 21:33:02.146361 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1345/2762] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:02.169746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:02.181541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:02.220795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.225827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.226416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.227257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.231632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.233505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.360627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:02.379266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b025188b-d6df-4fed-95b1-e9af91d2527e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1242 microversion: 2.1 time: 0.415740 Nov 02 21:33:02.380739 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1418/2763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:01 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1242 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:02.406054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:02.428500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:02.435407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:02.438700 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a2c0d3e-d742-4613-89eb-0bb30e23dbd2 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1360 microversion: 2.47 time: 0.289993 Nov 02 21:33:02.446288 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1346/2764] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:33:02 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:33:02.505494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1769019632"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:02.521242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:02.548716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.549571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.552364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.560460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.560971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.561425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.768239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:02.769720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:02.786061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.786831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.787486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.788408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:02.789181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:02.789849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:02.938536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:03.150818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:03.163946 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b96f38b9-5189-4e85-a71d-57b80104a017 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "POST /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea/action" status: 202 len: 52 microversion: 2.47 time: 0.675810 Nov 02 21:33:03.173236 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1419/2765] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:33:02 2022] POST /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea/action => generated 52 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Nov 02 21:33:03.180143 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c35e2518-9c64-49ba-b1f6-190d662373a2 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1493 microversion: 2.1 time: 0.410632 Nov 02 21:33:03.180797 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1347/2766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:02 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1493 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:03.203830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:03.204433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:03.212526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:03.214887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:03.221139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:03.222781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:03.223474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:03.224371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:03.225069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:03.225642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:03.247269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:03.248436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:03.253549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:03.265606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:03.266539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:03.270080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:03.366065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:03.366753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:03.368117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:03.368852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lazy-loading 'fault' on Instance uuid b0a10092-9128-4919-802d-47d26426773d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:33:03.564717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:03.573876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cb21a41-1e55-469c-8e4c-a5ed2f21f308 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 200 len: 1318 microversion: 2.1 time: 0.386600 Nov 02 21:33:03.577933 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1420/2767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:03 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:03.591077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:03.592010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:03.603113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:03.629681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:03.630799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:03.631367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:03.632783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:03.635003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:03.635690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:03.708837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:33:03.737063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:04.149230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:04.163894 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f6d8389c-091e-4570-8cf8-d4d1c5439f2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.978189 Nov 02 21:33:04.164862 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1348/2768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:03 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:04.189646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:04.191181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:04.199067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.200077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.200465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.209256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.209256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.209256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.250073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60d248c2-bd0c-484c-826e-f0c5e02ae524 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 204 len: 0 microversion: 2.47 time: 0.669787 Nov 02 21:33:04.255764 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1421/2769] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:33:03 2022] DELETE /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:33:04.265632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-007a3a3d-e477-4490-9dfd-c88449b73d38 req-32855a3c-8069-478b-bc98-9abffe13476c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81329b61-decf-4a21-a88b-3fb5a3e4f7a9", "name": "network-vif-deleted", "tag": "f1710205-2eee-461a-8f4e-b89be1e59030"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:04.281386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-007a3a3d-e477-4490-9dfd-c88449b73d38 req-32855a3c-8069-478b-bc98-9abffe13476c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.281386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-007a3a3d-e477-4490-9dfd-c88449b73d38 req-32855a3c-8069-478b-bc98-9abffe13476c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.281386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-007a3a3d-e477-4490-9dfd-c88449b73d38 req-32855a3c-8069-478b-bc98-9abffe13476c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.296953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:04.312866 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-835ec6f7-f9e8-4598-a48a-b19e54b4b5c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1308 microversion: 2.1 time: 0.126643 Nov 02 21:33:04.318805 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-007a3a3d-e477-4490-9dfd-c88449b73d38 req-32855a3c-8069-478b-bc98-9abffe13476c service nova] Creating event network-vif-deleted:f1710205-2eee-461a-8f4e-b89be1e59030 for instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 on n-h1-860863-4 Nov 02 21:33:04.318959 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1349/2770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:04 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:04.335554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-007a3a3d-e477-4490-9dfd-c88449b73d38 req-32855a3c-8069-478b-bc98-9abffe13476c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076621 Nov 02 21:33:04.338163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:04.340170 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1422/2771] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:04.340382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:04.352513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:04.355659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.356632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.357098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.357801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.358278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:04.361157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.361927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.369470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.372024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.373777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.374696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.377404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.377955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.490958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:04.497908 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-771c15f4-4897-44bf-9cee-c074039f836d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 200 len: 1287 microversion: 2.1 time: 0.181015 Nov 02 21:33:04.500729 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1350/2772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:04 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 1287 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:04.540688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:04.551029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:04.552770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:04.554338 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d58e1f1-4fd4-4ea6-884d-75238a7b4866 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1366 microversion: 2.47 time: 0.212484 Nov 02 21:33:04.555362 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1423/2773] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:33:04 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:33:04.601816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:04.603013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:04.611401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.612764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.613762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.615114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:04.615731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:04.616308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:04.640236 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d HTTP/1.1 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b0a10092-9128-4919-802d-47d26426773d'} Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:04.645881 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9dbd2f37-8443-4aac-9dbd-0c5ad2225f44 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 404 len: 111 microversion: 2.1 time: 0.049370 Nov 02 21:33:04.654768 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1351/2774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:04 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:04.663338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8db1c240-d371-4c17-af2a-148ef385771a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '.version_select at 0x7f9b68523a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:04.763820 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8db1c240-d371-4c17-af2a-148ef385771a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-key-1254689781" status: 202 len: 0 microversion: 2.1 time: 0.110145 Nov 02 21:33:04.765088 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1424/2775] 10.222.0.25 () {58 vars in 1209 bytes} [Wed Nov 2 21:33:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1254689781 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:33:04.944357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1855714329", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b4726632-ac93-4a1f-8349-9b723bbb1016"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:04.974472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=17 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:05.023658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:33:05.190640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:05.191342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:05.204596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.205143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.205605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.207854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.211617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.212253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.518371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:05.531654 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b581948-6dc1-4809-8486-9fb8d2f1df50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.343009 Nov 02 21:33:05.532786 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1425/2776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:05 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:05.541765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:05.549211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:05.556451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.557003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.557474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.558199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.558672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.559098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.705537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:05.717696 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1cd0c3d-e54f-4198-ac0d-5f7779d02bf8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1296 microversion: 2.1 time: 0.179645 Nov 02 21:33:05.721970 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1426/2777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:05 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:05.738721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:05.739363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:05.752657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.753827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.754300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.768818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.768818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.771183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.782262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:33:05.784233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:33:05.785208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:33:05.785643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:33:05.786062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:33:05.812098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.813087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.813689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.814637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.815537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.816190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.816749 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 HTTP/1.1 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '81329b61-decf-4a21-a88b-3fb5a3e4f7a9'} Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:05.818709 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:05.823505 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-570e23ec-d7bf-4982-9d36-2ab639a2ee39 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 404 len: 111 microversion: 2.1 time: 0.095946 Nov 02 21:33:05.833301 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1427/2778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:05 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:05.855932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:05.857181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:05.873163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.873671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.874118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.881485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:33:05.885481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:05.885481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:05.885481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:05.899201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:33:05.932449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:33:05.947107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:33:06.052210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:06.071457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:06.072890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:06.074073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6622dccb-e4d5-4e80-8265-647c432e10ea tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1366 microversion: 2.47 time: 0.239729 Nov 02 21:33:06.078539 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1428/2779] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:33:05 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:33:06.105773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2017703105", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "67c3f76f-7a17-4f1f-a61d-9ec78598dc27"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:06.240731 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-be3d6b9a-496d-498c-803b-9400c6d4c5ca tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297696 Nov 02 21:33:06.241617 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1352/2780] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:33:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Nov 02 21:33:06.248286 n-d-860863-4 devstack@n-api.service[121040]: ERROR sqlalchemy.pool.impl.QueuePool Nov 02 21:33:06.250748 n-d-860863-4 devstack@n-api.service[121040]: Exception ignored in: . at 0x7f9b6851dee0> Nov 02 21:33:06.250748 n-d-860863-4 devstack@n-api.service[121040]: Traceback (most recent call last): Nov 02 21:33:06.250748 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Nov 02 21:33:06.251324 n-d-860863-4 devstack@n-api.service[121040]: and _finalize_fairy(None, rec, pool, ref, echo, True), Nov 02 21:33:06.251324 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Nov 02 21:33:06.251504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-368f0874-763d-45ad-aefd-5e2df915515b req-8c15de69-f878-4c7f-a2c8-c3105a774760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6f276d-d362-46a3-94e9-ac8f4a4d9223", "name": "network-vif-plugged", "status": "completed", "tag": "a1f589d8-2ac3-40c4-b136-9cf3be98b245"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:06.251930 n-d-860863-4 devstack@n-api.service[121040]: connection_record.checkin() Nov 02 21:33:06.251930 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Nov 02 21:33:06.252369 n-d-860863-4 devstack@n-api.service[121040]: pool.dispatch.checkin(connection, self) Nov 02 21:33:06.252369 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Nov 02 21:33:06.253540 n-d-860863-4 devstack@n-api.service[121040]: fn(*args, **kw) Nov 02 21:33:06.253754 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Nov 02 21:33:06.253981 n-d-860863-4 devstack@n-api.service[121040]: time.sleep(0) Nov 02 21:33:06.254305 n-d-860863-4 devstack@n-api.service[121040]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Nov 02 21:33:06.255926 n-d-860863-4 devstack@n-api.service[121040]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 21:33:06.256120 n-d-860863-4 devstack@n-api.service[121040]: AssertionError: do not call blocking functions from the mainloop Nov 02 21:33:06.266482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-368f0874-763d-45ad-aefd-5e2df915515b req-8c15de69-f878-4c7f-a2c8-c3105a774760 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:06.267111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-368f0874-763d-45ad-aefd-5e2df915515b req-8c15de69-f878-4c7f-a2c8-c3105a774760 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:06.267391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-368f0874-763d-45ad-aefd-5e2df915515b req-8c15de69-f878-4c7f-a2c8-c3105a774760 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:06.281520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] validate_networks() for [('67c3f76f-7a17-4f1f-a61d-9ec78598dc27', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:33:06.326979 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-368f0874-763d-45ad-aefd-5e2df915515b req-8c15de69-f878-4c7f-a2c8-c3105a774760 service nova] Creating event network-vif-plugged:a1f589d8-2ac3-40c4-b136-9cf3be98b245 for instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 on n-h1-860863-4 Nov 02 21:33:06.340453 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-368f0874-763d-45ad-aefd-5e2df915515b req-8c15de69-f878-4c7f-a2c8-c3105a774760 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096049 Nov 02 21:33:06.362534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1353/2781] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:06.374785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a34ba11e-7107-4ced-8264-78991277df36 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:06.375506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a34ba11e-7107-4ced-8264-78991277df36 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:06.721911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a34ba11e-7107-4ced-8264-78991277df36 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:06.734143 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a34ba11e-7107-4ced-8264-78991277df36 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1209 microversion: 2.1 time: 0.366664 Nov 02 21:33:06.735022 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1354/2782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:06 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1209 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:06.751034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:06.752471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:06.796226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:06.799067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:06.800277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:06.806885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:06.807642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:06.808390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.174570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:07.187287 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9bfb67d4-4880-4cbc-b751-7d28b6a84cc0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.450995 Nov 02 21:33:07.191163 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1355/2783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:06 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:07.201444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:07.202584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:07.225033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.225556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.226003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.229126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.229677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.234672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.474046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:33:07.475342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:33:07.476030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:33:07.476614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:33:07.477684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:33:07.492380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.492875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.493411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.494133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.494826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.495321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.502038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:07.514143 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9f2a584-9e83-412e-86ef-a1bdce35762e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1364 microversion: 2.1 time: 0.321273 Nov 02 21:33:07.515603 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1356/2784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:07 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:07.521203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:07.522690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:07.530200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.531270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.531830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.533174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.533578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:33:07.533825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.534615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.540276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Getting quotas for user 1cb7808dc9e54e86811e0b7ad1cec847 and project ec7f3ac61d444f49a64f133092cbe0b7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:33:07.558592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:33:07.564135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:33:07.578669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.579245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.579677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.580185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lazy-loading 'fault' on Instance uuid f5dcc9a3-b88a-4b95-8bb3-02f1de288bea {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:33:07.585289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:07.636979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:07.647069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:07.648502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eaa18f9c4854df3b5fe2a36607afc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b15947e74154cec8983b327331697d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:07.649696 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2d941534-2ee5-4a5f-930d-79aad7c2c36e tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 200 len: 1371 microversion: 2.47 time: 0.132936 Nov 02 21:33:07.651748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1357/2785] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:33:07 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:33:07.704478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b68b3d6b-46c1-45ee-91d6-14048186417d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.624736 Nov 02 21:33:07.709419 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1429/2786] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:33:07.716624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0d22f260-a04f-469c-ab12-0ec171600c5f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:07.717260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d22f260-a04f-469c-ab12-0ec171600c5f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:07.761757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:07.762433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:07.778097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.778996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.779799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.780814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:07.781568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:07.782311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:07.789758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0d22f260-a04f-469c-ab12-0ec171600c5f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:07.798844 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0d22f260-a04f-469c-ab12-0ec171600c5f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1215 microversion: 2.1 time: 0.085274 Nov 02 21:33:07.801726 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1358/2787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:07 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:07.928278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:07.941345 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-761a1035-1777-4b55-b6fc-8982d634e9d2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1213 microversion: 2.1 time: 0.179610 Nov 02 21:33:07.956675 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1430/2788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:07 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1213 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:08.104884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-78169178-6e4e-45cd-b831-1bf3b3336c40 req-54bf5da4-27db-45f5-9ccb-b092738fb809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:08.128740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-78169178-6e4e-45cd-b831-1bf3b3336c40 req-54bf5da4-27db-45f5-9ccb-b092738fb809 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.129257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-78169178-6e4e-45cd-b831-1bf3b3336c40 req-54bf5da4-27db-45f5-9ccb-b092738fb809 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.129698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-78169178-6e4e-45cd-b831-1bf3b3336c40 req-54bf5da4-27db-45f5-9ccb-b092738fb809 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.154511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-78169178-6e4e-45cd-b831-1bf3b3336c40 req-54bf5da4-27db-45f5-9ccb-b092738fb809 service nova] Creating event network-changed:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:33:08.173787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-78169178-6e4e-45cd-b831-1bf3b3336c40 req-54bf5da4-27db-45f5-9ccb-b092738fb809 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065439 Nov 02 21:33:08.173787 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1359/2789] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:08.218720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:08.219442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:08.226979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.227474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.227914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.228619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.229109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.229665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.434485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:08.444363 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23c743ba-2004-4dde-9704-dd442b2be6b1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1313 microversion: 2.1 time: 0.229419 Nov 02 21:33:08.445064 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1431/2790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:08 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:08.538699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:08.539440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:08.549062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.549062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.549062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.549062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.549062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.549062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.679117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:08.682068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] [instance: f5dcc9a3-b88a-4b95-8bb3-02f1de288bea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:08.692172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.694319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.695738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.698752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.699395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.700005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.717712 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] HTTP exception thrown: Instance f5dcc9a3-b88a-4b95-8bb3-02f1de288bea could not be found. Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Request method failure captured: Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea HTTP/1.1 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuIDAZTv97PAoTj-OP0UilbX_1NRsAflvhfLyHRemTLsWfEftbX4pidurP57WAIFyAKyE20UY4Y7Kd_VcZnOpyMzfzRS5AYH2ENfxa31PWxUzLi5DLQxghT4r2Hz9u5YRw64T08H2Xdt-9xS0AYSJxroj6dR8Xg8UsaO0rcd-WoEDu8 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 3b15947e74154cec8983b327331697d2 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersAaction247Test-722111196 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3b15947e74154cec8983b327331697d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b15947e74154cec8983b327331697d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3b15947e74154cec8983b327331697d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3b15947e74154cec8983b327331697d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersAaction247Test-722111196 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 3b15947e74154cec8983b327331697d2 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersAaction247Test-722111196 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersAaction247Test-722111196-project Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 3eaa18f9c4854df3b5fe2a36607afc02 Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersAaction247Test-722111196-project Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f5dcc9a3-b88a-4b95-8bb3-02f1de288bea could not be found. Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f5dcc9a3-b88a-4b95-8bb3-02f1de288bea'} Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dcc9a3-b88a-4b95-8bb3-02f1de288bea could not be found. Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dcc9a3-b88a-4b95-8bb3-02f1de288bea could not be found. Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:08.719885 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dcc9a3-b88a-4b95-8bb3-02f1de288bea could not be found. Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] Returning 404 to user: Instance f5dcc9a3-b88a-4b95-8bb3-02f1de288bea could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:08.731587 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4817ea6f-defa-40e8-8fee-6aa6359ba936 tempest-ServersAaction247Test-722111196 tempest-ServersAaction247Test-722111196-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea" status: 404 len: 111 microversion: 2.47 time: 0.046975 Nov 02 21:33:08.734315 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1432/2791] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:33:08 2022] GET /compute/v2.1/servers/f5dcc9a3-b88a-4b95-8bb3-02f1de288bea => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:33:08.798028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:08.809366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fd3df456-ff30-4571-9190-3a6102040a2d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1364 microversion: 2.1 time: 0.276472 Nov 02 21:33:08.814701 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1360/2792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:08 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:08.823816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8377972-b094-414b-bc79-f5588aba9a4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:08.824435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8377972-b094-414b-bc79-f5588aba9a4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:08.888087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8377972-b094-414b-bc79-f5588aba9a4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:08.914359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8377972-b094-414b-bc79-f5588aba9a4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1215 microversion: 2.1 time: 0.094079 Nov 02 21:33:08.914922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1433/2793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:08 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:08.966459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:08.967078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:08.974658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.975143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.975589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:08.976579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:08.977115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:08.977554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:09.047618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:09.057115 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1308417-9e7f-4462-8db3-97f14e291b9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1261 microversion: 2.1 time: 0.094532 Nov 02 21:33:09.069662 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1361/2794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:08 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1261 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:09.477890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:09.478897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:09.514772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:09.521263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:09.522018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:09.523288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:09.523983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:09.525586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:09.838179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:09.840652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:09.854438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:09.857020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:09.857564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:09.875814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:09.876369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:09.879065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:09.930463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:09.936174 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9475f1df-4207-4880-90fb-50b72bf69ed0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1463 microversion: 2.1 time: 0.466677 Nov 02 21:33:09.937237 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1434/2795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:09 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1463 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:09.947668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:09.948360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:09.978048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:09.980108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:09.982057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:09.990902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:09.992367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:09.996109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:10.207427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:10.231612 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02735d42-822a-404f-96d5-ebd8da39e334 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1267 microversion: 2.1 time: 0.293265 Nov 02 21:33:10.234349 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1435/2796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:09 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:10.242857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:10.253720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:10.283246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:10.283748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:10.284215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:10.284943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:10.285427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:10.285982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:10.293981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:10.309318 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-75e0ad8b-ae65-4e4f-a744-69393f872dd4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1364 microversion: 2.1 time: 0.475232 Nov 02 21:33:10.310897 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1362/2797] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:09 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1364 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:10.317095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:10.318490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:10.346090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:10.347752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:10.349898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:10.354963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:10.355602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:10.357218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:10.481958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:10.498280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Old instance type m1.heat2, new instance type m1.heat {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 21:33:10.508761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:33:10.509848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:33:10.510702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:33:10.511112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:33:10.511618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:33:10.575470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:10.586227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cc74724f-71f1-46a5-8368-5a6ec99406d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1267 microversion: 2.1 time: 0.273844 Nov 02 21:33:10.588805 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1363/2798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:10 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:10.869821 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-97fe0426-4aeb-49b7-9367-11d00d475996 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223/action" status: 202 len: 0 microversion: 2.1 time: 0.632371 Nov 02 21:33:10.873061 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1436/2799] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:33:10 2022] POST /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:33:10.884178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:10.884626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:10.913938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:10.915533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:10.916336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:10.918657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:10.919637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:10.921815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:11.259846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:11.261187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:11.270833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:11.271748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:11.272261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:11.273256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:11.273809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:11.274303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:11.354013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:11.364150 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed4b3435-4ca4-4eb8-b1fd-88e89747ea3d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1472 microversion: 2.1 time: 0.486546 Nov 02 21:33:11.364836 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1364/2800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:10 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:11.375496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:11.376195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:11.388969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:11.399330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:11.400798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:11.406058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:11.406058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:11.406058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:11.406058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:11.425606 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9feb8bf0-d8b9-4181-88e6-7b9a44bb46f8 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1285 microversion: 2.1 time: 0.168818 Nov 02 21:33:11.448469 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1437/2801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:11 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:11.623628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:11.625472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:11.647294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:11.649455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:11.650221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:11.653515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:11.654005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:11.662491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:11.991794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:12.002951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0be5cae2-b181-4bae-af9e-48bed65274f0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1364 microversion: 2.1 time: 0.636832 Nov 02 21:33:12.006543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1365/2802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:11 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1364 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:12.197823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:12.212314 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f73bf961-cb22-4115-b405-70144fa8e4cf tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.600622 Nov 02 21:33:12.214402 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1438/2803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:11 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:12.389288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:12.390256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:12.405577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:12.406892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:12.410642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:12.412475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:12.414375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:12.416108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:12.465763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:12.466383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:12.479237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:12.484067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:12.486570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:12.492942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:12.500652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:12.501299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.011685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:13.023885 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.562895 Nov 02 21:33:13.027724 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1439/2804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:12 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:13.030222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:13.031945 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffa6431f-d291-4241-963c-d2e1d4648001 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003036 Nov 02 21:33:13.032444 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1440/2805] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 21:33:13 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 21:33:13.041795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:13.056322 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6179be3b-e0a4-4fac-96b2-361a98924478 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1472 microversion: 2.1 time: 0.671555 Nov 02 21:33:13.058741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:13.059359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:13.062386 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1366/2806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:12 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1472 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:13.069287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.070201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.070992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.072267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.073166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.073984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.087209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:13.304434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:13.309285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.311622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.313101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.316295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.317175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.317783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.396646 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-705d6db0-1ac3-4fe0-bbbf-1d0bc92c816b tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.318678 Nov 02 21:33:13.397916 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1367/2807] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:33:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:33:13.402769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:13.403869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:13.412060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.412841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.413804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.414680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.415350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.416026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.461621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:13.469703 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd5b025f-4942-4c55-8aaf-a5dfd476ab97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1364 microversion: 2.1 time: 0.436018 Nov 02 21:33:13.470335 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1441/2808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:13 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:13.479215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:13.489076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.489570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.490014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.490746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.491199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.497139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.539036 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-018e7477-dd13-4bc8-85a0-efa54f9fbcb2 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-860863-4" status: 200 len: 578 microversion: 2.1 time: 0.063552 Nov 02 21:33:13.547670 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1442/2809] 10.222.0.25 () {58 vars in 1172 bytes} [Wed Nov 2 21:33:13 2022] GET /compute/v2.1/os-services?host=n-d-860863-4 => generated 578 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:13.553254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:13.557769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.558508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.559157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.560099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.560758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.561386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.587966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bdaa2d73-ae3b-4e64-be60-046f00b452b9 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038465 Nov 02 21:33:13.588805 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1443/2810] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 21:33:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:13.604744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:13.609597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.610425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.611261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.623424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:13.629767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:13.632564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:13.689778 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0f1e85c6-ff24-43bb-9e19-af3ac512f613 tempest-ServicesAdminTestJSON-752708124 tempest-ServicesAdminTestJSON-752708124-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.090766 Nov 02 21:33:13.691026 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1444/2811] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:33:13 2022] GET /compute/v2.1/os-services => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:13.805861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:13.820980 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e410aac-1fa1-4a08-b814-292f6cee8d9d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.421686 Nov 02 21:33:13.823187 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1368/2812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:13 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:14.053856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:14.054486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:14.082606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.083125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.085185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.086195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.087352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.090320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.091951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:14.092570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:14.108670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.110553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.113913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.114699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.115168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.115593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.657615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:14.677332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:14.682912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6b8c697-9dda-4c5d-8820-52bd4b38eb44 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.634820 Nov 02 21:33:14.683526 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1445/2813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:14 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:14.690862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4bd24fa5-64b0-47bc-853d-14b7944d9006 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1472 microversion: 2.1 time: 0.602301 Nov 02 21:33:14.691432 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1369/2814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:14 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1472 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:14.695938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-707c9b20-a681-4098-b93b-fa99e5204a82 req-cd189faf-23e3-47d8-a1db-96bc0c139b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-plugged", "status": "completed", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:14.702815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5a62acb9-80c0-49c5-bae7-c815e0bbed05 req-9e9e1922-74b3-4fd3-990b-16e0663a6f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39bba200-8b07-48b4-a149-bb6a88f224ea", "tag": "6b9630f9-358a-424b-8a21-03d57a364b74"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:14.734229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5a62acb9-80c0-49c5-bae7-c815e0bbed05 req-9e9e1922-74b3-4fd3-990b-16e0663a6f6e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.735016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-707c9b20-a681-4098-b93b-fa99e5204a82 req-cd189faf-23e3-47d8-a1db-96bc0c139b95 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.735600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-707c9b20-a681-4098-b93b-fa99e5204a82 req-cd189faf-23e3-47d8-a1db-96bc0c139b95 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.737771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-707c9b20-a681-4098-b93b-fa99e5204a82 req-cd189faf-23e3-47d8-a1db-96bc0c139b95 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.738867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5a62acb9-80c0-49c5-bae7-c815e0bbed05 req-9e9e1922-74b3-4fd3-990b-16e0663a6f6e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.739330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5a62acb9-80c0-49c5-bae7-c815e0bbed05 req-9e9e1922-74b3-4fd3-990b-16e0663a6f6e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.759577 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5a62acb9-80c0-49c5-bae7-c815e0bbed05 req-9e9e1922-74b3-4fd3-990b-16e0663a6f6e service nova] Creating event network-changed:6b9630f9-358a-424b-8a21-03d57a364b74 for instance 39bba200-8b07-48b4-a149-bb6a88f224ea on n-h2-860863-4 Nov 02 21:33:14.759888 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-707c9b20-a681-4098-b93b-fa99e5204a82 req-cd189faf-23e3-47d8-a1db-96bc0c139b95 service nova] Creating event network-vif-plugged:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:33:14.765073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5a62acb9-80c0-49c5-bae7-c815e0bbed05 req-9e9e1922-74b3-4fd3-990b-16e0663a6f6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080117 Nov 02 21:33:14.767009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1446/2815] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:14.772267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-139bafd7-7f54-4481-bdab-e23ec458d34b req-8e6fc791-b77b-4138-81a1-eeaa9863be64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a66b645-00e9-4ae1-95cb-111cee96ba65", "tag": "ccb4218b-4a6d-44d0-927f-c7db772facda"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:14.774997 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-707c9b20-a681-4098-b93b-fa99e5204a82 req-cd189faf-23e3-47d8-a1db-96bc0c139b95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082246 Nov 02 21:33:14.775652 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1370/2816] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:14.785708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:14.786431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:14.796164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.796164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.796164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.796164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.796503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.796692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.805818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-139bafd7-7f54-4481-bdab-e23ec458d34b req-8e6fc791-b77b-4138-81a1-eeaa9863be64 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.806296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-139bafd7-7f54-4481-bdab-e23ec458d34b req-8e6fc791-b77b-4138-81a1-eeaa9863be64 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.806731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-139bafd7-7f54-4481-bdab-e23ec458d34b req-8e6fc791-b77b-4138-81a1-eeaa9863be64 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.831764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-139bafd7-7f54-4481-bdab-e23ec458d34b req-8e6fc791-b77b-4138-81a1-eeaa9863be64 service nova] Creating event network-changed:ccb4218b-4a6d-44d0-927f-c7db772facda for instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 on n-h2-860863-4 Nov 02 21:33:14.840246 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-139bafd7-7f54-4481-bdab-e23ec458d34b req-8e6fc791-b77b-4138-81a1-eeaa9863be64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071745 Nov 02 21:33:14.844844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1447/2817] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:14.859494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:14.860532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:14.875601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.880486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.881385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:14.882313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:14.883054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:14.883690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:15.660238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:15.674304 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa2760d0-9243-4b96-bd0d-ef06742b4b0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1364 microversion: 2.1 time: 0.896414 Nov 02 21:33:15.675644 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1371/2818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:14 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1364 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:15.677074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:15.692871 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1189c29c-69ea-4b8c-aa02-12cb58f5d961 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.845552 Nov 02 21:33:15.704951 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1448/2819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:14 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:15.718050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:15.719412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:15.720051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:15.721190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:15.728859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:15.729586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:15.730045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:15.730335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:15.730573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:15.731134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:15.731445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:15.732019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:15.732496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:15.734474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:15.734859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:15.735977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:16.030712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:16.044667 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b35d0d0-8fc1-4e12-9fad-569b0b54393c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.338690 Nov 02 21:33:16.056627 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1372/2820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:15 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:16.062282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:16.072247 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-647da469-7178-4a57-9b08-4261fc064fb5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1472 microversion: 2.1 time: 0.357538 Nov 02 21:33:16.073688 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1449/2821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:15 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:16.699176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:16.699758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:16.707352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:16.707844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:16.708288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:16.709019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:16.709479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:16.709910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:16.717697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:16.718401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:16.726559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:16.727042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:16.727679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:16.728366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:16.728813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:16.729292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:16.923466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:16.935810 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4dfc7b5-530d-445d-96e0-9fd557f41094 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1364 microversion: 2.1 time: 0.240440 Nov 02 21:33:16.936667 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1373/2822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:16 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:16.946001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:16.956628 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4566fa01-edcf-4344-8d93-670614633b39 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.243135 Nov 02 21:33:16.957451 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1450/2823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:16 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:17.077027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:17.078099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:17.086973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:17.099194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:17.100558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:17.105886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.107969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.110564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:17.111414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.112920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.114798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.115296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:17.116951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.118329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:17.121217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.121831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.129360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:17.372851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:17.376031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:17.383128 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a0a817ec-90b1-4245-904f-9ad645440cba tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.316869 Nov 02 21:33:17.384177 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1374/2824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:17 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:17.385092 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1e7d031-cb94-41d5-b5e0-41320d4f11cc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.293144 Nov 02 21:33:17.385673 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1451/2825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:17 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:17.960975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:17.961632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:17.964405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:17.969976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.970549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.971028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:17.972485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.973094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.973524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:17.984900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:17.985542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:17.994456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.994456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.994712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:17.995250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:17.995697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:17.996117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:18.383903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:18.393433 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c36eb72e-3d19-4af2-99d5-5c1a1c678c0f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1550 microversion: 2.1 time: 0.437413 Nov 02 21:33:18.412676 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1375/2826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:17 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1550 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:18.412776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:18.412883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:18.412883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:18.413091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b7541ab-eacc-4960-b4d0-f2f88413674b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.431221 Nov 02 21:33:18.420194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:18.421163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:18.421714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:18.422600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:18.423261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:18.423922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:18.430313 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1452/2827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:17 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:18.436892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:18.438214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:18.446157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:18.446655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:18.447095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:18.448078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:18.448540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:18.449157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:18.850194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:18.853025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:18.858004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3d4438c-921e-45f9-949b-b55baffb7285 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.426554 Nov 02 21:33:18.858581 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1453/2828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:18 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:18.864260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:18.864947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:18.865574 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-883a35f7-c452-4b61-9df3-44e7e4ea8a8f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.458624 Nov 02 21:33:18.866155 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1376/2829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:18 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:18.890245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:18.890501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:18.890858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:18.891597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:18.892047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:18.892597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:18.914673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:19.052562 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0961124f-9e50-4dff-95fd-3afdf90ffab9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188576 Nov 02 21:33:19.052562 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1454/2830] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:33:18 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:19.442854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:19.443561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:19.447232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:19.451773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:19.452258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:19.452705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:19.453477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:19.454283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:19.454938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:19.587303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d396ec5-2b01-4ead-a845-29fe5408e8de tempest-ComputeTenantNetworksTest-301094814 tempest-ComputeTenantNetworksTest-301094814-project] Calling method '.version_select at 0x7f9b6874d5e0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:19.927797 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d396ec5-2b01-4ead-a845-29fe5408e8de tempest-ComputeTenantNetworksTest-301094814 tempest-ComputeTenantNetworksTest-301094814-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.535858 Nov 02 21:33:19.934569 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1377/2831] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:33:19 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:19.950773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:19.950773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:19.954097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:19.954926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:19.955637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:19.956589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:19.956753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:19.957489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:19.962562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:19.990571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:20.002145 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bda5e059-0406-49d6-98c9-ee6a6356ed2b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.566127 Nov 02 21:33:20.006431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1455/2832] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:19 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:20.011680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:20.012408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:20.019263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:20.019952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:20.020491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:20.021379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:20.022664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:20.023205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:20.594176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:20.599408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:20.603287 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f7dae9cb-1e25-43f7-a017-f4315a760f19 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.666996 Nov 02 21:33:20.604827 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1378/2833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:19 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:20.611571 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d3c6adf-127c-46c8-9675-f2b56231a757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.603748 Nov 02 21:33:20.612572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56c23bd8-ce37-4c1c-8814-1f328a50bf0b tempest-ComputeTenantNetworksTest-301094814 tempest-ComputeTenantNetworksTest-301094814-project] Calling method '.version_select at 0x7f9b6d29d5e0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:20.625548 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1456/2834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:20 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:20.780196 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-56c23bd8-ce37-4c1c-8814-1f328a50bf0b tempest-ComputeTenantNetworksTest-301094814 tempest-ComputeTenantNetworksTest-301094814-project] 10.222.0.25 "GET /compute/v2.1/os-tenant-networks/08a78707-862c-4d49-a7ea-9219fae0342a" status: 200 len: 139 microversion: 2.1 time: 0.173941 Nov 02 21:33:20.780987 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1379/2835] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:33:20 2022] GET /compute/v2.1/os-tenant-networks/08a78707-862c-4d49-a7ea-9219fae0342a => generated 139 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:21.035845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:21.036497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:21.044007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:21.044553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:21.045024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:21.045725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:21.046302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:21.046733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:21.514324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:21.539350 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61352a0a-58c5-4034-abb5-b86d1bc92f61 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.508204 Nov 02 21:33:21.541093 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1457/2836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:21 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:21.628463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:21.628463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:21.637352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:21.637969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:21.648686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:21.654386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:21.655204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:21.656345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:21.657975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:21.658646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:21.659949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:21.660579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:21.661048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:21.664802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:21.665320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:21.665761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:22.158658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:22.177883 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52d86767-1e43-41f0-97fd-e9259859c757 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.544388 Nov 02 21:33:22.178633 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1458/2837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:21 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:22.183625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2d6cc71c-9aa8-4766-9b25-7fefd96a09b4 req-1279ccf4-5b52-48d4-832f-3b354c29b8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a66b645-00e9-4ae1-95cb-111cee96ba65", "name": "network-vif-plugged", "status": "completed", "tag": "ccb4218b-4a6d-44d0-927f-c7db772facda"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:22.209374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2d6cc71c-9aa8-4766-9b25-7fefd96a09b4 req-1279ccf4-5b52-48d4-832f-3b354c29b8c2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:22.210081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2d6cc71c-9aa8-4766-9b25-7fefd96a09b4 req-1279ccf4-5b52-48d4-832f-3b354c29b8c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:22.210682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2d6cc71c-9aa8-4766-9b25-7fefd96a09b4 req-1279ccf4-5b52-48d4-832f-3b354c29b8c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:22.233099 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2d6cc71c-9aa8-4766-9b25-7fefd96a09b4 req-1279ccf4-5b52-48d4-832f-3b354c29b8c2 service nova] Creating event network-vif-plugged:ccb4218b-4a6d-44d0-927f-c7db772facda for instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 on n-h2-860863-4 Nov 02 21:33:22.240701 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2d6cc71c-9aa8-4766-9b25-7fefd96a09b4 req-1279ccf4-5b52-48d4-832f-3b354c29b8c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060454 Nov 02 21:33:22.251714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:22.253020 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1459/2838] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:22.259566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-457de481-5954-4333-99f9-a20f6a5b2156 req-b569a20d-288b-45d5-b941-e4389f6ff9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:22.269750 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e2d3860-1030-4b07-9325-5df1a2b0037b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.646362 Nov 02 21:33:22.284972 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1380/2839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:21 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:22.293812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-457de481-5954-4333-99f9-a20f6a5b2156 req-b569a20d-288b-45d5-b941-e4389f6ff9e2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:22.294622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-457de481-5954-4333-99f9-a20f6a5b2156 req-b569a20d-288b-45d5-b941-e4389f6ff9e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:22.295234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-457de481-5954-4333-99f9-a20f6a5b2156 req-b569a20d-288b-45d5-b941-e4389f6ff9e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:22.319721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-457de481-5954-4333-99f9-a20f6a5b2156 req-b569a20d-288b-45d5-b941-e4389f6ff9e2 service nova] Creating event network-changed:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:33:22.333808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-457de481-5954-4333-99f9-a20f6a5b2156 req-b569a20d-288b-45d5-b941-e4389f6ff9e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078874 Nov 02 21:33:22.335114 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1460/2840] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:22.563595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:22.564217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:22.572528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:22.573047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:22.579682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:22.581544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:22.582229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:22.582854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:22.915347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:22.940684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf2e62bb-1aeb-4426-b27e-c3165c2ad80e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.377003 Nov 02 21:33:22.942105 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1381/2841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:22 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:23.211795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:23.215525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:23.248692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:23.249587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:23.264028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:23.265899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:23.270317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:23.271058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:23.302158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:23.302793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:23.315014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:23.319541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:23.321154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:23.322064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:23.331639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:23.344406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:23.344406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:23.645558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:23.704074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:23.715478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b25fd82a-d8b8-4f52-82db-121a8712c2b9 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1315 microversion: 2.1 time: 0.511343 Nov 02 21:33:23.716300 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1461/2842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:23 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:23.805382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:23.821796 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3065d619-8eeb-4f3f-9d49-30d4cae26d86 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.527953 Nov 02 21:33:23.822780 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1382/2843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:23 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:23.981765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:23.982755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:23.990594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:23.991392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:23.992053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:23.992960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:23.993440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:23.994051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:24.151701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:24.160046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:24.167592 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8949f00d-dbe8-487e-b56b-b798e5f0d712 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.193040 Nov 02 21:33:24.169132 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1462/2844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:23 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:24.279708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-27bf121a-fd9d-424c-b733-a595f217c462 req-2dfc9cb6-bd2f-4081-9cd5-5fbedb3d301c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39bba200-8b07-48b4-a149-bb6a88f224ea", "name": "network-vif-plugged", "status": "completed", "tag": "6b9630f9-358a-424b-8a21-03d57a364b74"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:24.292484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-27bf121a-fd9d-424c-b733-a595f217c462 req-2dfc9cb6-bd2f-4081-9cd5-5fbedb3d301c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:24.298267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-27bf121a-fd9d-424c-b733-a595f217c462 req-2dfc9cb6-bd2f-4081-9cd5-5fbedb3d301c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:24.299953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-27bf121a-fd9d-424c-b733-a595f217c462 req-2dfc9cb6-bd2f-4081-9cd5-5fbedb3d301c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:24.317064 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-27bf121a-fd9d-424c-b733-a595f217c462 req-2dfc9cb6-bd2f-4081-9cd5-5fbedb3d301c service nova] Creating event network-vif-plugged:6b9630f9-358a-424b-8a21-03d57a364b74 for instance 39bba200-8b07-48b4-a149-bb6a88f224ea on n-h2-860863-4 Nov 02 21:33:24.324278 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-27bf121a-fd9d-424c-b733-a595f217c462 req-2dfc9cb6-bd2f-4081-9cd5-5fbedb3d301c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052820 Nov 02 21:33:24.328723 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1383/2845] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:24.743107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:24.745093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:24.754417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:24.755630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:24.756264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:24.757492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:24.758118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:24.758718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:24.848313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:24.849283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:24.857948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:24.864624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:24.864624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:24.864624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:24.864624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:24.864624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:25.071137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:25.078940 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02a071ab-244c-49ab-92c9-5f3b78910933 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1501 microversion: 2.1 time: 0.341844 Nov 02 21:33:25.089983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1463/2846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:24 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1501 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:25.102482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:25.102960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:25.109907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:25.110392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:25.110826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:25.111520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:25.112760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:25.113217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:25.137685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'flavor' on Instance uuid 9a66b645-00e9-4ae1-95cb-111cee96ba65 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:33:25.138954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:25.146991 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e785ab8-29ea-4c78-8d07-f0970cf5b384 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.303975 Nov 02 21:33:25.147574 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1384/2847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:24 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:25.192612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:25.193390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:25.199643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:25.200218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:25.200653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:25.201377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:25.201827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:25.202268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:25.429457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:25.440254 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-efaa2f61-756a-4747-bf54-4f025396ea68 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1309 microversion: 2.1 time: 0.251120 Nov 02 21:33:25.441418 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1385/2848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:25 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:25.515860 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5965648-4d00-43cd-9153-5a04c645d3df tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "POST /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65/action" status: 202 len: 0 microversion: 2.1 time: 0.417212 Nov 02 21:33:25.516878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1464/2849] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:33:25 2022] POST /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:33:25.528000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:25.529585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:25.538009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:25.538775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:25.539530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:25.540517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:25.541379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:25.541964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:25.702509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7baccffa-2836-4640-bd99-dbb0d9d3763d tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Action: 'create', calling method: .version_select at 0x7f9b6859e790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1169341033"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:25.790555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:25.804721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1787519e-98a8-47d1-851c-f4aca9dfb711 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1509 microversion: 2.1 time: 0.281416 Nov 02 21:33:25.804721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1465/2850] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:25 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:26.169841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:26.170810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:26.177968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:26.178807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:26.179496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:26.180514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:26.181232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:26.181875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:26.344851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:26.362483 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0cb6768b-6926-4454-abb8-102771a87bdf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.190106 Nov 02 21:33:26.362483 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1466/2851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:26 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:26.464952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:26.465871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:26.473258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:26.473887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:26.482485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:26.482485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:26.482485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:26.482485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:26.649568 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7baccffa-2836-4640-bd99-dbb0d9d3763d tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.206659 Nov 02 21:33:26.651203 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1386/2852] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Nov 2 21:33:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1209 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 21:33:26.667413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ee13214d-fe9e-4fea-8d14-26dc1925dd23 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b685448b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:26.678953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:26.686888 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-30c8f293-2bd4-4bb4-aeca-f60e3451b240 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1491 microversion: 2.1 time: 0.226859 Nov 02 21:33:26.687748 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1467/2853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:26 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1491 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:26.765304 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ee13214d-fe9e-4fea-8d14-26dc1925dd23 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 200 len: 345 microversion: 2.1 time: 0.102446 Nov 02 21:33:26.765943 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1387/2854] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:26 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:33:26.832208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:26.833954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:26.850926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:26.853717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:26.854410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:26.855319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:26.856083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:26.856674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:26.936846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1855714329", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b4726632-ac93-4a1f-8349-9b723bbb1016"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:27.023943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:33:27.197717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:27.211967 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1674b69-5cee-4e14-b637-c0f81f296029 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1492 microversion: 2.1 time: 0.385429 Nov 02 21:33:27.225178 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1468/2855] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:26 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1492 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:27.245462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:27.246231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:27.261153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:27.261665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:27.262113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:27.262897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:27.263365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:27.263798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:27.328304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:33:27.796375 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e833f6c-8be9-4f0f-a5fb-5d6ef05420fe tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 204 len: 0 microversion: 2.1 time: 0.559406 Nov 02 21:33:27.802380 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1469/2856] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:27 2022] DELETE /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:33:27.808876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:27.811008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:27.838434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:27.839943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:27.844665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:27.848024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:27.848683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:27.849780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:28.164206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:28.177980 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7e9e0ae-25b9-4ae5-aee0-4e81730c00cf tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.373667 Nov 02 21:33:28.183857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1470/2857] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:27 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:28.206187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9249a626-cfa0-40ea-89c0-6e67c9571ce5 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6843e790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:28.232446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:33:28.233025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:33:28.233495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:33:28.233733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:33:28.234981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:33:28.249142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:28.249816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:28.250631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:28.251559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:28.252838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:28.253471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:28.275959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:33:28.283721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:33:28.297053 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9249a626-cfa0-40ea-89c0-6e67c9571ce5 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 200 len: 345 microversion: 2.1 time: 0.110303 Nov 02 21:33:28.297810 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1471/2858] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:28 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:28.301762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:33:28.303814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:28.304736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:33:28.305442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:28.312558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:28.313312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:28.314636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:28.315696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:28.316369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:28.317141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:28.528243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:28.540768 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5895b62-5d68-4110-8064-79fede0846ff tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1498 microversion: 2.1 time: 0.241822 Nov 02 21:33:28.541311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88a3e33f-0d6a-453f-879c-7b625e2f911d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.612818 Nov 02 21:33:28.544435 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1388/2859] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:33:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:33:28.557721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1472/2860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:28 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:28.562473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6750316e-e96a-4466-87f5-91cd0c5f1050 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:28.563440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6750316e-e96a-4466-87f5-91cd0c5f1050 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:28.712458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6750316e-e96a-4466-87f5-91cd0c5f1050 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:28.741480 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6750316e-e96a-4466-87f5-91cd0c5f1050 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1209 microversion: 2.1 time: 0.190524 Nov 02 21:33:28.747281 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1389/2861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:28 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:29.212060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:29.212508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:29.222540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:29.222843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:29.224548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:29.226309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:29.226944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:29.227391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:29.316370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3528eba-a0bb-4c00-9da2-941af954ffc6 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6856e1f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:29.401912 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3528eba-a0bb-4c00-9da2-941af954ffc6 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 200 len: 346 microversion: 2.1 time: 0.092640 Nov 02 21:33:29.402775 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1390/2862] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:29 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:29.416676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a561848-47f5-4702-a9e5-ffd5179dd983 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Action: 'create', calling method: .version_select at 0x7f9b6856f700>, body: {"snapshot": {"volume_id": "3292d392-972f-4ad2-8e7d-b9e573054a60", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1061020984"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:29.482900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:29.494140 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-411d2bfe-6d89-46c5-b872-386a8e9a558d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.287354 Nov 02 21:33:29.501194 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1473/2863] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:29 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:29.572646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:29.573291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:29.580169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:29.581771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:29.584484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:29.590283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:29.591536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:29.592219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:29.838852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:29.863512 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a83e3559-63a2-4346-bd91-e497d8766a3d tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1498 microversion: 2.1 time: 0.290518 Nov 02 21:33:29.863512 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1474/2864] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:29 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1498 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:29.881907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:29.882444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:29.888688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:29.889138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:29.892267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:29.892267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:29.892267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:29.892267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:30.003130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:30.013127 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1ea8591-8816-47f5-9273-7d57dd0ac57a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1213 microversion: 2.1 time: 0.149896 Nov 02 21:33:30.013807 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1475/2865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:29 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:30.082066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a561848-47f5-4702-a9e5-ffd5179dd983 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.669025 Nov 02 21:33:30.083007 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1391/2866] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Nov 2 21:33:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:30.094371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0692ff59-bbbe-4ffe-91cb-cc0040b89ea3 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b68514790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:30.168149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-4727ae34-5b9c-4024-92eb-bcdf1a5d322d req-3b8df61e-55f0-497f-9fcc-9e04e89f28cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a66b645-00e9-4ae1-95cb-111cee96ba65", "name": "network-vif-deleted", "tag": "ccb4218b-4a6d-44d0-927f-c7db772facda"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:30.191886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4727ae34-5b9c-4024-92eb-bcdf1a5d322d req-3b8df61e-55f0-497f-9fcc-9e04e89f28cf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:30.192389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4727ae34-5b9c-4024-92eb-bcdf1a5d322d req-3b8df61e-55f0-497f-9fcc-9e04e89f28cf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:30.192832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4727ae34-5b9c-4024-92eb-bcdf1a5d322d req-3b8df61e-55f0-497f-9fcc-9e04e89f28cf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:30.227684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-4727ae34-5b9c-4024-92eb-bcdf1a5d322d req-3b8df61e-55f0-497f-9fcc-9e04e89f28cf service nova] Creating event network-vif-deleted:ccb4218b-4a6d-44d0-927f-c7db772facda for instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 on n-h2-860863-4 Nov 02 21:33:30.233345 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-4727ae34-5b9c-4024-92eb-bcdf1a5d322d req-3b8df61e-55f0-497f-9fcc-9e04e89f28cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071835 Nov 02 21:33:30.235424 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1392/2867] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:30.242754 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0692ff59-bbbe-4ffe-91cb-cc0040b89ea3 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 287 microversion: 2.1 time: 0.152602 Nov 02 21:33:30.244010 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1476/2868] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:30 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:30.258315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-82073405-2ada-4681-b9fb-c634f329b967 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6856e0d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:30.369017 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-82073405-2ada-4681-b9fb-c634f329b967 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.117425 Nov 02 21:33:30.370313 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1393/2869] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 21:33:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:30.385007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6176e73-1f46-4207-ab62-4d5effac8453 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b68523a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:30.457709 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6176e73-1f46-4207-ab62-4d5effac8453 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 287 microversion: 2.1 time: 0.079070 Nov 02 21:33:30.458722 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1477/2870] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:30 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:30.519956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:30.520692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:30.527723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:30.528445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:30.528883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:30.529670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:30.530130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:30.530554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:30.752408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:30.763216 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7437c26-01ef-401b-8f4a-510017a029d9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.248795 Nov 02 21:33:30.764169 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1394/2871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:30 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:30.885470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:30.886154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:30.900723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:30.906167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:30.906827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:30.908060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:30.910978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:30.917125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:30.959373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:30.960249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:30.960868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:30.961540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lazy-loading 'fault' on Instance uuid 9a66b645-00e9-4ae1-95cb-111cee96ba65 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:33:31.040455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:31.041659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:31.054103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:31.054994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:31.057654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:31.058960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:31.059579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:31.060795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:31.116031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cb7808dc9e54e86811e0b7ad1cec847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec7f3ac61d444f49a64f133092cbe0b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:31.120617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:31.131773 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a55fdd77-b513-453a-87e3-5140125e8d05 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 200 len: 1305 microversion: 2.1 time: 0.249410 Nov 02 21:33:31.132789 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1478/2872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:30 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 1305 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:31.219935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:31.229086 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f51f2d38-6d55-4afd-808f-4cea052494f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1261 microversion: 2.1 time: 0.195735 Nov 02 21:33:31.230311 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1395/2873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:31 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:31.474469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-140abccc-6f72-459c-8f47-b044a4009df0 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6843e5e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:31.514442 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-140abccc-6f72-459c-8f47-b044a4009df0 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 287 microversion: 2.1 time: 0.046688 Nov 02 21:33:31.521158 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1479/2874] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:31 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:31.788158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:31.789416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:31.795986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:31.796614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:31.797107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:31.797880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:31.798496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:31.799125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:31.969465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:31.984014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c8995d4-386c-4d3e-b326-9feb7ab05021 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.200619 Nov 02 21:33:31.993251 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1396/2875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:31 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:32.157005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.157958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.170051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.170543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.170982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.171692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.194745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.209787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.246825 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 HTTP/1.1 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9a66b645-00e9-4ae1-95cb-111cee96ba65'} Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.249749 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.256321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:32.258605 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab22401b-c0de-4bfa-8187-280d27b75347 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 404 len: 111 microversion: 2.1 time: 0.106035 Nov 02 21:33:32.260035 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1480/2876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:32 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:32.260152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.261174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.272550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.273339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.274219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.274583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.275222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.276459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.277181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.279373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.281609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.282372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.282923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.284066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.284748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.285513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.369432 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 HTTP/1.1 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9a66b645-00e9-4ae1-95cb-111cee96ba65'} Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:32.374188 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.378853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:32.383354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f9b9107-9bc9-4c6e-b191-ac9008ee2856 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 404 len: 111 microversion: 2.1 time: 0.113119 Nov 02 21:33:32.383354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1481/2877] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:32 2022] DELETE /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:32.390280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:32.393599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.395184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 9a66b645-00e9-4ae1-95cb-111cee96ba65] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.400123 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bcd516ad-cd53-4a32-a706-67c46168fefb tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1279 microversion: 2.1 time: 0.145911 Nov 02 21:33:32.401247 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1397/2878] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:32 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:32.419072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.419699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.420763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.422910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.423422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.423874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.440989 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 HTTP/1.1 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9a66b645-00e9-4ae1-95cb-111cee96ba65'} Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.442972 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.447951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.447951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.447951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.447951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:32.447951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:32.447951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. Nov 02 21:33:32.447951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.449432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 9a66b645-00e9-4ae1-95cb-111cee96ba65 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:32.450514 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1578971-e8c7-4e0b-8248-4cce7f54dbb1 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65" status: 404 len: 111 microversion: 2.1 time: 0.064857 Nov 02 21:33:32.451677 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1482/2879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:32 2022] GET /compute/v2.1/servers/9a66b645-00e9-4ae1-95cb-111cee96ba65 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:32.459563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.460076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.482387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.486129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.486129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.486129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.486129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.486760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.505066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 HTTP/1.1 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '81329b61-decf-4a21-a88b-3fb5a3e4f7a9'} Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:32.509202 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:32.512999 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c231f69-317a-480b-86bb-d0e6daa9bc1f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 404 len: 111 microversion: 2.1 time: 0.056459 Nov 02 21:33:32.516409 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1398/2880] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:32 2022] DELETE /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:32.524078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.524803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 81329b61-decf-4a21-a88b-3fb5a3e4f7a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.531201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ef3814a6-6f0f-41ba-8675-94b6d7710424 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6855ad30>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.537375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.537906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.538361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.539096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.539558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.539993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.561972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 HTTP/1.1 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '81329b61-decf-4a21-a88b-3fb5a3e4f7a9'} Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.563622 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.568686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 81329b61-decf-4a21-a88b-3fb5a3e4f7a9 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:32.569488 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85c63dca-f465-4081-b47c-0d5c66b5a565 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9" status: 404 len: 111 microversion: 2.1 time: 0.051642 Nov 02 21:33:32.573838 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1483/2881] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:32 2022] GET /compute/v2.1/servers/81329b61-decf-4a21-a88b-3fb5a3e4f7a9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:33:32.582502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.582502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.588318 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ef3814a6-6f0f-41ba-8675-94b6d7710424 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 287 microversion: 2.1 time: 0.063574 Nov 02 21:33:32.590629 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1399/2882] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:32 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:32.592918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.593646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.593876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.594580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.595057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.595645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.921141 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 HTTP/1.1 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '215e245d-4a95-4290-8fe6-4254c8f2cea9'} Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:32.929646 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-740f5c76-30a6-461a-b546-f6160a39f74a tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 404 len: 111 microversion: 2.1 time: 0.355770 Nov 02 21:33:32.939277 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1484/2883] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:32 2022] DELETE /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 111 bytes in 360 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:32.947339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:32.948595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 215e245d-4a95-4290-8fe6-4254c8f2cea9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:32.959524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.960354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.961522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.961821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:32.962430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:32.962999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:32.984296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 HTTP/1.1 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '215e245d-4a95-4290-8fe6-4254c8f2cea9'} Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:32.988647 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.992663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:32.992663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:32.992663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:32.992663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:32.992663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:32.992663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. Nov 02 21:33:32.992663 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:32.996720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 215e245d-4a95-4290-8fe6-4254c8f2cea9 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:32.999893 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e0854f55-392c-4150-b094-c7c827d26b41 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9" status: 404 len: 111 microversion: 2.1 time: 0.058074 Nov 02 21:33:33.000657 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1400/2884] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:32 2022] GET /compute/v2.1/servers/215e245d-4a95-4290-8fe6-4254c8f2cea9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:33.011104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.011850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:33.015785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.021369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:33.027370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.028145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.028771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.029850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.030470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.031156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.044015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.044516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.047307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.048719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.049952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.052308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.068050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 HTTP/1.1 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e208b785-f6ec-4e99-9692-130e9c74a740'} Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:33.070674 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:33.074431 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-435cf57e-b8e9-4d94-9cf6-e62fbc77c176 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 404 len: 111 microversion: 2.1 time: 0.066817 Nov 02 21:33:33.076351 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1485/2885] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:33 2022] DELETE /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:33.089744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.090375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: e208b785-f6ec-4e99-9692-130e9c74a740] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:33.098145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.098694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.099325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.106090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.106595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.107252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.124124 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 HTTP/1.1 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e208b785-f6ec-4e99-9692-130e9c74a740'} Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.125912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance e208b785-f6ec-4e99-9692-130e9c74a740 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:33.130124 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c79832f4-3230-4d1a-a957-062788f49d69 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740" status: 404 len: 111 microversion: 2.1 time: 0.050052 Nov 02 21:33:33.133124 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1486/2886] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:33 2022] GET /compute/v2.1/servers/e208b785-f6ec-4e99-9692-130e9c74a740 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:33.138543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e772b7f-f08d-4bfa-abd5-ed5246f0d172 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.139057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e772b7f-f08d-4bfa-abd5-ed5246f0d172 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:33.146818 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-2e772b7f-f08d-4bfa-abd5-ed5246f0d172 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e772b7f-f08d-4bfa-abd5-ed5246f0d172 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c HTTP/1.1 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7b417526-c8e6-4c50-9fce-ca4e4686c79c'} Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.148654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e772b7f-f08d-4bfa-abd5-ed5246f0d172 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e772b7f-f08d-4bfa-abd5-ed5246f0d172 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c" status: 404 len: 111 microversion: 2.1 time: 0.015791 Nov 02 21:33:33.152445 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1487/2887] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:33 2022] DELETE /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:33.164244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8bab4aa6-e394-4aa8-ac40-37214cc86671 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.165192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8bab4aa6-e394-4aa8-ac40-37214cc86671 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 7b417526-c8e6-4c50-9fce-ca4e4686c79c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:33.173756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8bab4aa6-e394-4aa8-ac40-37214cc86671 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8bab4aa6-e394-4aa8-ac40-37214cc86671 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c HTTP/1.1 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7b417526-c8e6-4c50-9fce-ca4e4686c79c'} Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:33.176308 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:33.180260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:33.180260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:33.180260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:33.180260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. Nov 02 21:33:33.180260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:33.182930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8bab4aa6-e394-4aa8-ac40-37214cc86671 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 7b417526-c8e6-4c50-9fce-ca4e4686c79c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:33.184015 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8bab4aa6-e394-4aa8-ac40-37214cc86671 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c" status: 404 len: 111 microversion: 2.1 time: 0.026296 Nov 02 21:33:33.187983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1488/2888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:33 2022] GET /compute/v2.1/servers/7b417526-c8e6-4c50-9fce-ca4e4686c79c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:33.295313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:33.305777 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c54ad763-cfb9-4907-93c4-ff6ccc92f608 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.296628 Nov 02 21:33:33.306958 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1401/2889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:33 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:33.427330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.428299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:33.437335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.441931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.442694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.443685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:33.444370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:33.445303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:33.602470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8987af1f-6f0e-464a-9f5b-3e202a4c1b18 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6d29d430>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.670594 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8987af1f-6f0e-464a-9f5b-3e202a4c1b18 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 288 microversion: 2.1 time: 0.072048 Nov 02 21:33:33.671178 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1402/2890] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:33 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:33.683519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-124d235c-b808-40f5-ae60-830096a0dde9 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b685bcdc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.823283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:33.845938 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d1e5f48-2e89-4827-b238-ffc50ae5263a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.422101 Nov 02 21:33:33.865503 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1489/2891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:33 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:33.889432 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-124d235c-b808-40f5-ae60-830096a0dde9 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 202 len: 0 microversion: 2.1 time: 0.209326 Nov 02 21:33:33.890823 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1403/2892] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 21:33:33 2022] DELETE /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:33:33.900258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f43fa47-6f22-4973-aa67-ebfed50caf21 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6848a280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:33.982752 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f43fa47-6f22-4973-aa67-ebfed50caf21 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 287 microversion: 2.1 time: 0.086839 Nov 02 21:33:33.984434 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1490/2893] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:33 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:34.332465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:34.333687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:34.354779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:34.355488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:34.356085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:34.357025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:34.357633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:34.358360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:34.641108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:34.650476 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5580463e-5eb2-4b73-ad04-043490b60880 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.323873 Nov 02 21:33:34.651611 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1404/2894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:34 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:34.872904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:34.873546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:34.886959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:34.887634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:34.891859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:34.893687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:34.894678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:34.895283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:35.004236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-174a3b48-1523-402a-bea4-7309cdfe0e24 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b685bce50>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:35.072748 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-174a3b48-1523-402a-bea4-7309cdfe0e24 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 287 microversion: 2.1 time: 0.079959 Nov 02 21:33:35.073875 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1405/2895] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:34 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:33:35.242448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:35.251193 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27d5d8ea-e9fb-4f9f-a1e5-970128caaa87 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.382211 Nov 02 21:33:35.251793 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1491/2896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:34 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:35.677066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:35.678327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:35.685563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:35.688495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:35.689310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:35.690825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:35.692082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:35.700707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:35.917451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:35.931019 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9136b4e1-0743-4e84-a691-bcb0ed9a1a1d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.257851 Nov 02 21:33:35.932164 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1406/2897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:35 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:36.087763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-160122a3-7334-471e-95b6-7c397a41e813 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6848a9d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:36.147660 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-160122a3-7334-471e-95b6-7c397a41e813 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 200 len: 287 microversion: 2.1 time: 0.063661 Nov 02 21:33:36.148231 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1492/2898] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:36 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:36.288052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:36.288673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:36.297157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:36.299631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:36.300334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:36.301232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:36.301846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:36.302274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:36.587188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:36.616660 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-569fb6cb-f17e-4d33-a3e7-2f2e9f438560 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.334651 Nov 02 21:33:36.617986 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1407/2899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:36 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:36.945262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a6f68298-535a-4036-a7d5-c2ab43e1f9e4 req-1b5b15c3-4507-4937-b69f-bd7a502d28aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8104e5-2beb-4d11-9b34-c0930a7a6dc7", "tag": "f152964f-11b8-4a67-84f6-b8cc3297c29f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:36.956783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:36.958882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:36.978035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:36.978035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:36.978035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:36.981793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a6f68298-535a-4036-a7d5-c2ab43e1f9e4 req-1b5b15c3-4507-4937-b69f-bd7a502d28aa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:36.982265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:36.982981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:36.983858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:36.986021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a6f68298-535a-4036-a7d5-c2ab43e1f9e4 req-1b5b15c3-4507-4937-b69f-bd7a502d28aa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:36.986747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a6f68298-535a-4036-a7d5-c2ab43e1f9e4 req-1b5b15c3-4507-4937-b69f-bd7a502d28aa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:37.024454 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a6f68298-535a-4036-a7d5-c2ab43e1f9e4 req-1b5b15c3-4507-4937-b69f-bd7a502d28aa service nova] Creating event network-changed:f152964f-11b8-4a67-84f6-b8cc3297c29f for instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 on n-h1-860863-4 Nov 02 21:33:37.032161 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a6f68298-535a-4036-a7d5-c2ab43e1f9e4 req-1b5b15c3-4507-4937-b69f-bd7a502d28aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092732 Nov 02 21:33:37.034101 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1493/2900] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:37.179850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b01525e-119e-4424-9e1a-a594bc0febab tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6843e3a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:37.252831 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-0b01525e-119e-4424-9e1a-a594bc0febab tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] HTTP exception thrown: Snapshot 407110ba-765d-4a6b-bead-adaa1510af02 could not be found. Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b01525e-119e-4424-9e1a-a594bc0febab tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Request method failure captured: Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 HTTP/1.1 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuIlghtfS2pV3_lmTblM-7-bOZEvTs1dJTis4clgfZ-CHIBgHOvxYGTfUeitI7opetbd2ONA7RPVc545wc8VuUyJa7w-iTS4nosYW8eoVt1jqKp8n_ZR8c_FKQ7r2axv01ueVgp78LLy-czA4wH7wYelpaKd7LQKWXkqInQM2jDu1i8 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: dcb1573b68634cb4b78afba6f8ebdffb Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: exception: Snapshot 407110ba-765d-4a6b-bead-adaa1510af02 could not be found. Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '407110ba-765d-4a6b-bead-adaa1510af02'} Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 407110ba-765d-4a6b-bead-adaa1510af02 could not be found. (HTTP 404) (Request-ID: req-d93d506e-48ec-4595-8f5a-6c2d7ba6b25d) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:33:37.291592 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 407110ba-765d-4a6b-bead-adaa1510af02 could not be found. Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 407110ba-765d-4a6b-bead-adaa1510af02 could not be found. Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 407110ba-765d-4a6b-bead-adaa1510af02 could not be found. Nov 02 21:33:37.296827 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:37.300959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:37.303628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b01525e-119e-4424-9e1a-a594bc0febab tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Returning 404 to user: Snapshot 407110ba-765d-4a6b-bead-adaa1510af02 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:37.309221 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-497f6fdf-6735-4366-bec7-84d7745b31a9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.357390 Nov 02 21:33:37.309383 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b01525e-119e-4424-9e1a-a594bc0febab tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02" status: 404 len: 111 microversion: 2.1 time: 0.150324 Nov 02 21:33:37.310242 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1494/2901] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 21:33:37 2022] GET /compute/v2.1/os-snapshots/407110ba-765d-4a6b-bead-adaa1510af02 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:33:37.313949 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1408/2902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:36 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:37.324341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17035cbe-714d-491f-af07-19eb7e39834e tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6843e310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:37.601706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17035cbe-714d-491f-af07-19eb7e39834e tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 202 len: 0 microversion: 2.1 time: 0.286065 Nov 02 21:33:37.602998 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1495/2903] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:33:37 2022] DELETE /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:33:37.613528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35e91ab0-732f-44c9-990d-d4acb24b163d tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6856faf0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:37.649371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:37.650123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:37.668418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:37.678289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:37.678998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:37.680901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:37.684540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:37.686921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:37.732693 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-35e91ab0-732f-44c9-990d-d4acb24b163d tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 200 len: 345 microversion: 2.1 time: 0.125328 Nov 02 21:33:37.733746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1409/2904] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:37 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:38.051183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:38.062295 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51584047-43c2-4c51-b03b-405ae8b57ca9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.420643 Nov 02 21:33:38.088092 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1496/2905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:37 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:38.330179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:38.336185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:38.337098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:38.345875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:38.348342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:38.351327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:38.354499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:38.355147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:38.355768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:38.366312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:38.589814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:38.596570 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72fbc143-5bb7-47bd-b0e1-1ea4119ce6b2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.267716 Nov 02 21:33:38.597950 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1410/2906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:38 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:38.748029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f68d6dbd-9cd5-4873-a0a7-a5e1e0248241 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b68486820>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:38.817494 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f68d6dbd-9cd5-4873-a0a7-a5e1e0248241 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 200 len: 345 microversion: 2.1 time: 0.073447 Nov 02 21:33:38.825645 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1497/2907] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:38 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:39.092902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:39.093546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:39.103731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:39.114712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:39.115216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:39.117950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:39.117950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:39.121570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:39.122125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:39.358990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:39.368532 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d76eaef-5068-4870-9bd7-264bebac9b29 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.285789 Nov 02 21:33:39.369518 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1411/2908] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:39 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:39.620998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:39.621832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:39.645685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:39.645685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:39.645685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:39.645685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:39.645685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:39.645685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:39.845110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf688ce4-fec1-440b-9cd4-0164ba1036ce tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b685a1280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:39.894374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:39.902689 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7728962d-22ac-4305-ade3-3e84c5c646ba tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.285597 Nov 02 21:33:39.921580 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1498/2909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:39 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:39.983598 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf688ce4-fec1-440b-9cd4-0164ba1036ce tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 200 len: 345 microversion: 2.1 time: 0.155379 Nov 02 21:33:39.992713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1412/2910] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:39 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:40.219836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:40.220341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:40.228190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.229102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.230182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.231138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.231758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.238873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.250479 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe HTTP/1.1 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'c9ff1b00-bb4f-4926-8659-5aaca6904bfe'} Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:40.267963 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.272496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.274935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:40.275973 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9c761d2-4831-4bcc-88ba-964dc438e97f tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 404 len: 111 microversion: 2.1 time: 0.060005 Nov 02 21:33:40.283083 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1499/2911] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:40 2022] DELETE /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:40.285684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:40.286306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: c9ff1b00-bb4f-4926-8659-5aaca6904bfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:40.298075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.305385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.305907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.306940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.307588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.308226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.326167 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe HTTP/1.1 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'c9ff1b00-bb4f-4926-8659-5aaca6904bfe'} Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.334038 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance c9ff1b00-bb4f-4926-8659-5aaca6904bfe could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b33b916c-ac3f-4696-82ea-946476f4eb4c tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe" status: 404 len: 111 microversion: 2.1 time: 0.048184 Nov 02 21:33:40.338636 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1413/2912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:40 2022] GET /compute/v2.1/servers/c9ff1b00-bb4f-4926-8659-5aaca6904bfe => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:40.340513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:40.340513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:40.347388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.351026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.351478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.352225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.352688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.355557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.387618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 HTTP/1.1 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '082dcea3-173c-4af7-8c8b-9b8f5e0bf476'} Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:40.389845 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af73bd0b-93a1-4cce-846e-831f6097b508 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "DELETE /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 404 len: 111 microversion: 2.1 time: 0.056601 Nov 02 21:33:40.394142 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1500/2913] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:40 2022] DELETE /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:40.396834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:40.397653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:40.415207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:40.417712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] [instance: 082dcea3-173c-4af7-8c8b-9b8f5e0bf476] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:40.426611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.426611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.426611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.426611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.426611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.427094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.433874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.434391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.439597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.440516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.441059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.442638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.475388 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] HTTP exception thrown: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Request method failure captured: Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 HTTP/1.1 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuDPquDQfg2wLho7xWO6Y5xFL-OhsJ1JmcKel4ZGHMgXF4HMjh3OyvOBGMz2l-msezTdqk_64zadlkBgnsNVqpViWbNeAhRBxp1J_rROZqIhWcHDUIUBw890-r3GZZoOwgkCdoGFfAtcaFfAGKyxiqZM4E9ZG9zsK_TSpxedajL3rL0 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec7f3ac61d444f49a64f133092cbe0b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ec7f3ac61d444f49a64f133092cbe0b7 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-769381345 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1cb7808dc9e54e86811e0b7ad1cec847 Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-769381345-project Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '082dcea3-173c-4af7-8c8b-9b8f5e0bf476'} Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:40.479006 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] Returning 404 to user: Instance 082dcea3-173c-4af7-8c8b-9b8f5e0bf476 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:40.483825 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e16a5207-f18c-4b7e-bade-a9f291437b59 tempest-DeleteServersTestJSON-769381345 tempest-DeleteServersTestJSON-769381345-project] 10.222.0.25 "GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476" status: 404 len: 111 microversion: 2.1 time: 0.086422 Nov 02 21:33:40.487312 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1501/2914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:40 2022] GET /compute/v2.1/servers/082dcea3-173c-4af7-8c8b-9b8f5e0bf476 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:40.773997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:40.783887 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a522c5d9-4e03-455f-bbce-312357c9f7ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.394240 Nov 02 21:33:40.797173 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1414/2915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:40 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:40.933941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:40.934680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:40.943098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.943835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.946133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:40.946133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:40.946133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:40.946133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:41.000856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a6ee5b8-9d0a-455a-8b9f-08cf69f4fc4e tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6850b3a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:41.109707 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a6ee5b8-9d0a-455a-8b9f-08cf69f4fc4e tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 200 len: 345 microversion: 2.1 time: 0.113125 Nov 02 21:33:41.112173 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1415/2916] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:40 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:41.242454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:41.252996 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-01d617e6-60f9-45c9-a068-f7570ec61d10 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.322282 Nov 02 21:33:41.254255 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1502/2917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:40 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:41.816039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:41.816642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:41.829732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:41.831422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:41.831892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:41.834644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:41.835145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:41.837757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:42.091214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85f89000-673b-4e23-a040-72d7a0f68224 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Action: 'create', calling method: .version_select at 0x7f9b68603820>, body: {"keypair": {"name": "tempest-keypair-1563347591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD+eUyUhjOrH8Z8sc4yiECuYln5jEH6EabcVX7lA1uYav/USHx74IHwz/nC9NzfgSkHswQ40u8tyZMc9rEE/JSzJdtOoRjRUSTMVoYD///DzMj/Efoqsx/dxSuYLsXo0Q=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:42.118631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-85f89000-673b-4e23-a040-72d7a0f68224 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Getting quotas for project c78a3b929e4f4f2db5f46332df6f7975. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:33:42.125034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-85f89000-673b-4e23-a040-72d7a0f68224 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Getting quotas for user e1245c484e8d45e28600c4c1420df3fa and project c78a3b929e4f4f2db5f46332df6f7975. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:33:42.228634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:42.239168 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-682cd54c-2207-42d1-aebf-8c2fcd2aa343 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.433377 Nov 02 21:33:42.239850 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1503/2918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:41 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:42.245865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4f5c889-7922-4954-b849-aeff276210d7 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b685149d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:42.264818 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85f89000-673b-4e23-a040-72d7a0f68224 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.553046 Nov 02 21:33:42.264818 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1416/2919] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:33:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:42.278668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:42.280842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:42.293016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:42.304095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:42.304095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:42.304095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:42.304095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:42.304095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:42.304445 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a4f5c889-7922-4954-b849-aeff276210d7 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] HTTP exception thrown: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4f5c889-7922-4954-b849-aeff276210d7 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Request method failure captured: Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 HTTP/1.1 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuIlghtfS2pV3_lmTblM-7-bOZEvTs1dJTis4clgfZ-CHIBgHOvxYGTfUeitI7opetbd2ONA7RPVc545wc8VuUyJa7w-iTS4nosYW8eoVt1jqKp8n_ZR8c_FKQ7r2axv01ueVgp78LLy-czA4wH7wYelpaKd7LQKWXkqInQM2jDu1i8 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: dcb1573b68634cb4b78afba6f8ebdffb Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: exception: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3292d392-972f-4ad2-8e7d-b9e573054a60'} Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. (HTTP 404) (Request-ID: req-22c92b54-baa4-4778-ab90-787b54e0794b) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:33:42.316448 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.321769 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.334944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4f5c889-7922-4954-b849-aeff276210d7 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Returning 404 to user: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:42.334944 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a4f5c889-7922-4954-b849-aeff276210d7 tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 404 len: 109 microversion: 2.1 time: 0.087490 Nov 02 21:33:42.334944 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1504/2920] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:42 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:42.344209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec49c53b-3916-4db5-b53a-40194f65112c tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6843e9d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:42.410331 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ec49c53b-3916-4db5-b53a-40194f65112c tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] HTTP exception thrown: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec49c53b-3916-4db5-b53a-40194f65112c tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Request method failure captured: Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 HTTP/1.1 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuIlghtfS2pV3_lmTblM-7-bOZEvTs1dJTis4clgfZ-CHIBgHOvxYGTfUeitI7opetbd2ONA7RPVc545wc8VuUyJa7w-iTS4nosYW8eoVt1jqKp8n_ZR8c_FKQ7r2axv01ueVgp78LLy-czA4wH7wYelpaKd7LQKWXkqInQM2jDu1i8 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: dcb1573b68634cb4b78afba6f8ebdffb Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: exception: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3292d392-972f-4ad2-8e7d-b9e573054a60'} Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. (HTTP 404) (Request-ID: req-1972245f-2f1d-465e-b09e-f8c7c6082609) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:33:42.412279 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec49c53b-3916-4db5-b53a-40194f65112c tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Returning 404 to user: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec49c53b-3916-4db5-b53a-40194f65112c tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 404 len: 109 microversion: 2.1 time: 0.078471 Nov 02 21:33:42.416207 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1505/2921] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:33:42 2022] DELETE /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:42.422796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d831351c-ea8d-4086-ab9c-d7e4a19bb86f tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Calling method '.version_select at 0x7f9b6843eb80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:42.478272 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d831351c-ea8d-4086-ab9c-d7e4a19bb86f tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] HTTP exception thrown: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d831351c-ea8d-4086-ab9c-d7e4a19bb86f tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Request method failure captured: Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 HTTP/1.1 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuIlghtfS2pV3_lmTblM-7-bOZEvTs1dJTis4clgfZ-CHIBgHOvxYGTfUeitI7opetbd2ONA7RPVc545wc8VuUyJa7w-iTS4nosYW8eoVt1jqKp8n_ZR8c_FKQ7r2axv01ueVgp78LLy-czA4wH7wYelpaKd7LQKWXkqInQM2jDu1i8 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df2c8cb6ecdf46cda0ff2ba0902baa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df2c8cb6ecdf46cda0ff2ba0902baa35 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-18601302 Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: dcb1573b68634cb4b78afba6f8ebdffb Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesSnapshotsTestJSON-18601302-project Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: exception: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3292d392-972f-4ad2-8e7d-b9e573054a60'} Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. (HTTP 404) (Request-ID: req-64527029-ce44-4c03-8a92-f02ab1934e5b) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:33:42.485688 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d831351c-ea8d-4086-ab9c-d7e4a19bb86f tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] Returning 404 to user: Volume 3292d392-972f-4ad2-8e7d-b9e573054a60 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d831351c-ea8d-4086-ab9c-d7e4a19bb86f tempest-VolumesSnapshotsTestJSON-18601302 tempest-VolumesSnapshotsTestJSON-18601302-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60" status: 404 len: 109 microversion: 2.1 time: 0.068458 Nov 02 21:33:42.492623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1506/2922] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:33:42 2022] GET /compute/v2.1/os-volumes/3292d392-972f-4ad2-8e7d-b9e573054a60 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:33:42.718145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:42.729421 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-663f62f3-d176-4bf3-b1b8-7365220be047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.454669 Nov 02 21:33:42.735996 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1417/2923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:42 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:43.270285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:43.271533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:43.283101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:43.286617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:43.287277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:43.288206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:43.289013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:43.291735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:43.641970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:43.654504 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-baba92c5-3db2-4cd0-ac75-18132f6d1f10 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.390255 Nov 02 21:33:43.657462 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1507/2924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:43 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:43.765403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:43.767824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:43.782507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:43.787117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:43.788139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:43.789273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:43.789903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:43.791099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:44.601823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:44.613024 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-06ab3c69-01d7-4593-b442-f22bd6c64eb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.859335 Nov 02 21:33:44.615253 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1418/2925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:43 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:44.679908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:44.680439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:44.688176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:44.688675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:44.691512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:44.692310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:44.695213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:44.696282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:44.972450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:44.981857 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83af953c-13bd-4c7d-9e90-4d65ddcb7cd4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.305820 Nov 02 21:33:44.982778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1508/2926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:44 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:45.646195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:45.646960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:45.654863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:45.655419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:45.655863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:45.656561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:45.657257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:45.658013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:45.953424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:45.970141 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fdafcdc8-d1e8-4ba1-83ed-45517f3005ae tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.332017 Nov 02 21:33:45.972820 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1419/2927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:45 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:46.006395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:46.007024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:46.026103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:46.026985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:46.028166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:46.029308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:46.030768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:46.031497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:46.292051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:46.319204 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24a2fb4c-7c5e-4cf9-a2c3-cd12ceb5a24f tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.310158 Nov 02 21:33:46.319573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1509/2928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:46 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:46.637571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-fd248334-e2aa-455b-9aee-cb56e7a8b99a req-ef18d8ca-d633-40ca-9f4d-b91a6003763d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8104e5-2beb-4d11-9b34-c0930a7a6dc7", "name": "network-vif-plugged", "status": "completed", "tag": "f152964f-11b8-4a67-84f6-b8cc3297c29f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:46.651900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fd248334-e2aa-455b-9aee-cb56e7a8b99a req-ef18d8ca-d633-40ca-9f4d-b91a6003763d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:46.653223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fd248334-e2aa-455b-9aee-cb56e7a8b99a req-ef18d8ca-d633-40ca-9f4d-b91a6003763d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:46.653982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fd248334-e2aa-455b-9aee-cb56e7a8b99a req-ef18d8ca-d633-40ca-9f4d-b91a6003763d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:46.668648 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-fd248334-e2aa-455b-9aee-cb56e7a8b99a req-ef18d8ca-d633-40ca-9f4d-b91a6003763d service nova] Creating event network-vif-plugged:f152964f-11b8-4a67-84f6-b8cc3297c29f for instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 on n-h1-860863-4 Nov 02 21:33:46.675078 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-fd248334-e2aa-455b-9aee-cb56e7a8b99a req-ef18d8ca-d633-40ca-9f4d-b91a6003763d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045258 Nov 02 21:33:46.676175 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1420/2929] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:46.998297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:46.998923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:47.008067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:47.010155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:47.010934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:47.012037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:47.012649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:47.013294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:47.208261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-237472405", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "aea5a6ca-eefa-44fe-8e3c-dfb32a68a901"}], "security_groups": [{"name": "tempest-securitygroup--143614541"}], "key_name": "tempest-keypair-1563347591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:47.375169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:47.390361 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa5c8026-f00c-4337-9eb5-266e4a79f46e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.391946 Nov 02 21:33:47.390361 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1510/2930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:46 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:47.394889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:47.395750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:47.402787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:47.403700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:47.404418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:47.405341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:47.406561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:47.407101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:47.415499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] validate_networks() for [('aea5a6ca-eefa-44fe-8e3c-dfb32a68a901', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:33:47.726759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:47.737364 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da40608c-ab52-412f-ae9c-3099af2a7598 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.348860 Nov 02 21:33:47.738820 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1511/2931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:47 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:48.248673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:33:48.249201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:33:48.249674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:33:48.250463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:33:48.250888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:33:48.291581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:48.293502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:48.296836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:48.298501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:48.301444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:48.302103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:48.341367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Getting quotas for project c78a3b929e4f4f2db5f46332df6f7975. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:33:48.349717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:48.351278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Getting quotas for user e1245c484e8d45e28600c4c1420df3fa and project c78a3b929e4f4f2db5f46332df6f7975. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:33:48.372027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:33:48.376800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:33:48.410353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:48.412191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:48.419868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:48.420677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:48.421355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:48.426381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:48.427454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:48.428618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:48.615257 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7dc6b2f-5277-453f-b095-94f98153f892 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.412316 Nov 02 21:33:48.622713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1421/2932] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:33:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:33:48.628017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0cc066fb-65fc-49e1-8fa3-3c5679c88822 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:48.628650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0cc066fb-65fc-49e1-8fa3-3c5679c88822 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:48.639117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:48.652143 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7b085cc-a4a2-493e-807a-edfed3042573 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1477 microversion: 2.1 time: 0.242771 Nov 02 21:33:48.652143 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1512/2933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:48 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:48.711760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0cc066fb-65fc-49e1-8fa3-3c5679c88822 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:48.722820 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0cc066fb-65fc-49e1-8fa3-3c5679c88822 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1241 microversion: 2.1 time: 0.099206 Nov 02 21:33:48.728124 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1422/2934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:48 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:48.770306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:48.771409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:48.778169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:48.779885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:48.780593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:48.781208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:48.782493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:48.784040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:48.785031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:48.982266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:48.990562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:48.995329 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a27f1dbb-5a6e-4891-89bd-2391ed0f9f9b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1309 microversion: 2.1 time: 0.229734 Nov 02 21:33:48.997443 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1513/2935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:48 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1309 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:49.677466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:49.678078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:49.688666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:49.692259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:49.692886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:49.693819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:49.694846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:49.695618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:49.755296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c60a04fc-ea50-4682-87ef-56d892c199b4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:49.756858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c60a04fc-ea50-4682-87ef-56d892c199b4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:49.900748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c60a04fc-ea50-4682-87ef-56d892c199b4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:49.914950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c60a04fc-ea50-4682-87ef-56d892c199b4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1241 microversion: 2.1 time: 0.167150 Nov 02 21:33:49.915852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1514/2936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:49 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:49.973161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:49.982887 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4cc41e4b-04e1-4dfb-b574-e705965127f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1476 microversion: 2.1 time: 0.309076 Nov 02 21:33:49.997411 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1423/2937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:49 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:50.030810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:50.030810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:50.031118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.031588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.032030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.033255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.033907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.034400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.179397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:50.191412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c94f94d4-264e-4d79-8935-48f5268f820d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1490 microversion: 2.1 time: 0.177365 Nov 02 21:33:50.202632 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1515/2938] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:50 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1490 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:50.223657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:50.224267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:50.229962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.230443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.230881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.231570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.232011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.232623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.379581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:50.389438 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83ef102d-2e7f-4048-92b5-506ad35152ce tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1491 microversion: 2.1 time: 0.169610 Nov 02 21:33:50.390034 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1424/2939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:50 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1491 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:50.412717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:50.413609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:50.419906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.420597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.421225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.422091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.423008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.423596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.569441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:50.577180 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35894822-6efc-433a-8138-dcc97ac9549c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1490 microversion: 2.1 time: 0.168952 Nov 02 21:33:50.577757 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1516/2940] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:50 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1490 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:50.602586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:50.603164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:50.609523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.610117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.610627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.611972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.612774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.613590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.640523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:33:50.944148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:50.944881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:50.960375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.960375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.960375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:50.960375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:50.960375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:50.960375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:51.030112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:51.030989 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c83d53e8-629b-4f41-a15c-e2f77a5294a8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 204 len: 0 microversion: 2.1 time: 0.433075 Nov 02 21:33:51.031736 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1425/2941] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:50 2022] DELETE /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:33:51.037242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:51.043601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:51.043730 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02e7327b-dca0-48a1-9629-ca5516e16f6f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1245 microversion: 2.1 time: 0.099680 Nov 02 21:33:51.043730 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1517/2942] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:50 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:51.044503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:51.045149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:51.045847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:51.046757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:51.047313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:51.047965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:51.062228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:51.063129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:51.069441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:51.069945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:51.070375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:51.071081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:51.071536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:51.071965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:51.281890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:51.285804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:51.291913 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b728a51-8e61-4c27-86c7-09a965576318 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1496 microversion: 2.1 time: 0.249067 Nov 02 21:33:51.295507 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1518/2943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:51 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1496 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:51.295638 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da8fc74b-b762-43c7-bf37-62d8f7434053 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1474 microversion: 2.1 time: 0.260976 Nov 02 21:33:51.295638 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1426/2944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:51 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1474 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:52.069935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:52.071143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:52.097136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:52.101948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:52.102400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:52.103757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:52.104261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:52.104688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:52.225518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:52.234964 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e4dbb0d-84f0-4d47-9cfc-71264001c5b2 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1301 microversion: 2.1 time: 0.169039 Nov 02 21:33:52.235966 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1519/2945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:52 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:52.317729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:52.318842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:52.319007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:52.319714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:52.326978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:52.327569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:52.328187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:52.328999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:52.329522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:52.330056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:52.341257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:52.341749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:52.342190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:52.342894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:52.344638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:52.349086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:52.604467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:52.617103 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-680432d1-2606-4d3e-96e4-93184baf823f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1474 microversion: 2.1 time: 0.303839 Nov 02 21:33:52.619502 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1520/2946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:52 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1474 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:52.622163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:52.631687 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f96dd0c-ced7-4c4d-bbec-2721a46c3cf8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1496 microversion: 2.1 time: 0.318779 Nov 02 21:33:52.632302 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1427/2947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:52 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1496 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:53.262341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:53.263033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:53.277135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:53.278258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:53.278704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:53.279414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:53.279869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:53.289968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:53.646246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:53.646884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:53.663917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:53.664416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:53.665039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:53.668954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:53.669445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:53.669884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:53.835896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:53.843994 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90048d89-24bc-47bd-bfb2-d547574ce01a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1366 microversion: 2.1 time: 0.586607 Nov 02 21:33:53.861350 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1521/2948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:53 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1366 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:53.866361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:53.867278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:53.873060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:53.873727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:53.874641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:53.875351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:53.875805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:53.876227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.104095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:54.118611 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df71a025-ace0-4b4e-b474-25079ac1bcf4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1471 microversion: 2.1 time: 0.479148 Nov 02 21:33:54.119724 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1428/2949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:53 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1471 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:54.156065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:54.158647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:54.185961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.185961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.188561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.190944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.191639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.193966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.241679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:54.267763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98bcb2e0-aabf-40e6-aecc-b5289cc515ab tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1496 microversion: 2.1 time: 0.403425 Nov 02 21:33:54.269608 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1522/2950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:53 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1496 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:54.281501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-05271db0-9a2b-4576-bed3-8617aa9d9759 req-7f954c9e-93cc-4d2d-aae7-2fcb4a53a746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6f276d-d362-46a3-94e9-ac8f4a4d9223", "name": "network-vif-plugged", "status": "completed", "tag": "a1f589d8-2ac3-40c4-b136-9cf3be98b245"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:54.294623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-05271db0-9a2b-4576-bed3-8617aa9d9759 req-7f954c9e-93cc-4d2d-aae7-2fcb4a53a746 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.295272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-05271db0-9a2b-4576-bed3-8617aa9d9759 req-7f954c9e-93cc-4d2d-aae7-2fcb4a53a746 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.295904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-05271db0-9a2b-4576-bed3-8617aa9d9759 req-7f954c9e-93cc-4d2d-aae7-2fcb4a53a746 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.316099 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-05271db0-9a2b-4576-bed3-8617aa9d9759 req-7f954c9e-93cc-4d2d-aae7-2fcb4a53a746 service nova] Creating event network-vif-plugged:a1f589d8-2ac3-40c4-b136-9cf3be98b245 for instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 on n-h1-860863-4 Nov 02 21:33:54.322700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-05271db0-9a2b-4576-bed3-8617aa9d9759 req-7f954c9e-93cc-4d2d-aae7-2fcb4a53a746 service nova] Instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:33:54.334621 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-05271db0-9a2b-4576-bed3-8617aa9d9759 req-7f954c9e-93cc-4d2d-aae7-2fcb4a53a746 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061501 Nov 02 21:33:54.336027 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1523/2951] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:54.508463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a9fb60f-4023-48a5-a3a4-b8082a007f3f tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223/action" status: 204 len: 0 microversion: 2.1 time: 0.363872 Nov 02 21:33:54.514310 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1429/2952] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:33:54 2022] POST /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223/action => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:33:54.525067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:54.526016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:54.535387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.535921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.536485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.537418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.537879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.538418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.727095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0e35017d-e14f-45da-8acb-65cb9e00e5bb req-b79fe6da-5235-4841-b7ac-810a69578a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b834c8-a998-4c4e-9f40-10eb33b62506", "tag": "419d02b6-960b-48a8-82e3-9b8129f63648"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:54.769989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0e35017d-e14f-45da-8acb-65cb9e00e5bb req-b79fe6da-5235-4841-b7ac-810a69578a35 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.770395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0e35017d-e14f-45da-8acb-65cb9e00e5bb req-b79fe6da-5235-4841-b7ac-810a69578a35 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.770832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0e35017d-e14f-45da-8acb-65cb9e00e5bb req-b79fe6da-5235-4841-b7ac-810a69578a35 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.804842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:54.809160 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0e35017d-e14f-45da-8acb-65cb9e00e5bb req-b79fe6da-5235-4841-b7ac-810a69578a35 service nova] Creating event network-changed:419d02b6-960b-48a8-82e3-9b8129f63648 for instance e3b834c8-a998-4c4e-9f40-10eb33b62506 on n-h2-860863-4 Nov 02 21:33:54.821365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0e35017d-e14f-45da-8acb-65cb9e00e5bb req-b79fe6da-5235-4841-b7ac-810a69578a35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097370 Nov 02 21:33:54.822495 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1430/2953] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:54.858230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1924b5aa-d26c-4913-9b1a-c5aa1e509e1d req-9061f889-62b8-4a46-9faa-85d160062403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8104e5-2beb-4d11-9b34-c0930a7a6dc7", "name": "network-vif-deleted", "tag": "f152964f-11b8-4a67-84f6-b8cc3297c29f"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:54.904922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1924b5aa-d26c-4913-9b1a-c5aa1e509e1d req-9061f889-62b8-4a46-9faa-85d160062403 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.907102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1924b5aa-d26c-4913-9b1a-c5aa1e509e1d req-9061f889-62b8-4a46-9faa-85d160062403 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.912365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1924b5aa-d26c-4913-9b1a-c5aa1e509e1d req-9061f889-62b8-4a46-9faa-85d160062403 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.953801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1924b5aa-d26c-4913-9b1a-c5aa1e509e1d req-9061f889-62b8-4a46-9faa-85d160062403 service nova] Creating event network-vif-deleted:f152964f-11b8-4a67-84f6-b8cc3297c29f for instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 on n-h1-860863-4 Nov 02 21:33:54.960154 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1924b5aa-d26c-4913-9b1a-c5aa1e509e1d req-9061f889-62b8-4a46-9faa-85d160062403 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105903 Nov 02 21:33:54.961116 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1431/2954] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:33:54.966340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:54.967042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:54.990924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.991451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.991896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:54.992610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:54.993101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:54.995041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:55.069448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:55.082517 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e4d7b9c7-bc3e-4030-8ad1-4d13475052f2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1471 microversion: 2.1 time: 0.562567 Nov 02 21:33:55.101088 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1524/2955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:54 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1471 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:55.294193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:55.295003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:55.306949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:55.306949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:55.307180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:55.307306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:55.307487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:55.307946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:55.308690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:55.317234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83333d96-16c0-4156-99a7-e747f5786473 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1366 microversion: 2.1 time: 0.354862 Nov 02 21:33:55.319054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1432/2956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:54 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:55.412086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:55.425076 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-004a7544-62fd-4192-baae-a86dbac8f6a4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 200 len: 1294 microversion: 2.1 time: 0.135097 Nov 02 21:33:55.426259 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1525/2957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:55 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 1294 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:56.113183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:56.113822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:56.125192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.127086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.127086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.127086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.129514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.129514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.358588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:56.358588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:56.358588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.358588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.358588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.359892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.359892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.359892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.534761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:56.545679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2955ddc2-011f-4293-b51f-de66a9d7acd3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1471 microversion: 2.1 time: 0.432949 Nov 02 21:33:56.546663 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1433/2958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:56 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1471 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:56.551729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:56.552345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:56.572125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.572639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.573125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.575801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.576460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.577077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.595345 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 HTTP/1.1 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0b8104e5-2beb-4d11-9b34-c0930a7a6dc7'} Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:33:56.597706 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-90480956-aaa9-4c4e-bfbd-ccd6971cb0b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 404 len: 111 microversion: 2.1 time: 0.051516 Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1434/2959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:56 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:56.606027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:56.611292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.611892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.612521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.613506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.614116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.614697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.851309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:56.860422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d5b177c-e792-4bc2-828a-252562d6962f tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1366 microversion: 2.1 time: 0.522887 Nov 02 21:33:56.864751 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1526/2960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:56 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:56.876634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:56.880211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:56.892345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.894798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.910450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.911713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:56.914534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:56.915249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:56.954830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:33:56.987938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:57.001386 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7375412f-de81-4a7f-ac0d-5597a576b3c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.400628 Nov 02 21:33:57.021508 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1435/2961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:56 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:57.044440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:57.045189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:57.063009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.063009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.089529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.090565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.091474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.097264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.351389 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69f6a60a-7305-4975-99cb-53d2733e79cc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 204 len: 0 microversion: 2.1 time: 0.485053 Nov 02 21:33:57.357381 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1527/2962] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:33:56 2022] DELETE /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:33:57.365776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:57.369298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:57.391671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.392170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.398730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.400576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.401409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.402520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.477049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:57.489433 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e09caaeb-c1fe-4f9b-8960-61151aadf31f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.456506 Nov 02 21:33:57.490895 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1436/2963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:57 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:57.520742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:57.521819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:57.533607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.535246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.535719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.536442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.539118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.539743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.941519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:57.951624 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7632597-6d15-48dd-95e8-a4923b8e3cd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.436974 Nov 02 21:33:57.966740 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1437/2964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:57 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:57.967074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:57.967218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:57.968592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:57.972880 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-983bbfa1-efbc-46f5-92f5-ad0146cd23df tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1497 microversion: 2.1 time: 0.613950 Nov 02 21:33:57.973547 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1528/2965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:57 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1497 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:57.993348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.994300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.995151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.996106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:57.996755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:57.997465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:57.997858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:57.998498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:58.031236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:58.031908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:58.043744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:58.046499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:58.047650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:58.048098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:58.331725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:58.391769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:58.399919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1da16e48-7e75-48c2-8f76-dd9e4b4e088d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1463 microversion: 2.1 time: 0.441717 Nov 02 21:33:58.400471 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1438/2966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:57 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1463 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:58.422860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-496376877"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:58.426113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:58.434743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:58.436791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:58.439848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:58.440959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:58.441710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:58.443901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:58.444851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:58.452492 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-015f426a-c6c6-41c6-8438-89ab5670ac4e tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1366 microversion: 2.1 time: 0.467402 Nov 02 21:33:58.453625 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1529/2967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:57 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:58.461406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:58.461406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:58.476057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:58.481627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:58.482093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:58.482821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:58.484907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:58.485694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:58.490785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:58.714395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:58.721951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:33:58.737700 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a3d2de1-507d-43ec-b616-699b914b9e8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1463 microversion: 2.1 time: 0.281729 Nov 02 21:33:58.738949 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1530/2968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:58 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1463 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:33:58.770530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-842304c5-94ae-4a63-96f1-9fab600f57ab tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'create', calling method: .version_select at 0x7f9b685d2b80>, body: {"keypair": {"name": "tempest-keypair-1866173509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGykOeCrgYW4eJagiRmKvh4zf4iZkts3YrI4zUqCbLa+BFkRDOq94EH8XmQEmkpug5fxUocdAEBO6fkqvBShg/+0AWeLoS2nbn9d0yM8XwbZ7FkMYTMQq6kyw+4YTqNGwQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:58.814999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-842304c5-94ae-4a63-96f1-9fab600f57ab tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:33:58.827938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-842304c5-94ae-4a63-96f1-9fab600f57ab tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for user 64f57cf5139c4937b8158f8d9aef011b and project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:33:58.958877 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-842304c5-94ae-4a63-96f1-9fab600f57ab tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197850 Nov 02 21:33:58.959916 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1531/2969] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:33:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:33:59.000241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:59.009351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:59.017769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:59.018594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:59.019368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:59.020333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:59.020864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:59.021443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:59.191379 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0aeddc9c-b4e8-49e9-912e-c15b4c77edc8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.771757 Nov 02 21:33:59.193469 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1439/2970] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:33:58 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 21:33:59.333774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:59.347443 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-116fbbdf-5274-4bf2-90c5-8e4c7542e4ed tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1497 microversion: 2.1 time: 0.353443 Nov 02 21:33:59.348674 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1532/2971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:58 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1497 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:33:59.482747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:33:59.484195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:33:59.512545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:59.513086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:59.513538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:59.519270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:59.522310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:59.522947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:59.670392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-de558586-fd80-41ec-b216-a8471e217d00 req-0f571058-e22a-4bc3-84ff-92df6a578a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39bba200-8b07-48b4-a149-bb6a88f224ea", "name": "network-vif-deleted", "tag": "6b9630f9-358a-424b-8a21-03d57a364b74"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:33:59.695447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de558586-fd80-41ec-b216-a8471e217d00 req-0f571058-e22a-4bc3-84ff-92df6a578a85 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:33:59.697210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de558586-fd80-41ec-b216-a8471e217d00 req-0f571058-e22a-4bc3-84ff-92df6a578a85 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:33:59.699502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-de558586-fd80-41ec-b216-a8471e217d00 req-0f571058-e22a-4bc3-84ff-92df6a578a85 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:33:59.721752 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-de558586-fd80-41ec-b216-a8471e217d00 req-0f571058-e22a-4bc3-84ff-92df6a578a85 service nova] Creating event network-vif-deleted:6b9630f9-358a-424b-8a21-03d57a364b74 for instance 39bba200-8b07-48b4-a149-bb6a88f224ea on n-h2-860863-4 Nov 02 21:33:59.729894 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-de558586-fd80-41ec-b216-a8471e217d00 req-0f571058-e22a-4bc3-84ff-92df6a578a85 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062402 Nov 02 21:33:59.733819 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1533/2972] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:33:59.845173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:33:59.853170 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86362bb5-3382-466e-a41b-1f4b8b6a783c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1366 microversion: 2.1 time: 0.377555 Nov 02 21:33:59.855892 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1440/2973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:33:59 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:00.381528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:00.386382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:00.390824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:00.392008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:00.392963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:00.394190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:00.395525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:00.396199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:00.439771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:00.440633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:00.441297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:00.441921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lazy-loading 'fault' on Instance uuid 39bba200-8b07-48b4-a149-bb6a88f224ea {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:34:00.575781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:00.590121 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a1882f0-53fe-4e51-96cc-e76d08b763f2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 200 len: 1299 microversion: 2.1 time: 0.222220 Nov 02 21:34:00.592173 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1534/2974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:00 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 1299 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:00.882644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:00.885388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:00.898503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:00.902063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:00.902766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:00.906988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:00.907710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:00.909015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:01.186685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:01.204040 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e8a85a7-e1f9-4483-be31-ebf5075e3648 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1366 microversion: 2.1 time: 0.325644 Nov 02 21:34:01.204671 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1441/2975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:00 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:01.617400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:01.619746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:01.630371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:01.631494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:01.632138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:01.633115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:01.633568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:01.634196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:01.653269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea HTTP/1.1 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '39bba200-8b07-48b4-a149-bb6a88f224ea'} Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:34:01.655952 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:34:01.660018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:01.660018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:34:01.660018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:34:01.660018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:34:01.660018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:34:01.660018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:34:01.660018 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:34:01.664012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:34:01.665209 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7a19fa5c-3429-4d23-8348-6cf5ab9b09fc tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 404 len: 111 microversion: 2.1 time: 0.052411 Nov 02 21:34:01.666310 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1535/2976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:01 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:34:02.074147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-39990dfe-37ce-4cd3-b432-97724239195d req-3690a91e-d76b-4180-b21d-a9dfb4e8e3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b834c8-a998-4c4e-9f40-10eb33b62506", "name": "network-vif-plugged", "status": "completed", "tag": "419d02b6-960b-48a8-82e3-9b8129f63648"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:02.127651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39990dfe-37ce-4cd3-b432-97724239195d req-3690a91e-d76b-4180-b21d-a9dfb4e8e3e6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:02.131361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39990dfe-37ce-4cd3-b432-97724239195d req-3690a91e-d76b-4180-b21d-a9dfb4e8e3e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:02.132889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-39990dfe-37ce-4cd3-b432-97724239195d req-3690a91e-d76b-4180-b21d-a9dfb4e8e3e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:02.177705 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-39990dfe-37ce-4cd3-b432-97724239195d req-3690a91e-d76b-4180-b21d-a9dfb4e8e3e6 service nova] Creating event network-vif-plugged:419d02b6-960b-48a8-82e3-9b8129f63648 for instance e3b834c8-a998-4c4e-9f40-10eb33b62506 on n-h2-860863-4 Nov 02 21:34:02.195183 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-39990dfe-37ce-4cd3-b432-97724239195d req-3690a91e-d76b-4180-b21d-a9dfb4e8e3e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135867 Nov 02 21:34:02.199452 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1442/2977] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:02.231793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:02.233395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:02.246466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:02.247763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:02.248772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:02.256060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:02.257319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:02.259049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:02.377512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-540610263", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b4726632-ac93-4a1f-8349-9b723bbb1016"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:02.472534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:34:03.058868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:03.069329 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfa2e4fd-84d6-4c4c-adf6-25d0876e7cc8 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1366 microversion: 2.1 time: 0.843362 Nov 02 21:34:03.081811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1536/2978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:02 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1366 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:03.116247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1df935f-7b6e-4cd4-9f81-dfd69e6c704a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '.version_select at 0x7f9b68e87ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:03.120184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1df935f-7b6e-4cd4-9f81-dfd69e6c704a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:03.120732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1df935f-7b6e-4cd4-9f81-dfd69e6c704a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:03.121462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1df935f-7b6e-4cd4-9f81-dfd69e6c704a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:03.136716 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1df935f-7b6e-4cd4-9f81-dfd69e6c704a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.031844 Nov 02 21:34:03.146904 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1537/2979] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 21:34:03 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:03.165150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-343c3c38-cc18-4867-931b-d770d641f1f5 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:03.172391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-343c3c38-cc18-4867-931b-d770d641f1f5 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012198 Nov 02 21:34:03.174057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1538/2980] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:34:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:34:03.190697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8701faa-ccf1-41ce-a3e7-c135e637b29f tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-544867810", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:03.275998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8701faa-ccf1-41ce-a3e7-c135e637b29f tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.090460 Nov 02 21:34:03.277315 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1539/2981] 10.222.0.25 () {60 vars in 1146 bytes} [Wed Nov 2 21:34:03 2022] POST /compute/v2.1/flavors => generated 498 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:03.292260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-644ece91-2a94-42e5-a910-0444bf9d7701 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:03.301968 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-644ece91-2a94-42e5-a910-0444bf9d7701 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016010 Nov 02 21:34:03.302546 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1540/2982] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 21:34:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:34:03.444696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-773233656", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "42492445-e84b-481e-9e98-e751eaf6e39b"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:03.524911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] validate_networks() for None {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:34:03.986018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:34:03.986018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:34:03.986018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:34:03.987425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:34:03.988432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:34:04.001585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.003525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.004313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:04.013730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.014237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.020140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:04.056101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:34:04.071505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:34:04.094755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:34:04.102324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:34:04.111528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:34:04.114819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:34:04.114819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:34:04.114819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:34:04.114819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:34:04.135846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.136666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.138691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:04.138691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.139203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.139855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:04.179874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:34:04.196848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for user 64f57cf5139c4937b8158f8d9aef011b and project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:34:04.230846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:34:04.230846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:34:04.302020 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c75e629e-39fc-4d78-93d6-3d35e1b36d1b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.934633 Nov 02 21:34:04.306175 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1443/2983] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:34:04.312382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:04.314323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:04.345858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.346563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.348134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:04.354689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.364335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.364335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:04.561613 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a502b4ba-ed16-4be1-b259-1d8aa7d5fb02 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119858 Nov 02 21:34:04.569683 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1541/2984] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:34:04.601722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8904a284-9953-4e72-8b53-16e3e28927b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:04.602357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8904a284-9953-4e72-8b53-16e3e28927b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:04.782081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8904a284-9953-4e72-8b53-16e3e28927b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:04.808635 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8904a284-9953-4e72-8b53-16e3e28927b9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1208 microversion: 2.1 time: 0.239209 Nov 02 21:34:04.809573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1542/2985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:04 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1208 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:04.843686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-272eef08-1af5-46db-b5b2-d53f587dc2f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:04.847220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-272eef08-1af5-46db-b5b2-d53f587dc2f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:04.922527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:04.936814 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f90e48db-66ba-4789-ad54-75c31ce463ce tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1556 microversion: 2.1 time: 0.628963 Nov 02 21:34:04.938607 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1444/2986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:04 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1556 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:04.963113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:04.963782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:04.983061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.983836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.989613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:04.991551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:04.992593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:04.993165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-272eef08-1af5-46db-b5b2-d53f587dc2f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:04.995272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:05.006689 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-272eef08-1af5-46db-b5b2-d53f587dc2f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1278 microversion: 2.1 time: 0.186996 Nov 02 21:34:05.007274 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1543/2987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:04 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:05.248179 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-32849265-0317-4d73-91af-6408768b80c4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.289474 Nov 02 21:34:05.250039 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1445/2988] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:34:04 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-interface => generated 285 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:34:05.835735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e9569ea-e1db-492b-868f-fdb430baa0ee tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:05.836919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e9569ea-e1db-492b-868f-fdb430baa0ee tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:05.851314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:06.031371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74c1afa7-d6af-49c8-867b-d93370b3d5ec tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:06.032005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-74c1afa7-d6af-49c8-867b-d93370b3d5ec tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:06.227360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-74c1afa7-d6af-49c8-867b-d93370b3d5ec tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:06.255266 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-74c1afa7-d6af-49c8-867b-d93370b3d5ec tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1278 microversion: 2.1 time: 0.226114 Nov 02 21:34:06.260892 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1446/2989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:06 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:06.386859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e9569ea-e1db-492b-868f-fdb430baa0ee tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:06.397617 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e9569ea-e1db-492b-868f-fdb430baa0ee tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1208 microversion: 2.1 time: 0.566634 Nov 02 21:34:06.403568 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1544/2990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:05 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1208 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:06.504909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-630f5cae-d497-49d9-a598-c7dfd732c26f req-16df8fdf-9691-4010-961e-c0836a4f9774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-plugged", "status": "completed", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:06.535843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-630f5cae-d497-49d9-a598-c7dfd732c26f req-16df8fdf-9691-4010-961e-c0836a4f9774 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:06.538537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-630f5cae-d497-49d9-a598-c7dfd732c26f req-16df8fdf-9691-4010-961e-c0836a4f9774 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:06.539017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-630f5cae-d497-49d9-a598-c7dfd732c26f req-16df8fdf-9691-4010-961e-c0836a4f9774 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:06.564894 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-630f5cae-d497-49d9-a598-c7dfd732c26f req-16df8fdf-9691-4010-961e-c0836a4f9774 service nova] Creating event network-vif-plugged:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:34:06.578977 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-630f5cae-d497-49d9-a598-c7dfd732c26f req-16df8fdf-9691-4010-961e-c0836a4f9774 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076400 Nov 02 21:34:06.582651 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1447/2991] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:07.288792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:07.289684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:07.324017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:07.324526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:07.327732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:07.327732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:07.332339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:07.333138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:07.429050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:07.430123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:07.440648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:07.455447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:07.455447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:07.455447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:07.456265 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd2ddd42-2fb6-4ff6-8a72-30167d13f087 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1274 microversion: 2.1 time: 0.176147 Nov 02 21:34:07.457769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:07.458934 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1545/2992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:07 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:07.459436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:07.460097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:07.612194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:07.627718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-170473b7-142e-4f9f-8edf-33cf1ebce5b6 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1260 microversion: 2.1 time: 0.202684 Nov 02 21:34:07.629347 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1448/2993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:07 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:08.102040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ae28f0a2-d073-480b-b07a-1dff8fbefaab req-d83656e7-1f4f-4149-8e36-2236b15e4f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b834c8-a998-4c4e-9f40-10eb33b62506", "tag": "419d02b6-960b-48a8-82e3-9b8129f63648"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:08.139124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ae28f0a2-d073-480b-b07a-1dff8fbefaab req-d83656e7-1f4f-4149-8e36-2236b15e4f47 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:08.140516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ae28f0a2-d073-480b-b07a-1dff8fbefaab req-d83656e7-1f4f-4149-8e36-2236b15e4f47 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:08.143271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ae28f0a2-d073-480b-b07a-1dff8fbefaab req-d83656e7-1f4f-4149-8e36-2236b15e4f47 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:08.180417 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ae28f0a2-d073-480b-b07a-1dff8fbefaab req-d83656e7-1f4f-4149-8e36-2236b15e4f47 service nova] Creating event network-changed:419d02b6-960b-48a8-82e3-9b8129f63648 for instance e3b834c8-a998-4c4e-9f40-10eb33b62506 on n-h2-860863-4 Nov 02 21:34:08.195464 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ae28f0a2-d073-480b-b07a-1dff8fbefaab req-d83656e7-1f4f-4149-8e36-2236b15e4f47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101651 Nov 02 21:34:08.196080 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1546/2994] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:08.495816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:08.498597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:08.509169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:08.512635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:08.513447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:08.516655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:08.518874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:08.520351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:08.667112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:08.669080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:08.680475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:08.681705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:08.687633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:08.687633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:08.687633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:08.687633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:08.845578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:08.864810 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3115ec8e-e976-471e-b7f0-f6d8c671e722 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1330 microversion: 2.1 time: 0.380908 Nov 02 21:34:08.868012 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1449/2995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:08 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1330 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:08.917500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:08.929660 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e11b5012-17ef-439a-910f-cba0f980d955 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1278 microversion: 2.1 time: 0.274117 Nov 02 21:34:08.947131 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1547/2996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:08 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1278 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:09.898302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:09.909417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:09.922265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:09.923031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:09.925108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:09.928793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:09.929529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:09.930158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:09.969615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:09.971495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:09.998294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:10.002128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:10.010092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:10.010880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:10.017704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:10.018445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:10.710245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:10.720390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d872cbb-0927-48ba-9ac8-2700d36c6459 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1266 microversion: 2.1 time: 0.757284 Nov 02 21:34:10.729956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1548/2997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:09 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1266 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:10.734055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:10.739597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:10.755092 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9dcfa577-15c4-40a2-82e7-2e2e0d1b73a4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1336 microversion: 2.1 time: 0.864254 Nov 02 21:34:10.756584 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1450/2998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:09 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1336 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:11.291831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:11.309515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:11.309515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Searching by: {'deleted': False, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:34:11.357269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:11.360797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:11.365611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:11.372591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:11.375792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:11.377839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:11.446117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:34:11.543511 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8dbdcda2-08e2-4f3a-b6da-6a277ddfbcd8 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.255535 Nov 02 21:34:11.545142 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1549/2999] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:34:11 2022] GET /compute/v2.1/servers => generated 344 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:11.573754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:11.581727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:11.583218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Searching by: {'deleted': False, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:34:11.620114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:11.624157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:11.626130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:11.630644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:11.631683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:11.644401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:11.735008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:34:11.746146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:11.747121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:11.766251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:11.767377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:11.769846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:11.771813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:11.773665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:11.775271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:11.899095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:11.916745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:11.917566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:11.918179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:12.346930 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e3c8cdb-cc22-41e5-ab2c-07d100b7b1f2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.792353 Nov 02 21:34:12.347918 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1451/3000] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:34:11 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:12.354332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:12.354945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:12.378128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:12.409758 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44ba3715-8909-4096-8718-9d1ed3d06ced tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 0.661481 Nov 02 21:34:12.410026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:12.410141 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1550/3001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:11 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:12.416271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4eee459e-10d6-4b60-97df-0d3915419663 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:12.429394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:12.433748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:12.433748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:12.434705 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4eee459e-10d6-4b60-97df-0d3915419663 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020873 Nov 02 21:34:12.434705 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1551/3002] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:34:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:12.441974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:12.442509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:12.785016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:12.793281 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6837186f-ca7a-419f-8551-a3eebec8e8e0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1378 microversion: 2.1 time: 0.444151 Nov 02 21:34:12.803762 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1452/3003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:12 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1378 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:12.805429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:12.810680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:12.823584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:12.825473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:12.826650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:12.827631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:12.828801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:12.830608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:12.874076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:34:13.437773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:13.440333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:13.466048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:13.466048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:13.466048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:13.466048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:13.466048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:13.466048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:13.535685 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0daa4dd-752b-44f8-b589-d32fdb9883b7 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 204 len: 0 microversion: 2.1 time: 0.733830 Nov 02 21:34:13.543766 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1552/3004] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:34:12 2022] DELETE /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:34:13.556486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:13.558779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:13.587228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:13.592485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:13.592485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:13.592485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:13.592485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:13.592485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:14.434406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:14.442854 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1af3719-39ef-4d9a-b59a-09fc797c1c60 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1609 microversion: 2.1 time: 0.897700 Nov 02 21:34:14.453283 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1553/3005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:13 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1609 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:14.458465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b9f179ea-cc0d-4aba-ba5e-09680208d701 req-df97c08d-9420-45b7-8943-f3058b9f9f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:14.471449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:14.481695 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e80e109-3073-4926-9cc4-d9bb9fa64992 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 1.049998 Nov 02 21:34:14.505856 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1453/3006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:13 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:14.512574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b9f179ea-cc0d-4aba-ba5e-09680208d701 req-df97c08d-9420-45b7-8943-f3058b9f9f26 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:14.515897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b9f179ea-cc0d-4aba-ba5e-09680208d701 req-df97c08d-9420-45b7-8943-f3058b9f9f26 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:14.517458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b9f179ea-cc0d-4aba-ba5e-09680208d701 req-df97c08d-9420-45b7-8943-f3058b9f9f26 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:14.522250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:14.524425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:14.544799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:14.546778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:14.547472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:14.548126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:14.549773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:14.552129 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b9f179ea-cc0d-4aba-ba5e-09680208d701 req-df97c08d-9420-45b7-8943-f3058b9f9f26 service nova] Creating event network-changed:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h1-860863-4 Nov 02 21:34:14.553445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:14.554884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:14.566101 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b9f179ea-cc0d-4aba-ba5e-09680208d701 req-df97c08d-9420-45b7-8943-f3058b9f9f26 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111248 Nov 02 21:34:14.569245 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1554/3007] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:14.871157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-00efd152-0f57-4159-b74b-3adcd1648d56 req-b51b0dee-5f37-46c6-8c1d-5a1abd443b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74205bc1-a1c3-46a3-97fe-1b9e0f6160f7", "tag": "8faaa153-5a68-41da-b657-b84567902020"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:14.907513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-00efd152-0f57-4159-b74b-3adcd1648d56 req-b51b0dee-5f37-46c6-8c1d-5a1abd443b3e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:14.908386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-00efd152-0f57-4159-b74b-3adcd1648d56 req-b51b0dee-5f37-46c6-8c1d-5a1abd443b3e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:14.916738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-00efd152-0f57-4159-b74b-3adcd1648d56 req-b51b0dee-5f37-46c6-8c1d-5a1abd443b3e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:14.937276 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-00efd152-0f57-4159-b74b-3adcd1648d56 req-b51b0dee-5f37-46c6-8c1d-5a1abd443b3e service nova] Creating event network-changed:8faaa153-5a68-41da-b657-b84567902020 for instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 on n-h1-860863-4 Nov 02 21:34:14.952342 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-00efd152-0f57-4159-b74b-3adcd1648d56 req-b51b0dee-5f37-46c6-8c1d-5a1abd443b3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102324 Nov 02 21:34:14.961360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:14.966649 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1555/3008] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:14.975286 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-49bba5ec-be6b-4df4-b6f2-ff1ed0d80e30 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1378 microversion: 2.1 time: 0.467723 Nov 02 21:34:14.976192 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1454/3009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:14 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1378 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:15.478601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:15.480652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:15.491290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:15.492317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:15.496229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:15.497036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:15.497517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:15.497958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:15.515086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:15.515631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:15.531146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:15.532166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:15.534545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:15.536258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:15.537052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:15.538293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:16.145857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:16.156256 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22cd5f9a-2922-45f0-b9ba-c90f6e8aec45 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1609 microversion: 2.1 time: 0.686276 Nov 02 21:34:16.177329 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1556/3010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:15 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1609 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:16.183989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:16.184854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:16.191950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:16.194505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:16.194505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:16.194505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:16.194505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:16.197932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:16.203030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:16.395196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=18 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:16.764311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:16.773365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14a9e121-812f-4058-8525-0064d9be3d48 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 1.263612 Nov 02 21:34:16.773957 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1455/3011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:15 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:16.863636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:16.886097 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d62888fc-9a6d-4a64-b611-9065b3251b26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1378 microversion: 2.1 time: 0.706442 Nov 02 21:34:16.888038 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1557/3012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:16 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1378 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:17.185166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:17.185818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:17.199511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:17.200016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:17.200460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:17.201206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:17.201666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:17.202099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:17.477306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:17.489159 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8f5e81f0-f741-42cc-8e79-0f0bc017d2b4 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1541 microversion: 2.1 time: 0.307894 Nov 02 21:34:17.489864 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1456/3013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:17 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1541 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:17.695397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fec443ac-e0c7-485f-8d65-65f5e08243fd req-07c4c9d6-8265-427d-94f1-6dd2ddb06f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b770f9-192e-4e5b-bc35-ff50fa086b05", "name": "network-vif-deleted", "tag": "9c164165-3330-4775-880c-b1662625a664"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:17.765925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fec443ac-e0c7-485f-8d65-65f5e08243fd req-07c4c9d6-8265-427d-94f1-6dd2ddb06f8e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:17.766807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fec443ac-e0c7-485f-8d65-65f5e08243fd req-07c4c9d6-8265-427d-94f1-6dd2ddb06f8e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:17.768985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fec443ac-e0c7-485f-8d65-65f5e08243fd req-07c4c9d6-8265-427d-94f1-6dd2ddb06f8e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:17.802620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:17.804551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:17.820619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:17.838518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:17.838609 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fec443ac-e0c7-485f-8d65-65f5e08243fd req-07c4c9d6-8265-427d-94f1-6dd2ddb06f8e service nova] Creating event network-vif-deleted:9c164165-3330-4775-880c-b1662625a664 for instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 on n-h2-860863-4 Nov 02 21:34:17.839319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:17.840351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:17.843744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:17.848868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:17.868975 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fec443ac-e0c7-485f-8d65-65f5e08243fd req-07c4c9d6-8265-427d-94f1-6dd2ddb06f8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178187 Nov 02 21:34:17.876604 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1558/3014] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:17.915839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:17.917965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:17.949598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:17.953795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:17.959619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:17.963153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:17.966708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:17.971425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:18.875361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:18.885591 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d4bd546b-2dba-4ba1-9258-3c1e716a8aea tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 1.087811 Nov 02 21:34:18.919693 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1457/3015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:17 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:18.924777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:18.938719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:18.959649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:18.967552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:18.967986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:18.968736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:18.969274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:18.969730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:19.024916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:19.039363 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef79bf0e-beea-41b6-b393-bcd9b833038c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1378 microversion: 2.1 time: 1.128507 Nov 02 21:34:19.053923 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1559/3016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:17 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1378 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:19.142239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:19.160039 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed16c861-f0ec-488c-b396-a33d7e02d171 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1253 microversion: 2.1 time: 0.239152 Nov 02 21:34:19.160793 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1458/3017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:18 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1253 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:19.923851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:19.924595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:19.941546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:19.942625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:19.943319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:19.944238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:19.944881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:19.949414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:20.070792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:20.071358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:20.086221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:20.086221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:20.086221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:20.086221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:20.086221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:20.094503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:21.368094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:21.390756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee142f71-d9f6-4892-83eb-349dc4cb6b53 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 1.471146 Nov 02 21:34:21.405944 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1560/3018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:19 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:21.413880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:21.430187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:21.449895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:21.453260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:21.468876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:21.469155 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fca7dc75-e96a-453b-8e65-dd183b8012a5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1378 microversion: 2.1 time: 1.401752 Nov 02 21:34:21.469253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:21.469333 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1459/3019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:20 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1378 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:21.473975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-9475589e-0c55-47d7-9065-d5fd6edfb34d req-349edee8-bf83-4cab-9fe8-339f7a2e710f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "name": "network-vif-plugged", "status": "completed", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:21.481724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:21.482764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:21.483481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:21.487935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:21.542967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9475589e-0c55-47d7-9065-d5fd6edfb34d req-349edee8-bf83-4cab-9fe8-339f7a2e710f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:21.543435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9475589e-0c55-47d7-9065-d5fd6edfb34d req-349edee8-bf83-4cab-9fe8-339f7a2e710f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:21.543867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9475589e-0c55-47d7-9065-d5fd6edfb34d req-349edee8-bf83-4cab-9fe8-339f7a2e710f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:21.565047 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-9475589e-0c55-47d7-9065-d5fd6edfb34d req-349edee8-bf83-4cab-9fe8-339f7a2e710f service nova] Creating event network-vif-plugged:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h1-860863-4 Nov 02 21:34:21.573333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-9475589e-0c55-47d7-9065-d5fd6edfb34d req-349edee8-bf83-4cab-9fe8-339f7a2e710f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102720 Nov 02 21:34:21.573948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1460/3020] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:21.647326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:21.659438 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-162668cb-8ead-4cc3-ab5b-1b646324d0da tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1253 microversion: 2.1 time: 0.247974 Nov 02 21:34:21.660079 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1561/3021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:21 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1253 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:22.439647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:22.440663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:22.460524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:22.462341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:22.475871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:22.476432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:22.478766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:22.480548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:22.482060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:22.482517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:22.496572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:22.497129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:22.513631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:22.515261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:22.518296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:22.528337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:22.528337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:22.528337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:23.556586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:23.558407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:23.580720 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-81fd9a35-027f-4af3-bdaa-3d7020a4ceb7 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1378 microversion: 2.1 time: 1.078265 Nov 02 21:34:23.581439 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1562/3022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:22 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1378 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:23.589910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:23.591789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:23.604482 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c2440713-e02f-4794-8fef-34da3f4b9fc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 1.169144 Nov 02 21:34:23.608911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:23.609635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:23.610264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:23.612474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:23.615159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:23.616024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:23.623088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1461/3023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:22 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:23.749503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:23.775873 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-866fefaa-d8cd-4a1a-b32d-69aa12f779f9 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1253 microversion: 2.1 time: 0.193155 Nov 02 21:34:23.780955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1563/3024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:23 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1253 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:24.614585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:24.617371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:24.630809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:24.631698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:24.654483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:24.655569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:24.657312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:24.662186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:24.663373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:24.668175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:24.669852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:24.670490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:24.671032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:24.672053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:24.674821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:24.679502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:25.816105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:25.836066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed35c394-ae89-42a1-a5b1-11ddeeb0b493 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1378 microversion: 2.1 time: 1.228515 Nov 02 21:34:25.850814 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1462/3025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:24 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1378 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:25.871809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:25.878391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:25.902091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:25.907218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:25.907946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:25.909441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:25.910074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:25.915206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:26.057570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:26.071360 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b4675ab-9841-418a-88dc-9a35858ea7f0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 1.444443 Nov 02 21:34:26.074130 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1564/3026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:24 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:26.085637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-59693c6b-5eea-446d-adda-3dd93c99a1cb req-5354c429-9bba-4cf5-a6ce-884090401ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74205bc1-a1c3-46a3-97fe-1b9e0f6160f7", "name": "network-vif-plugged", "status": "completed", "tag": "8faaa153-5a68-41da-b657-b84567902020"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:26.112661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-59693c6b-5eea-446d-adda-3dd93c99a1cb req-5354c429-9bba-4cf5-a6ce-884090401ead service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:26.113249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-59693c6b-5eea-446d-adda-3dd93c99a1cb req-5354c429-9bba-4cf5-a6ce-884090401ead service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:26.132062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-59693c6b-5eea-446d-adda-3dd93c99a1cb req-5354c429-9bba-4cf5-a6ce-884090401ead service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:26.192846 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-59693c6b-5eea-446d-adda-3dd93c99a1cb req-5354c429-9bba-4cf5-a6ce-884090401ead service nova] Creating event network-vif-plugged:8faaa153-5a68-41da-b657-b84567902020 for instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 on n-h1-860863-4 Nov 02 21:34:26.218939 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-59693c6b-5eea-446d-adda-3dd93c99a1cb req-5354c429-9bba-4cf5-a6ce-884090401ead service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139944 Nov 02 21:34:26.223105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1565/3027] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:26.227888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:26.237605 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8eb65625-4e0b-495a-a33e-8de877e8c0a2 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1253 microversion: 2.1 time: 0.384635 Nov 02 21:34:26.247080 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1463/3028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:25 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1253 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:26.878387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:26.879345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:26.927433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:26.929203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:26.934131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:26.936292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:26.940779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:26.942728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:27.105830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:27.108918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:27.136200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:27.145924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:27.150660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:27.157232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:27.160960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:27.161618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:27.657863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:27.670669 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72f991ee-7b9b-44d6-99f2-cda8fb9636e6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1528 microversion: 2.1 time: 0.795439 Nov 02 21:34:27.690440 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1566/3029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:26 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1528 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:27.700740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:27.704246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:27.719239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:27.720283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:27.720908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:27.738419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:27.739201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:27.741317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:27.923008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:27.932464 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2b33e34-6be7-4fc2-bb23-67fb9879da28 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1308 microversion: 2.1 time: 0.833396 Nov 02 21:34:27.942052 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1464/3030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:27 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1308 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:27.959272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:27.959895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:27.985587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:27.998228 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d68a0d88-afad-49f5-8678-609ef139a16d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1253 microversion: 2.1 time: 0.306123 Nov 02 21:34:27.998816 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1567/3031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:27 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1253 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:28.006851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:28.009722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:28.010336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:28.013394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:28.014699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:28.015334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:28.318400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:28.347128 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47416539-6f82-4e7b-926e-2fdc63e9dd8a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1528 microversion: 2.1 time: 0.401196 Nov 02 21:34:28.347784 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1465/3032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:27 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1528 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:28.372106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60ef2330-848a-4265-bb09-41181c53898d tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:28.474945 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60ef2330-848a-4265-bb09-41181c53898d tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/42492445-e84b-481e-9e98-e751eaf6e39b" status: 202 len: 0 microversion: 2.1 time: 0.106623 Nov 02 21:34:28.475535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1568/3033] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:34:28 2022] DELETE /compute/v2.1/flavors/42492445-e84b-481e-9e98-e751eaf6e39b => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:34:28.487314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e61bb729-ace7-45d2-a9ea-e575aaa0988f tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:28.521536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e61bb729-ace7-45d2-a9ea-e575aaa0988f tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036020 Nov 02 21:34:28.521536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1466/3034] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:34:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:28.542617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:28.547261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:28.571832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:28.572331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:28.572770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:28.574771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:28.576717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:28.584632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:28.665301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:28.673726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Old instance type tempest-test_resize_flavor_-544867810, new instance type m1.heat {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 21:34:28.699975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:34:28.700594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:34:28.701267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:34:28.701847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:34:28.702447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:34:28.972135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:28.973085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:28.991551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:28.992067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:28.992511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:28.993244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:29.004460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:29.006846 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d85b6f5-3085-4c89-b98d-d18ff6f3ce39 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6/action" status: 202 len: 0 microversion: 2.1 time: 0.471601 Nov 02 21:34:29.007321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:29.018127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1569/3035] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:34:28 2022] POST /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:34:29.035304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:29.040047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:29.076176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:29.081249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:29.082937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:29.083798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:29.107332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:29.114093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:29.484423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:29.498703 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae68549d-06bd-4f46-8932-64aafdad981f tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1253 microversion: 2.1 time: 0.477470 Nov 02 21:34:29.501545 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1570/3036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:29 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1253 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:29.518034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:29.518937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:29.528745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:29.534202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:29.534659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:29.535404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:29.535865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:29.542576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:29.707856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:29.716476 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4023414a-245f-4c56-9bd4-f0c085bb6979 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1489 microversion: 2.1 time: 0.752261 Nov 02 21:34:29.722833 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1467/3037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:28 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1489 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:29.746609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:29.750661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:29.772340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:29.774445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:29.783993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:29.785005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:29.785662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:29.786452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:29.896319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:30.057496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:30.071073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c571bdf7-052e-4c9a-b4f1-ade4a1a0e3d3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1537 microversion: 2.1 time: 0.568228 Nov 02 21:34:30.071945 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1571/3038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:29 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1537 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:30.143496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0b048e40-143e-4f40-b685-11f6bca93a20 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "PUT /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1084 microversion: 2.1 time: 0.399436 Nov 02 21:34:30.162929 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1468/3039] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:34:29 2022] PUT /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1084 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:30.170102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:30.171581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:30.191470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:30.202054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:30.205774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:30.212680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:30.216397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:30.219049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:30.532119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:30.535551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:30.555532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:30.555532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:30.555532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:30.556321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:30.556956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:30.557554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:30.589027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:30.617451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:30.618226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:30.618978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:30.619748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lazy-loading 'fault' on Instance uuid f5b770f9-192e-4e5b-bc35-ff50fa086b05 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:34:30.641048 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-896a2d7e-a369-499e-858f-e6f6b440dd6e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1510 microversion: 2.1 time: 0.464316 Nov 02 21:34:30.641048 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1572/3040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:30 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:30.662818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:30.662818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:30.687425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:30.689047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:30.691536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:30.692729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:30.700283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:30.701983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:30.801116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76ee5464ca941dab091f128d471431d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48783c740e441c8ad56aed0b3ad95ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:30.809699 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d8f210e-8163-47c3-9210-f23d9839d930 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 200 len: 1258 microversion: 2.1 time: 0.285917 Nov 02 21:34:30.819158 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1469/3041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:30 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 1258 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:31.013215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:31.025640 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8306a230-aec3-40b9-a750-bf564e9c2a75 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1510 microversion: 2.1 time: 0.374629 Nov 02 21:34:31.031734 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1573/3042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:30 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:31.048528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:31.049550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:31.056420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.056909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.057377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.058087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.058541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.058967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.095890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:31.096570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:31.125615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.127204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.129275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.130204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.130831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.133311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.136120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:34:31.362227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:31.365085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:31.378591 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb5f74c7-d2d6-4269-a577-9f58647a782a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1537 microversion: 2.1 time: 0.285370 Nov 02 21:34:31.379585 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1574/3043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:31 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:31.507353 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ee37583f-31ff-4dc5-ae96-f7d0dc4550a2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 204 len: 0 microversion: 2.1 time: 0.462582 Nov 02 21:34:31.508288 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1470/3044] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:34:31 2022] DELETE /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:34:31.516639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:31.517986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:31.548766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.549877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.550552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.552326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.554709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.555176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.850186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:31.851054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] [instance: f5b770f9-192e-4e5b-bc35-ff50fa086b05] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:31.881656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.884512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.887965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.892266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:31.892959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:31.899018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:31.931963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:31.951206 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4be34dbd-c6d1-46ac-94a1-eaad15f2869d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1516 microversion: 2.1 time: 0.438351 Nov 02 21:34:31.955091 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] HTTP exception thrown: Instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 could not be found. Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Request method failure captured: Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 HTTP/1.1 Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGlwLpaviI-3gItAhob5jg02tDb6d9pWeR6xMD1SYum2SXZykA4buk3i4igztME6J7lHHK2S8jTBwFxv78dZ3QuRVpMLgiWLIQxIMhQmRBLRfrgvxKdygY1gfBh61KKiRs3pTXXJXD6OPZY1ENeAjE64aPQpyMrA14_wY1BGTyQbOk Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b48783c740e441c8ad56aed0b3ad95ec Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestBootFromVolume-1384963691 Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b48783c740e441c8ad56aed0b3ad95ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b48783c740e441c8ad56aed0b3ad95ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b48783c740e441c8ad56aed0b3ad95ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b48783c740e441c8ad56aed0b3ad95ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestBootFromVolume-1384963691 Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b48783c740e441c8ad56aed0b3ad95ec Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1384963691 Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestBootFromVolume-1384963691-project Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e76ee5464ca941dab091f128d471431d Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestBootFromVolume-1384963691-project Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 could not be found. Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f5b770f9-192e-4e5b-bc35-ff50fa086b05'} Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 could not be found. Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 could not be found. Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:34:31.957343 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:31.962779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:31.962779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:34:31.962779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:34:31.962779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:34:31.962779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:34:31.962779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 could not be found. Nov 02 21:34:31.962779 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:31.965082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Returning 404 to user: Instance f5b770f9-192e-4e5b-bc35-ff50fa086b05 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:34:31.966145 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88005db6-eb64-4b6e-afa8-38f6d6623367 tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05" status: 404 len: 111 microversion: 2.1 time: 0.123829 Nov 02 21:34:31.966881 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1471/3045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:31 2022] GET /compute/v2.1/servers/f5b770f9-192e-4e5b-bc35-ff50fa086b05 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:34:31.971384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1575/3046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:31 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1516 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:31.979838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22fad845-01ce-42a3-b16f-b2d4e9efa42d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] Calling method '.version_select at 0x7f9b68b1a040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:32.103180 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22fad845-01ce-42a3-b16f-b2d4e9efa42d tempest-ServersTestBootFromVolume-1384963691 tempest-ServersTestBootFromVolume-1384963691-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178693684" status: 202 len: 0 microversion: 2.1 time: 0.114395 Nov 02 21:34:32.109540 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1472/3047] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:34:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178693684 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:34:32.405181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:32.406185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:32.426646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:32.427227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:32.427723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:32.428456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:32.428970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:32.434895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:32.981571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:32.982454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:32.997880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:32.998366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:32.998810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:32.999521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:32.999980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:33.000412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:33.093948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:33.113371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27d7700e-d5cf-425e-8804-49cf9d40b948 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1537 microversion: 2.1 time: 0.713050 Nov 02 21:34:33.130050 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1576/3048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:32 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1537 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:33.615709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:33.630307 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae791f70-4773-4432-9209-2fb8ca2cc033 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1516 microversion: 2.1 time: 0.652489 Nov 02 21:34:33.642466 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1473/3049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:32 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1516 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:34.147952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:34.148762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:34.168683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:34.173786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:34.177092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:34.181499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:34.184746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:34.185293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:34.667531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:34.668069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:34.678556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:34.679675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:34.680175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:34.681118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:34.681730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:34.682156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:34.941477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:34.957998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65c7d054-4cbb-4673-a5e6-7365755b5a2e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1537 microversion: 2.1 time: 0.818016 Nov 02 21:34:34.958922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1577/3050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:34 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1537 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:35.149597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:35.164657 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0aff9ae3-254c-4c7d-808b-d92c005c4396 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1516 microversion: 2.1 time: 0.501351 Nov 02 21:34:35.181346 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1474/3051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:34 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1516 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:35.409519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-31ec38fb-66c4-417e-a067-3b578893182e req-fd9f9d1b-b9fb-46b5-be84-270857feb327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74205bc1-a1c3-46a3-97fe-1b9e0f6160f7", "name": "network-vif-deleted", "tag": "8faaa153-5a68-41da-b657-b84567902020"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:35.441863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-31ec38fb-66c4-417e-a067-3b578893182e req-fd9f9d1b-b9fb-46b5-be84-270857feb327 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:35.442636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-31ec38fb-66c4-417e-a067-3b578893182e req-fd9f9d1b-b9fb-46b5-be84-270857feb327 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:35.443304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-31ec38fb-66c4-417e-a067-3b578893182e req-fd9f9d1b-b9fb-46b5-be84-270857feb327 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:35.468921 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-31ec38fb-66c4-417e-a067-3b578893182e req-fd9f9d1b-b9fb-46b5-be84-270857feb327 service nova] Creating event network-vif-deleted:8faaa153-5a68-41da-b657-b84567902020 for instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 on n-h1-860863-4 Nov 02 21:34:35.493976 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-31ec38fb-66c4-417e-a067-3b578893182e req-fd9f9d1b-b9fb-46b5-be84-270857feb327 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080763 Nov 02 21:34:35.500365 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1578/3052] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:35.882649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:35.883893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:35.896509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:35.899131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:35.900191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:35.902321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:35.903745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:35.904404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:35.991059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:35.992967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:36.011014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:36.011811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:36.013001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:36.019527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:36.025436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:36.026427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:36.278731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:36.304488 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-026226a8-6e56-4798-a0ca-edca636b100e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.420971 Nov 02 21:34:36.306590 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1475/3053] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:35 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:36.317720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:36.319022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:36.332526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:36.334985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:36.337978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:36.339595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:36.340066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:36.343889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:36.345409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:36.353804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0b6baa1-c501-4584-9779-0e45681d2232 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1537 microversion: 2.1 time: 0.366587 Nov 02 21:34:36.354421 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1579/3054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:35 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1537 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:36.384769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:36.385580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:36.386091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:36.386665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lazy-loading 'fault' on Instance uuid 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:34:36.451243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:36.460889 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a4395113-ff0e-4b70-b2b3-91f5ece38e06 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 200 len: 1319 microversion: 2.1 time: 0.151911 Nov 02 21:34:36.473332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1476/3055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:36 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:37.333443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:37.334995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:37.365808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:37.366778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:37.367236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:37.367974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:37.376345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:37.377756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:37.378652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:37.379035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:37.402550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:37.403049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:37.405630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:37.406365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:37.406825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:37.407293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:38.001658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:38.009640 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-540d553d-9ba1-4bce-997b-7b89125ddd4d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.637052 Nov 02 21:34:38.020971 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1477/3056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:37 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:38.032058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:38.037507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:38.054159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:38.054755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:38.055310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:38.057626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:38.059992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:38.061036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:38.092570 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 HTTP/1.1 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '74205bc1-a1c3-46a3-97fe-1b9e0f6160f7'} Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:34:38.100261 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:38.105054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:34:38.105054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:34:38.105054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:34:38.105054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:34:38.105054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:34:38.105054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:34:38.105054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:34:38.106787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:34:38.111658 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c5bcac4-bae1-4afb-b23b-da63239b5e46 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 404 len: 111 microversion: 2.1 time: 0.098444 Nov 02 21:34:38.112521 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1478/3057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:38 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:34:38.167302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:38.196523 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8fea934-ccba-4bd2-ba5b-156d160c2057 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.856796 Nov 02 21:34:38.201453 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1580/3058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:37 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:38.229282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-54236381"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:38.232525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:38.249760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:38.250549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:38.251116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:38.252132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:38.253498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:38.256907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:38.353861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-873233703", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b4726632-ac93-4a1f-8349-9b723bbb1016"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:38.920914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] validate_networks() for [('b4726632-ac93-4a1f-8349-9b723bbb1016', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:34:39.207205 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-925bc3a4-5a27-4a3c-a5f4-cbcde56fc085 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.981864 Nov 02 21:34:39.207911 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1479/3059] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:34:38 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 02 21:34:39.219091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:39.220402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:39.238833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:39.238833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:39.238833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:39.238833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:39.238833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:39.238833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:39.553879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:39.572664 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a189adfb-1c33-4161-b1d1-264e563099ac tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.359054 Nov 02 21:34:39.573281 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1480/3060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:39 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:39.883691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:34:39.884431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:34:39.885119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:34:39.885544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:34:39.885960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:34:39.897144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:39.897892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:39.899801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:39.900555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:39.901043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:39.901874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:39.924183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:34:39.933967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Getting quotas for user 9ac55f39aebb4cf2b169157a45a2e134 and project e35e2aeb94534e21afbdf440429f44de. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:34:39.948127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:39.949576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:34:39.952011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:34:40.162185 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-14adf265-d9d4-46c0-988c-4758e17cb545 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812099 Nov 02 21:34:40.162800 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1581/3061] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:34:40.174234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a55be3d7-0eeb-423a-b49b-ff93c7e8e087 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:40.176470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a55be3d7-0eeb-423a-b49b-ff93c7e8e087 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:40.277227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a55be3d7-0eeb-423a-b49b-ff93c7e8e087 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:40.288313 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a55be3d7-0eeb-423a-b49b-ff93c7e8e087 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1208 microversion: 2.1 time: 0.116061 Nov 02 21:34:40.288313 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1481/3062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:40 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1208 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:40.597182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:40.598042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:40.619735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:40.624969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:40.624969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:40.624969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:40.624969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:40.624969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:40.974881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-903847ac-ff7f-44f1-90af-44a5fec89b0e req-ab8a6813-50b8-433e-a1eb-8e66383db411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-unplugged", "status": "completed", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:40.993021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-903847ac-ff7f-44f1-90af-44a5fec89b0e req-ab8a6813-50b8-433e-a1eb-8e66383db411 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:40.993507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-903847ac-ff7f-44f1-90af-44a5fec89b0e req-ab8a6813-50b8-433e-a1eb-8e66383db411 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:40.993943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-903847ac-ff7f-44f1-90af-44a5fec89b0e req-ab8a6813-50b8-433e-a1eb-8e66383db411 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:41.027674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-903847ac-ff7f-44f1-90af-44a5fec89b0e req-ab8a6813-50b8-433e-a1eb-8e66383db411 service nova] Creating event network-vif-unplugged:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:34:41.049543 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-903847ac-ff7f-44f1-90af-44a5fec89b0e req-ab8a6813-50b8-433e-a1eb-8e66383db411 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077707 Nov 02 21:34:41.057501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1482/3063] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:41.189756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:41.202009 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f002f0b8-e01a-4211-8ff1-9d324c5c7e92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.609288 Nov 02 21:34:41.202996 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1582/3064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:40 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:41.317929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:41.318970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:41.326803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:41.327584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:41.333449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:41.333449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:41.333449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:41.333449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:41.410864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:41.421535 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c0580848-9966-410a-98af-ad53af48d696 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1212 microversion: 2.1 time: 0.113889 Nov 02 21:34:41.422449 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1483/3065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:41 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:42.229877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:42.230707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:42.242292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:42.246599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:42.248223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:42.251378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:42.252364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:42.254562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:42.449887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:42.450813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:42.458704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:42.459531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:42.460675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:42.464759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:42.464759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:42.464759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:42.622125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:42.631933 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5aa063ba-cebb-405c-b699-224fe6ba83c6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.407101 Nov 02 21:34:42.632512 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1583/3066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:42 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:42.679321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:42.682486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:42.690834 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38f499e1-a9ef-4a0b-b472-7505b086cfb3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1204 microversion: 2.1 time: 0.245094 Nov 02 21:34:42.706019 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1484/3067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:42 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1204 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:43.662559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:43.663741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:43.678847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:43.681486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:43.683129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:43.685052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:43.691155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:43.691155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:43.723595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:43.724224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:43.740229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:43.762582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:43.764067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:43.764847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:43.765350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:43.765791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:44.218610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:44.232340 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fb1d9df5-627a-4cd9-a622-06f141049c3a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1268 microversion: 2.1 time: 0.513230 Nov 02 21:34:44.233144 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1485/3068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:43 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1268 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:44.283037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:44.291463 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-653a231d-9516-427a-8d5c-f4c44023e074 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.636292 Nov 02 21:34:44.308528 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1584/3069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:43 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:44.620862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09146752-6a54-468e-8c18-3dcb25a0c7b6"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:44.623302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:44.631005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:44.631985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:44.632609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:44.633332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:44.633967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:44.634549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:45.105835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1d62e6be-76fd-40e4-bff7-691fe2d2eebb req-fb989ee8-b5ad-419d-8132-7f289a5bf5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-plugged", "status": "completed", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:45.144508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1d62e6be-76fd-40e4-bff7-691fe2d2eebb req-fb989ee8-b5ad-419d-8132-7f289a5bf5c5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:45.146556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1d62e6be-76fd-40e4-bff7-691fe2d2eebb req-fb989ee8-b5ad-419d-8132-7f289a5bf5c5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:45.147005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1d62e6be-76fd-40e4-bff7-691fe2d2eebb req-fb989ee8-b5ad-419d-8132-7f289a5bf5c5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:45.179738 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1d62e6be-76fd-40e4-bff7-691fe2d2eebb req-fb989ee8-b5ad-419d-8132-7f289a5bf5c5 service nova] Creating event network-vif-plugged:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:34:45.191741 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1d62e6be-76fd-40e4-bff7-691fe2d2eebb req-fb989ee8-b5ad-419d-8132-7f289a5bf5c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089473 Nov 02 21:34:45.193168 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1585/3070] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:45.264991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:45.280534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:45.289714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:45.290450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:45.293167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:45.294639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:45.295309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:45.295976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:45.502531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-06f8f038-a74e-42b9-8e77-a57578afad07 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "POST /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.885785 Nov 02 21:34:45.503170 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1486/3071] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:34:44 2022] POST /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:34:45.527770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:45.533523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:45.537081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:45.539802 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9635ac53-5556-447c-9934-abdff32da6d0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1308 microversion: 2.1 time: 0.283817 Nov 02 21:34:45.541929 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1586/3072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:45 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:45.579617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:45.579617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:45.579617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:45.579617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:45.579617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:45.582708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:45.890861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:45.904088 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f4468baa-d592-400d-ba46-4668ee024ffb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.392504 Nov 02 21:34:45.905716 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1487/3073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:45 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:46.568541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:46.569705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:46.585296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:46.615933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:46.619623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:46.622604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:46.625766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:46.627767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:46.917576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5ea4bdef-6c1c-4066-9a54-618931d770ce req-51ecde2d-a2c8-440e-bb00-124bb431406a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016437e7-ff39-49a9-ac01-b1a1b8c369c3", "tag": "2cc7ca0f-f800-42dc-8d56-470ebb29b069"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:46.917576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5ea4bdef-6c1c-4066-9a54-618931d770ce req-51ecde2d-a2c8-440e-bb00-124bb431406a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:46.917576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5ea4bdef-6c1c-4066-9a54-618931d770ce req-51ecde2d-a2c8-440e-bb00-124bb431406a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:46.917576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5ea4bdef-6c1c-4066-9a54-618931d770ce req-51ecde2d-a2c8-440e-bb00-124bb431406a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:46.917576 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5ea4bdef-6c1c-4066-9a54-618931d770ce req-51ecde2d-a2c8-440e-bb00-124bb431406a service nova] Creating event network-changed:2cc7ca0f-f800-42dc-8d56-470ebb29b069 for instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 on n-h1-860863-4 Nov 02 21:34:46.917576 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5ea4bdef-6c1c-4066-9a54-618931d770ce req-51ecde2d-a2c8-440e-bb00-124bb431406a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054517 Nov 02 21:34:46.917576 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1488/3074] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:34:46.943198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:46.950624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:46.991590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:46.991767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:46.992470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:46.993234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:46.993370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:46.993751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:47.066926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:47.078465 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cbb39b07-8cac-408d-8eac-782a5f225944 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1308 microversion: 2.1 time: 0.514438 Nov 02 21:34:47.079723 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1587/3075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:46 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:47.356191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:47.369676 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0f672432-f63f-4b0f-ba3c-6c37c6bac631 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.441106 Nov 02 21:34:47.370852 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1489/3076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:46 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:48.108252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:48.108879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:48.122032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:48.122528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:48.122977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:48.123684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:48.124141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:48.125427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:48.397901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:48.398644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:48.409858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:48.420119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:48.425356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:48.425356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:48.425356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:48.425356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:48.425356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:48.662325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:48.681331 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5c48d14e-2ab9-479b-bef7-4c49ac7b8198 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1308 microversion: 2.1 time: 0.569466 Nov 02 21:34:48.682000 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1588/3077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:48 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1308 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:48.793155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:48.803032 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5651d76f-b6f6-40a3-91a6-24e2d82fc05d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.411157 Nov 02 21:34:48.806712 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1490/3078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:48 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:49.705290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:49.706728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:49.734274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:49.747193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:49.748033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:49.748799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:49.749739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:49.750181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:49.833131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:49.834027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:49.850130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:49.853545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:49.853545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:49.853545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:49.853545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:49.853545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:49.912148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:49.946628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:50.282982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:50.288970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:50.305549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd41f856-d514-46df-9d0c-df8169a35415 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1308 microversion: 2.1 time: 0.602822 Nov 02 21:34:50.312894 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1589/3079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:49 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1308 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:50.349820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:50.370772 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81773154-88f6-418f-9dca-7d57de122bbb tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.542235 Nov 02 21:34:50.374995 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1491/3080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:49 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:51.344320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:51.345710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:51.372817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:51.375237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:51.376946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:51.381968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:51.381968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:51.381968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:51.402845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:51.403664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:51.423667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:51.424751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:51.427270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:51.429007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:51.429749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:51.431650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:52.267596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:52.276105 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c060a29-091a-4c0d-8015-5c97070d36ba tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1308 microversion: 2.1 time: 0.936934 Nov 02 21:34:52.285380 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1590/3081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:51 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1308 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:52.345711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:52.364283 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fcc7840d-b074-430d-b77e-b836b9cdc2e1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.965442 Nov 02 21:34:52.368460 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1492/3082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:51 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:53.303602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:53.304232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:53.311350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:53.311706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:53.312258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:53.312967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:53.314196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:53.314779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:53.393896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:53.394512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:53.401755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:53.402244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:53.402683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:53.403381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:53.403835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:53.404262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:53.689761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:53.709249 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb834041-464c-4fdd-988f-80b8deaaa82e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1308 microversion: 2.1 time: 0.408031 Nov 02 21:34:53.710138 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1591/3083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:53 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:53.829353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7fcca493-ceef-40a8-b443-d6846fd12080 req-3cf01dbc-7bd4-47ec-8fcb-22c59e885dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016437e7-ff39-49a9-ac01-b1a1b8c369c3", "name": "network-vif-plugged", "status": "completed", "tag": "2cc7ca0f-f800-42dc-8d56-470ebb29b069"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:53.865729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7fcca493-ceef-40a8-b443-d6846fd12080 req-3cf01dbc-7bd4-47ec-8fcb-22c59e885dfd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:53.866431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7fcca493-ceef-40a8-b443-d6846fd12080 req-3cf01dbc-7bd4-47ec-8fcb-22c59e885dfd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:53.868876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7fcca493-ceef-40a8-b443-d6846fd12080 req-3cf01dbc-7bd4-47ec-8fcb-22c59e885dfd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:53.962550 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7fcca493-ceef-40a8-b443-d6846fd12080 req-3cf01dbc-7bd4-47ec-8fcb-22c59e885dfd service nova] Creating event network-vif-plugged:2cc7ca0f-f800-42dc-8d56-470ebb29b069 for instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 on n-h1-860863-4 Nov 02 21:34:53.983864 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7fcca493-ceef-40a8-b443-d6846fd12080 req-3cf01dbc-7bd4-47ec-8fcb-22c59e885dfd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161261 Nov 02 21:34:53.987924 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1592/3084] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:34:54.745324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:54.746086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:54.760709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:54.767192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:54.773887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:54.773887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:54.773887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:54.773887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:54.844028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:54.853351 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ea704b4-7f4b-4c23-aeee-fade7fcda931 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 1.463294 Nov 02 21:34:54.857191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1493/3085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:53 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:55.337566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:55.348983 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4ad0a09-4f2b-4a69-b5ae-805e008c0164 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1308 microversion: 2.1 time: 0.608511 Nov 02 21:34:55.354609 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1593/3086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:54 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:55.887461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:55.888063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:55.900593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:55.900593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:55.901313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:55.910165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:55.911043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:55.913241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:56.291037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:56.300324 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe541eb3-addd-4c7b-b4fc-17b5dbde25f6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.417167 Nov 02 21:34:56.300916 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1494/3087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:55 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:56.385280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:56.389977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:56.400719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:56.401404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:56.401972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:56.402797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:56.403366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:56.406214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:56.457574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:34:56.814000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:56.834235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9a3da742-54ea-4fd7-b49f-5bb7e44d3502 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1489 microversion: 2.1 time: 0.452940 Nov 02 21:34:56.841096 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1594/3088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:56 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1489 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:56.861298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-975321277"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:56.864481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:56.875949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:56.877526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:56.879572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:56.882450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:56.885697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:56.886353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:57.075124 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-16641a18-6b12-4dc5-b012-83714fad9b33 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "PUT /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1074 microversion: 2.1 time: 0.218992 Nov 02 21:34:57.079403 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1495/3089] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:34:56 2022] PUT /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1074 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:57.100131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:57.100945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:57.110664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:57.117526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:57.121032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:57.122133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:57.124707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:57.126672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:57.326861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:57.327933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:57.338521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:57.343868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:57.346184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:57.352121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:57.356688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:57.361774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:57.495528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:57.509150 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c341fec8-b91c-459e-be23-d6744c9b2613 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1500 microversion: 2.1 time: 0.412751 Nov 02 21:34:57.530898 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1595/3090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:57 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:57.537144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:57.538393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:57.544904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:57.545803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:57.547073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:57.548580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:57.549498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:57.550147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:57.949234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:57.976475 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cfe977dc-081f-4868-8ad0-9a1305982a97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1500 microversion: 2.1 time: 0.444198 Nov 02 21:34:57.999627 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1596/3091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:57 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1500 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:58.018012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5570068d-a0a4-4c58-95e3-8da016195351 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:34:58.031487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5570068d-a0a4-4c58-95e3-8da016195351 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:58.034656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5570068d-a0a4-4c58-95e3-8da016195351 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:58.035503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5570068d-a0a4-4c58-95e3-8da016195351 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:58.074380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:58.091578 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d149f963-8260-4c0d-9dcd-4cb93f97230e tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.761586 Nov 02 21:34:58.093044 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1496/3092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:57 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:34:58.105096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5570068d-a0a4-4c58-95e3-8da016195351 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:34:58.419678 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5570068d-a0a4-4c58-95e3-8da016195351 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "POST /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3/action" status: 202 len: 0 microversion: 2.1 time: 0.418542 Nov 02 21:34:58.421500 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1597/3093] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:34:57 2022] POST /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:34:58.437594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:58.442122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:58.454653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:58.455161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:58.478277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:58.479244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:58.489006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:58.489671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:58.818997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:58.827656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8f6275b9-f63c-4a4d-a0dc-3ef96c111652 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.400439 Nov 02 21:34:58.843945 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1497/3094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:58 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:59.127913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:59.130549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:59.149664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:59.157794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:59.157794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:59.158539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:59.159357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:59.160699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:59.583584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:34:59.599458 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02062f46-a31a-4e27-af0f-768cc4a5cd78 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1542 microversion: 2.1 time: 0.481061 Nov 02 21:34:59.603358 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1598/3095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:59 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1542 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:34:59.851607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:34:59.854581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:34:59.872581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:59.874505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:59.878241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:34:59.879372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:34:59.884998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:34:59.887217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:00.435847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:00.445638 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b7f9866-9556-41a1-9a31-b1cd38a372e1 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.599270 Nov 02 21:35:00.446221 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1498/3096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:34:59 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:00.629116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:00.629842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:00.651121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:00.652440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:00.652921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:00.653708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:00.659121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:00.659900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:01.083694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:01.095188 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-825e0163-951b-4264-a7cf-935cb6934c98 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1541 microversion: 2.1 time: 0.473793 Nov 02 21:35:01.109183 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1599/3097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:00 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1541 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:01.469000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:01.470212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:01.497808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:01.498341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:01.501607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:01.502405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:01.512960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:01.512960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:01.583625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ad1ca6e4-2fc2-4ee7-a376-d8a03a9506d8 req-98f8fd8d-f072-48bc-92bd-e32f4b65472b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "name": "network-vif-unplugged", "status": "completed", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:01.617796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ad1ca6e4-2fc2-4ee7-a376-d8a03a9506d8 req-98f8fd8d-f072-48bc-92bd-e32f4b65472b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:01.632034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ad1ca6e4-2fc2-4ee7-a376-d8a03a9506d8 req-98f8fd8d-f072-48bc-92bd-e32f4b65472b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:01.632034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ad1ca6e4-2fc2-4ee7-a376-d8a03a9506d8 req-98f8fd8d-f072-48bc-92bd-e32f4b65472b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:01.731252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ad1ca6e4-2fc2-4ee7-a376-d8a03a9506d8 req-98f8fd8d-f072-48bc-92bd-e32f4b65472b service nova] Creating event network-vif-unplugged:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h2-860863-4 Nov 02 21:35:01.751789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-ad1ca6e4-2fc2-4ee7-a376-d8a03a9506d8 req-98f8fd8d-f072-48bc-92bd-e32f4b65472b service nova] Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:35:01.800666 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ad1ca6e4-2fc2-4ee7-a376-d8a03a9506d8 req-98f8fd8d-f072-48bc-92bd-e32f4b65472b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223132 Nov 02 21:35:01.811685 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1600/3098] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:35:02.066179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:02.086527 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-511c122f-39f2-4b19-90b5-af9b4a856985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.622737 Nov 02 21:35:02.088536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1499/3099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:01 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:02.120637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:02.134690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:02.148532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:02.149132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:02.149575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:02.152345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:02.152826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:02.153296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:02.173105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:02.472342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:02.484719 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-70a2070e-b5fe-4451-a614-fbfd908558b4 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1541 microversion: 2.1 time: 0.367062 Nov 02 21:35:02.487103 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1500/3100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:02 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1541 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:02.550997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "630a85d3-6dc2-4bc4-852e-ece560527277"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:02.554013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:02.562498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:02.563264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:02.563936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:02.564725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:02.565293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:02.565949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:02.745142 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] HTTP exception thrown: Volume 630a85d3-6dc2-4bc4-852e-ece560527277 could not be found. Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Request method failure captured: Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments/09146752-6a54-468e-8c18-3dcb25a0c7b6 HTTP/1.1 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 74 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuI1JJSAnrYZZHBkFc9dk8cu33E2hZVb0wQT6nCS1uQ6B0N0XLC0Oro51Jz7C8hOwLI24X382eJQnvHO7rZKxakHxHZEiLVpEXqYsfK1VAM8TNxemzk1dRp6L9VGgcgiAgxsKXMja98CugPCP6XsfZa_NHfledWFUVmsoat2-fgae3A Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c98b941f9f9946f28724980270127053 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesAdminNegativeTest-703044090 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98b941f9f9946f28724980270127053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98b941f9f9946f28724980270127053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98b941f9f9946f28724980270127053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98b941f9f9946f28724980270127053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesAdminNegativeTest-703044090 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c98b941f9f9946f28724980270127053 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-703044090 Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesAdminNegativeTest-703044090-project-admin Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 61e49f672a6e40ce8a01b49d139c917b Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesAdminNegativeTest-703044090-project-admin Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: {"volumeAttachment": {"volumeId": "630a85d3-6dc2-4bc4-852e-ece560527277"}} Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: exception: Volume 630a85d3-6dc2-4bc4-852e-ece560527277 could not be found. Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': 'e3b834c8-a998-4c4e-9f40-10eb33b62506', 'id': '09146752-6a54-468e-8c18-3dcb25a0c7b6', 'body': {'volumeAttachment': {'volumeId': '630a85d3-6dc2-4bc4-852e-ece560527277'}}} Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 630a85d3-6dc2-4bc4-852e-ece560527277 could not be found. (HTTP 404) (Request-ID: req-8ca64b18-1c4b-459f-8036-5139246b34a5) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:35:02.747508 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 630a85d3-6dc2-4bc4-852e-ece560527277 could not be found. Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 630a85d3-6dc2-4bc4-852e-ece560527277 could not be found. Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 630a85d3-6dc2-4bc4-852e-ece560527277 could not be found. Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Returning 400 to user: Volume 630a85d3-6dc2-4bc4-852e-ece560527277 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aab1be52-b5ad-443b-acac-67dc8d544227 tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments/09146752-6a54-468e-8c18-3dcb25a0c7b6" status: 400 len: 107 microversion: 2.1 time: 0.887213 Nov 02 21:35:02.752369 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1601/3101] 10.222.0.25 () {60 vars in 1433 bytes} [Wed Nov 2 21:35:01 2022] PUT /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments/09146752-6a54-468e-8c18-3dcb25a0c7b6 => generated 107 bytes in 890 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:35:02.916489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:02.917388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:02.931303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:02.933771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:02.934583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:02.936405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:02.938660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:02.942595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:03.116469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:03.117379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:03.138952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:03.138952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:03.138952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:03.138952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:03.138952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:03.138952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:03.145790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lazy-loading 'services' on Instance uuid e3b834c8-a998-4c4e-9f40-10eb33b62506 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:35:03.538420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:03.552133 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0573cb68-bb6b-47c2-9baf-4cc38293956d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.442977 Nov 02 21:35:03.560382 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1602/3102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:03 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:03.567453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:03.568830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:03.583631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:03.584259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:03.584919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:03.585929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:03.586574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:03.587163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:03.595048 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa5d0eee-a8a3-4c44-abf8-e39c4f953b84 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments/09146752-6a54-468e-8c18-3dcb25a0c7b6" status: 202 len: 0 microversion: 2.1 time: 0.682924 Nov 02 21:35:03.596382 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1501/3103] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:35:02 2022] DELETE /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments/09146752-6a54-468e-8c18-3dcb25a0c7b6 => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:35:03.618175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:03.624172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:03.653452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:03.661408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:03.665126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:03.673045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:03.674966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:03.676279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:03.722189 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ab9ddcd-fb3b-4979-b598-806b9715b275 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115865 Nov 02 21:35:03.723591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1502/3104] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:03 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:03.955021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-baae7356-531b-4dc7-9bff-8f42000c3bb6 req-08193562-3ef0-46d5-a45d-77153570f4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:04.019560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-baae7356-531b-4dc7-9bff-8f42000c3bb6 req-08193562-3ef0-46d5-a45d-77153570f4d7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:04.021633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-baae7356-531b-4dc7-9bff-8f42000c3bb6 req-08193562-3ef0-46d5-a45d-77153570f4d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:04.028337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-baae7356-531b-4dc7-9bff-8f42000c3bb6 req-08193562-3ef0-46d5-a45d-77153570f4d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:04.037952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:04.062228 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0784b3d0-544f-4b11-9b3b-a7d6dfd96e5d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1541 microversion: 2.1 time: 0.498378 Nov 02 21:35:04.074825 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1603/3105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:03 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1541 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:04.077131 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-baae7356-531b-4dc7-9bff-8f42000c3bb6 req-08193562-3ef0-46d5-a45d-77153570f4d7 service nova] Creating event network-changed:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h2-860863-4 Nov 02 21:35:04.098315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-baae7356-531b-4dc7-9bff-8f42000c3bb6 req-08193562-3ef0-46d5-a45d-77153570f4d7 service nova] Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:35:04.138635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-baae7356-531b-4dc7-9bff-8f42000c3bb6 req-08193562-3ef0-46d5-a45d-77153570f4d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191618 Nov 02 21:35:04.145049 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1503/3106] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:04.589671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:04.591160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:04.638613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:04.648630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:04.648630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:04.656501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:04.658109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:04.658901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:04.740060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:04.754217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:04.787593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:04.798049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:04.803267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:04.803267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:04.803267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:04.803267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:04.945174 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4725e787-0ce8-4f5b-86cb-50cb2a419bfd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211357 Nov 02 21:35:04.945938 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1504/3107] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:04 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:05.231181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:05.240356 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc00c8dd-731d-4fb6-b5e3-5b26440287a9 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.665392 Nov 02 21:35:05.253019 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1604/3108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:04 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:05.258451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:05.265879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:05.283772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:05.288961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:05.297972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:05.299121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:05.300186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:05.309633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:05.547154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7462b8b0-e0d5-43dd-b032-660f495bc816 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Action: 'create', calling method: .version_select at 0x7f9b685a1ca0>, body: {"keypair": {"name": "tempest-keypair-675257804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/AIcbMGMec+emcLrzVZHLgS6R1eCwTeOVVL/pbik8CR1DcTd7egrBldatiksucYxuuQl9t0aW6gWdA5a1acDTmXx9330snxrW9bjdROAyKNX0Q+fIrObFYxGmB8bEUgA=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:05.693790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7462b8b0-e0d5-43dd-b032-660f495bc816 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Getting quotas for project 41b1686d030644c18ae3444af845830a. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:35:05.701879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7462b8b0-e0d5-43dd-b032-660f495bc816 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Getting quotas for user 7bcfd298215d4a8b99d2d942cb049610 and project 41b1686d030644c18ae3444af845830a. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:35:05.751878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:05.767757 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0bab2f00-4eb3-4e07-8072-f26b589a9047 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1541 microversion: 2.1 time: 0.513095 Nov 02 21:35:05.768363 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1605/3109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:05 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1541 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:05.933274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7462b8b0-e0d5-43dd-b032-660f495bc816 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.978965 Nov 02 21:35:05.934122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1505/3110] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:35:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:05.959717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:05.962788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:05.999440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:06.001606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:06.007874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:06.014106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:06.019133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:06.023034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:06.203012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1a25bd3-117c-485b-9163-7722b071b8a6 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.248780 Nov 02 21:35:06.215770 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1606/3111] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:05 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:06.277080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:06.277080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:06.287969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:06.291089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:06.292000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:06.295937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:06.296973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:06.297945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:06.796489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:06.797157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:06.811316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:06.833307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:06.838324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:06.840473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:06.846215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:06.846611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:06.886144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:06.916463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca8dadd1-a129-4bb9-b1d4-e197964c78d4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.651368 Nov 02 21:35:06.917190 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1506/3112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:06 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:07.227214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:07.230596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:07.250361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:07.251402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:07.251850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:07.252558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:07.258918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:07.259505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:07.368093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:07.369901 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1751976b-84c9-46b4-9262-f6b0c566a692 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150647 Nov 02 21:35:07.372386 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1507/3113] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:07 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:07.404610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-884906e2-f2a5-4d57-904e-dadbf7b3aa12 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1473 microversion: 2.1 time: 0.593565 Nov 02 21:35:07.404610 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1607/3114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:06 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1473 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:07.967035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:07.967035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:08.031754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:08.038793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:08.045833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:08.065537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:08.073005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:08.073480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:08.412806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:08.438736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:08.536203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:08.541219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:08.542327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:08.545039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:08.552584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a37ad30-5a35-472c-89ea-99f898c8b487 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.612973 Nov 02 21:35:08.553490 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1508/3115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:07 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:08.564557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:08.564557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:08.564557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:08.566475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:08.568902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:08.583998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:08.584746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:08.585562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:08.586519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:08.587147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:08.587813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:08.655998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b5ee28d-93f3-4c42-8886-dac2619b18f1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.254705 Nov 02 21:35:08.663896 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1608/3116] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:08 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:08.899158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:08.916670 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2d6a4c96-4070-48f6-b3e2-8211906fd6d1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1473 microversion: 2.1 time: 0.361979 Nov 02 21:35:08.923689 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1509/3117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:08 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:09.582968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:09.586656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:09.599472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:09.604048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:09.607363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:09.609726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:09.617508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:09.618147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:09.671452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:09.677177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:09.689014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:09.699220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:09.700118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:09.703228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:09.706021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:09.706726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:09.835805 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4728b5fc-a9a0-41a0-b798-a4bf51a38879 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163656 Nov 02 21:35:09.840484 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1510/3118] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:09 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:09.943476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:09.944777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:09.961319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:09.962821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:09.965480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:09.966990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:09.969807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:09.973215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:09.994452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:10.004341 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2c28628-a030-494f-8f52-3aacaef41b8b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.425869 Nov 02 21:35:10.012449 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1609/3119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:09 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:10.425204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:10.440414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ecc86d63-3e7b-4046-a48f-544fbdef0bea tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1470 microversion: 2.1 time: 0.498583 Nov 02 21:35:10.446254 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1511/3120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:09 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:10.476158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:10.476820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:10.485887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:10.502775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:10.504273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:10.505293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:10.505976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:10.507167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:10.566734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:10.679132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:10.691214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:10.691701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:10.692559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:10.693043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:10.693481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:10.821666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:35:10.857757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for user 64f57cf5139c4937b8158f8d9aef011b and project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:35:10.858244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:10.862533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:10.871533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:10.872025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:10.872994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:10.875552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:10.876555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:10.877229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:10.933264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0f49ddf-d2c7-4bb1-80f9-af2e173c71fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077925 Nov 02 21:35:10.933264 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1512/3121] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:10 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:11.037667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:11.047370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:11.064043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:11.066912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:11.070328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:11.071475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:11.074002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:11.075391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:11.424511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:11.434993 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-622321e8-1609-4cc3-8820-715335faa478 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.402998 Nov 02 21:35:11.449363 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1513/3122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:11 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:11.590203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "90c52ba2-8213-481f-9d4d-5811a754fb70"}], "security_groups": [{"name": "tempest-securitygroup--1341760958"}], "key_name": "tempest-keypair-675257804", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:11.867709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] validate_networks() for [('90c52ba2-8213-481f-9d4d-5811a754fb70', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:35:11.874461 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a42e5921-aaba-43a6-b3b9-798b16db98a8 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6/action" status: 202 len: 0 microversion: 2.1 time: 1.391938 Nov 02 21:35:11.877625 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1610/3123] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:35:10 2022] POST /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6/action => generated 0 bytes in 1405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:35:11.894042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:11.908683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:11.928856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:11.934976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:11.935834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:11.936562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:11.937567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:11.939875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:11.941044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:12.535945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:12.544896 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2cfe1a92-56f4-4089-9951-cf52edacee24 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1469 microversion: 2.1 time: 0.663674 Nov 02 21:35:12.549851 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1611/3124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:11 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1469 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:12.564064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:12.570445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:12.585716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:12.588999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:12.591249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:12.598375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:12.598375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:12.598375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:12.693804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ef70cd9-7859-49d2-b2ac-2e9d1102f6f4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142346 Nov 02 21:35:12.695693 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1612/3125] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:12 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:12.708041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:12.710287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:12.731059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:12.731918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:12.732574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:12.738262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:12.738262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:12.738262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:13.254817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:35:13.255361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:35:13.255943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:35:13.256457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:35:13.257262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:35:13.280196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:13.283221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:13.283967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:13.285023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:13.289744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:13.290565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:13.333183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:13.350459 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6b0f85d-ea6d-45a1-a30a-1c0f57618f89 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.653038 Nov 02 21:35:13.351931 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1613/3126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:12 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:13.376086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Getting quotas for project 41b1686d030644c18ae3444af845830a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:35:13.400117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Getting quotas for user 7bcfd298215d4a8b99d2d942cb049610 and project 41b1686d030644c18ae3444af845830a. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:35:13.463794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:35:13.466596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:35:13.576916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:13.577802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:13.591091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:13.591916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:13.592862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:13.593700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:13.595252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:13.595930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:13.702023 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fb6ffdb2-9df7-40db-8a4e-49ff62f76c66 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.108506 Nov 02 21:35:13.702023 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1514/3127] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:35:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:35:13.711677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:13.729392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:13.763812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:13.764309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:13.764804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:13.768969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:13.769744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:13.771298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:13.836107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8b286388-0ad6-4eac-b132-e23e3b5134ad tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128934 Nov 02 21:35:13.840896 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1515/3128] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:13 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:13.842254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0dcb6f99-1462-413e-8d5e-0a13d5767cd1 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:13.842998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0dcb6f99-1462-413e-8d5e-0a13d5767cd1 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:13.984237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0dcb6f99-1462-413e-8d5e-0a13d5767cd1 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:14.014845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:14.015057 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0dcb6f99-1462-413e-8d5e-0a13d5767cd1 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1225 microversion: 2.1 time: 0.165831 Nov 02 21:35:14.017197 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1516/3129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:13 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1225 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:14.018091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2d9f18b-efb5-48b0-a29c-cac719385d50 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1469 microversion: 2.1 time: 0.440973 Nov 02 21:35:14.033356 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1614/3130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:13 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1469 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:14.209282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-94b385c7-8efd-4416-a80e-32a2b80c6835 req-9171cd4c-58a1-4c06-a2b6-3afd20b9a904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "name": "network-vif-plugged", "status": "completed", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:14.224621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94b385c7-8efd-4416-a80e-32a2b80c6835 req-9171cd4c-58a1-4c06-a2b6-3afd20b9a904 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:14.225458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94b385c7-8efd-4416-a80e-32a2b80c6835 req-9171cd4c-58a1-4c06-a2b6-3afd20b9a904 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:14.225861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-94b385c7-8efd-4416-a80e-32a2b80c6835 req-9171cd4c-58a1-4c06-a2b6-3afd20b9a904 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:14.238785 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-94b385c7-8efd-4416-a80e-32a2b80c6835 req-9171cd4c-58a1-4c06-a2b6-3afd20b9a904 service nova] Creating event network-vif-plugged:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h2-860863-4 Nov 02 21:35:14.245174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-94b385c7-8efd-4416-a80e-32a2b80c6835 req-9171cd4c-58a1-4c06-a2b6-3afd20b9a904 service nova] Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:35:14.256496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-94b385c7-8efd-4416-a80e-32a2b80c6835 req-9171cd4c-58a1-4c06-a2b6-3afd20b9a904 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050829 Nov 02 21:35:14.260589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1517/3131] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:14.379941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:14.380566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:14.386964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:14.387451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:14.387894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:14.388591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:14.389087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:14.389522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:14.442012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:14.443342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:14.449986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:14.450678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:14.451292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:14.452149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:14.452803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:14.453410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:14.709237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:14.726037 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e19970a-4411-4f2c-a15b-e531a1781ec7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.349925 Nov 02 21:35:14.726811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1615/3132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:14 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:14.756444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:14.764786 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd7264ab-eacf-4e22-b9cb-23adbfdff275 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.327946 Nov 02 21:35:14.765397 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1518/3133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:14 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:14.849098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:14.853282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:14.860576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:14.861206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:14.861887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:14.862611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:14.863075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:14.863646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:14.899094 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a75fa3d9-b8a0-46d5-be6c-35509f9dfcb5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054114 Nov 02 21:35:14.899689 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1616/3134] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:35:14 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:35:15.043415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0da274d-036c-464a-8107-1b01b40b2b27 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:15.044208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0da274d-036c-464a-8107-1b01b40b2b27 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:15.046285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:15.047019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:15.058101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:15.060777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:15.061894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:15.063806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:15.065948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:15.066496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:15.165417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0da274d-036c-464a-8107-1b01b40b2b27 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:15.192427 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0da274d-036c-464a-8107-1b01b40b2b27 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1225 microversion: 2.1 time: 0.136749 Nov 02 21:35:15.192427 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1519/3135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:15 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1225 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:15.192427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-802935817", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "aea5a6ca-eefa-44fe-8e3c-dfb32a68a901"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:15.293125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:15.305080 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-07d802e7-9e64-4aaa-a5cd-f3be04647297 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1469 microversion: 2.1 time: 0.262846 Nov 02 21:35:15.306474 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1617/3136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:15 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1469 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:15.307469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] validate_networks() for [('aea5a6ca-eefa-44fe-8e3c-dfb32a68a901', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:35:15.753394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:15.755242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:15.764364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:15.764877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:15.765344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:15.766611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:15.767068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:15.774410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:15.828260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:35:15.829828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:35:15.830496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:35:15.831008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:35:15.831521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:35:15.845881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:15.845881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:15.845881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:15.845881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:15.845881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:15.846638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:15.901273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Getting quotas for project c78a3b929e4f4f2db5f46332df6f7975. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:35:15.930843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Getting quotas for user e1245c484e8d45e28600c4c1420df3fa and project c78a3b929e4f4f2db5f46332df6f7975. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:35:15.959991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:15.970024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:35:15.975724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:35:16.091072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:16.119054 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed5b3133-8a41-48e3-ad9b-6e134c5300e7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.371048 Nov 02 21:35:16.120727 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1618/3137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:15 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:16.149658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:16.150767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:16.180219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.180465 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-82841512-c19b-4b69-8292-3752585c248b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994497 Nov 02 21:35:16.181214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.182150 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1520/3138] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:35:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:35:16.183724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.184688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.187487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.190052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.200305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fdde7e10-6948-4749-be0e-71caf86cd4fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:16.208119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fdde7e10-6948-4749-be0e-71caf86cd4fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:16.376808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fdde7e10-6948-4749-be0e-71caf86cd4fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:16.384667 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fdde7e10-6948-4749-be0e-71caf86cd4fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1217 microversion: 2.1 time: 0.195732 Nov 02 21:35:16.389616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1521/3139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:16 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:16.400846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:16.411776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:16.435540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.436735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.437426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.441767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.446129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.446768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.519047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:16.680622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:16.692248 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a39b9ed7-e06a-4178-8dd0-6bae479cc51b tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1277 microversion: 2.1 time: 0.298183 Nov 02 21:35:16.692798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1522/3140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:16 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1277 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:16.708493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:16.710305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:16.732019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.732538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.733125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.737844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:16.739851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.746435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.747548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.754763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f960f476-8090-460e-9fb5-b75b6b99ea65 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.631003 Nov 02 21:35:16.756489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1619/3141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:16 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:16.787148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-128764574"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:16.799596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:16.807684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.808408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.809296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.810275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:16.812659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:16.814774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:16.976749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:16.991343 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b92a216-6d6c-484a-9c47-a453eace7c63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1535 microversion: 2.1 time: 0.292871 Nov 02 21:35:16.991343 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1523/3142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:16 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1535 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:17.152964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:17.153684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:17.168425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:17.168917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:17.169385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:17.170086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:17.171840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:17.177913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:17.392794 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44f8ceec-4e1d-4c9b-9e06-56c6ac58b1c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.609917 Nov 02 21:35:17.394519 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1620/3143] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:35:16 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Nov 02 21:35:17.405983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8e71298f-b22e-40a6-9452-fe247ff2a401 req-89341705-eb3f-4f09-82a9-373b776fd5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-unplugged", "status": "completed", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:17.417548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e71298f-b22e-40a6-9452-fe247ff2a401 req-89341705-eb3f-4f09-82a9-373b776fd5da service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:17.418036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e71298f-b22e-40a6-9452-fe247ff2a401 req-89341705-eb3f-4f09-82a9-373b776fd5da service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:17.418466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e71298f-b22e-40a6-9452-fe247ff2a401 req-89341705-eb3f-4f09-82a9-373b776fd5da service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:17.437636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8e71298f-b22e-40a6-9452-fe247ff2a401 req-89341705-eb3f-4f09-82a9-373b776fd5da service nova] Creating event network-vif-unplugged:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:35:17.443897 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8e71298f-b22e-40a6-9452-fe247ff2a401 req-89341705-eb3f-4f09-82a9-373b776fd5da service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047731 Nov 02 21:35:17.449234 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1621/3144] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:17.459359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:17.460623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:17.472998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:17.481665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:17.482160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:17.483275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:17.483828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:17.484440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:17.669239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:17.685752 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f5baf30-22ad-4eef-87ac-e31931ae1def tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.534946 Nov 02 21:35:17.692648 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1524/3145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:17 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:17.697678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9757430-707d-4e2e-b26a-b68d4e512f93 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:17.698486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9757430-707d-4e2e-b26a-b68d4e512f93 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:17.822243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9757430-707d-4e2e-b26a-b68d4e512f93 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:17.827240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:17.831073 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9757430-707d-4e2e-b26a-b68d4e512f93 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1217 microversion: 2.1 time: 0.137097 Nov 02 21:35:17.846780 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1525/3146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:17 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:17.847041 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32f8082a-1d58-4722-b4c2-87a0dddfddba tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.386101 Nov 02 21:35:17.847041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1622/3147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:17 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:17.852395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:17.857871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:17.865298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:17.866070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:17.866695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:17.867750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:17.868302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:17.868826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:17.994448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:18.003502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e11d2d9-26ce-4eee-8ab9-abf6684a5af7 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1295 microversion: 2.1 time: 0.154954 Nov 02 21:35:18.004450 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1526/3148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:17 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1295 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:18.031307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:18.032004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:18.042530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:18.043043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:18.045664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:18.045664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:18.045664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:18.045664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:18.070877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:18.221172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:18.233216 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d8e8e1d-e303-4acc-a2a9-8dabd723ed41 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1535 microversion: 2.1 time: 0.209067 Nov 02 21:35:18.235302 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1623/3149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:18 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1535 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:18.422271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-95170f16-4ade-4ae9-a077-8ad37169ecc1 req-ff2101af-bd34-4bbd-9d2f-7d0084a14a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "name": "network-vif-unplugged", "status": "completed", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:18.440902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-95170f16-4ade-4ae9-a077-8ad37169ecc1 req-ff2101af-bd34-4bbd-9d2f-7d0084a14a87 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:18.442383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-95170f16-4ade-4ae9-a077-8ad37169ecc1 req-ff2101af-bd34-4bbd-9d2f-7d0084a14a87 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:18.444581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-95170f16-4ade-4ae9-a077-8ad37169ecc1 req-ff2101af-bd34-4bbd-9d2f-7d0084a14a87 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:18.459912 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-95170f16-4ade-4ae9-a077-8ad37169ecc1 req-ff2101af-bd34-4bbd-9d2f-7d0084a14a87 service nova] Creating event network-vif-unplugged:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h1-860863-4 Nov 02 21:35:18.471395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-95170f16-4ade-4ae9-a077-8ad37169ecc1 req-ff2101af-bd34-4bbd-9d2f-7d0084a14a87 service nova] Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:35:18.491912 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-95170f16-4ade-4ae9-a077-8ad37169ecc1 req-ff2101af-bd34-4bbd-9d2f-7d0084a14a87 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073418 Nov 02 21:35:18.492880 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1527/3150] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:18.711242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:18.711920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:18.729344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:18.729804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:18.730924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:18.731856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:18.732113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:18.732559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:18.864263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:18.865014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:18.895556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:18.895556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:18.895556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:18.895556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:18.895556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:18.895556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:19.404164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:19.424558 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a0fc742-2a05-4b5f-9a70-225124b79e42 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1269 microversion: 2.1 time: 0.560587 Nov 02 21:35:19.440972 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1528/3151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:18 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1269 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:19.440972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:19.440972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:19.440972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:19.443152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:19.443152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:19.443152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:19.443152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:19.443447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:19.541913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:19.554391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7844e2b2-382d-4be7-a9bf-79044862a068 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.846913 Nov 02 21:35:19.556370 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1624/3152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:18 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:19.562096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:19.563062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:19.570526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:19.571452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:19.572246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:19.579381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:19.579381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:19.579381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:19.644205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:19.652108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6bac9218-ebe7-47cd-8a46-2b2ed48152c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.224238 Nov 02 21:35:19.652889 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1529/3153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:19 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:19.675146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:19.676108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:19.684117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:19.684807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:19.685471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:19.685929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:19.687040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:19.687676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:19.688819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:19.715690 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5a8b42a-2cc6-4dd9-8960-65693395f8ec tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1283 microversion: 2.1 time: 0.157884 Nov 02 21:35:19.716560 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1625/3154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:19 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:19.937178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:19.947377 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d657ae16-7628-472e-a946-2e8e4cf22832 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1535 microversion: 2.1 time: 0.280693 Nov 02 21:35:19.949593 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1530/3155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:19 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1535 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:20.450578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:20.451740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:20.466289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:20.470345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:20.471058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:20.472147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:20.472846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:20.474602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:20.551487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-40585367-06cc-42ec-8a17-e5475ba97590 req-95c2423b-c2f6-4681-959c-e37f24db5c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:20.568130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-40585367-06cc-42ec-8a17-e5475ba97590 req-95c2423b-c2f6-4681-959c-e37f24db5c48 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:20.570280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-40585367-06cc-42ec-8a17-e5475ba97590 req-95c2423b-c2f6-4681-959c-e37f24db5c48 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:20.570280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-40585367-06cc-42ec-8a17-e5475ba97590 req-95c2423b-c2f6-4681-959c-e37f24db5c48 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:20.593832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-40585367-06cc-42ec-8a17-e5475ba97590 req-95c2423b-c2f6-4681-959c-e37f24db5c48 service nova] Creating event network-changed:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h1-860863-4 Nov 02 21:35:20.619037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:20.628510 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84bfbbec-b267-4af1-b4a1-5dd3f9a57f7a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1275 microversion: 2.1 time: 0.181838 Nov 02 21:35:20.632534 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1626/3156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:20 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:20.636060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-40585367-06cc-42ec-8a17-e5475ba97590 req-95c2423b-c2f6-4681-959c-e37f24db5c48 service nova] Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:35:20.645408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:20.649091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:20.659770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:20.659770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:20.659770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:20.661003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:20.661880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:20.662407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:20.689138 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-40585367-06cc-42ec-8a17-e5475ba97590 req-95c2423b-c2f6-4681-959c-e37f24db5c48 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136347 Nov 02 21:35:20.689138 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1531/3157] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:20.698440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:20.699145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:20.718661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:20.721361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:20.723189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:20.724153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:20.727722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:20.728406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:20.728601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:21.254170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:21.271763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0079f52f-0163-477b-98f0-dfff4587f76d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.637975 Nov 02 21:35:21.274857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1627/3158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:20 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:21.288304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:21.289327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:21.303475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:21.304142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:21.304416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:21.310260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:21.311043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:21.311658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:21.351069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:21.366653 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-70ab170f-0891-46cd-8489-d7d8c2f9ed31 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1686 microversion: 2.1 time: 0.673917 Nov 02 21:35:21.367830 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1532/3159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:20 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1686 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:21.384242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:21.384242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:21.392399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:21.393311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:21.393969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:21.395333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:21.396005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:21.402596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:21.895490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:21.906140 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41469481-686c-4239-bce9-d2b2f08afb80 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1351 microversion: 2.1 time: 0.628582 Nov 02 21:35:21.911140 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1628/3160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:21 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1351 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:21.916837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:21.917799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:21.930971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:21.931476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:21.931916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:21.932630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:21.933161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:21.933592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:21.945384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:21.961475 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ddee153-647f-4a8a-9407-d3ca296ce7a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1535 microversion: 2.1 time: 0.587468 Nov 02 21:35:21.962270 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1533/3161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:21 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1535 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:22.307669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:22.310786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:22.312226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:22.317594 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5e6f2f1-cfeb-465b-bae7-7a206dfd2c41 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 0.404981 Nov 02 21:35:22.318459 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1629/3162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:21 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:22.319703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:22.320260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:22.321005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:22.321822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:22.322678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:22.323644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:22.392075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:22.392707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:22.399340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:22.399846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:22.400291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:22.401149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:22.401492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:22.402123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:22.810168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:22.823425 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5fa05b34-4152-4347-97ac-a84467e76ba2 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.526898 Nov 02 21:35:22.830954 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1534/3163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:22 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:22.833636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7ef3163b-a136-4d9b-ae18-0e3354e200da req-dfb5be4e-8d0f-4844-a887-ed2e536672e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d", "tag": "43f1d141-5b6e-4492-bc2d-1a27d7c1b538"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:22.847066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ef3163b-a136-4d9b-ae18-0e3354e200da req-dfb5be4e-8d0f-4844-a887-ed2e536672e1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:22.847657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ef3163b-a136-4d9b-ae18-0e3354e200da req-dfb5be4e-8d0f-4844-a887-ed2e536672e1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:22.849042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ef3163b-a136-4d9b-ae18-0e3354e200da req-dfb5be4e-8d0f-4844-a887-ed2e536672e1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:22.878771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:22.885654 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7ef3163b-a136-4d9b-ae18-0e3354e200da req-dfb5be4e-8d0f-4844-a887-ed2e536672e1 service nova] Creating event network-changed:43f1d141-5b6e-4492-bc2d-1a27d7c1b538 for instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d on n-h2-860863-4 Nov 02 21:35:22.896656 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d759cf9-c5eb-43c8-a65d-8dec0104732f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1686 microversion: 2.1 time: 0.508171 Nov 02 21:35:22.898247 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1630/3164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:22 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1686 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:22.911317 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7ef3163b-a136-4d9b-ae18-0e3354e200da req-dfb5be4e-8d0f-4844-a887-ed2e536672e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083395 Nov 02 21:35:22.915622 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1535/3165] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:22.938470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:22.939526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:22.947093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:22.947591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:22.948031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:22.949207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:22.949840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:22.950822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:22.988849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:22.993795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:23.014680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:23.018894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:23.019801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:23.020741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:23.030794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:23.030794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:23.685935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:23.702817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb352968-0c07-4503-a1cb-0f2d4c768047 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1351 microversion: 2.1 time: 0.770275 Nov 02 21:35:23.703810 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1631/3166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:22 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1351 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:23.722050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:23.722677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:23.730038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:23.730732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:23.731364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:23.732972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:23.734532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:23.735160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:24.213174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:24.228538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de283b37-fb26-4cb1-b802-71c57891b580 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1535 microversion: 2.1 time: 1.247238 Nov 02 21:35:24.229531 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1536/3167] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:22 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1535 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:24.234220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:24.235501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:24.242648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:24.243283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:24.243852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:24.244414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:24.245056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:24.245694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:24.765446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:24.779512 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-04925d25-916d-42e6-a585-3c6f9481cc97 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.548655 Nov 02 21:35:24.781122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1537/3168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:24 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:24.790352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:24.795918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:24.797914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:24.804567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:24.805180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:24.805682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:24.806889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:24.807574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:24.808005 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e308657b-7331-4cfc-ab61-9075f0b34378 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 1.103140 Nov 02 21:35:24.808803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:24.817344 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1632/3169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:23 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:24.828036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e056245c-19f1-45d4-ab0a-8fcb1191c78f req-70d33141-9104-4828-9b8e-5b639879a90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-plugged", "status": "completed", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:24.892833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e056245c-19f1-45d4-ab0a-8fcb1191c78f req-70d33141-9104-4828-9b8e-5b639879a90b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:24.899037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e056245c-19f1-45d4-ab0a-8fcb1191c78f req-70d33141-9104-4828-9b8e-5b639879a90b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:24.899495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e056245c-19f1-45d4-ab0a-8fcb1191c78f req-70d33141-9104-4828-9b8e-5b639879a90b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:24.953095 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e056245c-19f1-45d4-ab0a-8fcb1191c78f req-70d33141-9104-4828-9b8e-5b639879a90b service nova] Creating event network-vif-plugged:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:35:24.977645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e056245c-19f1-45d4-ab0a-8fcb1191c78f req-70d33141-9104-4828-9b8e-5b639879a90b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158848 Nov 02 21:35:24.980104 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1633/3170] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:25.005692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:25.010247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:25.030910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:25.032578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:25.033237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:25.034734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:25.035362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:25.036033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:25.636510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:25.648539 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f497c889-d959-45da-8421-8a484c5589c8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.865110 Nov 02 21:35:25.655491 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1538/3171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:24 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:25.670777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1d94d757-7000-4d0e-b134-f74e7713c271 req-2b68c981-8895-44fb-b64f-d064799e7bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3", "tag": "bd2e539d-2e74-4848-b1f8-61c861bf13c2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:25.717332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1d94d757-7000-4d0e-b134-f74e7713c271 req-2b68c981-8895-44fb-b64f-d064799e7bfc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:25.719393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1d94d757-7000-4d0e-b134-f74e7713c271 req-2b68c981-8895-44fb-b64f-d064799e7bfc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:25.721479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1d94d757-7000-4d0e-b134-f74e7713c271 req-2b68c981-8895-44fb-b64f-d064799e7bfc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:25.748900 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1d94d757-7000-4d0e-b134-f74e7713c271 req-2b68c981-8895-44fb-b64f-d064799e7bfc service nova] Creating event network-changed:bd2e539d-2e74-4848-b1f8-61c861bf13c2 for instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 on n-h1-860863-4 Nov 02 21:35:25.762786 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1d94d757-7000-4d0e-b134-f74e7713c271 req-2b68c981-8895-44fb-b64f-d064799e7bfc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101320 Nov 02 21:35:25.766144 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1539/3172] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:25.777534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:25.782945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:25.801589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:25.802571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:25.804920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:25.806177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:25.808003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:25.811224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:25.955713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:25.975498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:25.990521 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffbf0545-f147-4d4b-b436-ffe1be285ed2 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1351 microversion: 2.1 time: 1.001904 Nov 02 21:35:25.992632 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1634/3173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:24 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1351 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:26.007252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:26.010694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:26.029720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:26.030413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:26.031056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:26.032358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:26.034484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:26.035261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:26.821780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:26.840575 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e62115c-1c31-400b-8434-113a2ebe45b6 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1528 microversion: 2.1 time: 1.068286 Nov 02 21:35:26.841551 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1540/3174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:25 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1528 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:26.852554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:26.853426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:26.855205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:26.864266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38f30239-c2b4-4e41-aac8-4fd6059bc9c7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.866050 Nov 02 21:35:26.868594 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1635/3175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:25 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:26.871955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:26.871955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:26.871955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:26.874502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:26.876567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:26.877386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:26.905743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:26.906692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:26.917265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:26.929390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:26.931098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:26.932002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:26.932350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:26.932825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:27.514575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:27.532452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:27.553628 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cf76823-01a3-4ae2-a7dc-f90a2d179efc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 0.710295 Nov 02 21:35:27.555225 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1541/3176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:26 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:27.565249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:27.588655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:27.589293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:27.591889 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4a5dbe8-f206-480a-929f-5e6dc515967d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.722064 Nov 02 21:35:27.595653 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1636/3177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:26 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:27.600555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:27.601272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:27.602337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:27.603354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:27.603965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:27.604541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:27.606466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:27.607202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:27.615487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:27.616415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:27.618815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:27.623678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:27.625399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:27.625399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:27.827366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=24 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:27.954912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:27.970803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:27.971039 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03a41a5e-c500-43e2-bb68-1f5c234b19bc tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1528 microversion: 2.1 time: 0.408554 Nov 02 21:35:27.971747 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1542/3178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:27 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1528 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:27.983707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e552feba-3a93-4160-b07b-1d708d975383 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1351 microversion: 2.1 time: 0.386050 Nov 02 21:35:27.998437 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1637/3179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:27 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1351 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:28.015033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:28.015033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:28.016378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:28.017118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:28.017884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:28.018780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:28.019606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:28.020204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:28.036373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e85901bb-79c7-48d0-a693-25ddc50e7fac req-ed8ada3e-16c0-4aeb-813a-d652b7d58e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "name": "network-vif-plugged", "status": "completed", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:28.085192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e85901bb-79c7-48d0-a693-25ddc50e7fac req-ed8ada3e-16c0-4aeb-813a-d652b7d58e90 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:28.086052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e85901bb-79c7-48d0-a693-25ddc50e7fac req-ed8ada3e-16c0-4aeb-813a-d652b7d58e90 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:28.088234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e85901bb-79c7-48d0-a693-25ddc50e7fac req-ed8ada3e-16c0-4aeb-813a-d652b7d58e90 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:28.164548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e85901bb-79c7-48d0-a693-25ddc50e7fac req-ed8ada3e-16c0-4aeb-813a-d652b7d58e90 service nova] Creating event network-vif-plugged:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h1-860863-4 Nov 02 21:35:28.189817 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e85901bb-79c7-48d0-a693-25ddc50e7fac req-ed8ada3e-16c0-4aeb-813a-d652b7d58e90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183404 Nov 02 21:35:28.192162 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1543/3180] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:28.212363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-491c1d9f-0d0b-4ba6-b967-158e256c649a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:28.243468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-491c1d9f-0d0b-4ba6-b967-158e256c649a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] HTTP exception thrown: Flavor 42492445-e84b-481e-9e98-e751eaf6e39b could not be found. Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-491c1d9f-0d0b-4ba6-b967-158e256c649a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Request method failure captured: Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/flavors/42492445-e84b-481e-9e98-e751eaf6e39b HTTP/1.1 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGrAarWSQu0SNfh4lq92k3YT30VzXmN9AxGt-hmAs8ErRK1wzdl9I5K7HWvDu9epLZjYwge1ZzGNBjBas6qhifSm6eQ_Ht4qUv3yTG5AxALQFNZzklqDsL1A2pgLSdS_aTVryzc_h-qIQYFiqe-VjsxcTdy0NHJM_VUsgr1mkiUolM Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: c9da48f72e6f4a3789e4726d913b7818 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MigrationsAdminTest-2058601362 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9da48f72e6f4a3789e4726d913b7818"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9da48f72e6f4a3789e4726d913b7818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9da48f72e6f4a3789e4726d913b7818"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9da48f72e6f4a3789e4726d913b7818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MigrationsAdminTest-2058601362 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: c9da48f72e6f4a3789e4726d913b7818 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MigrationsAdminTest-2058601362 Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MigrationsAdminTest-2058601362-project-admin Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 797913cfdee748ec984de6b8b16b2d5d Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MigrationsAdminTest-2058601362-project-admin Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: exception: Flavor 42492445-e84b-481e-9e98-e751eaf6e39b could not be found. Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '42492445-e84b-481e-9e98-e751eaf6e39b'} Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42492445-e84b-481e-9e98-e751eaf6e39b could not be found. Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42492445-e84b-481e-9e98-e751eaf6e39b could not be found. Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:28.257939 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42492445-e84b-481e-9e98-e751eaf6e39b could not be found. Nov 02 21:35:28.262846 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:28.290154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-491c1d9f-0d0b-4ba6-b967-158e256c649a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Returning 404 to user: Flavor 42492445-e84b-481e-9e98-e751eaf6e39b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:28.291328 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-491c1d9f-0d0b-4ba6-b967-158e256c649a tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/42492445-e84b-481e-9e98-e751eaf6e39b" status: 404 len: 109 microversion: 2.1 time: 0.097822 Nov 02 21:35:28.292406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1544/3181] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:28 2022] DELETE /compute/v2.1/flavors/42492445-e84b-481e-9e98-e751eaf6e39b => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:28.376328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:28.388535 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f794278e-6d0f-4315-9579-6cf7b7fa44b8 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1510 microversion: 2.1 time: 0.388557 Nov 02 21:35:28.389168 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1638/3182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:27 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:28.569317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-873942810", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:28.584270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:28.585810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:28.598581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:28.600807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:28.602159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:28.603986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:28.604470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:28.605172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:29.230541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:29.242466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8289aa2-2b9d-422b-ae3f-a62b5b1082d3 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 0.666413 Nov 02 21:35:29.273817 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1639/3183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:28 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:29.281732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:29.284889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:29.297712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:29.298561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:29.299368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:29.300543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:29.301245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:29.301907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:29.439134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:35:29.999784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:30.005083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:30.016117 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db3cd6e5-36cc-44fb-a2c2-54cb0d8a83f5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.740486 Nov 02 21:35:30.021339 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1640/3184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:29 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:30.035693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:30.036560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:30.056765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:30.057299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:30.058111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:30.058457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:30.058923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:30.061226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:30.553653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:30.580963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8efb0d6-4f4c-4bde-82b9-83748c4ef560 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1351 microversion: 2.1 time: 0.558432 Nov 02 21:35:30.582461 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1641/3185] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:30 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1351 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:30.588591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:30.589478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:30.597283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:30.598060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:30.598674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:30.599708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:30.600476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:30.613763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:30.743374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:35:30.743906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:35:30.744339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:35:30.745114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:35:30.746154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:35:30.772816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:30.772816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:30.773591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:30.774411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:30.776509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:30.777076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:30.840892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:35:30.856856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Getting quotas for user 64f57cf5139c4937b8158f8d9aef011b and project e5eba8c9cfbe46c99316db189ccbe690. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:35:30.919731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:35:30.931297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:35:31.096904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:31.135369 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f003140-1851-4512-8761-e679fe12a853 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1487 microversion: 2.1 time: 0.524405 Nov 02 21:35:31.139931 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1642/3186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:30 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1487 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:31.192356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:31.194751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:31.207129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:31.209595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:31.212918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:31.215616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:31.230243 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a0fbec3-8b31-4bc8-9fb7-3eb7ea36f2de tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.666938 Nov 02 21:35:31.231320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:31.232031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:31.242900 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1545/3187] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:35:31.261909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:31.263367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:31.299180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:31.301336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:31.301981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:31.318642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:31.319911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:31.322180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:31.958707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:31.970528 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27b72120-146f-44dd-a1a1-1a3a638cd9fc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 0.815442 Nov 02 21:35:31.975094 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1643/3188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:31 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:31.980127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-966159970"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:31.998722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:32.006267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:32.006751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:32.007854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:32.008794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:32.009347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:32.009993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:32.056246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:32.067110 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-061175b9-34ce-4dab-96e5-e2e9e9d6956f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.822311 Nov 02 21:35:32.102681 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1546/3189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:31 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:32.119511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f622088-76b1-4c8c-b9c4-63e4e67eab74 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:32.123169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f622088-76b1-4c8c-b9c4-63e4e67eab74 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:32.254308 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1bae5716-a27d-468a-81b5-1de8717b59b4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "PUT /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1060 microversion: 2.1 time: 0.277788 Nov 02 21:35:32.256827 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1644/3190] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:35:31 2022] PUT /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1060 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:32.273251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:32.274888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:32.285704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:32.301126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:32.302271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:32.303341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:32.303964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:32.304593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:32.341531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4f622088-76b1-4c8c-b9c4-63e4e67eab74 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:32.374502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f622088-76b1-4c8c-b9c4-63e4e67eab74 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1212 microversion: 2.1 time: 0.265242 Nov 02 21:35:32.374502 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1547/3191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:32 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1212 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:32.397642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:32.399662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:32.440444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:32.443712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:32.443712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:32.445937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:32.448097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:32.449201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:32.917682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:32.927330 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-280db4c2-57f8-45cc-b0a9-e31db5c5e041 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1351 microversion: 2.1 time: 0.669054 Nov 02 21:35:32.932884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1645/3192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:32 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1351 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:32.944239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7283924-a374-46aa-a4bf-991c53643e24 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Action: 'create', calling method: .version_select at 0x7f9b6841cb80>, body: {"keypair": {"name": "tempest-keypair-988081662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNB0wFsCF8kluv8w5Iit00B+0ykeAFr9t9KLT4V1tHbGIV1p5RytrLdM/Lee5GqG/+Tts9EcytNWaIJixoAWY/NlcC9zA/w/9e4F7e/zDcSyISX1MSzlyc9yH/OuOF38g=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:32.989249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e7283924-a374-46aa-a4bf-991c53643e24 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Getting quotas for project cdd81c8f14274b0e80039fc545be40d2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:35:33.001826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e7283924-a374-46aa-a4bf-991c53643e24 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Getting quotas for user 3b730f0403344adea9f279c0912749e6 and project cdd81c8f14274b0e80039fc545be40d2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:35:33.003470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:33.013945 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ba24746-8189-469d-b0f1-3df5cd58b008 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1487 microversion: 2.1 time: 0.636870 Nov 02 21:35:33.016771 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1548/3193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:32 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1487 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:33.021622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ae2fa8c8-f365-442e-bcda-f368a0a17fdc req-3fbf37b5-d8de-4236-b988-663fa096f821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d", "name": "network-vif-plugged", "status": "completed", "tag": "43f1d141-5b6e-4492-bc2d-1a27d7c1b538"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:33.045941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ae2fa8c8-f365-442e-bcda-f368a0a17fdc req-3fbf37b5-d8de-4236-b988-663fa096f821 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.046360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ae2fa8c8-f365-442e-bcda-f368a0a17fdc req-3fbf37b5-d8de-4236-b988-663fa096f821 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.061425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ae2fa8c8-f365-442e-bcda-f368a0a17fdc req-3fbf37b5-d8de-4236-b988-663fa096f821 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.086213 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ae2fa8c8-f365-442e-bcda-f368a0a17fdc req-3fbf37b5-d8de-4236-b988-663fa096f821 service nova] Creating event network-vif-plugged:43f1d141-5b6e-4492-bc2d-1a27d7c1b538 for instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d on n-h2-860863-4 Nov 02 21:35:33.096788 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ae2fa8c8-f365-442e-bcda-f368a0a17fdc req-3fbf37b5-d8de-4236-b988-663fa096f821 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077084 Nov 02 21:35:33.097485 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1549/3194] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:33.104072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:33.114369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:33.114618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7283924-a374-46aa-a4bf-991c53643e24 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.179218 Nov 02 21:35:33.115488 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1646/3195] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:35:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:35:33.138428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:33.141850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:33.160067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.161537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.162553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.162953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.163089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.163548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.165245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.165631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.166244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.166370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.166930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.167771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.504594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:33.507807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-601dffb1-ccbc-48e8-b2ff-4e6196f5f0ff tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1487 microversion: 2.1 time: 0.389537 Nov 02 21:35:33.508413 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1647/3196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:33 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1487 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:33.526226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:33.527158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:33.542777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.543548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.544839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.545780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.547836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.548580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.565138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:33.577381 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8941ce61-22f5-4cb3-ace5-51ab1664ae8a tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 0.478436 Nov 02 21:35:33.577979 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1550/3197] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:33 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:33.590085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:33.597475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:33.613823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.617510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.618336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.619253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.621446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.622376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.848153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:33.860197 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61e20b8c-2bc8-4ea0-a5ee-40762befdb19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.345932 Nov 02 21:35:33.861386 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1648/3198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:33 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:33.885257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:33.888126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:33.910132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.914742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.916522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:33.918912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:33.924513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:33.925912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:34.016892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:35:34.161527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:34.182915 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-60eeeae9-f0b7-40b3-a343-ce265b9349e9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1216 microversion: 2.1 time: 0.600456 Nov 02 21:35:34.188527 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1551/3199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:33 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1216 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:34.208301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:34.210860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:34.229496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:34.230267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:34.230961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:34.232835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:34.233810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:34.234622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:34.498226 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da1c75b2-e358-47be-a973-12f3466dbfd7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 204 len: 0 microversion: 2.1 time: 0.634959 Nov 02 21:35:34.502495 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1649/3200] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:33 2022] DELETE /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:35:34.508226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:34.508956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:34.525049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:34.525560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:34.526024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:34.530568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:34.532385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:34.532904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.139823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:35.152744 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad5421c9-14c9-45a9-89c0-10332b9ef8c3 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1351 microversion: 2.1 time: 0.962358 Nov 02 21:35:35.153531 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1552/3201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:34 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1351 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:35.159975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:35.160836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:35.171173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:35.179405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:35.179405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:35.179405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.179405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:35.179405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:35.179405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.205514 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c9feef4e-45f7-4598-89c8-84d9d188cd0e tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1493 microversion: 2.1 time: 0.692832 Nov 02 21:35:35.221370 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1650/3202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:34 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1493 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:35.229407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:35.230265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:35.247138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:35.247807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:35.248275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.249019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:35.249703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:35.250391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.438308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:35.449488 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-931f07fd-f962-4a61-bd05-5341ee45be9b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 0.294146 Nov 02 21:35:35.453027 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1553/3203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:35 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:35.477368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:35.478194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:35.491653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:35.491653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:35.491653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.491653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:35.491653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:35.491653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.527785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:35.542339 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d25e1bb2-5949-40c9-a467-d68d93ce9f1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.318215 Nov 02 21:35:35.560039 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1651/3204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:35 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:35.567221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7ab52489-4051-4633-a11d-7da433184963 req-754b7902-4333-4bda-b8cd-a22e76d0ec6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3", "name": "network-vif-plugged", "status": "completed", "tag": "bd2e539d-2e74-4848-b1f8-61c861bf13c2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:35.583517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ab52489-4051-4633-a11d-7da433184963 req-754b7902-4333-4bda-b8cd-a22e76d0ec6d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:35.584586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ab52489-4051-4633-a11d-7da433184963 req-754b7902-4333-4bda-b8cd-a22e76d0ec6d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:35.586627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ab52489-4051-4633-a11d-7da433184963 req-754b7902-4333-4bda-b8cd-a22e76d0ec6d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:35.593258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:35.603173 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d98dfe66-8506-45c5-90f7-ace6dc7d6da0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1264 microversion: 2.1 time: 0.147472 Nov 02 21:35:35.604445 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1554/3205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:35 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:35.633429 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7ab52489-4051-4633-a11d-7da433184963 req-754b7902-4333-4bda-b8cd-a22e76d0ec6d service nova] Creating event network-vif-plugged:bd2e539d-2e74-4848-b1f8-61c861bf13c2 for instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 on n-h1-860863-4 Nov 02 21:35:35.638745 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7ab52489-4051-4633-a11d-7da433184963 req-754b7902-4333-4bda-b8cd-a22e76d0ec6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078158 Nov 02 21:35:35.639387 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1652/3206] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:36.177620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:36.178617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:36.197013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:36.198205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:36.199992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:36.203332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:36.204587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:36.206430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:36.235856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:36.236825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:36.241178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:36.252580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:36.255923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:36.260564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:36.261370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:36.261853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:36.265326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:36.772100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:36.786746 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54826c73-7b0a-4c0e-8f63-8d738ae0648e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1541 microversion: 2.1 time: 0.609268 Nov 02 21:35:36.787864 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1555/3207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:36 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1541 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:36.796402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:36.798013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:36.811711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:36.813508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:36.814843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:36.818168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:36.819287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:36.820359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:37.134685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:37.145159 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c45122e8-67ca-4d4c-bd09-4108acc3dde3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1493 microversion: 2.1 time: 0.914630 Nov 02 21:35:37.160860 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1653/3208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:36 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1493 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:37.170790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:37.171667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:37.179070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:37.179565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:37.180376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:37.181278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:37.182311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:37.182918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:37.411802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:37.423462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1372013-1edb-4bd0-b2ac-b4705ed552bb tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1317 microversion: 2.1 time: 0.630360 Nov 02 21:35:37.447047 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1556/3209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:36 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:37.457348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:37.457348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:37.481283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:37.481930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:37.482502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:37.483429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:37.483960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:37.486162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:37.880650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:37.893140 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-132780b9-0297-4c06-9aa9-8ca2222457d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.726578 Nov 02 21:35:37.893703 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1654/3210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:37 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:37.928670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:37.930288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:37.948328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:37.948328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:37.948695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:37.949476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:37.950465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:37.951172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:37.971995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:37.983130 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-214e9b82-75cf-46fd-a498-651c3fd05a2b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1312 microversion: 2.1 time: 0.534793 Nov 02 21:35:37.992034 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1557/3211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:37 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:38.173984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:38.174996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:38.178613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:38.204430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:38.206407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:38.208122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:38.210923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:38.214493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:38.224663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:38.426930 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9828086c-1c12-4d16-9b6e-7dd8cd122a8a tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.508054 Nov 02 21:35:38.431219 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1655/3212] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:35:37 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d/os-interface => generated 284 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:38.448515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:38.449297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:38.457865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:38.461358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:38.462870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:38.467430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:38.470988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:38.477104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:38.617534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:38.633600 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63bb176c-2865-4300-953f-b3a828b4fa95 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1451 microversion: 2.1 time: 0.461839 Nov 02 21:35:38.636356 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1558/3213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:38 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1451 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:38.647694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e4bf15d6-5116-4360-b270-1e7e54fc8684 req-55a62193-7884-448c-a56f-d105c2cc006a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016437e7-ff39-49a9-ac01-b1a1b8c369c3", "name": "network-vif-deleted", "tag": "2cc7ca0f-f800-42dc-8d56-470ebb29b069"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:38.671460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e4bf15d6-5116-4360-b270-1e7e54fc8684 req-55a62193-7884-448c-a56f-d105c2cc006a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:38.674997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e4bf15d6-5116-4360-b270-1e7e54fc8684 req-55a62193-7884-448c-a56f-d105c2cc006a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:38.675755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e4bf15d6-5116-4360-b270-1e7e54fc8684 req-55a62193-7884-448c-a56f-d105c2cc006a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:38.711664 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e4bf15d6-5116-4360-b270-1e7e54fc8684 req-55a62193-7884-448c-a56f-d105c2cc006a service nova] Creating event network-vif-deleted:2cc7ca0f-f800-42dc-8d56-470ebb29b069 for instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 on n-h1-860863-4 Nov 02 21:35:38.725710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e4bf15d6-5116-4360-b270-1e7e54fc8684 req-55a62193-7884-448c-a56f-d105c2cc006a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087689 Nov 02 21:35:38.728428 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1559/3214] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:38.920888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:38.921579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:38.933975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:38.934887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:38.937046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:38.938486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:38.940782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:38.943140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:39.152981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:39.177410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-54d70c29-47b0-448e-96b9-2d20a353113b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1507 microversion: 2.1 time: 0.728021 Nov 02 21:35:39.194449 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1656/3215] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:38 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1507 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:39.205257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:39.205257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:39.215943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:39.216450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:39.216893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:39.240113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:39.240113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:39.244444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:39.259402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:39.337297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:39.350316 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9f1289e-241a-4333-9f17-cd82136c2d12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.435732 Nov 02 21:35:39.358252 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1560/3216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:38 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:39.662874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:39.663509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:39.699782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:39.704959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:39.708541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:39.709868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:39.716020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:39.717816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:39.782928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:39.784643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:39.785323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:39.785784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lazy-loading 'fault' on Instance uuid 016437e7-ff39-49a9-ac01-b1a1b8c369c3 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:35:39.800016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:39.810387 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef3a3ea7-43f7-44e7-89f0-c14684f502a1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1312 microversion: 2.1 time: 0.609838 Nov 02 21:35:39.811641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1657/3217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:39 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1312 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:39.841344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:39.849362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9f5ee25-747c-4280-b823-ce02f30b76c3 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 200 len: 1309 microversion: 2.1 time: 0.193404 Nov 02 21:35:39.849944 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1561/3218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:39 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:40.220735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a09ea86d-d39d-4b7e-9d0c-4ddf72072e9f req-d98aacfb-b54d-4ccd-bd92-82c018018dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:40.262140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a09ea86d-d39d-4b7e-9d0c-4ddf72072e9f req-d98aacfb-b54d-4ccd-bd92-82c018018dac service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:40.262625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a09ea86d-d39d-4b7e-9d0c-4ddf72072e9f req-d98aacfb-b54d-4ccd-bd92-82c018018dac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:40.263075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a09ea86d-d39d-4b7e-9d0c-4ddf72072e9f req-d98aacfb-b54d-4ccd-bd92-82c018018dac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:40.313465 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a09ea86d-d39d-4b7e-9d0c-4ddf72072e9f req-d98aacfb-b54d-4ccd-bd92-82c018018dac service nova] Creating event network-changed:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h2-860863-4 Nov 02 21:35:40.329276 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a09ea86d-d39d-4b7e-9d0c-4ddf72072e9f req-d98aacfb-b54d-4ccd-bd92-82c018018dac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112527 Nov 02 21:35:40.329906 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1658/3219] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:40.386048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:40.386675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:40.404513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:40.412962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:40.412962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:40.412962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:40.412962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:40.412962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:40.806316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:40.836317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:40.837179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:40.845355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:40.855044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:40.858419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:40.861056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:40.863847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:40.864514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:40.953696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:40.957053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:40.970131 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3b45661-e1e4-41ae-88a8-34c12cae8bfc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.588190 Nov 02 21:35:40.970722 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1562/3220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:40 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:40.984527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:40.985513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:40.994644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:40.995394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:40.996020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:40.996904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:40.997550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:40.998163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.033685 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 HTTP/1.1 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '016437e7-ff39-49a9-ac01-b1a1b8c369c3'} Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.035756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1932d04-c267-45de-a04e-88b1b1456bcd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 404 len: 111 microversion: 2.1 time: 0.065035 Nov 02 21:35:41.046139 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1563/3221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:40 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:41.050696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-310295650", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "309e15fd-5a47-4b78-9ebf-fa9ca0d3d10e"}, {"port": "e275aa3b-1168-4e2f-b0eb-2f72e786a728", "tag": "port-1"}, {"port": "7f5961db-4af2-4b0f-a483-74c05409c407", "tag": "port-2"}, {"uuid": "306699e8-5a95-4c24-8491-7fafec305663", "tag": "net-1"}, {"uuid": "306699e8-5a95-4c24-8491-7fafec305663"}, {"uuid": "1c49adae-45f2-430a-9db8-2afbb0b01e8e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1c49adae-45f2-430a-9db8-2afbb0b01e8e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bc31e3ab-59ae-48b4-bc02-ddc5b638c721", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2a87037a-9979-4d25-993a-7252581e9b71", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "35896b08-a948-4c5a-a91b-efdc7e9be051", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1198236224"}], "key_name": "tempest-keypair-988081662", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:41.239869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:41.248801 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a94df02d-b94a-4e78-860b-1382e2cf3b47 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1312 microversion: 2.1 time: 0.417432 Nov 02 21:35:41.261914 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1659/3222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:40 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:41.282138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:41.283464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:41.303973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.319325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.324371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.331253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.335678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.339371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.365284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] validate_networks() for [('309e15fd-5a47-4b78-9ebf-fa9ca0d3d10e', None, None, None, None, None), (None, None, 'e275aa3b-1168-4e2f-b0eb-2f72e786a728', None, None, None), (None, None, '7f5961db-4af2-4b0f-a483-74c05409c407', None, None, None), ('306699e8-5a95-4c24-8491-7fafec305663', None, None, None, None, None), ('306699e8-5a95-4c24-8491-7fafec305663', None, None, None, None, None), ('1c49adae-45f2-430a-9db8-2afbb0b01e8e', '10.2.2.100', None, None, None, None), ('1c49adae-45f2-430a-9db8-2afbb0b01e8e', '10.2.2.200', None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:35:41.392650 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 HTTP/1.1 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '016437e7-ff39-49a9-ac01-b1a1b8c369c3'} Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:41.394724 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.399297 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.400713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:41.403166 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-18fcfd32-33cd-4460-aba8-cfa30f5ef078 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 404 len: 111 microversion: 2.1 time: 0.139645 Nov 02 21:35:41.403965 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1660/3223] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:41 2022] DELETE /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:41.415231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:41.416419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 016437e7-ff39-49a9-ac01-b1a1b8c369c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:41.436037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.436886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.440249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.444484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.444484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.444484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.480575 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 HTTP/1.1 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '016437e7-ff39-49a9-ac01-b1a1b8c369c3'} Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.482197 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 016437e7-ff39-49a9-ac01-b1a1b8c369c3 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:41.488974 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d3bd050-dd4c-483b-872b-8de3ada02548 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3" status: 404 len: 111 microversion: 2.1 time: 0.075012 Nov 02 21:35:41.495569 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1661/3224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:41 2022] GET /compute/v2.1/servers/016437e7-ff39-49a9-ac01-b1a1b8c369c3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:41.501249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:41.511820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:41.523394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.524700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.526752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.527712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.528899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.529947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.565737 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 HTTP/1.1 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '74205bc1-a1c3-46a3-97fe-1b9e0f6160f7'} Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:41.567670 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.575564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:41.579424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f7bda0b-6687-4bd8-af2f-10b376e34b6c tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 404 len: 111 microversion: 2.1 time: 0.080670 Nov 02 21:35:41.583344 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1662/3225] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:41 2022] DELETE /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:41.595785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:41.596666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:41.611270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.616299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.617108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.618020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.618640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.619454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.653396 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 HTTP/1.1 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '74205bc1-a1c3-46a3-97fe-1b9e0f6160f7'} Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.661702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.666782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.666782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.666782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.666782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:41.666782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:41.666782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. Nov 02 21:35:41.666782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.669022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:41.670269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cee601c6-5ec4-43d0-b747-ab216b7c5985 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7" status: 404 len: 111 microversion: 2.1 time: 0.085695 Nov 02 21:35:41.670997 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1663/3226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:41 2022] GET /compute/v2.1/servers/74205bc1-a1c3-46a3-97fe-1b9e0f6160f7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:41.691651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:41.692539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:41.703569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.704296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.704898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.706996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.711025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.711662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.741713 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 HTTP/1.1 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '0b8104e5-2beb-4d11-9b34-c0930a7a6dc7'} Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:41.743513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.748019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.756582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:41.758862 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ced599b-18d8-469e-9baf-88cd6cdcbfc0 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 404 len: 111 microversion: 2.1 time: 0.083560 Nov 02 21:35:41.760296 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1664/3227] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:41 2022] DELETE /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:35:41.774152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:41.776055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:41.803992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.811284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.814106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.818194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.836227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.836804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.903504 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 HTTP/1.1 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '0b8104e5-2beb-4d11-9b34-c0930a7a6dc7'} Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:41.905158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:41.916292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a98d3dcf-aff2-4ff1-b436-87f7cef753bd tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7" status: 404 len: 111 microversion: 2.1 time: 0.136810 Nov 02 21:35:41.920514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1665/3228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:41 2022] GET /compute/v2.1/servers/0b8104e5-2beb-4d11-9b34-c0930a7a6dc7 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:41.937655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:41.938163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:41.965814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.966323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.972273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:41.973222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:41.973711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:41.996065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea HTTP/1.1 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '39bba200-8b07-48b4-a149-bb6a88f224ea'} Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:42.090639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddbb76ae-6f77-46cd-b129-585eb47d6eb7 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 404 len: 111 microversion: 2.1 time: 0.147451 Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1666/3229] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:41 2022] DELETE /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:42.096623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:42.119934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:42.121529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:42.125980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:42.127088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:42.127914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:42.128608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:42.365607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:42.829039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:42.849390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58745cab-63c3-4eac-a1a3-8504ffdfe9e6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.770961 Nov 02 21:35:42.871738 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1667/3230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:42 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:42.871738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:42.871738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 39bba200-8b07-48b4-a149-bb6a88f224ea] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:42.909076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:42.919350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:42.919959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:42.929311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:42.930050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:42.930519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:42.999047 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea HTTP/1.1 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '39bba200-8b07-48b4-a149-bb6a88f224ea'} Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.002357 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.007164 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.007164 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.007164 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.007164 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:43.007164 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:43.007164 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. Nov 02 21:35:43.007164 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.022025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 39bba200-8b07-48b4-a149-bb6a88f224ea could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:43.029570 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d49d78c-0bb1-4d15-b0bc-94d978dc64c4 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea" status: 404 len: 111 microversion: 2.1 time: 0.163488 Nov 02 21:35:43.042735 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1668/3231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:42 2022] GET /compute/v2.1/servers/39bba200-8b07-48b4-a149-bb6a88f224ea => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:43.053267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:43.054186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:43.063494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:43.073407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.073904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.074354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.075124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.075581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.076179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.438671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:43.452012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2e85c1f-5579-408e-991f-2ec530984c7c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1312 microversion: 2.1 time: 0.415248 Nov 02 21:35:43.456131 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1669/3232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:43 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:43.482698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-239ab206-3072-4641-9a36-05c9848ffa49 req-242a5c88-44a7-4c9e-9d3d-75062deafd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d", "tag": "43f1d141-5b6e-4492-bc2d-1a27d7c1b538"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:43.513157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-239ab206-3072-4641-9a36-05c9848ffa49 req-242a5c88-44a7-4c9e-9d3d-75062deafd5e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.513937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-239ab206-3072-4641-9a36-05c9848ffa49 req-242a5c88-44a7-4c9e-9d3d-75062deafd5e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.514583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-239ab206-3072-4641-9a36-05c9848ffa49 req-242a5c88-44a7-4c9e-9d3d-75062deafd5e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.537914 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-239ab206-3072-4641-9a36-05c9848ffa49 req-242a5c88-44a7-4c9e-9d3d-75062deafd5e service nova] Creating event network-changed:43f1d141-5b6e-4492-bc2d-1a27d7c1b538 for instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d on n-h2-860863-4 Nov 02 21:35:43.545923 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-239ab206-3072-4641-9a36-05c9848ffa49 req-242a5c88-44a7-4c9e-9d3d-75062deafd5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072220 Nov 02 21:35:43.548996 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1670/3233] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:43.570146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:43.570968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:43.604437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.604958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.608035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.608778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.609421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.610046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.634376 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d HTTP/1.1 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'b0a10092-9128-4919-802d-47d26426773d'} Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:43.658890 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.663678 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.677006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:43.679831 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28a4b5f2-daea-45b8-972a-d1c7d4cfe446 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 404 len: 111 microversion: 2.1 time: 0.129517 Nov 02 21:35:43.681656 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1671/3234] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:43 2022] DELETE /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:43.693931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:43.701582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: b0a10092-9128-4919-802d-47d26426773d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:43.728358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.732135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.732887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.734184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.736823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.737524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.758282 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d HTTP/1.1 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'b0a10092-9128-4919-802d-47d26426773d'} Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.760131 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.764847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.764847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.764847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.764847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:43.764847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:43.764847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. Nov 02 21:35:43.764847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.767037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance b0a10092-9128-4919-802d-47d26426773d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:43.768096 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a7f4cec-918a-4b60-b078-ce0e48a7c81d tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d" status: 404 len: 111 microversion: 2.1 time: 0.083589 Nov 02 21:35:43.769192 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1672/3235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:43 2022] GET /compute/v2.1/servers/b0a10092-9128-4919-802d-47d26426773d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:43.790761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:43.791456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:43.800740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.801457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.802064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.802940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.803584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.804174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.839653 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c HTTP/1.1 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7e400a75-8726-4f78-a1f1-4e2c15183f2c'} Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:43.842766 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.850038 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.857571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:43.858796 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d9a88843-8b55-4812-9c82-d03e09f4e64a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 404 len: 111 microversion: 2.1 time: 0.077457 Nov 02 21:35:43.860848 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1673/3236] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:43 2022] DELETE /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:43.884153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:43.885098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 7e400a75-8726-4f78-a1f1-4e2c15183f2c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:43.897501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.901212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.901897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.902817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.903626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.904625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.956957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c HTTP/1.1 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7e400a75-8726-4f78-a1f1-4e2c15183f2c'} Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:43.958848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.962788 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:43.962788 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:43.962788 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:43.962788 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:43.962788 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:43.962788 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. Nov 02 21:35:43.962788 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:43.968304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 7e400a75-8726-4f78-a1f1-4e2c15183f2c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:43.973702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76d302ad-339d-4bae-8c71-16a4fd1a003b tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c" status: 404 len: 111 microversion: 2.1 time: 0.094295 Nov 02 21:35:43.976900 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1674/3237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:43 2022] GET /compute/v2.1/servers/7e400a75-8726-4f78-a1f1-4e2c15183f2c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:35:43.984357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:43.986000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:43.996763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:43.997824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:43.998684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:43.999680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:44.001308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:44.002047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:44.958608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:44.970075 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce72d958-46f1-4580-8194-23862f589169 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.991771 Nov 02 21:35:44.972922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1675/3238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:43 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:44.988842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-960b4eef-6b13-4917-a558-2e2ba793e963 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:44.989864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-960b4eef-6b13-4917-a558-2e2ba793e963 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: aff5f2b8-21b9-4190-99dc-ce1881b75760] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:45.010915 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-960b4eef-6b13-4917-a558-2e2ba793e963 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-960b4eef-6b13-4917-a558-2e2ba793e963 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760 HTTP/1.1 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'aff5f2b8-21b9-4190-99dc-ce1881b75760'} Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:45.011216 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.016649 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.016649 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:45.016649 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:45.016649 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:45.016649 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:45.016649 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.016649 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.017890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-960b4eef-6b13-4917-a558-2e2ba793e963 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:45.022747 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-960b4eef-6b13-4917-a558-2e2ba793e963 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760" status: 404 len: 111 microversion: 2.1 time: 0.046767 Nov 02 21:35:45.023848 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1676/3239] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:44 2022] DELETE /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:45.031977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8c8301bf-060a-4a86-a760-e3d963b86823"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:45.038993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:45.045255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:45.045996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:45.047132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:45.048590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:45.049605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:45.050255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:45.116261 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] HTTP exception thrown: Volume 8ce6d343-2977-44d6-b0ef-74fe35e13b5f could not be found. Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Request method failure captured: Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3/os-volume_attachments/8ce6d343-2977-44d6-b0ef-74fe35e13b5f HTTP/1.1 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 74 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuI1JJSAnrYZZHBkFc9dk8cu33E2hZVb0wQT6nCS1uQ6B0N0XLC0Oro51Jz7C8hOwLI24X382eJQnvHO7rZKxakHxHZEiLVpEXqYsfK1VAM8TNxemzk1dRp6L9VGgcgiAgxsKXMja98CugPCP6XsfZa_NHfledWFUVmsoat2-fgae3A Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c98b941f9f9946f28724980270127053 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesAdminNegativeTest-703044090 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c98b941f9f9946f28724980270127053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98b941f9f9946f28724980270127053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c98b941f9f9946f28724980270127053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c98b941f9f9946f28724980270127053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesAdminNegativeTest-703044090 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c98b941f9f9946f28724980270127053 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-703044090 Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesAdminNegativeTest-703044090-project-admin Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 61e49f672a6e40ce8a01b49d139c917b Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesAdminNegativeTest-703044090-project-admin Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: {"volumeAttachment": {"volumeId": "8c8301bf-060a-4a86-a760-e3d963b86823"}} Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: exception: Volume 8ce6d343-2977-44d6-b0ef-74fe35e13b5f could not be found. Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': '4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3', 'id': '8ce6d343-2977-44d6-b0ef-74fe35e13b5f', 'body': {'volumeAttachment': {'volumeId': '8c8301bf-060a-4a86-a760-e3d963b86823'}}} Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ce6d343-2977-44d6-b0ef-74fe35e13b5f could not be found. (HTTP 404) (Request-ID: req-4ce5e117-b98f-4d80-ab72-50abbdd37efd) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:35:45.127171 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ce6d343-2977-44d6-b0ef-74fe35e13b5f could not be found. Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ce6d343-2977-44d6-b0ef-74fe35e13b5f could not be found. Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ce6d343-2977-44d6-b0ef-74fe35e13b5f could not be found. Nov 02 21:35:45.131791 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.148730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] Returning 404 to user: Volume 8ce6d343-2977-44d6-b0ef-74fe35e13b5f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:45.165724 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-383edcff-d5e9-4a27-bf26-377f52f6597b tempest-VolumesAdminNegativeTest-703044090 tempest-VolumesAdminNegativeTest-703044090-project-admin] 10.222.0.25 "PUT /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3/os-volume_attachments/8ce6d343-2977-44d6-b0ef-74fe35e13b5f" status: 404 len: 109 microversion: 2.1 time: 0.124734 Nov 02 21:35:45.171062 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1677/3240] 10.222.0.25 () {60 vars in 1433 bytes} [Wed Nov 2 21:35:45 2022] PUT /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3/os-volume_attachments/8ce6d343-2977-44d6-b0ef-74fe35e13b5f => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:45.173161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:45.176702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:45.191204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:45.191731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:45.192175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:45.195387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:45.195862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:45.196304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:45.441283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:45.459417 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8e2ecd1-2b48-4feb-8ab7-6b16409aff56 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1312 microversion: 2.1 time: 0.288402 Nov 02 21:35:45.470086 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1678/3241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:45 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1312 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:45.479685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1d2cca9-576f-46df-8bcd-2eec0254fa4a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:45.485195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1d2cca9-576f-46df-8bcd-2eec0254fa4a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: aff5f2b8-21b9-4190-99dc-ce1881b75760] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:45.502961 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b1d2cca9-576f-46df-8bcd-2eec0254fa4a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1d2cca9-576f-46df-8bcd-2eec0254fa4a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760 HTTP/1.1 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'aff5f2b8-21b9-4190-99dc-ce1881b75760'} Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:45.505324 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1d2cca9-576f-46df-8bcd-2eec0254fa4a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance aff5f2b8-21b9-4190-99dc-ce1881b75760 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1d2cca9-576f-46df-8bcd-2eec0254fa4a tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760" status: 404 len: 111 microversion: 2.1 time: 0.048027 Nov 02 21:35:45.511867 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1679/3242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:45 2022] GET /compute/v2.1/servers/aff5f2b8-21b9-4190-99dc-ce1881b75760 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:45.520847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:45.529467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:45.551433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:45.551931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:45.556774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:45.557721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:45.558380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:45.560258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:45.640210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:35:46.167810 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51147cd6-8ed5-460f-9713-4e30a0f95436 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 204 len: 0 microversion: 2.1 time: 0.652991 Nov 02 21:35:46.168765 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1680/3243] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:45 2022] DELETE /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:35:46.176093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:46.178094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:46.196044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:46.196551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:46.199287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:46.200041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:46.200562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:46.200972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:46.498648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:46.512017 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c905532-1b92-4dca-89a7-6989ffa6d3b9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.341273 Nov 02 21:35:46.513017 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1681/3244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:46 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:46.533087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:46.533721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:46.547849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:46.549439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:46.549896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:46.554152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:46.554700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:46.555144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:46.985075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:46.996975 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b1df2dd-8ea4-4510-aa59-2e440dba10db tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1480 microversion: 2.1 time: 0.480185 Nov 02 21:35:46.999223 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1682/3245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:46 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1480 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:47.053792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-691db9e5-4c5d-4ce4-b849-8c72768d5805 req-bc46069d-3ab3-4061-ab7d-bdad7f885f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "name": "network-vif-plugged", "status": "completed", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:47.155771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-691db9e5-4c5d-4ce4-b849-8c72768d5805 req-bc46069d-3ab3-4061-ab7d-bdad7f885f2f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:47.156376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-691db9e5-4c5d-4ce4-b849-8c72768d5805 req-bc46069d-3ab3-4061-ab7d-bdad7f885f2f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:47.156903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-691db9e5-4c5d-4ce4-b849-8c72768d5805 req-bc46069d-3ab3-4061-ab7d-bdad7f885f2f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:47.174085 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-691db9e5-4c5d-4ce4-b849-8c72768d5805 req-bc46069d-3ab3-4061-ab7d-bdad7f885f2f service nova] Creating event network-vif-plugged:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h2-860863-4 Nov 02 21:35:47.183648 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-691db9e5-4c5d-4ce4-b849-8c72768d5805 req-bc46069d-3ab3-4061-ab7d-bdad7f885f2f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183146 Nov 02 21:35:47.184494 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1683/3246] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:47.191448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:47.192374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:47.199539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:47.200319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:47.200952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:47.201867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:47.202494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:47.203863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:47.223714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f445ff3-09bd-4654-b45d-00d993710033 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1312 microversion: 2.1 time: 0.388872 Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1684/3247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:47 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:47.708442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:47.789014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:47.811017 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a612da2-546d-4a88-8cee-e4adbf7e9e91 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.232679 Nov 02 21:35:47.811017 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1685/3248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:47 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:48.033233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:48.034814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:48.086739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:48.089638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:48.090569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:48.092249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:48.103354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:48.104190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:48.264378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:35:48.266781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:35:48.267505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:35:48.268043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:35:48.268583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:35:48.295348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:48.296254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:48.299561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:48.300550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:48.301576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:48.305512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:48.371928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Getting quotas for project cdd81c8f14274b0e80039fc545be40d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:35:48.386856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Getting quotas for user 3b730f0403344adea9f279c0912749e6 and project cdd81c8f14274b0e80039fc545be40d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:35:48.604498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:48.628484 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a1796fc0-d7e8-4ac0-b58c-f0b5dab6f703 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1480 microversion: 2.1 time: 0.601955 Nov 02 21:35:48.633262 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1686/3249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:48 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1480 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:48.739556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:48.740557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:48.749132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:48.749665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:48.763166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:35:48.773721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bc31e3ab-59ae-48b4-bc02-ddc5b638c721',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2a87037a-9979-4d25-993a-7252581e9b71',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35896b08-a948-4c5a-a91b-efdc7e9be051',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:35:48.780190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:48.780190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:48.780190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:48.782673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:49.130128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:49.147966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e0d38ef-078c-4490-bd42-bbdca192f9ed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1462 microversion: 2.1 time: 0.419467 Nov 02 21:35:49.148824 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1687/3250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:48 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1462 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:49.164921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:49.165948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:49.174120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:49.174691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:49.175281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:49.176061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:49.176582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:49.177133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:49.331476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:49.340078 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20b88b0a-058a-49b1-86e0-c32d22211a9e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1681 microversion: 2.1 time: 0.189816 Nov 02 21:35:49.340875 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1688/3251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:49 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:49.359932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:49.359932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:49.363941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:49.364439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:49.365047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:49.365765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:49.366220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:49.366651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:49.535528 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6b70511-7043-4b46-940c-936f3b98b5d9 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1613 microversion: 2.1 time: 0.183424 Nov 02 21:35:49.536446 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1689/3252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:49 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1613 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:49.560913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:49.561958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:49.574060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:49.574966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:49.575659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:49.580939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:49.613942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:49.614653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:49.854195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '797913cfdee748ec984de6b8b16b2d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9da48f72e6f4a3789e4726d913b7818', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:49.854956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] flavor_id is None. Assuming migration. {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 21:35:49.855470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 21:35:50.402401 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53b4715f-5a08-446c-8c2c-6970ea370759 tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.847298 Nov 02 21:35:50.403029 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1690/3253] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:35:49 2022] POST /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:35:50.415582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-727d2563-596b-46b2-bf4f-fb61ed5c8e37 req-4300571b-b1b5-4f72-8bf2-7d7e15f03c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52c05f-47cb-4f31-ba15-8925b5d357a8", "name": "network-vif-deleted", "tag": "ee8ea9d5-2781-435f-8035-a1efad0ea968"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:50.433056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-727d2563-596b-46b2-bf4f-fb61ed5c8e37 req-4300571b-b1b5-4f72-8bf2-7d7e15f03c7e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.433733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-727d2563-596b-46b2-bf4f-fb61ed5c8e37 req-4300571b-b1b5-4f72-8bf2-7d7e15f03c7e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.434330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-727d2563-596b-46b2-bf4f-fb61ed5c8e37 req-4300571b-b1b5-4f72-8bf2-7d7e15f03c7e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.446150 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-727d2563-596b-46b2-bf4f-fb61ed5c8e37 req-4300571b-b1b5-4f72-8bf2-7d7e15f03c7e service nova] Creating event network-vif-deleted:ee8ea9d5-2781-435f-8035-a1efad0ea968 for instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 on n-h2-860863-4 Nov 02 21:35:50.452246 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-727d2563-596b-46b2-bf4f-fb61ed5c8e37 req-4300571b-b1b5-4f72-8bf2-7d7e15f03c7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047896 Nov 02 21:35:50.454073 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1691/3254] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:50.462145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:50.463154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:50.472196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.472795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.473446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.474257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.474817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.475398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.526471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.527184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.527903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.528574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lazy-loading 'fault' on Instance uuid 1d52c05f-47cb-4f31-ba15-8925b5d357a8 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:35:50.538223 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-af5e546f-e45c-43aa-ae33-1e3a5d9ac257 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 9.498950 Nov 02 21:35:50.539907 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1564/3255] 10.222.0.25 () {62 vars in 1189 bytes} [Wed Nov 2 21:35:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 9501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:35:50.544734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:50.545695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:50.553639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.554392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.555055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.556496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.557206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.557858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.617718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:35:50.622228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac55f39aebb4cf2b169157a45a2e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35e2aeb94534e21afbdf440429f44de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:50.667466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af370bb0-5223-4e54-9ca3-edcfa072a006 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 200 len: 1283 microversion: 2.1 time: 0.211778 Nov 02 21:35:50.668063 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1692/3256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:50 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:50.688777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:50.691134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:50.704396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.705702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.706373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.719773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:50.720653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:50.722040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:50.985640 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb51e827-3bfb-47ed-8f2d-c07434e90587 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 204 len: 0 microversion: 2.1 time: 0.443040 Nov 02 21:35:50.987785 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1565/3257] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:35:50 2022] DELETE /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:35:50.994346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:51.003633 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c623ce84-7144-47d9-bcac-9956dd61b9fd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.328782 Nov 02 21:35:51.005989 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1693/3258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:50 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:51.011362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91dfffab-6e6f-4827-ad4e-93491ed9a8ff tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:51.011987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-91dfffab-6e6f-4827-ad4e-93491ed9a8ff tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:51.013315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:51.014088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:51.043926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:51.048457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:51.052037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:51.054067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:51.054828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:51.055552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:51.108185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-91dfffab-6e6f-4827-ad4e-93491ed9a8ff tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:51.122603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-91dfffab-6e6f-4827-ad4e-93491ed9a8ff tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:51.131034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-91dfffab-6e6f-4827-ad4e-93491ed9a8ff tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:51.137357 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-91dfffab-6e6f-4827-ad4e-93491ed9a8ff tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1284 microversion: 2.32 time: 0.127517 Nov 02 21:35:51.139964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1694/3259] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:35:51 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:35:51.149826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:51.151855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:51.171618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:51.172136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:51.172952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:51.176704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:51.177426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:51.179672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:51.448733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:51.462393 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7a8588bb-9bea-4dae-b61b-221d3516cd63 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1471 microversion: 2.1 time: 0.472242 Nov 02 21:35:51.462761 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1566/3260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:50 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1471 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:51.552508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:51.560702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d30e2def-64aa-4ace-9e1d-64c7bff7c727 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1513 microversion: 2.1 time: 0.418733 Nov 02 21:35:51.561307 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1695/3261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:51 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1513 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:51.694388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:51.695019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] [instance: 1d52c05f-47cb-4f31-ba15-8925b5d357a8] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:51.701063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:51.701786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:51.702236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:51.702979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:51.703694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:51.704062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:51.719033 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] HTTP exception thrown: Instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 could not be found. Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Request method failure captured: Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 HTTP/1.1 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGT5Z4Vc5hiFrJ5PNp-MVm1z_6OFGBynaydWD7VrHI838QIii30o7eEpc7xzSmn2f8bbXYoc5wM3c3_AGKOgjs3N_PgQuxB8nU2nEEjPzPxaC6f_G5ivlzS4t26TkKpqHmlnh3SOiyMNvKdjElEg9BkqXccBbtaiB2carRtNcbX6AQ Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e35e2aeb94534e21afbdf440429f44de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestJSON-1876137422 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e35e2aeb94534e21afbdf440429f44de Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestJSON-1876137422 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 9ac55f39aebb4cf2b169157a45a2e134 Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestJSON-1876137422-project Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 could not be found. Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '1d52c05f-47cb-4f31-ba15-8925b5d357a8'} Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 could not be found. Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 could not be found. Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:51.722911 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 could not be found. Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] Returning 404 to user: Instance 1d52c05f-47cb-4f31-ba15-8925b5d357a8 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:51.729710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-394cd646-3a93-4a01-ad11-5aa7506b1d66 tempest-ServersTestJSON-1876137422 tempest-ServersTestJSON-1876137422-project] 10.222.0.25 "GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8" status: 404 len: 111 microversion: 2.1 time: 0.031832 Nov 02 21:35:51.733932 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1567/3262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:51 2022] GET /compute/v2.1/servers/1d52c05f-47cb-4f31-ba15-8925b5d357a8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:52.170124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47568697-bb82-451a-8066-4cb351ba0708 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:52.172239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47568697-bb82-451a-8066-4cb351ba0708 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:52.181489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:52.284744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47568697-bb82-451a-8066-4cb351ba0708 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:52.294373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47568697-bb82-451a-8066-4cb351ba0708 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:52.296171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47568697-bb82-451a-8066-4cb351ba0708 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:52.297886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47568697-bb82-451a-8066-4cb351ba0708 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1284 microversion: 2.32 time: 0.132829 Nov 02 21:35:52.300475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1696/3263] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:35:52 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:35:52.488894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:52.489554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:52.499563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:52.499563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:52.499563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:52.499962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:52.500275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:52.500884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:52.593857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:52.594970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:52.606121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:52.606911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:52.607675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:52.608667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:52.609960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:52.610822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:53.330092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:53.341120 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8668e97c-34c1-4704-afc6-beb6bbdbaeb1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1471 microversion: 2.1 time: 0.855938 Nov 02 21:35:53.346099 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1568/3264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:52 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1471 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:53.356746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:53.357633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:53.373601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:53.390055 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bb65d8b-bdc6-48ed-842c-f9a112408ce0 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1513 microversion: 2.1 time: 0.809391 Nov 02 21:35:53.394063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:53.394217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1697/3265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:52 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1513 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:53.394308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:53.395633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:53.407986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:53.409143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:53.412707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:53.416073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:53.416219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:53.416549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:53.416666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:53.417090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:53.417803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:53.418265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:53.418830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:53.570457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:53.583635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:53.588578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:53.590052 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4458fc44-3636-4808-bd26-8c1e24ff029c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1526 microversion: 2.32 time: 0.198192 Nov 02 21:35:53.592355 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1698/3266] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:35:53 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1526 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:35:53.668632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-26f103bb-a4b2-44cf-9042-778bb314f509 req-f82a1c95-6683-41ef-8133-124ea7c00b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-unplugged", "status": "completed", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:53.687691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-26f103bb-a4b2-44cf-9042-778bb314f509 req-f82a1c95-6683-41ef-8133-124ea7c00b59 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:53.688452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-26f103bb-a4b2-44cf-9042-778bb314f509 req-f82a1c95-6683-41ef-8133-124ea7c00b59 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:53.688602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-26f103bb-a4b2-44cf-9042-778bb314f509 req-f82a1c95-6683-41ef-8133-124ea7c00b59 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:53.718275 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-26f103bb-a4b2-44cf-9042-778bb314f509 req-f82a1c95-6683-41ef-8133-124ea7c00b59 service nova] Creating event network-vif-unplugged:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:35:53.726584 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-26f103bb-a4b2-44cf-9042-778bb314f509 req-f82a1c95-6683-41ef-8133-124ea7c00b59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061220 Nov 02 21:35:53.727883 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1699/3267] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:35:53.875273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:53.883960 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ab4375c-62c1-4b92-90ab-b696d27f5bb7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.535372 Nov 02 21:35:53.884564 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1569/3268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:53 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:54.369050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:54.369773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:54.402012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:54.402593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:54.403053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:54.403786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:54.404248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:54.404678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:54.418250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:54.419299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:54.430059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:54.430751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:54.434788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:54.440744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:54.446363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:54.447151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:54.738972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:54.765801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0385e187-4562-413e-9620-e26ad0ae9c04 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1471 microversion: 2.1 time: 0.346831 Nov 02 21:35:54.765801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1570/3269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:54 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1471 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:54.771381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:54.772294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:54.781027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:54.782100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:54.792216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:54.793351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:54.794228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:54.794890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:54.909106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:54.923756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:54.933123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:54.938147 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3cd9b23b-0ed5-42af-8db8-225628611d4c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1574 microversion: 2.32 time: 0.171140 Nov 02 21:35:54.938147 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1571/3270] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:35:54 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:35:54.940974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-50b4f13b-b755-485e-8b5c-3ad48fee1e4e req-ecaf6215-462c-4a7a-a4d0-27a25090b4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3", "name": "network-vif-deleted", "tag": "bd2e539d-2e74-4848-b1f8-61c861bf13c2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:54.977153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-50b4f13b-b755-485e-8b5c-3ad48fee1e4e req-ecaf6215-462c-4a7a-a4d0-27a25090b4e8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:54.977670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-50b4f13b-b755-485e-8b5c-3ad48fee1e4e req-ecaf6215-462c-4a7a-a4d0-27a25090b4e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:54.978078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-50b4f13b-b755-485e-8b5c-3ad48fee1e4e req-ecaf6215-462c-4a7a-a4d0-27a25090b4e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:54.990073 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-50b4f13b-b755-485e-8b5c-3ad48fee1e4e req-ecaf6215-462c-4a7a-a4d0-27a25090b4e8 service nova] Creating event network-vif-deleted:bd2e539d-2e74-4848-b1f8-61c861bf13c2 for instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 on n-h1-860863-4 Nov 02 21:35:54.995522 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-50b4f13b-b755-485e-8b5c-3ad48fee1e4e req-ecaf6215-462c-4a7a-a4d0-27a25090b4e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059087 Nov 02 21:35:54.996384 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1572/3271] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:35:55.034846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:55.043837 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e7e51a9-9753-4fcc-9a27-a13060a773c3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1471 microversion: 2.1 time: 0.679251 Nov 02 21:35:55.044705 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1700/3272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:54 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1471 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:55.787362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:55.788063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:55.801739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:55.802294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:55.802745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:55.803474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:55.803930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:55.804357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:55.866341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:55.866832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:55.867268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:55.867728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lazy-loading 'fault' on Instance uuid 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:35:55.969489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:55.970058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:55.988422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:55.988917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:55.989407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:55.990193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:55.991284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:55.991985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:56.033955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:56.056029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-68085ce2-7ece-49c8-898d-e4c75511ff3c tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 200 len: 1307 microversion: 2.1 time: 0.273600 Nov 02 21:35:56.056635 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1573/3273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:55 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:56.070020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:56.071019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:56.083197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:56.084264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:56.101665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:56.103488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:56.104319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:56.105075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:56.328514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:56.349326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:56.351118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:56.352529 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-18e7264e-e42c-4490-b5e3-4092dd692861 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1582 microversion: 2.32 time: 0.396313 Nov 02 21:35:56.369814 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1701/3274] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:35:55 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1582 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:35:56.623226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:56.650432 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a180ce75-a82a-4bb0-8df1-ee74f1fbf6f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.584512 Nov 02 21:35:56.669691 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1574/3275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:56 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:57.084457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:57.085666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:57.109861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.109861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.109861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.110366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.111080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.112416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.174477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] HTTP exception thrown: Instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 could not be found. Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Request method failure captured: Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 HTTP/1.1 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuIokJf1X-_WTh8aGsBwOrC4mCdQHCd-ivo6a54dBa_Lgx2w4IoacrH7UpzPCPvLIMQsy82lFNsPW_v5dQMpZfUqmHoRrmPr-lKLGYrjRSYh3mZQCCSSJXJQj5GlhKKUDfB0IkiKbFOSZkcgPm2segc36_AioH_4vOqg9lHcjWi51Wk Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c78a3b929e4f4f2db5f46332df6f7975 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesAdminNegativeTest-1354388358 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesAdminNegativeTest-1354388358 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c78a3b929e4f4f2db5f46332df6f7975 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1354388358 Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesAdminNegativeTest-1354388358-project Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e1245c484e8d45e28600c4c1420df3fa Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesAdminNegativeTest-1354388358-project Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 could not be found. Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3'} Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 could not be found. Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 could not be found. Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:35:57.178310 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:57.183307 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:35:57.183307 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:35:57.183307 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:35:57.183307 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:35:57.183307 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:35:57.183307 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 could not be found. Nov 02 21:35:57.183307 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:35:57.188773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Returning 404 to user: Instance 4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:35:57.189944 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29493603-bbdb-47de-854b-fd7b3ebe755b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3" status: 404 len: 111 microversion: 2.1 time: 0.109534 Nov 02 21:35:57.193049 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1702/3276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:57 2022] GET /compute/v2.1/servers/4cfc44da-7540-4178-9bfd-0d5cbb4aa8c3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:35:57.277826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:57.281542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:57.292024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.293965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.295629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.301764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.302628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.303451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.383203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:57.384463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:57.398434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.400359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.401833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.404078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.405321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.408406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.421047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:57.585443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:57.603326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:57.608448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:57.614618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35be92c9-ff3d-4b38-abba-d0ffb1d5ba0d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1592 microversion: 2.32 time: 0.235456 Nov 02 21:35:57.635554 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1703/3277] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:35:57 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1592 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:35:57.645981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:57.658188 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81f64d3c-c76a-43be-be29-729f68894236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.383119 Nov 02 21:35:57.659781 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1575/3278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:57 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:57.695224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:57.695874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:57.704520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.704813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:57.707723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.707723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.707970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:57.708070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.708070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.708070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.722542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.723129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.723535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:57.730278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:57.738517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:57.738517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:58.086524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:58.087274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:58.110664 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0f13fd00-5645-43ad-ab7b-b25c1ee262c6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.419137 Nov 02 21:35:58.111607 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1576/3279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:57 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:58.138544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:58.139774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:58.143035 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc871901-54f7-47ac-9458-55e87a9e6014 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.432712 Nov 02 21:35:58.143715 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1704/3280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:57 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:35:58.162422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:58.162949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:58.165297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:58.168197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:58.170079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:58.170611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:58.337080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:58.410919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:35:58.507816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:58.525387 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61e84a52-7572-464a-ad6e-17206fbeed00 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.390804 Nov 02 21:35:58.531690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1577/3281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:58 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:35:58.558383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:35:58.560645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:58.578896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:58.583648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:58.583648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:58.583648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:58.583648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:58.583648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:58.651699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:58.652344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:58.665193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:58.665874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:58.669633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:58.670378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:58.670901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:58.671384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:58.952445 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31f8b5c2-2ba4-4f1e-8a62-5e0d2813742b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.398344 Nov 02 21:35:58.953915 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1705/3282] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:35:58 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:35:58.984038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:58.985549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:59.003165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:59.004114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:59.005113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:59.006449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:59.007157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:59.008159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:59.061473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:59.073280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:59.075506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:59.076714 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d7cdb93b-22cd-4cb0-9286-a67200e77d98 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1660 microversion: 2.32 time: 0.430562 Nov 02 21:35:59.077366 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1578/3283] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:35:58 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1660 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:35:59.170389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:35:59.171018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:35:59.193029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:59.193029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:59.193029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:59.193392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:35:59.193855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:35:59.194285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:35:59.696321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:35:59.707050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-117978db-2c9f-4d0f-813c-c1956a566854 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1670 microversion: 2.1 time: 0.748071 Nov 02 21:35:59.713471 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1706/3284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:58 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1670 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:00.004343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:00.016710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1c47df18-b58d-4824-b7d9-8b0c73da578d tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.848766 Nov 02 21:36:00.017391 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1579/3285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:35:59 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:00.061473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Calling method '.version_select at 0x7f9b697eb940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:00.063547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:00.064191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:00.065377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:00.111147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:00.111856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:00.123938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:00.124516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:00.125782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:00.128563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:00.129292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:00.129413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:00.129921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:00.130371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:00.131104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:00.159366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:00.161818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:00.162506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:00.163116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:00.175707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e96bbaf-784a-44c5-8816-994ed61ad6b6 tempest-PortsAdminExtendedAttrsTestJSON-751830776 tempest-PortsAdminExtendedAttrsTestJSON-751830776-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.324556 Nov 02 21:36:00.176487 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1707/3286] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:35:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:00.688008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:00.698096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:00.701989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:00.704439 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-644319e1-6967-4c3b-b66d-2a3adf76a126 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1707 microversion: 2.32 time: 0.598626 Nov 02 21:36:00.705768 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1580/3287] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:00 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1707 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:00.740467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:00.741232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:00.751680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:00.752473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:00.753172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:00.754313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:00.755093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:00.755694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:01.040174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:01.041658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:01.052153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:01.053094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:01.053794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:01.054758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:01.055452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:01.056111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:01.692234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:01.708275 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23b22e75-e6de-4600-b37b-18bb22752ed5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1670 microversion: 2.1 time: 0.970540 Nov 02 21:36:01.709019 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1708/3288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:00 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1670 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:01.729756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:01.735533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:01.736167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:01.741555 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-890bbc1a-e524-48bb-978f-645ae8d640e2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.705617 Nov 02 21:36:01.742467 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1581/3289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:01 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:01.756956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:01.766506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:01.768558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:01.769554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:01.770350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:01.770964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:02.290422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:02.339266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:02.371551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:02.371551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:02.371551 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f58c82dd-f8e9-4586-9b11-d1d35d28c3b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1707 microversion: 2.32 time: 0.629019 Nov 02 21:36:02.371551 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1709/3290] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:01 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1707 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:02.734677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:02.735212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:02.748823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:02.750344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:02.751026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:02.755261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:02.755965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:02.756621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:02.774357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:02.775007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:02.790414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:02.795353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:02.797007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:02.801272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:02.801969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:02.803252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.161738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:03.171670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc0f9780-220a-4b78-b537-165dd10fe804 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.405123 Nov 02 21:36:03.189625 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1710/3291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:02 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:03.214556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:03.216081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:03.233233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.234237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.234920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.235958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.236583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.237211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.277793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:36:03.388306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:03.400401 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-06f9a1e6-16bc-4787-8f2b-d726b57582e7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.670091 Nov 02 21:36:03.417760 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1582/3292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:02 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:03.442791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:03.443562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:03.467011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.467934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.469202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.470192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.470885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.471539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.693423 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d83e7b1f-b291-43a0-8df6-cadc2a95cbdd tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 204 len: 0 microversion: 2.1 time: 0.501790 Nov 02 21:36:03.697077 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1711/3293] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:36:03 2022] DELETE /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:36:03.709494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:03.720154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:03.744138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.744650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.747018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.747935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.751290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.751797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.850558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8941cfda-5ca3-434b-ad50-7a631bff1a7c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 200 len: 322 microversion: 2.1 time: 0.154216 Nov 02 21:36:03.855905 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1712/3294] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:36:03 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:03.870159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:03.872312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:03.882411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.883548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.884620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:03.887083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:03.887083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:03.887083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:04.187156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:04.202370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:04.204956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:04.207117 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-43842035-831d-4cd8-ab6e-198c9701e860 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1754 microversion: 2.32 time: 0.787505 Nov 02 21:36:04.239984 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1583/3295] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:03 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1754 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:04.251439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:04.251439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:04.268017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:04.269510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:04.271098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:04.272370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:04.274732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:04.279197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:04.387637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:04.400849 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d8eb286-e53c-42a9-808a-7b7b669e3ae5 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1680 microversion: 2.1 time: 0.540885 Nov 02 21:36:04.401493 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1713/3296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:03 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1680 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:04.430210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:04.442150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:04.468426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:04.470269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:04.470666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:04.476423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:04.476423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:04.476643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:04.888022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:04.926581 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec4e139f-8351-4df2-82e4-5eea7b8e5595 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.675353 Nov 02 21:36:04.926581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1584/3297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:04 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:04.948210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:04.950053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:04.961136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:04.979475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:04.980369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:04.981574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:04.982277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:04.983477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:04.984700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:04.998983 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56dd6b34-762a-4132-86cd-94ebc25e2e4c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.572871 Nov 02 21:36:04.999612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1714/3298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:04 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:05.264347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:05.265831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:05.274511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:05.279482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:05.279482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:05.289842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:05.290513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:05.291059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:05.470168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:05.486000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e23c0ef-e33d-4c19-a720-ed99401c6957 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.545387 Nov 02 21:36:05.505118 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1585/3299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:04 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:05.521564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:05.522378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:05.534279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:05.535084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:05.535712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:05.536628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:05.537642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:05.538325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:05.618386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:05.637100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:05.677435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:05.681695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-056db88f-5ffd-4767-99cb-272f00b1abba tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1754 microversion: 2.32 time: 0.421091 Nov 02 21:36:05.684531 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1715/3300] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:05 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1754 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:05.690023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:05.690643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:05.697524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:05.698014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:05.698462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:05.699159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:05.699616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:05.700047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:05.879950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:05.888460 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4cadfbc-5f35-49f6-8102-6ea504fcfab1 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1680 microversion: 2.1 time: 0.381985 Nov 02 21:36:05.901416 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1586/3301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:05 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1680 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:06.017554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:06.027273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:06.027608 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92334f68-7967-42b4-8dea-dca4daa5ebb0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.341803 Nov 02 21:36:06.028196 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1716/3302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:05 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:06.028536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:06.038279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:06.041336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:06.041983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:06.044370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:06.045053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:06.045650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:06.055543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:06.056028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:06.068703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:06.069405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:06.070105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:06.071185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:06.071801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:06.072476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:06.144383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:06.541701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:06.550281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:06.555641 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.532525 Nov 02 21:36:06.610488 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1587/3303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:06 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:06.610488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:06.610488 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001163 Nov 02 21:36:06.610488 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1588/3304] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 21:36:06 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 21:36:06.611384 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.514620 Nov 02 21:36:06.611384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1717/3305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:06 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:06.611571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:06.611571 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.007888 Nov 02 21:36:06.611571 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1589/3306] 10.222.0.25 () {54 vars in 1035 bytes} [Wed Nov 2 21:36:06 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 02 21:36:06.611845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:06.611845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa2c0bb6-f2f0-4376-be70-24f998cdfa4e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001516 Nov 02 21:36:06.611845 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1718/3307] 10.222.0.25 () {54 vars in 1041 bytes} [Wed Nov 2 21:36:06 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:06.612094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:06.612094 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40d4b865-3eb5-410a-bcf4-e7c48a041353 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001351 Nov 02 21:36:06.612094 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1590/3308] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 21:36:06 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 21:36:06.718575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:06.719274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:06.725863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:06.726950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:06.727585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:06.728501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:06.729153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:06.729754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:06.776573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1277341386", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "abf3b988-f5ac-44d9-9b37-c74857f22c78"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:06.867768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] validate_networks() for [('abf3b988-f5ac-44d9-9b37-c74857f22c78', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:36:07.079909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:07.098851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:07.102478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:07.104258 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cfa46285-72ef-4c0e-94e7-3845235ad733 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1801 microversion: 2.32 time: 0.390387 Nov 02 21:36:07.104989 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1719/3309] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:06 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1801 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:07.123029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:07.123796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:07.136903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:07.138204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:07.139778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:07.140869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:07.141573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:07.143015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:07.275630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:07.304990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8554d665-3bcc-4210-ab22-cb5387a354dc tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1613 microversion: 2.1 time: 0.194349 Nov 02 21:36:07.306341 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1720/3310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:07 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1613 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:07.580976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:07.582157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:07.594761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:07.595343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:07.596299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:07.597120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:07.598981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:07.599493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:07.864765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:36:07.865955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:36:07.867646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:36:07.868865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:36:07.869744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:36:07.888509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:07.890374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:07.890374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:07.894249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:07.894249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:07.894249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:07.894249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:07.899474 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9115e30a-477a-44d5-8f7a-bb156de48ad5 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.323095 Nov 02 21:36:07.925952 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1721/3311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:07 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:07.932790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:36:07.942402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for user 368ab16b50f84f0d9cf6e79e039dc257 and project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:36:07.958243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:36:07.961318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:36:08.011129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7ac01279-387b-4e13-803b-695c212bcec2 req-b5906d94-322e-440c-aa58-d450f2ce6062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b834c8-a998-4c4e-9f40-10eb33b62506", "name": "network-vif-deleted", "tag": "419d02b6-960b-48a8-82e3-9b8129f63648"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:08.019892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:08.038106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ac01279-387b-4e13-803b-695c212bcec2 req-b5906d94-322e-440c-aa58-d450f2ce6062 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:08.038106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ac01279-387b-4e13-803b-695c212bcec2 req-b5906d94-322e-440c-aa58-d450f2ce6062 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:08.038968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ac01279-387b-4e13-803b-695c212bcec2 req-b5906d94-322e-440c-aa58-d450f2ce6062 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:08.085858 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7ac01279-387b-4e13-803b-695c212bcec2 req-b5906d94-322e-440c-aa58-d450f2ce6062 service nova] Creating event network-vif-deleted:419d02b6-960b-48a8-82e3-9b8129f63648 for instance e3b834c8-a998-4c4e-9f40-10eb33b62506 on n-h2-860863-4 Nov 02 21:36:08.100310 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7ac01279-387b-4e13-803b-695c212bcec2 req-b5906d94-322e-440c-aa58-d450f2ce6062 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094736 Nov 02 21:36:08.101138 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1722/3312] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:36:08.137702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:08.138704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:08.155111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:08.156303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:08.157450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:08.159032 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-431a80f0-d04a-4dcf-9327-297423995236 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402029 Nov 02 21:36:08.159422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:08.161646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:08.162729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:08.162969 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1591/3313] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:36:08.177489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f021d796-ff9b-4732-9856-40a4cc54f64f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:08.178193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f021d796-ff9b-4732-9856-40a4cc54f64f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:08.763426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f021d796-ff9b-4732-9856-40a4cc54f64f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:08.776223 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f021d796-ff9b-4732-9856-40a4cc54f64f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1215 microversion: 2.1 time: 0.606564 Nov 02 21:36:08.789084 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1592/3314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:08 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1215 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:08.811988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:08.812966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:08.828987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:08.840789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:08.841187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:08.845323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:08.845876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:08.846333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:08.984982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:08.990349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:08.991013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:08.992077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lazy-loading 'fault' on Instance uuid e3b834c8-a998-4c4e-9f40-10eb33b62506 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:36:09.203344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1245c484e8d45e28600c4c1420df3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78a3b929e4f4f2db5f46332df6f7975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:09.220165 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2bb613b2-53d0-4e42-80fe-5652599ea07b tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 200 len: 1331 microversion: 2.1 time: 0.424474 Nov 02 21:36:09.220165 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1593/3315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:08 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 1331 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:09.240065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:09.241350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:09.266427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:09.266939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:09.272730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:09.274649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:09.275139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:09.275578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:09.411623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:09.424500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:09.428042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:09.429324 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17e2869e-d8ad-489c-8ef8-ea7aa08761a2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1848 microversion: 2.32 time: 1.297704 Nov 02 21:36:09.433750 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1723/3316] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:08 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1848 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:09.665038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:09.681388 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-610eb9b3-2a19-4da7-8ccb-b465ebbce52c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.455935 Nov 02 21:36:09.684335 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1594/3317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:09 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:09.808311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:09.810888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:09.824579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:09.833197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:09.834144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:09.836850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:09.839868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:09.842848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:10.016839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:10.034868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed71b4c5-eac3-49ed-a8aa-0b9da6813633 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1219 microversion: 2.1 time: 0.232546 Nov 02 21:36:10.038326 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1724/3318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:09 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1219 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:10.246709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:10.247238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] [instance: e3b834c8-a998-4c4e-9f40-10eb33b62506] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:10.266828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:10.267334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:10.274773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:10.276556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:10.277428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:10.279624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:10.316479 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] HTTP exception thrown: Instance e3b834c8-a998-4c4e-9f40-10eb33b62506 could not be found. Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Request method failure captured: Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 HTTP/1.1 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuIokJf1X-_WTh8aGsBwOrC4mCdQHCd-ivo6a54dBa_Lgx2w4IoacrH7UpzPCPvLIMQsy82lFNsPW_v5dQMpZfUqmHoRrmPr-lKLGYrjRSYh3mZQCCSSJXJQj5GlhKKUDfB0IkiKbFOSZkcgPm2segc36_AioH_4vOqg9lHcjWi51Wk Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: c78a3b929e4f4f2db5f46332df6f7975 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesAdminNegativeTest-1354388358 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c78a3b929e4f4f2db5f46332df6f7975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesAdminNegativeTest-1354388358 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: c78a3b929e4f4f2db5f46332df6f7975 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1354388358 Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesAdminNegativeTest-1354388358-project Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e1245c484e8d45e28600c4c1420df3fa Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesAdminNegativeTest-1354388358-project Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e3b834c8-a998-4c4e-9f40-10eb33b62506 could not be found. Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e3b834c8-a998-4c4e-9f40-10eb33b62506'} Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b834c8-a998-4c4e-9f40-10eb33b62506 could not be found. Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b834c8-a998-4c4e-9f40-10eb33b62506 could not be found. Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:36:10.321577 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:10.325780 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:10.325780 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:36:10.325780 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:36:10.325780 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:36:10.325780 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:36:10.325780 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b834c8-a998-4c4e-9f40-10eb33b62506 could not be found. Nov 02 21:36:10.325780 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:10.333627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Returning 404 to user: Instance e3b834c8-a998-4c4e-9f40-10eb33b62506 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:36:10.339372 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-778901be-0df0-438b-8e40-8640d83433c9 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506" status: 404 len: 111 microversion: 2.1 time: 0.096702 Nov 02 21:36:10.341168 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1595/3319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:10 2022] GET /compute/v2.1/servers/e3b834c8-a998-4c4e-9f40-10eb33b62506 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:36:10.349194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93ecf805-0dcb-4e12-ae80-589fc81846b4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] Calling method '.version_select at 0x7f9b68dd8b80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:10.460532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:10.461501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:10.472748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:10.473401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:10.475963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:10.477179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:10.479377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:10.480106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:10.515678 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93ecf805-0dcb-4e12-ae80-589fc81846b4 tempest-VolumesAdminNegativeTest-1354388358 tempest-VolumesAdminNegativeTest-1354388358-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563347591" status: 202 len: 0 microversion: 2.1 time: 0.169665 Nov 02 21:36:10.518007 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1725/3320] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563347591 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:36:10.717664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:10.718954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:10.728567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:10.729365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:10.730000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:10.731233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:10.732897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:10.733677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:10.956091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:10.965589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:10.971499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:10.976612 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ba392b0-a9af-45ca-8d75-1d67c5246cdb tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1848 microversion: 2.32 time: 0.520332 Nov 02 21:36:10.979281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:10.980110 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1596/3321] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:10 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1848 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:10.995066 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-366580cd-1950-4dca-91c5-57a7c63cc4f3 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.282390 Nov 02 21:36:11.005788 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1726/3322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:10 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:11.062856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:11.063719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:11.075916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:11.076591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:11.077991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:11.078913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:11.079561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:11.081452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:11.213124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:11.223527 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44755258-aa75-4c36-bb0d-80a33ea28c98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1267 microversion: 2.1 time: 0.164826 Nov 02 21:36:11.225740 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1597/3323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:11 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:11.429427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0bd76f86-4dc8-4dd3-ae27-c5488cffa3a2 req-dc82980e-ff4c-413a-8035-57d7957e60a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "8ef8f96f-40d1-4605-8ab7-0fb83406c4aa"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:11.457801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0bd76f86-4dc8-4dd3-ae27-c5488cffa3a2 req-dc82980e-ff4c-413a-8035-57d7957e60a6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:11.457801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0bd76f86-4dc8-4dd3-ae27-c5488cffa3a2 req-dc82980e-ff4c-413a-8035-57d7957e60a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:11.457801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0bd76f86-4dc8-4dd3-ae27-c5488cffa3a2 req-dc82980e-ff4c-413a-8035-57d7957e60a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:11.476823 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0bd76f86-4dc8-4dd3-ae27-c5488cffa3a2 req-dc82980e-ff4c-413a-8035-57d7957e60a6 service nova] Creating event network-changed:8ef8f96f-40d1-4605-8ab7-0fb83406c4aa for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:36:11.483815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0bd76f86-4dc8-4dd3-ae27-c5488cffa3a2 req-dc82980e-ff4c-413a-8035-57d7957e60a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059366 Nov 02 21:36:11.491178 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1727/3324] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:12.021807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:12.022825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:12.026241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:12.029311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:12.041323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:12.041834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:12.042286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:12.043008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:12.043469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:12.051056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:12.053070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:12.056954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:12.057788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:12.059063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:12.060045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:12.061011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:12.416518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:12.432148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:12.432860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:12.434280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:12.443743 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71e82ee8-f70c-4989-8481-7a9cb2feb09b tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1848 microversion: 2.32 time: 0.438695 Nov 02 21:36:12.444497 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48387e36-ccd4-4bdd-b2d4-5141dad3d886 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.423010 Nov 02 21:36:12.456952 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1598/3325] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:12 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1848 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:12.456952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:12.456952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:12.458347 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1728/3326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:12 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:12.476363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:12.476988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:12.477521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:12.478329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:12.480833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:12.481418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:12.558230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:12.572982 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63b11828-251a-4031-b8ec-4d37cd84a9ff tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1273 microversion: 2.1 time: 0.126451 Nov 02 21:36:12.574625 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1599/3327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:12 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:13.473555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:13.473555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:13.480277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:13.480998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:13.481541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:13.483078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:13.484435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:13.485191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:13.488412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:13.493570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:13.501989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:13.502495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:13.502942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:13.503655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:13.504105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:13.508657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:14.044590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:14.062519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e8908d78-808e-4504-9352-a8b06a7af26c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1476 microversion: 2.1 time: 0.578726 Nov 02 21:36:14.065460 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1600/3328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:13 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1476 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:14.074530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:14.076914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:14.087171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:14.088781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:14.089424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:14.090456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:14.091090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:14.092078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:14.101490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:14.121391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:14.128955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:14.130490 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e69e48ab-8262-4ae7-82ee-608524092c92 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1869 microversion: 2.32 time: 0.662539 Nov 02 21:36:14.131081 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1729/3329] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:13 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1869 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:14.560412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:14.565983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:14.573676 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-826668ff-29b0-4f86-8d6e-8747d3415ed6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1315 microversion: 2.1 time: 0.506850 Nov 02 21:36:14.574939 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1601/3330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:14 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:14.922610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bc5915bb-8c7d-4d37-b387-f1228878461d req-6632fa27-8f1e-4464-af5b-8314068ae1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "e275aa3b-1168-4e2f-b0eb-2f72e786a728"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:14.934922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bc5915bb-8c7d-4d37-b387-f1228878461d req-6632fa27-8f1e-4464-af5b-8314068ae1b6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:14.935739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bc5915bb-8c7d-4d37-b387-f1228878461d req-6632fa27-8f1e-4464-af5b-8314068ae1b6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:14.936384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bc5915bb-8c7d-4d37-b387-f1228878461d req-6632fa27-8f1e-4464-af5b-8314068ae1b6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:14.950595 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bc5915bb-8c7d-4d37-b387-f1228878461d req-6632fa27-8f1e-4464-af5b-8314068ae1b6 service nova] Creating event network-changed:e275aa3b-1168-4e2f-b0eb-2f72e786a728 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:36:14.960964 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bc5915bb-8c7d-4d37-b387-f1228878461d req-6632fa27-8f1e-4464-af5b-8314068ae1b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044332 Nov 02 21:36:14.963188 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1730/3331] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:15.095456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:15.096100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:15.107886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:15.109457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:15.110011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:15.110950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:15.112281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:15.112945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8d37f07f-a7fb-4277-ad96-57ab5a7852b3 req-e238bbfd-3d13-48cd-ac1a-e714dae8841a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "name": "network-vif-unplugged", "status": "completed", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:15.113148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:15.130636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8d37f07f-a7fb-4277-ad96-57ab5a7852b3 req-e238bbfd-3d13-48cd-ac1a-e714dae8841a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:15.132186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8d37f07f-a7fb-4277-ad96-57ab5a7852b3 req-e238bbfd-3d13-48cd-ac1a-e714dae8841a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:15.134076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8d37f07f-a7fb-4277-ad96-57ab5a7852b3 req-e238bbfd-3d13-48cd-ac1a-e714dae8841a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:15.158307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8d37f07f-a7fb-4277-ad96-57ab5a7852b3 req-e238bbfd-3d13-48cd-ac1a-e714dae8841a service nova] Creating event network-vif-unplugged:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h1-860863-4 Nov 02 21:36:15.168019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-8d37f07f-a7fb-4277-ad96-57ab5a7852b3 req-e238bbfd-3d13-48cd-ac1a-e714dae8841a service nova] Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:36:15.189716 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8d37f07f-a7fb-4277-ad96-57ab5a7852b3 req-e238bbfd-3d13-48cd-ac1a-e714dae8841a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084022 Nov 02 21:36:15.191366 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1731/3332] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:36:15.203494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:15.211456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:15.213448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:15.214511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:15.215215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:15.217126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:15.217823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:15.219069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:16.197939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:16.224042 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-237938ba-a9d5-41e6-b95c-ce93fcb0d8ce tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1475 microversion: 2.1 time: 1.139187 Nov 02 21:36:16.228565 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1602/3333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:15 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1475 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:16.244082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:16.246225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:16.264534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:16.265878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:16.266516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:16.267415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:16.268054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:16.268659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:16.503766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:16.526105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:16.529645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:16.532213 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86271ab2-78e3-45fe-9727-1edab292e70d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1869 microversion: 2.32 time: 1.335063 Nov 02 21:36:16.534063 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1732/3334] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:15 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1869 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:16.542478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:16.544741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:16.557788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:16.559103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:16.559396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:16.560347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:16.561351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:16.562577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:16.606019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:36:16.747472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:16.783090 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f461430-81e6-4c76-b318-6661391dabc1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1315 microversion: 2.1 time: 0.551740 Nov 02 21:36:16.807681 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1603/3335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:16 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:17.028500 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edef6c30-c3ef-41a3-b859-6b823caee6f9 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 204 len: 0 microversion: 2.1 time: 0.492726 Nov 02 21:36:17.029154 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1733/3336] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:36:16 2022] DELETE /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:36:17.038629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:17.039540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:17.054166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:17.054947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:17.058151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:17.062521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:17.062521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:17.062521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:17.104512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-369056aa-e952-4e83-9317-a42440e47e89 req-98923eb9-0687-4739-8fe3-f44adeb8aefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d81595-7ffa-4bbe-8d6f-fe9196690b0b", "tag": "0e635ff5-298e-48fd-8cf7-0efb0c3288d4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:17.146562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-369056aa-e952-4e83-9317-a42440e47e89 req-98923eb9-0687-4739-8fe3-f44adeb8aefc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:17.150857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-369056aa-e952-4e83-9317-a42440e47e89 req-98923eb9-0687-4739-8fe3-f44adeb8aefc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:17.152687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-369056aa-e952-4e83-9317-a42440e47e89 req-98923eb9-0687-4739-8fe3-f44adeb8aefc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:17.194843 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-369056aa-e952-4e83-9317-a42440e47e89 req-98923eb9-0687-4739-8fe3-f44adeb8aefc service nova] Creating event network-changed:0e635ff5-298e-48fd-8cf7-0efb0c3288d4 for instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b on n-h1-860863-4 Nov 02 21:36:17.209695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-369056aa-e952-4e83-9317-a42440e47e89 req-98923eb9-0687-4739-8fe3-f44adeb8aefc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106781 Nov 02 21:36:17.212163 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1734/3337] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:17.257365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:17.258892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:17.282472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:17.285011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:17.287685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:17.288907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:17.289609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:17.291512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:17.906423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:17.971704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:17.990543 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01f922b3-da5d-43ad-96cc-70b816bc1cbc tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1666 microversion: 2.1 time: 0.956515 Nov 02 21:36:18.001385 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1604/3338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:17 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1666 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:18.024284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:18.025434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:18.044433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:18.049916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:18.049916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:18.049916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:18.049916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:18.062086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:18.200514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:18.215595 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d8799540-4a2d-4072-8328-2298d81d9932 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1475 microversion: 2.1 time: 0.963163 Nov 02 21:36:18.218875 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1735/3339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:17 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1475 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:18.239170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9dcb63df-ca6e-42b5-9c98-2955f74a7615 req-f062bf85-bb75-4027-ae82-5e1df26f1513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:18.268119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9dcb63df-ca6e-42b5-9c98-2955f74a7615 req-f062bf85-bb75-4027-ae82-5e1df26f1513 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:18.272695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9dcb63df-ca6e-42b5-9c98-2955f74a7615 req-f062bf85-bb75-4027-ae82-5e1df26f1513 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:18.273469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9dcb63df-ca6e-42b5-9c98-2955f74a7615 req-f062bf85-bb75-4027-ae82-5e1df26f1513 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:18.317730 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9dcb63df-ca6e-42b5-9c98-2955f74a7615 req-f062bf85-bb75-4027-ae82-5e1df26f1513 service nova] Creating event network-changed:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h1-860863-4 Nov 02 21:36:18.331376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-9dcb63df-ca6e-42b5-9c98-2955f74a7615 req-f062bf85-bb75-4027-ae82-5e1df26f1513 service nova] Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:36:18.363399 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9dcb63df-ca6e-42b5-9c98-2955f74a7615 req-f062bf85-bb75-4027-ae82-5e1df26f1513 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139995 Nov 02 21:36:18.364617 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1736/3340] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:18.426828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:18.428019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:18.436225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:18.437846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:18.439475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:18.440534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:18.442403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:18.443645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:18.769808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:19.797490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:19.810056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:19.812952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:19.814368 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8190dab0-2814-486d-b2de-0ad0eb1ca888 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1890 microversion: 2.32 time: 1.811511 Nov 02 21:36:19.815560 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1605/3341] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:18 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1890 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:19.825533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:19.825533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:19.832287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:19.833765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:19.834379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:19.835423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:19.835968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:19.836449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:20.085126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:20.088751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:20.101806 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55bbbe3a-d769-41eb-a89b-78e2e560a82b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1315 microversion: 2.1 time: 1.733625 Nov 02 21:36:20.101806 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1737/3342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:18 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1315 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:20.114547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:20.118674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:20.178483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:20.179671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:20.181483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:20.183738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:20.184353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:20.185131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:22.292445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:22.298308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bcfd298215d4a8b99d2d942cb049610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41b1686d030644c18ae3444af845830a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:22.312449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7632132c-ce27-4a99-853d-ebe8814719be tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1475 microversion: 2.1 time: 2.209473 Nov 02 21:36:22.317427 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dbd1b5d3-6979-472c-b44e-3f70604e5d96 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 200 len: 1666 microversion: 2.1 time: 2.491231 Nov 02 21:36:22.319998 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1606/3344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:19 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 1666 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:22.334330 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1738/3344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:20 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1475 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:22.338786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:22.340970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:22.350206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:22.351272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:22.352795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:22.353741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:22.353968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f6a78c86-9e6e-46ce-84ab-6370c5c299d0 req-7e6a5964-cb1a-483d-894d-41f73950dc9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "7f5961db-4af2-4b0f-a483-74c05409c407"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:22.357260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:22.357902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:22.377666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:22.402306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f6a78c86-9e6e-46ce-84ab-6370c5c299d0 req-7e6a5964-cb1a-483d-894d-41f73950dc9d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:22.402983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f6a78c86-9e6e-46ce-84ab-6370c5c299d0 req-7e6a5964-cb1a-483d-894d-41f73950dc9d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:22.403486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f6a78c86-9e6e-46ce-84ab-6370c5c299d0 req-7e6a5964-cb1a-483d-894d-41f73950dc9d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:22.432180 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f6a78c86-9e6e-46ce-84ab-6370c5c299d0 req-7e6a5964-cb1a-483d-894d-41f73950dc9d service nova] Creating event network-changed:7f5961db-4af2-4b0f-a483-74c05409c407 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:36:22.442849 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f6a78c86-9e6e-46ce-84ab-6370c5c299d0 req-7e6a5964-cb1a-483d-894d-41f73950dc9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106939 Nov 02 21:36:22.444031 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1739/3345] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:22.460633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:22.463272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:22.488600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:22.489574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:22.490538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:22.499628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:22.500617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:22.501351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:23.799378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:23.815511 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c63a44a-8627-4cb0-a010-7a4dc9b9f5eb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1315 microversion: 2.1 time: 1.369950 Nov 02 21:36:23.816209 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1740/3346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:22 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1315 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:23.822402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1bdd1c13-7b75-4c3a-bf56-c8205f507dbf req-b70a601f-b6ce-4ae9-bdcc-c9e9714433b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d", "name": "network-vif-deleted", "tag": "43f1d141-5b6e-4492-bc2d-1a27d7c1b538"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:23.836211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1bdd1c13-7b75-4c3a-bf56-c8205f507dbf req-b70a601f-b6ce-4ae9-bdcc-c9e9714433b7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:23.836694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1bdd1c13-7b75-4c3a-bf56-c8205f507dbf req-b70a601f-b6ce-4ae9-bdcc-c9e9714433b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:23.837152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1bdd1c13-7b75-4c3a-bf56-c8205f507dbf req-b70a601f-b6ce-4ae9-bdcc-c9e9714433b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:23.850353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1bdd1c13-7b75-4c3a-bf56-c8205f507dbf req-b70a601f-b6ce-4ae9-bdcc-c9e9714433b7 service nova] Creating event network-vif-deleted:43f1d141-5b6e-4492-bc2d-1a27d7c1b538 for instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d on n-h2-860863-4 Nov 02 21:36:23.855668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1bdd1c13-7b75-4c3a-bf56-c8205f507dbf req-b70a601f-b6ce-4ae9-bdcc-c9e9714433b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Nov 02 21:36:23.856797 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1741/3347] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:23.864627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:23.865469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:23.872345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:23.873223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:23.873704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:23.874713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:23.875329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:23.875913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:23.944024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:23.955076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:23.956880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:23.958383 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1476412-7817-4094-aade-35849cdc7840 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1890 microversion: 2.32 time: 1.637114 Nov 02 21:36:23.959246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1607/3348] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:22 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1890 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:23.978699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:23.979403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] [instance: bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:23.987764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:23.988548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:23.989108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:23.989975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:23.990487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:23.990923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:24.008635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] HTTP exception thrown: Instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d could not be found. Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Request method failure captured: Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d HTTP/1.1 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuKIvk8H47FWWbYcq6M3t4OCBObBQ_EEEidjQalaXtb03l8oqmyqJ_Tz-I9lolqtTUJCBywcQgYGnAk5wGtaW6k93xtFe7YRs_KIlEwuolF_lafnzDCgyIIV4T0omkzNGS92aQ3zgyyKO_3fhI6cu0FNzMdU8WrPwd-Qhde2w-pDA18 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 41b1686d030644c18ae3444af845830a Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestFqdnHostnames-1407122435 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_41b1686d030644c18ae3444af845830a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41b1686d030644c18ae3444af845830a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/41b1686d030644c18ae3444af845830a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/41b1686d030644c18ae3444af845830a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestFqdnHostnames-1407122435 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 41b1686d030644c18ae3444af845830a Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1407122435 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestFqdnHostnames-1407122435-project Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7bcfd298215d4a8b99d2d942cb049610 Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestFqdnHostnames-1407122435-project Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d could not be found. Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d'} Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d could not be found. Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d could not be found. Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:36:24.011056 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d could not be found. Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Returning 404 to user: Instance bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22c8089b-a29f-46f3-b516-967476b5b836 tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d" status: 404 len: 111 microversion: 2.1 time: 0.052340 Nov 02 21:36:24.015763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1608/3349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:23 2022] GET /compute/v2.1/servers/bb68d831-d6b7-4f18-ad5d-319fcfaf8a3d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:36:24.036440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-64a4bfc8-c6dc-4867-bbfc-534999e2249e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] Calling method '.version_select at 0x7f9b6874d9d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:24.125946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-64a4bfc8-c6dc-4867-bbfc-534999e2249e tempest-ServersTestFqdnHostnames-1407122435 tempest-ServersTestFqdnHostnames-1407122435-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-675257804" status: 202 len: 0 microversion: 2.1 time: 0.096518 Nov 02 21:36:24.130152 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1609/3350] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:36:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-675257804 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:36:24.418966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:24.444819 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9bf2f40f-ea86-4897-9e85-37a5b85d2f90 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1475 microversion: 2.1 time: 0.586423 Nov 02 21:36:24.462962 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1742/3351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:23 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1475 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:24.839595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:24.840227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:24.848189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:24.849042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:24.849492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:24.850203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:24.850907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:24.851440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:24.987268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:24.988672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:24.996462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:24.997476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:24.998111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:24.999044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:24.999661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:25.000300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:25.410783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:25.439295 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f852cc28-7676-4f31-9410-233454bc5b18 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1315 microversion: 2.1 time: 0.604036 Nov 02 21:36:25.445157 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1610/3352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:24 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:25.502658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:25.513216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:25.515198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:25.523765 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fbc2d56d-a460-4d8f-8d3d-5025a807427c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.541785 Nov 02 21:36:25.524413 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1743/3353] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:24 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:25.791811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:25.791811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:25.803230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:25.803803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:25.804362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:25.805648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:25.806122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:25.806572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:25.905725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b77bb8eb-39c1-46db-9caa-ffab12046535 req-6dce05dc-427f-4ff2-9fdb-44bae4514e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:25.925031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b77bb8eb-39c1-46db-9caa-ffab12046535 req-6dce05dc-427f-4ff2-9fdb-44bae4514e2d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:25.925512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b77bb8eb-39c1-46db-9caa-ffab12046535 req-6dce05dc-427f-4ff2-9fdb-44bae4514e2d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:25.925944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b77bb8eb-39c1-46db-9caa-ffab12046535 req-6dce05dc-427f-4ff2-9fdb-44bae4514e2d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:25.951419 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b77bb8eb-39c1-46db-9caa-ffab12046535 req-6dce05dc-427f-4ff2-9fdb-44bae4514e2d service nova] Creating event network-changed:2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:36:25.970916 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b77bb8eb-39c1-46db-9caa-ffab12046535 req-6dce05dc-427f-4ff2-9fdb-44bae4514e2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070096 Nov 02 21:36:25.971824 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1744/3354] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:25.991307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-72a1ba9a-1724-4b50-bdb5-006bb7ec9973 req-3bd132e4-8e6f-41f3-b8f8-36cf503fb28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d81595-7ffa-4bbe-8d6f-fe9196690b0b", "name": "network-vif-plugged", "status": "completed", "tag": "0e635ff5-298e-48fd-8cf7-0efb0c3288d4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:26.012737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-72a1ba9a-1724-4b50-bdb5-006bb7ec9973 req-3bd132e4-8e6f-41f3-b8f8-36cf503fb28b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:26.013398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-72a1ba9a-1724-4b50-bdb5-006bb7ec9973 req-3bd132e4-8e6f-41f3-b8f8-36cf503fb28b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:26.013928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-72a1ba9a-1724-4b50-bdb5-006bb7ec9973 req-3bd132e4-8e6f-41f3-b8f8-36cf503fb28b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:26.033180 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-72a1ba9a-1724-4b50-bdb5-006bb7ec9973 req-3bd132e4-8e6f-41f3-b8f8-36cf503fb28b service nova] Creating event network-vif-plugged:0e635ff5-298e-48fd-8cf7-0efb0c3288d4 for instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b on n-h1-860863-4 Nov 02 21:36:26.048237 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-72a1ba9a-1724-4b50-bdb5-006bb7ec9973 req-3bd132e4-8e6f-41f3-b8f8-36cf503fb28b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061507 Nov 02 21:36:26.048970 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1745/3355] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:36:26.468798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:26.470009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:26.480726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:26.485589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:26.486243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:26.489718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:26.489718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:26.489718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:26.984912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:26.998712 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b03ad708-f259-45e3-b86a-809f29c11fed tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1473 microversion: 2.1 time: 1.509981 Nov 02 21:36:27.001253 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1611/3356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:25 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1473 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:27.007386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:27.008636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:27.017913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:27.018641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:27.019507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:27.020490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:27.021194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:27.022059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:27.403032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:27.426794 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed0783d6-b551-4c06-b6ba-d4ef55a931c2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1315 microversion: 2.1 time: 0.963253 Nov 02 21:36:27.428383 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1746/3357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:26 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:27.711865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:27.722571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:27.724031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:27.725246 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c12780b-fb0b-4c8c-a6c2-1f22283df7a6 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.722254 Nov 02 21:36:27.725810 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1612/3358] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:27 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:28.026064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:28.026693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:28.038400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.041587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.042229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.043113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.049992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.050705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.412969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:28.444385 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2dff30f9-a572-4886-83ae-275cf1edda3b tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1470 microversion: 2.1 time: 0.419404 Nov 02 21:36:28.446695 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1747/3359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:28 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:28.464507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:28.466376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:28.478352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.478858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.483010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:28.484546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:28.485827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.486591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.487066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.487500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.507514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.508750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.509408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.512375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.513999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.515855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.896619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:28.920286 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9502c5cf-e806-4394-9f63-311ebcce44d2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1501 microversion: 2.1 time: 0.474173 Nov 02 21:36:28.922071 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1613/3360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:28 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1501 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:28.929720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:28.930540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:28.938952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.939730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.940466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.941393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:28.942001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:28.942959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:28.988488 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-acdbd281-4d07-4163-9172-a9cc74dd665a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "POST /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.510886 Nov 02 21:36:28.989334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1748/3361] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:36:28 2022] POST /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:36:29.009371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce465a11-bc63-4afb-a6df-837ddff83d97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:29.023946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce465a11-bc63-4afb-a6df-837ddff83d97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:29.024436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce465a11-bc63-4afb-a6df-837ddff83d97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:29.024887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce465a11-bc63-4afb-a6df-837ddff83d97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:29.089144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce465a11-bc63-4afb-a6df-837ddff83d97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:36:29.316131 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce465a11-bc63-4afb-a6df-837ddff83d97 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.315817 Nov 02 21:36:29.319974 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1749/3362] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:36:28 2022] POST /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:36:29.335879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:29.342252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:29.367231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:29.368845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:29.369791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:29.372629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:29.373852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:29.374402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:30.260312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:30.276493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:30.282832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:30.287832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c00d6bf-aa79-4fb1-90e8-aa328e6b9f21 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.364469 Nov 02 21:36:30.297378 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1614/3363] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:28 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:30.318342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:30.321666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:30.322214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:30.335234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:30.335668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2a1cbe3-f308-4967-a434-39cdd42a7935 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 1.003554 Nov 02 21:36:30.336185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:30.336485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1750/3364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:29 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:30.337141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:30.337859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:30.338327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:30.338760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:30.349623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-cf3bd7b5-054f-4976-9c6d-ee2b37e5a941 req-ebff85c8-3516-477f-a119-e98d3b16a2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "35d64f03-f33e-4ab9-8420-b891f3cc9308"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:30.362311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cf3bd7b5-054f-4976-9c6d-ee2b37e5a941 req-ebff85c8-3516-477f-a119-e98d3b16a2f0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:30.363108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cf3bd7b5-054f-4976-9c6d-ee2b37e5a941 req-ebff85c8-3516-477f-a119-e98d3b16a2f0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:30.363772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cf3bd7b5-054f-4976-9c6d-ee2b37e5a941 req-ebff85c8-3516-477f-a119-e98d3b16a2f0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:30.383490 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-cf3bd7b5-054f-4976-9c6d-ee2b37e5a941 req-ebff85c8-3516-477f-a119-e98d3b16a2f0 service nova] Creating event network-changed:35d64f03-f33e-4ab9-8420-b891f3cc9308 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:36:30.406511 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-cf3bd7b5-054f-4976-9c6d-ee2b37e5a941 req-ebff85c8-3516-477f-a119-e98d3b16a2f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067656 Nov 02 21:36:30.410988 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1751/3365] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:30.429314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-644010ec-46b1-485d-901a-51d80800caaf req-bef6807b-8c51-4007-958b-2faa7fc52775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "name": "network-vif-plugged", "status": "completed", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:30.458567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-644010ec-46b1-485d-901a-51d80800caaf req-bef6807b-8c51-4007-958b-2faa7fc52775 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:30.459361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-644010ec-46b1-485d-901a-51d80800caaf req-bef6807b-8c51-4007-958b-2faa7fc52775 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:30.460675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-644010ec-46b1-485d-901a-51d80800caaf req-bef6807b-8c51-4007-958b-2faa7fc52775 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:30.476875 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-644010ec-46b1-485d-901a-51d80800caaf req-bef6807b-8c51-4007-958b-2faa7fc52775 service nova] Creating event network-vif-plugged:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h1-860863-4 Nov 02 21:36:30.484286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-644010ec-46b1-485d-901a-51d80800caaf req-bef6807b-8c51-4007-958b-2faa7fc52775 service nova] Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:36:30.511531 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-644010ec-46b1-485d-901a-51d80800caaf req-bef6807b-8c51-4007-958b-2faa7fc52775 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098912 Nov 02 21:36:30.512746 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1752/3366] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:30.954178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:30.989063 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-117ce2e0-747c-42ba-9a72-84e16d34f899 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.662877 Nov 02 21:36:30.989063 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1615/3367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:30 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:31.327691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:31.328395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:31.342514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:31.343350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:31.345905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:31.345905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:31.347409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:31.357694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:31.374687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:31.375893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:31.387847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:31.392092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:31.392773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:31.397540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:31.398115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:31.401365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:31.766669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:31.778899 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d07cbe2a-8636-41cb-970e-c990de38e98c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 0.408384 Nov 02 21:36:31.781792 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1616/3368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:31 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:32.013140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:32.013956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:32.028269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:32.030225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:32.031700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:32.033844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:32.034624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:32.037118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:32.573004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:32.589842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:32.591959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:32.593576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e4cc01e6-b0f9-471b-bccf-070c3726698a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.270719 Nov 02 21:36:32.604309 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1753/3369] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:31 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:32.820554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:32.822511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:32.840670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:32.841868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:32.847050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:32.848226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:32.848985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:32.853132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:32.881198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:32.890623 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc6b8220-1f21-43c8-97d7-6fd4e1685b42 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.881472 Nov 02 21:36:32.890782 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1617/3370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:32 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:33.598622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:33.606469 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71b318b2-a9b8-46dc-aa5d-667341075a26 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 0.798629 Nov 02 21:36:33.607349 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1754/3371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:32 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:33.630536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:33.631163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:33.645970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:33.645970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:33.645970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:33.645970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:33.645970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:33.645970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:33.767806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ebcb173c-3bcf-4c60-8581-814958dd1848 req-d339fd07-6e69-4f7d-9609-e074e268bd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "52ef5d76-a38d-4aa9-95c4-e68c61c33135"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:33.796854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ebcb173c-3bcf-4c60-8581-814958dd1848 req-d339fd07-6e69-4f7d-9609-e074e268bd2b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:33.799569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ebcb173c-3bcf-4c60-8581-814958dd1848 req-d339fd07-6e69-4f7d-9609-e074e268bd2b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:33.800784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ebcb173c-3bcf-4c60-8581-814958dd1848 req-d339fd07-6e69-4f7d-9609-e074e268bd2b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:33.813437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:33.855025 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ebcb173c-3bcf-4c60-8581-814958dd1848 req-d339fd07-6e69-4f7d-9609-e074e268bd2b service nova] Creating event network-changed:52ef5d76-a38d-4aa9-95c4-e68c61c33135 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:36:33.871764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ebcb173c-3bcf-4c60-8581-814958dd1848 req-d339fd07-6e69-4f7d-9609-e074e268bd2b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108164 Nov 02 21:36:33.878463 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1755/3372] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:34.078841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff6b908e-4a68-4772-96c7-5b2e98b11d7a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: .version_select at 0x7f9b6d217d30>, body: {"keypair": {"name": "tempest-keypair-162619605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhsj2tY8GFQAinm76tHCVUXJlM5KyKkp/2jWBBAp+Dtldn/W2ANb3AZgmLE+zD+J/M7svg2OzinurpDEWaXh+s24S2MiPszGjN6Fg4J8zvS34k7+v/KTQbG8jhJeBpq5Q=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:34.114315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ff6b908e-4a68-4772-96c7-5b2e98b11d7a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:36:34.119927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ff6b908e-4a68-4772-96c7-5b2e98b11d7a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:36:34.185715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:34.200565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:34.202635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:34.204081 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83a2f5fa-5eff-455d-819c-05308f3349c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.579227 Nov 02 21:36:34.204700 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1618/3373] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:33 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:34.217156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:34.217916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:34.231332 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff6b908e-4a68-4772-96c7-5b2e98b11d7a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.323081 Nov 02 21:36:34.231939 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1756/3374] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:36:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:36:34.237247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:34.237745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:34.250913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:34.251725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:34.252214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:34.252654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:34.629469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:34.634074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:34.635541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:34.638855 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-90ee67a1-efaf-4f68-8117-212f7bea6de0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.433137 Nov 02 21:36:34.656419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:34.658115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1619/3375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:34 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:34.658723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:34.661864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:34.669831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:34.669831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:34.669831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:35.236356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:35.237136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:35.252129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:35.252720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:35.255682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:35.269130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:35.269757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:35.270222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:35.363054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:35.897230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:35.912281 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d8a410b4-e124-4101-a5b5-317173f093da tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 1.285819 Nov 02 21:36:35.925106 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1757/3376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:34 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:35.933479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:35.954044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:35.988754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:35.996198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:35.997273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:36.001630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:36.002309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:36.005991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:36.025029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:36.035917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:36.051579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:36.054395 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9822cb0c-5d69-485a-8721-b9adf9051fc8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.824465 Nov 02 21:36:36.057059 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1620/3377] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:35 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:36.776750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:36.801328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-de715b64-4513-4f9b-bbdd-f96342656577 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.883976 Nov 02 21:36:36.802347 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1758/3378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:35 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:36.944156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:36.945456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:36.957547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:36.958232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:36.958833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:36.959704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:36.960331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:36.960943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:37.099972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:37.099972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:37.105144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:37.105748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:37.106553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:37.109283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:37.111230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:37.112054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:37.748322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:37.760298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b5006e77-cee2-4606-a582-f74ff88c8c79 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 0.823535 Nov 02 21:36:37.761715 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1621/3379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:36 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:37.773393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0941efc6-73b2-4a91-86d7-14c6411b9961 req-00ba48d4-0406-4545-a538-85be007ba3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "name": "network-vif-unplugged", "status": "completed", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:37.814631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0941efc6-73b2-4a91-86d7-14c6411b9961 req-00ba48d4-0406-4545-a538-85be007ba3c2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:37.815528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0941efc6-73b2-4a91-86d7-14c6411b9961 req-00ba48d4-0406-4545-a538-85be007ba3c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:37.816552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0941efc6-73b2-4a91-86d7-14c6411b9961 req-00ba48d4-0406-4545-a538-85be007ba3c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:37.832416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0941efc6-73b2-4a91-86d7-14c6411b9961 req-00ba48d4-0406-4545-a538-85be007ba3c2 service nova] Creating event network-vif-unplugged:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h2-860863-4 Nov 02 21:36:37.841636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-0941efc6-73b2-4a91-86d7-14c6411b9961 req-00ba48d4-0406-4545-a538-85be007ba3c2 service nova] Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:36:37.865288 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0941efc6-73b2-4a91-86d7-14c6411b9961 req-00ba48d4-0406-4545-a538-85be007ba3c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100746 Nov 02 21:36:37.868255 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1622/3380] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:37.882325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:37.884296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:37.899548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:37.901306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:37.902848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:37.904507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:37.906904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:37.907644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:38.019240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:38.047768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:38.049636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:38.051061 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05212999-389c-4a0b-a6e4-dd2c57acb39c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.963616 Nov 02 21:36:38.051808 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1759/3381] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:37 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:38.656857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:38.671126 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3a5fea5-c1af-40c9-a0ec-c03e57ed8087 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.799946 Nov 02 21:36:38.673332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1623/3382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:37 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:38.786018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:38.786641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:38.801874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:38.802668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:38.803278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:38.804313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:38.805653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:38.806265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:39.083067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:39.084687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:39.132132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:39.134750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:39.135867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:39.136801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:39.142067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:39.144740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:39.610410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:39.637803 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2882e662-b8fb-42a3-9826-6a377690f342 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 0.854180 Nov 02 21:36:39.639650 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1760/3383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:38 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:39.663064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-83a59c16-02eb-4b77-b166-7da1d1ff5204 req-7d5f76e0-8eb6-47f7-b6ef-e5f3007726c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "4fe00742-6aa2-4e8c-afbd-8f04868461c0"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:39.675175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83a59c16-02eb-4b77-b166-7da1d1ff5204 req-7d5f76e0-8eb6-47f7-b6ef-e5f3007726c8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:39.675836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83a59c16-02eb-4b77-b166-7da1d1ff5204 req-7d5f76e0-8eb6-47f7-b6ef-e5f3007726c8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:39.677047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83a59c16-02eb-4b77-b166-7da1d1ff5204 req-7d5f76e0-8eb6-47f7-b6ef-e5f3007726c8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:39.695006 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-83a59c16-02eb-4b77-b166-7da1d1ff5204 req-7d5f76e0-8eb6-47f7-b6ef-e5f3007726c8 service nova] Creating event network-changed:4fe00742-6aa2-4e8c-afbd-8f04868461c0 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:36:39.703252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-83a59c16-02eb-4b77-b166-7da1d1ff5204 req-7d5f76e0-8eb6-47f7-b6ef-e5f3007726c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061186 Nov 02 21:36:39.704572 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1761/3384] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:39.712394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:39.713505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:39.722479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:39.723191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:39.724020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:39.724997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:39.725695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:39.727387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:39.984032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:39.993946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:39.995733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:39.997194 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c00fd38-095e-4a11-8c2a-ca9298a28173 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.920894 Nov 02 21:36:40.009505 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1624/3385] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:39 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:40.174690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:40.187515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e071b043-4b08-43f7-a00f-33d94971ee33 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.479944 Nov 02 21:36:40.227098 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1762/3386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:39 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:40.663699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:40.664333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:40.676419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=72,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:40.678248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:40.680499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:40.680499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:40.680499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:40.693121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:40.694033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:41.031462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:41.032100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:41.050821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:41.051603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:41.052215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:41.053177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:41.053800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:41.054399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:41.763580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:41.772039 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b34e2ebc-2d87-4c81-96bf-a954d5412802 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 1.112114 Nov 02 21:36:41.785726 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1625/3387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:40 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:41.793767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:41.794574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:41.816059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:41.816786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:41.817445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:41.818367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:41.819543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:41.825628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:42.147308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:42.175255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:42.182042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:42.190583 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e0e8309-8d87-4ce8-adc2-ed2fac33d8c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.165026 Nov 02 21:36:42.192588 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1763/3388] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:41 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:42.231354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-48ca71f2-b24f-445c-857a-2178454ef455 req-1c6e8ca5-2277-413f-90c3-89b9414e4e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:42.251433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-48ca71f2-b24f-445c-857a-2178454ef455 req-1c6e8ca5-2277-413f-90c3-89b9414e4e2e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:42.251940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-48ca71f2-b24f-445c-857a-2178454ef455 req-1c6e8ca5-2277-413f-90c3-89b9414e4e2e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:42.252348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-48ca71f2-b24f-445c-857a-2178454ef455 req-1c6e8ca5-2277-413f-90c3-89b9414e4e2e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:42.283306 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-48ca71f2-b24f-445c-857a-2178454ef455 req-1c6e8ca5-2277-413f-90c3-89b9414e4e2e service nova] Creating event network-changed:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h2-860863-4 Nov 02 21:36:42.292971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-48ca71f2-b24f-445c-857a-2178454ef455 req-1c6e8ca5-2277-413f-90c3-89b9414e4e2e service nova] Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:36:42.307713 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-48ca71f2-b24f-445c-857a-2178454ef455 req-1c6e8ca5-2277-413f-90c3-89b9414e4e2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092618 Nov 02 21:36:42.308671 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1764/3389] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:42.320636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:42.333177 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b7201f34-42eb-4243-9ffa-91ead3af42b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.545852 Nov 02 21:36:42.334014 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1626/3390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:41 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:42.799671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:42.800787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:42.830838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:42.830838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:42.831176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:42.841948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:42.849054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:42.850398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:43.009235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1247450829", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633e65a1-5eb1-4582-84ab-e86a0d55a55b"}], "security_groups": [{"name": "tempest-securitygroup--1301977606"}], "key_name": "tempest-keypair-162619605", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:43.368424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:43.384523 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09ee84a0-66e6-4dec-ba1d-112b28be1d57 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 0.590657 Nov 02 21:36:43.411122 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1765/3391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:42 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:43.417194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:43.418050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:43.441241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:43.441738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:43.458363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:43.458806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] validate_networks() for [('633e65a1-5eb1-4582-84ab-e86a0d55a55b', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:36:43.459242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:43.459770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:43.460165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:44.039691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:44.104259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:44.115884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:44.124372 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-176466c4-8f6e-4ba1-9cd9-791cef531b59 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.710255 Nov 02 21:36:44.126377 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1766/3392] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:43 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:44.137154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:44.137907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:44.151985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:44.154554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:44.155964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:44.157620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:44.159562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:44.161339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:44.162783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:44.895689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:36:44.900964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:36:44.900964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:36:44.901443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:36:44.902137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:36:44.920047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:44.930784 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c865f79d-c2e9-4c55-8884-6594716fd41d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.800027 Nov 02 21:36:44.936492 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1767/3393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:44 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:44.948246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:44.948786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:44.959287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:44.963498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:44.970707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:44.970707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:44.970707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:44.970707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:44.971484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:44.972650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:44.975192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:44.976225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:44.976878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:44.980809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:45.012842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:36:45.034044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:36:45.079140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:36:45.089210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:36:45.252943 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14ce067c-8d5b-4003-856f-a3d79e98e5bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.249079 Nov 02 21:36:45.263502 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1627/3394] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:36:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:36:45.285168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:45.286144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:45.312475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:45.313557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:45.314424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:45.320361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:45.324729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:45.326402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:46.415137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:46.436743 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e96c837-bf64-4295-bcc9-2b83b690063a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1469 microversion: 2.1 time: 1.493344 Nov 02 21:36:46.437899 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1768/3395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:44 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1469 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:46.469390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e796e9b6-c805-4276-9610-e112120f6e58 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:46.470353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e796e9b6-c805-4276-9610-e112120f6e58 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:46.746208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:46.765191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:46.767354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:46.768905 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b895a0f5-579f-4787-8b27-bd5935cf83c5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.503951 Nov 02 21:36:46.769687 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1628/3396] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:45 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:46.775007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:46.776156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:46.784445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:46.785373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:46.786293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:46.787394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:46.787607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e796e9b6-c805-4276-9610-e112120f6e58 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:46.788382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:46.789369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:46.828395 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e796e9b6-c805-4276-9610-e112120f6e58 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1241 microversion: 2.1 time: 0.370345 Nov 02 21:36:46.830859 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1769/3397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:46 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1241 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:47.299119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:47.310698 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f8cff32-c502-4069-90fd-d00dd6d2cab4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.539783 Nov 02 21:36:47.311895 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1629/3398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:46 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:47.472017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:47.472017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:47.485133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:47.486005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:47.486733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:47.487696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:47.488429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:47.489288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:47.803778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:47.805703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:47.826391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:47.827084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:47.831889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:47.833504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:47.834917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:47.836058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:47.842528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:47.859585 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19c37b9e-4236-438c-98f0-70afd54e5d06 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1462 microversion: 2.1 time: 0.395736 Nov 02 21:36:47.874043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1770/3399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:47 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1462 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:47.886792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:47.887486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:47.921276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:47.921939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:47.922398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:47.923197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:47.923673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:47.924115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.098463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:48.111695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4dccd9df-73d0-48ec-8c1a-78d4a1512898 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1293 microversion: 2.1 time: 0.235114 Nov 02 21:36:48.129258 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1771/3400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:47 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1293 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:48.147387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:48.148207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:48.159311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:48.160559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:48.162081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.162884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:48.163361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:48.163915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.504899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:48.527722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:48.530881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:48.534238 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-02d00c14-6b71-400c-b2a9-d4b59dc6c347 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.740963 Nov 02 21:36:48.535372 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1630/3401] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:47 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:48.542470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:48.543457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:48.551810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:48.552539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:48.554136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.555083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:48.555833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:48.556275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.774901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d42cf5d2-2e33-4676-9fbd-0240810eddab tempest-MigrationsAdminTest-2058601362 tempest-MigrationsAdminTest-2058601362-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1613 microversion: 2.1 time: 0.644273 Nov 02 21:36:48.775473 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1772/3402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:48 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1613 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:48.792560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9f560b3f-aefe-4f2f-89e5-17f51e8996ea req-bfc5fc1c-fa5f-4979-8146-cb50e695d4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "name": "network-vif-plugged", "status": "completed", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:48.792560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9f560b3f-aefe-4f2f-89e5-17f51e8996ea req-bfc5fc1c-fa5f-4979-8146-cb50e695d4b0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:48.792560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9f560b3f-aefe-4f2f-89e5-17f51e8996ea req-bfc5fc1c-fa5f-4979-8146-cb50e695d4b0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:48.792560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9f560b3f-aefe-4f2f-89e5-17f51e8996ea req-bfc5fc1c-fa5f-4979-8146-cb50e695d4b0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.834790 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9f560b3f-aefe-4f2f-89e5-17f51e8996ea req-bfc5fc1c-fa5f-4979-8146-cb50e695d4b0 service nova] Creating event network-vif-plugged:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h2-860863-4 Nov 02 21:36:48.843184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9f560b3f-aefe-4f2f-89e5-17f51e8996ea req-bfc5fc1c-fa5f-4979-8146-cb50e695d4b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065736 Nov 02 21:36:48.843807 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1773/3403] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:48.851907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:48.852699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:48.862175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:48.862673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:48.863118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.863835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:48.864323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:48.880753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:48.897354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:36:49.014182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:49.083079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:49.094721 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9df8ae87-f49a-4973-a67c-caa3ed53f72e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.557925 Nov 02 21:36:49.096058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1631/3404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:48 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:49.151684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:49.153407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:49.172039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:49.174049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:49.175314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:49.179124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:49.180410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:49.181954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:49.263912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-751ba035-12c2-4aac-a784-7a1640338840 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 204 len: 0 microversion: 2.1 time: 0.418346 Nov 02 21:36:49.264714 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1774/3405] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:36:48 2022] DELETE /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:36:49.274974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:49.275681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:49.281826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:49.282314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:49.282752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:49.283444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:49.284086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:49.284511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:49.459484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:49.469589 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-50038738-8f79-45e5-880f-a9e00e591eca tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1299 microversion: 2.1 time: 0.321245 Nov 02 21:36:49.470880 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1632/3406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:49 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:49.560951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:49.562558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:49.568623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:49.569394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:49.570012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:49.570892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:49.571632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:49.572540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:49.731330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:49.744277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72d74deb-5e8f-418c-a213-ac9473de10fe tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1468 microversion: 2.1 time: 0.472945 Nov 02 21:36:49.744498 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1775/3407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:49 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1468 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:50.119528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:50.120812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:50.128517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:50.134543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:50.134543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:50.134543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:50.134543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:50.134543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:50.697821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:50.707799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:50.723844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:50.727104 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bbb265e-5665-4d7a-b6ec-8add183efd77 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.169979 Nov 02 21:36:50.737467 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1633/3408] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:49 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:50.747297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:50.747997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:50.809380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:50.811193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:50.811643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:50.815338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:50.815338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:50.822752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:51.046784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:51.053886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a27bee8-732f-44f0-9001-a1f3e91139d1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.938117 Nov 02 21:36:51.055459 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1776/3409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:50 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:51.064800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:51.065929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:51.075933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:51.081757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:51.081757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:51.081757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:51.082658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:51.083640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:51.144718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:51.152841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e5207fac-bc61-4d23-bcae-630843986f5d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1299 microversion: 2.1 time: 0.413889 Nov 02 21:36:51.156064 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1634/3410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:50 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1299 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:51.607596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:51.631401 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8305db8-1113-4f9b-80a3-f47973bdbf92 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 200 len: 1468 microversion: 2.1 time: 0.574647 Nov 02 21:36:51.633874 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1777/3411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:51 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:51.765327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:51.771751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:51.836353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:51.837380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:51.837995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:51.839652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:51.839652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:51.841183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:52.085436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:52.086214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:52.088547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:52.102463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:52.103103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:52.108882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:52.108882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:52.108882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:52.108882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:52.958150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:52.999927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:53.002756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:53.021660 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9a45ee10-b457-4ddd-a21e-d649eb4928ac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.248354 Nov 02 21:36:53.021660 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1635/3412] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:51 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:53.036492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:53.040256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:53.057163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.058103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.059119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.061890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.062554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.063317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.230602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:53.243509 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eff581f7-970f-4c86-8a50-54564edce8da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 1.161618 Nov 02 21:36:53.245013 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1778/3413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:52 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:53.265707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9e914ebe-ac16-4fe6-b06e-67ed41dd8330 req-2584f174-6c5e-48f4-9d08-8376c0821bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5e664b-a320-40e4-a26b-bcc48d601c6d", "name": "network-vif-deleted", "tag": "7e84ccd9-ff54-430f-b9c8-cc1d26a165d6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:53.292347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9e914ebe-ac16-4fe6-b06e-67ed41dd8330 req-2584f174-6c5e-48f4-9d08-8376c0821bc0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.300898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9e914ebe-ac16-4fe6-b06e-67ed41dd8330 req-2584f174-6c5e-48f4-9d08-8376c0821bc0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.301878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9e914ebe-ac16-4fe6-b06e-67ed41dd8330 req-2584f174-6c5e-48f4-9d08-8376c0821bc0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.337083 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9e914ebe-ac16-4fe6-b06e-67ed41dd8330 req-2584f174-6c5e-48f4-9d08-8376c0821bc0 service nova] Creating event network-vif-deleted:7e84ccd9-ff54-430f-b9c8-cc1d26a165d6 for instance ce5e664b-a320-40e4-a26b-bcc48d601c6d on n-h2-860863-4 Nov 02 21:36:53.344171 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9e914ebe-ac16-4fe6-b06e-67ed41dd8330 req-2584f174-6c5e-48f4-9d08-8376c0821bc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094872 Nov 02 21:36:53.346165 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1779/3414] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:53.352031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:53.353071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: ce5e664b-a320-40e4-a26b-bcc48d601c6d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:53.361927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.362772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.363385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.364336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.365032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.365690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.394299 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] HTTP exception thrown: Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d could not be found. Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Request method failure captured: Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d HTTP/1.1 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGphY35NfxCVDRyEKnzUsUBiPMSRJ706VBrdJy2x5nZRsvtRzY4V9gtuNPg7cDQhd-cW4SJ5sjw_eaIQhbvS8ekQO_f3fck_Q1TrphTbKmxYOb7dPfsFbw-ki2HXxoR_ZTUSx_XAznmC6KsK-ElB3KnkhtRTlB9099UxlZNN_2C56s Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-MigrationsAdminTest-129171093 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-MigrationsAdminTest-129171093-project Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 64f57cf5139c4937b8158f8d9aef011b Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-MigrationsAdminTest-129171093-project Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d could not be found. Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'ce5e664b-a320-40e4-a26b-bcc48d601c6d'} Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d could not be found. Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d could not be found. Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:36:53.396039 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d could not be found. Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Returning 404 to user: Instance ce5e664b-a320-40e4-a26b-bcc48d601c6d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a300afb9-37bd-4fea-ba12-df61983183d2 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d" status: 404 len: 111 microversion: 2.1 time: 0.050527 Nov 02 21:36:53.401639 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1780/3415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:53 2022] GET /compute/v2.1/servers/ce5e664b-a320-40e4-a26b-bcc48d601c6d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:36:53.429952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:53.431089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:53.440559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.441754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.442506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.443498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.444211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.445272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.478924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:36:53.860468 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99b70e3b-45cf-4450-8d8a-6e7e99cc8869 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 204 len: 0 microversion: 2.1 time: 0.452275 Nov 02 21:36:53.862229 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1781/3416] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:36:53 2022] DELETE /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:36:53.875738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:53.876628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:53.911000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.911000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.912047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:53.914216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:53.914858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:53.915583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:54.210780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:54.225902 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-56bd5e67-c4d2-446a-a7c1-fc78632c2c01 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 1.202096 Nov 02 21:36:54.238563 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1636/3417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:53 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:54.251322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:54.252215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:54.261067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:54.261833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:54.262570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:54.263509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:54.264325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:54.265011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:54.811613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:54.823083 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5fa9fe95-6be5-41d1-ab39-ddcd2db7c92a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1534 microversion: 2.1 time: 0.956698 Nov 02 21:36:54.825302 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1782/3418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:53 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1534 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:54.833572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:54.834765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:54.853699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:54.855676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:54.857582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:54.860069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:54.860784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:54.861655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:54.871194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:54.872357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:54.905892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:54.912308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:54.918256 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e82aaa2a-946c-4a0b-9d25-c3f2639df796 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.675073 Nov 02 21:36:54.920180 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1637/3419] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:54 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:55.261099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:55.262447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:55.264636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:55.265594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:55.281055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:55.281771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:55.286889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:55.287869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:55.288707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:55.289737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:55.422866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:55.441817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-605240fc-a982-48a6-b421-9cc4b59d39b7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.614978 Nov 02 21:36:55.442655 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1783/3420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:54 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:55.746509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:55.765861 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c1dd2d7-ffe6-4686-988a-e5235acf01fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.508900 Nov 02 21:36:55.767493 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1638/3421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:55 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:55.848345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:55.849656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:55.856699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:55.857791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:55.862600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:55.862600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:55.862600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:55.862600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:55.951763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:55.952805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:55.963815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:55.965143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:55.968024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:55.970417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:55.971013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:55.972573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:56.493136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:56.516610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f83735b6-5219-4b9b-98b0-99dd3d9769cd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1534 microversion: 2.1 time: 0.667418 Nov 02 21:36:56.545065 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1784/3422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:55 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1534 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:56.575630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:56.576389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:56.602077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:56.602853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:56.603650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:56.604715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:56.605586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:56.606373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:56.676492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:56.708793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:56.714643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:56.720856 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2bbdf6f0-76d4-48d9-b473-66eff88a2d88 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.768228 Nov 02 21:36:56.720856 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1639/3423] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:55 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:36:56.792499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:36:56.793757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:56.794673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:56.805595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:56.806880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:56.809781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:56.810811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:56.813216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:56.813925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:57.102007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:57.118253 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d706541-a1d8-4ca4-8535-4bd40c126ef4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.571212 Nov 02 21:36:57.118765 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1785/3424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:56 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:57.279577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:57.289359 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-696a2417-88e0-4de6-93ea-f3bdab8621e8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.501473 Nov 02 21:36:57.291966 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1640/3425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:56 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:36:57.547463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:57.549121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:57.567425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:57.568131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:57.568985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:57.570122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:57.570595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:57.571040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:57.760622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:57.760622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:57.789904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:57.796324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:57.797159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:57.802554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:57.804280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:57.809037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:58.213757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:58.230529 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee4c2087-4073-4adb-a406-3e4a8aff020a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 200 len: 1492 microversion: 2.1 time: 0.686618 Nov 02 21:36:58.233152 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1786/3426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:57 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 1492 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:58.353170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89ca0db1-deaa-4992-90d7-ccdc3de632c8 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Action: 'create', calling method: .version_select at 0x7f9b6970b040>, body: {"pool": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:58.615188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:58.627302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:58.629424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:58.630958 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ef54d1e5-8817-4ac2-bc4f-e95f61c57b17 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.886524 Nov 02 21:36:58.632164 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1641/3427] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:36:57 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:36:58.666957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:58.671992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:58.697272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:58.698232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:58.700654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:58.700654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:58.702925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:58.703799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:59.125863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:59.134455 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6d35aaa5-51e7-43e9-81a2-0987a0d9d7db tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1511 microversion: 2.1 time: 0.500888 Nov 02 21:36:59.159544 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1642/3428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:58 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:59.166557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e1558562-438b-458b-a539-42761918c203 req-225f35ed-d79e-4b00-b700-6b49a99e751e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6", "name": "network-vif-deleted", "tag": "4e3e1252-c5a6-4c9d-bd85-806e0c449764"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:36:59.177885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1558562-438b-458b-a539-42761918c203 req-225f35ed-d79e-4b00-b700-6b49a99e751e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:59.178809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1558562-438b-458b-a539-42761918c203 req-225f35ed-d79e-4b00-b700-6b49a99e751e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:59.180219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1558562-438b-458b-a539-42761918c203 req-225f35ed-d79e-4b00-b700-6b49a99e751e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:59.193165 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e1558562-438b-458b-a539-42761918c203 req-225f35ed-d79e-4b00-b700-6b49a99e751e service nova] Creating event network-vif-deleted:4e3e1252-c5a6-4c9d-bd85-806e0c449764 for instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 on n-h1-860863-4 Nov 02 21:36:59.199279 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e1558562-438b-458b-a539-42761918c203 req-225f35ed-d79e-4b00-b700-6b49a99e751e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038172 Nov 02 21:36:59.200587 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1643/3429] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:36:59.208098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:59.209217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:36:59.217979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:59.217979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:59.217979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:59.219790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:36:59.220518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:36:59.221362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:36:59.963894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:36:59.978203 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9958de2f-b72c-4b41-bd45-8db959354ea4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.775294 Nov 02 21:36:59.978815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1644/3430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:59 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:36:59.998624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:36:59.998624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:00.010319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:00.010856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:00.012302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:00.021517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:00.022654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:00.024657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:00.058869 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] HTTP exception thrown: Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 could not be found. Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Request method failure captured: Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 HTTP/1.1 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGphY35NfxCVDRyEKnzUsUBiPMSRJ706VBrdJy2x5nZRsvtRzY4V9gtuNPg7cDQhd-cW4SJ5sjw_eaIQhbvS8ekQO_f3fck_Q1TrphTbKmxYOb7dPfsFbw-ki2HXxoR_ZTUSx_XAznmC6KsK-ElB3KnkhtRTlB9099UxlZNN_2C56s Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MigrationsAdminTest-129171093-project Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 64f57cf5139c4937b8158f8d9aef011b Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MigrationsAdminTest-129171093-project Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 could not be found. Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6'} Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 could not be found. Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 could not be found. Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:00.061749 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 could not be found. Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Returning 404 to user: Instance b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81dbbe66-5027-4f93-970d-1f10c3ff65f9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6" status: 404 len: 111 microversion: 2.1 time: 0.083432 Nov 02 21:37:00.068042 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1645/3431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:36:59 2022] GET /compute/v2.1/servers/b0c5c9c6-c531-4e4a-9c92-6d8b7c6bafa6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:37:00.074021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:00.077446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:00.082094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:00.082594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:00.083039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:00.083828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:00.084207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:00.084632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:00.527107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:00.544240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:00.546743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:00.557060 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bfb701d-3df6-4553-bf88-1eca189ef23a tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.488533 Nov 02 21:37:00.574416 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1646/3432] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:00 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:00.582736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a36c639-a383-4342-9bdf-b6410adc5db9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '.version_select at 0x7f9b6d2fce50>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:00.683885 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a36c639-a383-4342-9bdf-b6410adc5db9 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866173509" status: 202 len: 0 microversion: 2.1 time: 0.108230 Nov 02 21:37:00.684481 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1647/3433] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:37:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866173509 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:37:00.709752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:00.710635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:00.718163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:00.718993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:00.719588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:00.720472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:00.721137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:00.721944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:01.129102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:01.138473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-be9aa0d4-927b-4675-b8fa-0bf12414aafc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1488 microversion: 2.1 time: 0.449266 Nov 02 21:37:01.139937 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1648/3434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:00 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1488 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:01.146030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:01.146978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:01.155066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:01.155889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:01.156571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:01.157679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:01.158370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:01.160699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:01.512463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:01.523995 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8587e064-35cc-4ebc-9232-976f9bfd287a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.382275 Nov 02 21:37:01.525377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1649/3435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:01 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:01.543519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:01.547312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:01.556885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:01.557771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:01.558484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:01.559719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:01.560336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:01.562190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:01.731388 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03ce0c0b-9c86-4464-afe6-31419822a2a2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 200 len: 157 microversion: 2.1 time: 0.204210 Nov 02 21:37:01.733367 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1650/3436] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:01 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 157 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:01.742087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-cd4766ec-1652-4155-a0f6-a86914b5774e req-11f68b2c-9d98-40bc-89f1-8044c0cff8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9478ec40-75b3-43e3-88b3-f8ff18b6c267", "tag": "4faf4586-71a6-4fa1-89a2-85f11d5b72fd"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:01.770187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cd4766ec-1652-4155-a0f6-a86914b5774e req-11f68b2c-9d98-40bc-89f1-8044c0cff8d7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:01.771311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cd4766ec-1652-4155-a0f6-a86914b5774e req-11f68b2c-9d98-40bc-89f1-8044c0cff8d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:01.772208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cd4766ec-1652-4155-a0f6-a86914b5774e req-11f68b2c-9d98-40bc-89f1-8044c0cff8d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:01.831005 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-cd4766ec-1652-4155-a0f6-a86914b5774e req-11f68b2c-9d98-40bc-89f1-8044c0cff8d7 service nova] Creating event network-changed:4faf4586-71a6-4fa1-89a2-85f11d5b72fd for instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 on n-h2-860863-4 Nov 02 21:37:01.837494 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-cd4766ec-1652-4155-a0f6-a86914b5774e req-11f68b2c-9d98-40bc-89f1-8044c0cff8d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102451 Nov 02 21:37:01.838863 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1651/3437] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:01.846380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:01.847387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:01.893222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:01.893723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:01.894169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:01.897016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:01.897016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:01.897016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:02.554354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:02.571181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:02.573232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:02.575877 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-268a26ce-5638-4c37-bb27-c75e13b02946 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.735292 Nov 02 21:37:02.577759 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1652/3438] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:01 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:02.600922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:02.602469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:02.630296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:02.630296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:02.630296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:02.630296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:02.630296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:02.630296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:03.751798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:03.762653 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-897a0caf-77c3-44ed-81b3-8c41893db639 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.183423 Nov 02 21:37:03.763253 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1653/3439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:02 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:03.778358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:03.779747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:03.801943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:03.802439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:03.802877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:03.803581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:03.804045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:03.807828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:03.995374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89ca0db1-deaa-4992-90d7-ccdc3de632c8 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.750369 Nov 02 21:37:03.995983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1787/3440] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:36:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:04.001752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:04.003300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:04.019938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:04.020578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:04.023815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:04.024824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:04.025429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:04.025958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:04.080699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:37:04.186686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:04.194699 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3230c77c-f949-4dbe-b064-5797d4c45b83 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.426635 Nov 02 21:37:04.201937 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1654/3441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:03 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:04.201937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:04.201937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:04.208342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:04.209689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:04.210366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:04.211269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:04.211917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:04.212532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:04.442764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d37929f5-2095-4536-b520-062ce8535ab1 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 204 len: 0 microversion: 2.1 time: 0.445324 Nov 02 21:37:04.444771 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1788/3442] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:37:03 2022] DELETE /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:37:04.450528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:04.451459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:04.451627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:04.462566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:04.464824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:04.466211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:04.466512 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-746bb393-f46a-4247-9bba-eeee9ff366f5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.270156 Nov 02 21:37:04.466928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:04.467566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:04.467964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1655/3443] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:04 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:04.469175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:04.470642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:04.471329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:04.472451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-538be589-12a2-43d2-9100-e639b484c32a tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Calling method '.version_select at 0x7f9b685bc820>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:05.123843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:05.139939 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9df34563-9688-41ca-b86e-877f29865a62 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.692278 Nov 02 21:37:05.143993 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1789/3444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:04 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:05.164222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:05.164222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:05.165160 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-538be589-12a2-43d2-9100-e639b484c32a tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/336a6bb4-1d3b-4418-8c47-b935d23bd5a0" status: 200 len: 142 microversion: 2.1 time: 0.695978 Nov 02 21:37:05.165763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1656/3445] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:37:04 2022] GET /compute/v2.1/os-floating-ips/336a6bb4-1d3b-4418-8c47-b935d23bd5a0 => generated 142 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:05.172603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:05.179056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:05.179571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:05.180077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:05.180526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:05.184321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:05.184860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:05.186913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:05.187751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:05.188429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:05.189266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:05.192654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:05.193341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:05.193970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:05.196787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:05.630697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:05.647749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:05.661634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-697a5f36-d82c-4745-b0c0-1996c2a1fc36 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.494817 Nov 02 21:37:05.673145 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1657/3446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:05 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:05.673145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05098d8b-0ad1-49ac-98ce-ab1c7f715844 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Calling method '.version_select at 0x7f9b6d1d9940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:05.684607 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ba7c793-961d-40a6-98bd-dd98a606092c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1469 microversion: 2.1 time: 0.535768 Nov 02 21:37:05.687162 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1790/3447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:05 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1469 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:05.732365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:05.732365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:05.759097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:05.759949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:05.760654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:05.761855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:05.762554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:05.764243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:06.119904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:06.139363 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb2b86ce-3f39-4157-81f0-271f8d27cf68 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.415500 Nov 02 21:37:06.140907 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1791/3448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:05 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:06.146063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:06.146951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:06.167296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:06.167821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:06.170461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:06.172423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:06.174031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:06.174489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:06.406516 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05098d8b-0ad1-49ac-98ce-ab1c7f715844 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.737182 Nov 02 21:37:06.430141 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1658/3449] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:37:05 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:06.439953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:06.442701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:06.468296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:06.469484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:06.470513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:06.472338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:06.475132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:06.476055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:07.002456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:07.037760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:07.037760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:07.037760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5b855ce-dedf-40b6-a8ee-51e853a646c0 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.895022 Nov 02 21:37:07.038221 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1792/3450] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:06 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:07.049507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-000f113a-041e-4aee-bba6-7f0b96b00877 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Calling method '.version_select at 0x7f9b6882f940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:07.832991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:07.835331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:07.846803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-386ffb08-e195-4e53-a23e-29f6514f1f5a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.412997 Nov 02 21:37:07.875358 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1659/3451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:06 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:07.880855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:07.881717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:07.906483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:07.909979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:07.913227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:07.918464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:07.923071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:07.923868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:08.371566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:08.382347 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1e04a3a-a555-41ad-82e9-9542d01c9dad tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 200 len: 1469 microversion: 2.1 time: 0.505733 Nov 02 21:37:08.382947 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1660/3452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:07 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 1469 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:08.398165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:08.399448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:08.407497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:08.408362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:08.409035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:08.409922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:08.410544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:08.411163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:08.927646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:08.944066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a123fa93-3c24-4f3d-a73b-ca422f297c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.552613 Nov 02 21:37:08.944066 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1661/3453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:08 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:08.944066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1699921413", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "abf3b988-f5ac-44d9-9b37-c74857f22c78"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:09.055097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] validate_networks() for [('abf3b988-f5ac-44d9-9b37-c74857f22c78', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:37:09.661251 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-000f113a-041e-4aee-bba6-7f0b96b00877 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/336a6bb4-1d3b-4418-8c47-b935d23bd5a0" status: 202 len: 0 microversion: 2.1 time: 2.621981 Nov 02 21:37:09.665278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1793/3454] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:37:07 2022] DELETE /compute/v2.1/os-floating-ips/336a6bb4-1d3b-4418-8c47-b935d23bd5a0 => generated 0 bytes in 2627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:37:09.672861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:09.674357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:09.694321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:09.694854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:09.695307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:09.696039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:09.701096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:09.702988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.255633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:10.282877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:10.289128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:10.290832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a03c96d4-f4e3-4a36-9c87-16a75c9d7917 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.624102 Nov 02 21:37:10.309751 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1794/3455] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:09 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:10.327334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e76aa4d4-2195-48bb-8e2f-0dc851ea7cea req-a2c670fe-eb0d-4b82-9807-b39bc99f8b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9478ec40-75b3-43e3-88b3-f8ff18b6c267", "name": "network-vif-plugged", "status": "completed", "tag": "4faf4586-71a6-4fa1-89a2-85f11d5b72fd"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:10.365329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e76aa4d4-2195-48bb-8e2f-0dc851ea7cea req-a2c670fe-eb0d-4b82-9807-b39bc99f8b29 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.368902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e76aa4d4-2195-48bb-8e2f-0dc851ea7cea req-a2c670fe-eb0d-4b82-9807-b39bc99f8b29 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.369866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e76aa4d4-2195-48bb-8e2f-0dc851ea7cea req-a2c670fe-eb0d-4b82-9807-b39bc99f8b29 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.387936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:37:10.392115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:37:10.392723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:37:10.393061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:37:10.393687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:37:10.399612 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e76aa4d4-2195-48bb-8e2f-0dc851ea7cea req-a2c670fe-eb0d-4b82-9807-b39bc99f8b29 service nova] Creating event network-vif-plugged:4faf4586-71a6-4fa1-89a2-85f11d5b72fd for instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 on n-h2-860863-4 Nov 02 21:37:10.413091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e76aa4d4-2195-48bb-8e2f-0dc851ea7cea req-a2c670fe-eb0d-4b82-9807-b39bc99f8b29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097638 Nov 02 21:37:10.422151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1795/3456] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:10.426717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.427485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.456429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.461245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.461933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.464964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.519435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:37:10.529142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for user 368ab16b50f84f0d9cf6e79e039dc257 and project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:37:10.554803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:37:10.558583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:37:10.598757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:10.666227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c3fb2c85-3286-4c34-9328-2668042c1e5c req-f82538da-3104-4845-97a5-383bc4d377ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6f276d-d362-46a3-94e9-ac8f4a4d9223", "name": "network-vif-deleted", "tag": "a1f589d8-2ac3-40c4-b136-9cf3be98b245"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:10.678391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c3fb2c85-3286-4c34-9328-2668042c1e5c req-f82538da-3104-4845-97a5-383bc4d377ac service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.679137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c3fb2c85-3286-4c34-9328-2668042c1e5c req-f82538da-3104-4845-97a5-383bc4d377ac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.683349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c3fb2c85-3286-4c34-9328-2668042c1e5c req-f82538da-3104-4845-97a5-383bc4d377ac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.711553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41704887-a99d-4dae-856c-0431f9be1fed tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761465 Nov 02 21:37:10.713146 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1662/3457] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:37:10.720242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:10.720529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: eb6f276d-d362-46a3-94e9-ac8f4a4d9223] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:10.721487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c3fb2c85-3286-4c34-9328-2668042c1e5c req-f82538da-3104-4845-97a5-383bc4d377ac service nova] Creating event network-vif-deleted:a1f589d8-2ac3-40c4-b136-9cf3be98b245 for instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 on n-h1-860863-4 Nov 02 21:37:10.728607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.729404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.730079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.730963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.731626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.732556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.735156 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c3fb2c85-3286-4c34-9328-2668042c1e5c req-f82538da-3104-4845-97a5-383bc4d377ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.308671 Nov 02 21:37:10.737513 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1796/3458] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:10.747882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67b86df8-6c50-452a-95b1-9ab15cdc12c3 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Action: 'create', calling method: .version_select at 0x7f9b6d11d9d0>, body: {"pool": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:10.768425 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] HTTP exception thrown: Instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 could not be found. Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Request method failure captured: Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 HTTP/1.1 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuGphY35NfxCVDRyEKnzUsUBiPMSRJ706VBrdJy2x5nZRsvtRzY4V9gtuNPg7cDQhd-cW4SJ5sjw_eaIQhbvS8ekQO_f3fck_Q1TrphTbKmxYOb7dPfsFbw-ki2HXxoR_ZTUSx_XAznmC6KsK-ElB3KnkhtRTlB9099UxlZNN_2C56s Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MigrationsAdminTest-129171093-project Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 64f57cf5139c4937b8158f8d9aef011b Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MigrationsAdminTest-129171093-project Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 could not be found. Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'eb6f276d-d362-46a3-94e9-ac8f4a4d9223'} Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 could not be found. Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 could not be found. Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:10.770905 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 could not be found. Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Returning 404 to user: Instance eb6f276d-d362-46a3-94e9-ac8f4a4d9223 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:37:10.776233 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05492231-69e3-400f-8fbb-7a7b1c69828c tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223" status: 404 len: 111 microversion: 2.1 time: 0.059691 Nov 02 21:37:10.778713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1663/3459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:10 2022] GET /compute/v2.1/servers/eb6f276d-d362-46a3-94e9-ac8f4a4d9223 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:37:10.787294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:10.788750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:10.798246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.798972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.800573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:10.801195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:10.801883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:10.802511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:11.338452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:11.351045 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c344478f-1064-4be6-be2b-7aab06d1db4f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1367 microversion: 2.1 time: 0.571125 Nov 02 21:37:11.352404 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1664/3460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:10 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1367 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:11.371586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2faa556-fcb3-4b3a-91d7-cdd600c31811 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:11.373222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2faa556-fcb3-4b3a-91d7-cdd600c31811 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:11.480569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2faa556-fcb3-4b3a-91d7-cdd600c31811 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:11.491042 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2faa556-fcb3-4b3a-91d7-cdd600c31811 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1215 microversion: 2.1 time: 0.137096 Nov 02 21:37:11.505303 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1665/3461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:11 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:11.505303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:11.505303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:11.506176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:11.506946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:11.507473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:11.508253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:11.509114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:11.509660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:11.572362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:37:11.988335 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d2ed057-4f0e-444e-936e-bd7e4c7ca60a tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 204 len: 0 microversion: 2.1 time: 0.495128 Nov 02 21:37:11.989184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1666/3462] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:37:11 2022] DELETE /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:37:12.002209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:12.002931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:12.031028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:12.031541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:12.031995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:12.032729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:12.040408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:12.041019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:12.431706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:12.454102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:12.460732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:12.463827 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2140f8d7-a708-49e3-80b0-073c62ed8341 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.468653 Nov 02 21:37:12.478938 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1667/3463] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:11 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:12.502610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:12.503374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:12.527083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:12.527083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:12.527083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:12.527083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:12.527083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:12.527951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:13.518561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:13.534414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4c9b458e-a20d-4d11-9782-e414de503492 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1469 microversion: 2.1 time: 1.053294 Nov 02 21:37:13.536184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1668/3464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:12 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1469 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:13.543033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:13.544536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:13.583147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:13.583651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:13.588114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:13.589960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:13.590647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:13.591262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:14.377168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:14.387183 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-150bbf37-f61e-4241-888a-ec7044492da5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1556 microversion: 2.1 time: 0.849598 Nov 02 21:37:14.406246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1669/3465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:13 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1556 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:14.429160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:14.430075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:14.439717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:14.440472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:14.441142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:14.442012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:14.442626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:14.443212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:14.820449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:14.852905 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-373a2bd6-f1b6-495c-b701-f43ba6d738dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1267 microversion: 2.1 time: 0.445211 Nov 02 21:37:14.862376 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1670/3466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:14 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1267 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:14.876500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:14.880580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:14.904171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:14.909611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:14.910342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:14.911282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:14.913296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:14.914831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:15.920958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:15.941969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:15.948676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:15.956093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48a9e2bc-e398-4f00-9080-5e3429db6e78 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.092313 Nov 02 21:37:15.964356 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1671/3467] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:14 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:15.994418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:16.001802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:16.017877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:16.018773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:16.019474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:16.020444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:16.026556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:16.027336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:16.744005 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f50f9769-d4d2-4cd7-ac35-33bf3029e804 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.777682 Nov 02 21:37:16.749609 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1672/3468] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:37:15 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-interface => generated 284 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:16.763570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:16.763570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:16.787358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:16.797352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:16.805406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:16.808171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:16.814562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:16.819499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:17.321827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:17.336231 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3e4b01a4-7e41-445a-8e4f-d4e102f748a0 tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1427 microversion: 2.1 time: 0.582464 Nov 02 21:37:17.339930 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1673/3469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:16 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1427 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:17.359505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:17.362289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:17.370451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:17.375150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:17.377876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:17.379195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:17.380757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:17.381495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:17.494211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67b86df8-6c50-452a-95b1-9ab15cdc12c3 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.754930 Nov 02 21:37:17.494811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1797/3470] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:37:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:17.537701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:17.553521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:17.575184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:17.575929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:17.576621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:17.583797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:17.587700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:17.588567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:17.703057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:17.713050 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14b9ad83-ab8b-479c-8a24-b758c6821a9a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1273 microversion: 2.1 time: 0.371022 Nov 02 21:37:17.713568 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1674/3471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:17 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:17.733672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e06d08c2-7f7b-465a-876c-d2327fc5eece req-5b5b7b7c-225e-48a6-b585-234ca1890baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af801d7-895e-4005-8df7-5c8e47eba467", "name": "network-vif-deleted", "tag": "081b5980-608f-454c-9129-5e3e9c6aa74e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:17.755970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e06d08c2-7f7b-465a-876c-d2327fc5eece req-5b5b7b7c-225e-48a6-b585-234ca1890baa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:17.756778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e06d08c2-7f7b-465a-876c-d2327fc5eece req-5b5b7b7c-225e-48a6-b585-234ca1890baa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:17.757420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e06d08c2-7f7b-465a-876c-d2327fc5eece req-5b5b7b7c-225e-48a6-b585-234ca1890baa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:17.773313 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e06d08c2-7f7b-465a-876c-d2327fc5eece req-5b5b7b7c-225e-48a6-b585-234ca1890baa service nova] Creating event network-vif-deleted:081b5980-608f-454c-9129-5e3e9c6aa74e for instance 6af801d7-895e-4005-8df7-5c8e47eba467 on n-h2-860863-4 Nov 02 21:37:17.782321 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e06d08c2-7f7b-465a-876c-d2327fc5eece req-5b5b7b7c-225e-48a6-b585-234ca1890baa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066814 Nov 02 21:37:17.784091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1675/3472] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:17.791080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f4f1730-371b-42f7-9273-cdaf4ef59dd0 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Calling method '.version_select at 0x7f9b6d29de50>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:18.441773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:18.460457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:18.464404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:18.469034 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdbb8fe6-2b41-449e-b7a5-9305d0466e69 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.972861 Nov 02 21:37:18.469852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1798/3473] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:17 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:18.490130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:18.491216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:18.514574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:18.515140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:18.515630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:18.519705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:18.520349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:18.523222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:18.638083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:18.639832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:18.640329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:18.641229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lazy-loading 'fault' on Instance uuid 6af801d7-895e-4005-8df7-5c8e47eba467 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:37:18.833248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f57cf5139c4937b8158f8d9aef011b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eba8c9cfbe46c99316db189ccbe690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:18.843038 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95bab775-2d88-4dc8-b175-529b32cdfbbd tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 200 len: 1303 microversion: 2.1 time: 0.370488 Nov 02 21:37:18.861838 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1799/3474] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:18 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 1303 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:18.874900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:18.874900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:18.887313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:18.891912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:18.893614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:18.894481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:18.895368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:18.896300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:19.214797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:19.241732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a71e593-d23e-46da-9bb3-c149aef1822b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1273 microversion: 2.1 time: 0.373901 Nov 02 21:37:19.242654 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1800/3475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:18 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1273 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:19.506682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:19.507107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:19.525341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:19.525341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:19.525341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:19.526303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:19.527111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:19.527743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:19.984056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:20.017512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:20.019671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:20.021140 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea3ebc4c-4876-4356-ab5f-a802d5590111 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.518977 Nov 02 21:37:20.022246 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1801/3476] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:19 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:20.027232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:20.031087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] [instance: 6af801d7-895e-4005-8df7-5c8e47eba467] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:20.047754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:20.047754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:20.047754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:20.051780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:20.053495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:20.054412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:20.106399 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] HTTP exception thrown: Instance 6af801d7-895e-4005-8df7-5c8e47eba467 could not be found. Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Request method failure captured: Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 HTTP/1.1 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuGphY35NfxCVDRyEKnzUsUBiPMSRJ706VBrdJy2x5nZRsvtRzY4V9gtuNPg7cDQhd-cW4SJ5sjw_eaIQhbvS8ekQO_f3fck_Q1TrphTbKmxYOb7dPfsFbw-ki2HXxoR_ZTUSx_XAznmC6KsK-ElB3KnkhtRTlB9099UxlZNN_2C56s Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e5eba8c9cfbe46c99316db189ccbe690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e5eba8c9cfbe46c99316db189ccbe690 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-MigrationsAdminTest-129171093 Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-MigrationsAdminTest-129171093-project Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 64f57cf5139c4937b8158f8d9aef011b Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-MigrationsAdminTest-129171093-project Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 6af801d7-895e-4005-8df7-5c8e47eba467 could not be found. Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '6af801d7-895e-4005-8df7-5c8e47eba467'} Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af801d7-895e-4005-8df7-5c8e47eba467 could not be found. Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af801d7-895e-4005-8df7-5c8e47eba467 could not be found. Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:20.109941 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af801d7-895e-4005-8df7-5c8e47eba467 could not be found. Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] Returning 404 to user: Instance 6af801d7-895e-4005-8df7-5c8e47eba467 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-802779b7-de64-4e64-8895-8f031e30f0aa tempest-MigrationsAdminTest-129171093 tempest-MigrationsAdminTest-129171093-project] 10.222.0.25 "GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467" status: 404 len: 111 microversion: 2.1 time: 0.094949 Nov 02 21:37:20.121619 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1802/3477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:20 2022] GET /compute/v2.1/servers/6af801d7-895e-4005-8df7-5c8e47eba467 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:37:20.130939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ece3d80e-80b6-417a-8854-e1c89df1d0bd req-7eaded03-c509-4857-92e6-363a9b49597c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9478ec40-75b3-43e3-88b3-f8ff18b6c267", "tag": "4faf4586-71a6-4fa1-89a2-85f11d5b72fd"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:20.148399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ece3d80e-80b6-417a-8854-e1c89df1d0bd req-7eaded03-c509-4857-92e6-363a9b49597c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:20.149256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ece3d80e-80b6-417a-8854-e1c89df1d0bd req-7eaded03-c509-4857-92e6-363a9b49597c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:20.149900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ece3d80e-80b6-417a-8854-e1c89df1d0bd req-7eaded03-c509-4857-92e6-363a9b49597c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:20.180647 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ece3d80e-80b6-417a-8854-e1c89df1d0bd req-7eaded03-c509-4857-92e6-363a9b49597c service nova] Creating event network-changed:4faf4586-71a6-4fa1-89a2-85f11d5b72fd for instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 on n-h2-860863-4 Nov 02 21:37:20.187807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ece3d80e-80b6-417a-8854-e1c89df1d0bd req-7eaded03-c509-4857-92e6-363a9b49597c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064914 Nov 02 21:37:20.189266 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1803/3478] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:20.273021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:20.274160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:20.297437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:20.302973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:20.302973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:20.302973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:20.302973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:20.302973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:20.506740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:21.328123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:21.370823 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e408d4f4-1cdd-4fd7-9568-05c1ea9dccd0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 1.102726 Nov 02 21:37:21.378778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1804/3479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:20 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:21.396177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:21.397750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:21.443715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:21.444587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:21.445428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:21.446665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:21.447476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:21.448229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:21.488285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:21.888353 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f4f1730-371b-42f7-9273-cdaf4ef59dd0 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90" status: 202 len: 0 microversion: 2.1 time: 4.102750 Nov 02 21:37:21.892283 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1676/3480] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:37:17 2022] DELETE /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90 => generated 0 bytes in 4107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:37:21.908787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1320162f-3de5-4e9e-ad88-1c8bd1b5b198 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Calling method '.version_select at 0x7f9b6d29d0d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:22.085758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-1320162f-3de5-4e9e-ad88-1c8bd1b5b198 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9423eea2-01ad-4099-9351-f4b8eb411e90 could not be found", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:37:22.086450 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1320162f-3de5-4e9e-ad88-1c8bd1b5b198 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] HTTP exception thrown: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1320162f-3de5-4e9e-ad88-1c8bd1b5b198 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Request method failure captured: Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90 HTTP/1.1 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuL51EgYMvJvWr6rUy5ZcnoUHmHi0oidNidxzdONTjDFgaMV8cjBxc2X0UzKuzxlKZPJ5JHiQLojKN41uFcjczFr-odevNossAA2Jd4Taob9s9q-24TzIwhJEvYZBZgIqIwydzWULb4tKcW2Jpymnfw-u9be6m4E7NQl36ViW5u4mRc Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 521270cbefd84e17900244dc3e72bff7 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsTestJSON-192275159 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_521270cbefd84e17900244dc3e72bff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/521270cbefd84e17900244dc3e72bff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/521270cbefd84e17900244dc3e72bff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/521270cbefd84e17900244dc3e72bff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsTestJSON-192275159 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 521270cbefd84e17900244dc3e72bff7 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsTestJSON-192275159 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsTestJSON-192275159-project Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 71293e85d9bc4be798dd348800c0901e Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsTestJSON-192275159-project Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: exception: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9423eea2-01ad-4099-9351-f4b8eb411e90'} Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9423eea2-01ad-4099-9351-f4b8eb411e90 could not be found Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1edd247f-5706-4334-8b8c-26b84915e794'] Nov 02 21:37:22.089478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90. Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1320162f-3de5-4e9e-ad88-1c8bd1b5b198 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Returning 404 to user: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:37:22.095242 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1320162f-3de5-4e9e-ad88-1c8bd1b5b198 tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90" status: 404 len: 111 microversion: 2.1 time: 0.187017 Nov 02 21:37:22.098647 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1677/3481] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:37:21 2022] GET /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:37:22.106263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-341a06cd-6354-4642-ab94-aeddab7e75de tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Calling method '.version_select at 0x7f9b686211f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:22.266197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-341a06cd-6354-4642-ab94-aeddab7e75de tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9423eea2-01ad-4099-9351-f4b8eb411e90 could not be found", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:37:22.266979 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-341a06cd-6354-4642-ab94-aeddab7e75de tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] HTTP exception thrown: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.281879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-341a06cd-6354-4642-ab94-aeddab7e75de tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Request method failure captured: Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90 HTTP/1.1 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuL51EgYMvJvWr6rUy5ZcnoUHmHi0oidNidxzdONTjDFgaMV8cjBxc2X0UzKuzxlKZPJ5JHiQLojKN41uFcjczFr-odevNossAA2Jd4Taob9s9q-24TzIwhJEvYZBZgIqIwydzWULb4tKcW2Jpymnfw-u9be6m4E7NQl36ViW5u4mRc Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 521270cbefd84e17900244dc3e72bff7 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-FloatingIPsTestJSON-192275159 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_521270cbefd84e17900244dc3e72bff7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/521270cbefd84e17900244dc3e72bff7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/521270cbefd84e17900244dc3e72bff7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/521270cbefd84e17900244dc3e72bff7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-FloatingIPsTestJSON-192275159 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 521270cbefd84e17900244dc3e72bff7 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-FloatingIPsTestJSON-192275159 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-FloatingIPsTestJSON-192275159-project Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 71293e85d9bc4be798dd348800c0901e Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-FloatingIPsTestJSON-192275159-project Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: exception: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9423eea2-01ad-4099-9351-f4b8eb411e90'} Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9423eea2-01ad-4099-9351-f4b8eb411e90 could not be found Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0209576-4e38-498b-b8ba-edebff8be68b'] Nov 02 21:37:22.286310 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90. Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-341a06cd-6354-4642-ab94-aeddab7e75de tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] Returning 404 to user: Floating IP not found for ID 9423eea2-01ad-4099-9351-f4b8eb411e90 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-341a06cd-6354-4642-ab94-aeddab7e75de tempest-FloatingIPsTestJSON-192275159 tempest-FloatingIPsTestJSON-192275159-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90" status: 404 len: 111 microversion: 2.1 time: 0.189238 Nov 02 21:37:22.291452 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1678/3482] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:37:22 2022] DELETE /compute/v2.1/os-floating-ips/9423eea2-01ad-4099-9351-f4b8eb411e90 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:37:22.342745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:22.348057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:22.352978 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a3876373-a882-429f-8122-20991f401ad7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.970542 Nov 02 21:37:22.353657 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1805/3483] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:21 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:22.427180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:22.428299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:22.447418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:22.452140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:22.453325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:22.457679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:22.475258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:22.478845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:23.162937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:23.175219 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e8fe4f11-6698-4f11-bd46-6a4affb9dfa7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 0.752403 Nov 02 21:37:23.175812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1679/3484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:22 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:23.389833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:23.391052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:23.406950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:23.409562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:23.410505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:23.411470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:23.414009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:23.416760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:24.173853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-213465cf-0c33-409d-aea6-83fde375d8f0 req-c8677ef8-7e50-4f29-bdc3-e997c59f330d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5246e2d9-6502-4b53-b677-c95eaccb2c99", "tag": "3d772d58-1688-4351-8c3c-7485a3f89f0c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:24.197186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-213465cf-0c33-409d-aea6-83fde375d8f0 req-c8677ef8-7e50-4f29-bdc3-e997c59f330d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:24.198086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-213465cf-0c33-409d-aea6-83fde375d8f0 req-c8677ef8-7e50-4f29-bdc3-e997c59f330d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:24.198991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-213465cf-0c33-409d-aea6-83fde375d8f0 req-c8677ef8-7e50-4f29-bdc3-e997c59f330d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:24.253784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-213465cf-0c33-409d-aea6-83fde375d8f0 req-c8677ef8-7e50-4f29-bdc3-e997c59f330d service nova] Creating event network-changed:3d772d58-1688-4351-8c3c-7485a3f89f0c for instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 on n-h2-860863-4 Nov 02 21:37:24.253784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-213465cf-0c33-409d-aea6-83fde375d8f0 req-c8677ef8-7e50-4f29-bdc3-e997c59f330d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.757774 Nov 02 21:37:24.253784 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1680/3485] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:37:24.273333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:24.275393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:24.298160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:24.299046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:24.300531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:24.301576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:24.304003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:24.305734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:24.706330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:24.727319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:24.735843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:24.738477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c615d4a-b72d-4fc8-aee7-5bac41390582 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.355097 Nov 02 21:37:24.740287 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1806/3486] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:23 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:25.079186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:25.083808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:25.128642 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8e1bfa9-8b0c-4ed9-8c2a-18d78f4a4da3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 0.858533 Nov 02 21:37:25.132020 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1681/3487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:24 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:25.765952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:25.766565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:25.777391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:25.778010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:25.786639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:25.796405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:25.802568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:25.804493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:25.807321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:26.163751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:26.164364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:26.176564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:26.177541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:26.178175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:26.179134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:26.179760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:26.180369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:26.353614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:26.364217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:26.394977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:26.399459 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e0e869f-42ec-43a5-bd6e-0c84fc24a035 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.637990 Nov 02 21:37:26.404903 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1807/3488] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:25 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:27.219254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:27.233368 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e321101-9f96-49ea-afba-2e6865faadb3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 1.073813 Nov 02 21:37:27.233368 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1682/3489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:26 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:27.433976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:27.435851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:27.476971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:27.478571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:27.479261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:27.484802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:27.485608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:27.486215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:28.260742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:28.262079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:28.276148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:28.276662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:28.285339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:28.290302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:28.291522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:28.291985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:28.907721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:28.930761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:28.948956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:28.956448 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f03014ec-7dcc-43ea-a727-d8b7a4e2fa70 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.526335 Nov 02 21:37:28.962878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1808/3490] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:27 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:29.310562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:29.338665 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b5317af-fedd-4d23-ad31-c42dab9d9205 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 1.077064 Nov 02 21:37:29.345186 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1683/3491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:28 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:29.362769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e51dc08-ae3f-424e-bea0-50686970f7f3 tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] Calling method '.version_select at 0x7f9b6d11db80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:29.394904 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e51dc08-ae3f-424e-bea0-50686970f7f3 tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.377434 Nov 02 21:37:29.394904 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1809/3492] 10.222.0.25 () {60 vars in 1226 bytes} [Wed Nov 2 21:37:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:37:29.403554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-58ef3b3b-ad54-4526-ad94-3c5bc7a8f440 tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] Action: 'update', calling method: .version_select at 0x7f9b6929d430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:29.984984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:29.985774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:29.996452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:29.998902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:30.003053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:30.008254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:30.008254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:30.008254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:30.201933 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-58ef3b3b-ad54-4526-ad94-3c5bc7a8f440 tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.804019 Nov 02 21:37:30.205524 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1684/3493] 10.222.0.25 () {62 vars in 1247 bytes} [Wed Nov 2 21:37:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:37:30.376240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-11b16da5-bf5b-487f-bee2-341b15610f70 req-6207129b-1801-457f-b094-963ce8c44586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-plugged", "status": "completed", "tag": "e275aa3b-1168-4e2f-b0eb-2f72e786a728"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:30.409255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-11b16da5-bf5b-487f-bee2-341b15610f70 req-6207129b-1801-457f-b094-963ce8c44586 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:30.415430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-11b16da5-bf5b-487f-bee2-341b15610f70 req-6207129b-1801-457f-b094-963ce8c44586 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:30.416918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-11b16da5-bf5b-487f-bee2-341b15610f70 req-6207129b-1801-457f-b094-963ce8c44586 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:30.471517 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-11b16da5-bf5b-487f-bee2-341b15610f70 req-6207129b-1801-457f-b094-963ce8c44586 service nova] Creating event network-vif-plugged:e275aa3b-1168-4e2f-b0eb-2f72e786a728 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:30.496998 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-11b16da5-bf5b-487f-bee2-341b15610f70 req-6207129b-1801-457f-b094-963ce8c44586 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275728 Nov 02 21:37:30.500229 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1685/3494] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:30.525936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0194a735-e9bb-4082-b3a3-3cb44d618558 tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] Calling method '.version_select at 0x7f9b685bcc10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:30.579576 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0194a735-e9bb-4082-b3a3-3cb44d618558 tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.074084 Nov 02 21:37:30.586289 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1686/3495] 10.222.0.25 () {60 vars in 1226 bytes} [Wed Nov 2 21:37:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:37:30.598719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:30.601587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:30.620075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:30.621409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:30.622994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:30.627352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:30.629660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:30.630280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:30.877694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:30.898674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:30.900630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:30.907625 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a2e6ef1-6278-4ad8-ac3a-a9fa42093994 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.925857 Nov 02 21:37:30.917151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1810/3496] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:29 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:37:30.929978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3332d62c-394a-48d8-855c-d68d7132594b tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] Action: 'update', calling method: .version_select at 0x7f9b687b9ca0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:31.092545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:31.114947 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bb3ab62-10d0-434b-b935-a09772b4210b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 0.517178 Nov 02 21:37:31.127565 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1687/3497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:30 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:31.745522 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3332d62c-394a-48d8-855c-d68d7132594b tempest-QuotaClassesAdmin257Test-1018658296 tempest-QuotaClassesAdmin257Test-1018658296-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.826968 Nov 02 21:37:31.747077 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1811/3498] 10.222.0.25 () {62 vars in 1247 bytes} [Wed Nov 2 21:37:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:37:31.940958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:31.940958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:31.954549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:31.955056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:31.955498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:31.956219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:31.961135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:31.962345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:32.143582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:32.144799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:32.154576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:32.155603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:32.156348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:32.157364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:32.158578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:32.159245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:32.791697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:32.825397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:32.829954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:32.835986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-26057109-07a5-4e6b-99bb-7bec84e4aacf tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.900399 Nov 02 21:37:32.868395 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1688/3499] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:31 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:32.874885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-985802e6-5a55-4c4b-b69d-b49396d952b6 req-a3f92a47-af7d-4cc9-88f6-bd6f0677414c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-plugged", "status": "completed", "tag": "35d64f03-f33e-4ab9-8420-b891f3cc9308"}, {"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-plugged", "status": "completed", "tag": "7f5961db-4af2-4b0f-a483-74c05409c407"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:32.896901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-985802e6-5a55-4c4b-b69d-b49396d952b6 req-a3f92a47-af7d-4cc9-88f6-bd6f0677414c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:32.914873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-985802e6-5a55-4c4b-b69d-b49396d952b6 req-a3f92a47-af7d-4cc9-88f6-bd6f0677414c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:32.915674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-985802e6-5a55-4c4b-b69d-b49396d952b6 req-a3f92a47-af7d-4cc9-88f6-bd6f0677414c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:32.942222 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-985802e6-5a55-4c4b-b69d-b49396d952b6 req-a3f92a47-af7d-4cc9-88f6-bd6f0677414c service nova] Creating event network-vif-plugged:35d64f03-f33e-4ab9-8420-b891f3cc9308 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:32.943699 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-985802e6-5a55-4c4b-b69d-b49396d952b6 req-a3f92a47-af7d-4cc9-88f6-bd6f0677414c service nova] Creating event network-vif-plugged:7f5961db-4af2-4b0f-a483-74c05409c407 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:32.963437 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-985802e6-5a55-4c4b-b69d-b49396d952b6 req-a3f92a47-af7d-4cc9-88f6-bd6f0677414c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093864 Nov 02 21:37:32.973503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1689/3500] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:33.069817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:33.087761 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-62413192-1a19-481e-98b9-98fb29bd118d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 0.951207 Nov 02 21:37:33.090578 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1812/3501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:32 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:37:33.870122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:33.871020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:33.900097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:33.900799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:33.901538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:33.905218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:33.905218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:33.905218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:34.115964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:34.116685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:34.125755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:34.134179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:34.134906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:34.135873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:34.136443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:34.136944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:34.226462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:34.332215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:34.350466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:34.352202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:34.353573 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3dc8b189-4fc7-4dc3-b4b5-2f5fcbc34f62 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.487682 Nov 02 21:37:34.357637 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1690/3502] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:33 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:34.459292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:34.470415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8231bc7f-41f6-4689-bd50-47a4b5b34348 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 0.358513 Nov 02 21:37:34.471405 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1813/3503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:34 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:37:35.124032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5246e2d9-6502-4b53-b677-c95eaccb2c99", "name": "network-vif-plugged", "status": "completed", "tag": "3d772d58-1688-4351-8c3c-7485a3f89f0c"}, {"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-plugged", "status": "completed", "tag": "4fe00742-6aa2-4e8c-afbd-8f04868461c0"}, {"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-plugged", "status": "completed", "tag": "2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:35.144549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:35.148543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:35.148543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:35.225871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] Creating event network-vif-plugged:3d772d58-1688-4351-8c3c-7485a3f89f0c for instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 on n-h2-860863-4 Nov 02 21:37:35.244070 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] Creating event network-vif-plugged:4fe00742-6aa2-4e8c-afbd-8f04868461c0 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:35.244753 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] Creating event network-vif-plugged:2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:35.300114 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-93bba100-fd55-482d-9b32-0ea96e404134 req-9f6bc655-a9bb-4697-9dc9-afd5de7ee067 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.162337 Nov 02 21:37:35.306181 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1691/3504] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:35.384534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:35.385358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:35.401456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:35.404398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:35.405058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:35.406026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:35.409007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:35.409461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:35.495670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:35.496503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:35.523371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:35.525267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:35.525750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:35.529956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:35.533828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:35.535054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:36.472114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:36.484977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:36.490083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:36.491155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:36.501707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf54c642-ca33-4eef-a298-5e1651b377d2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 1.114753 Nov 02 21:37:36.502667 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1814/3505] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:35 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:36.509623 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0569782a-927a-4f80-8fac-e88891a42165 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 1.018224 Nov 02 21:37:36.526736 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1692/3506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:35 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:37.397811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-60ee9326-8b96-4018-9467-a8482b766160 req-b41f4e7c-b30b-4476-b4ea-7f1c7c286510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-plugged", "status": "completed", "tag": "8ef8f96f-40d1-4605-8ab7-0fb83406c4aa"}, {"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-plugged", "status": "completed", "tag": "52ef5d76-a38d-4aa9-95c4-e68c61c33135"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:37.425895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-60ee9326-8b96-4018-9467-a8482b766160 req-b41f4e7c-b30b-4476-b4ea-7f1c7c286510 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:37.427587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-60ee9326-8b96-4018-9467-a8482b766160 req-b41f4e7c-b30b-4476-b4ea-7f1c7c286510 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:37.428953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-60ee9326-8b96-4018-9467-a8482b766160 req-b41f4e7c-b30b-4476-b4ea-7f1c7c286510 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:37.473641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-60ee9326-8b96-4018-9467-a8482b766160 req-b41f4e7c-b30b-4476-b4ea-7f1c7c286510 service nova] Creating event network-vif-plugged:8ef8f96f-40d1-4605-8ab7-0fb83406c4aa for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:37.473641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-60ee9326-8b96-4018-9467-a8482b766160 req-b41f4e7c-b30b-4476-b4ea-7f1c7c286510 service nova] Creating event network-vif-plugged:52ef5d76-a38d-4aa9-95c4-e68c61c33135 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:37.496469 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-60ee9326-8b96-4018-9467-a8482b766160 req-b41f4e7c-b30b-4476-b4ea-7f1c7c286510 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102562 Nov 02 21:37:37.502134 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1815/3507] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:37.536364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:37.542639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:37.554018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:37.557273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:37.572515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:37.594879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:37.598233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:37.600984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:37.601658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:37.602607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:37.603273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:37.605701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:37.606427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:37.610509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:37.611030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:37.613643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:38.019924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:38.032950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6a3dfec7-f301-44b6-9f1a-4a31717a27dd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1315 microversion: 2.1 time: 0.495260 Nov 02 21:37:38.045349 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1816/3508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:37 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:38.080222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:38.103222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:38.110842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:38.117522 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34206fa5-6100-431e-90cf-757a29791038 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.585346 Nov 02 21:37:38.118164 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1693/3509] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:37 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:37:39.063249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:39.063850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:39.083202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:39.086489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:39.087744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:39.090745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:39.090745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:39.090745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:39.145447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:39.145447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:39.156019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:39.156516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:39.156976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:39.157687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:39.169069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:39.169704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:39.611195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:39.621413 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-369b5b82-9079-410c-8e68-d83ffb0ddfb8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1501 microversion: 2.1 time: 0.562625 Nov 02 21:37:39.625969 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1817/3510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:39 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1501 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:39.647580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:39.650082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:39.664536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:39.665363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:39.665970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:39.668519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:39.669434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:39.670659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:39.709798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:39.727493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:39.731352 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-42786dc3-1553-495c-aaca-9431df820c74 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.087802 Nov 02 21:37:39.735868 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1818/3511] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:39 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 21:37:39.738685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:39.739929 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-02af86a6-f596-4c34-85f6-0dd7be5b0c45 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1878 microversion: 2.32 time: 0.600267 Nov 02 21:37:39.740492 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1694/3512] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:39 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1878 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:37:40.752402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:40.752402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:40.767736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:40.768471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:40.776529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:40.784008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:40.785572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:40.786293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:40.787659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:40.788254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:40.789525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:40.789824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:40.790696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:40.791430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:40.793187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:40.795930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:40.798656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:40.896760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0dc67291-6b58-43da-91e8-a561f253d8e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.153252 Nov 02 21:37:40.897995 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1819/3513] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:40 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:41.247170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Action: 'update', calling method: .version_select at 0x7f9b68258430>, body: {"quota_set": {"ram": "5120"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:41.366941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.367692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.368478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.369647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.370280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.370870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.520336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:41.554616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:41.565975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:41.571950 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1fe82672-f92f-4d75-84e8-82d4ad07906c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2831 microversion: 2.32 time: 0.804450 Nov 02 21:37:41.571950 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1695/3514] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:37:40 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2831 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:37:41.572201 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df6e8a10-5c2a-4229-bd2e-f09995372932 tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5" status: 200 len: 148 microversion: 2.57 time: 0.549104 Nov 02 21:37:41.572201 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1820/3515] 10.222.0.25 () {62 vars in 1303 bytes} [Wed Nov 2 21:37:41 2022] PUT /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5 => generated 148 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:37:41.580782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Calling method '.version_select at 0x7f9b6d13ad30>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:41.597107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:41.598253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:41.608439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.609315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.610017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.611000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.611465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.612327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.697903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.698970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.699580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.700947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.701690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.702373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.725698 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-52e282d6-a468-4ff7-b54a-27fabca2746f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5/detail" status: 200 len: 463 microversion: 2.57 time: 0.148604 Nov 02 21:37:41.726347 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1696/3516] 10.222.0.25 () {60 vars in 1304 bytes} [Wed Nov 2 21:37:41 2022] GET /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5/detail => generated 463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:37:41.875260 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4bc45c94-6804-4854-90ef-cc18967f6c34 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.283914 Nov 02 21:37:41.879082 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1821/3517] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:37:41 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b/os-interface => generated 1831 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:37:41.916968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:41.923575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:41.940793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.941311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.941748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.942460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:41.942907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:41.943336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:41.990423 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-813aa97f-79dc-4503-bbb0-5db0f3c8ba90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.085115 Nov 02 21:37:41.993213 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1697/3518] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:41 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:42.054277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Action: 'update', calling method: .version_select at 0x7f9b688149d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:42.142667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:42.143173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:42.143620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:42.144356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:42.144823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:42.157774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:42.216833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:42.217606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:42.218224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:42.219368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:42.220298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:42.220912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:42.402424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08601296-8557-4042-a1f4-def13aae988f tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5?user_id=8fd9f93b07bb412d814eaa4384610a9c" status: 200 len: 148 microversion: 2.57 time: 0.353732 Nov 02 21:37:42.413529 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1822/3519] 10.222.0.25 () {62 vars in 1384 bytes} [Wed Nov 2 21:37:42 2022] PUT /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5?user_id=8fd9f93b07bb412d814eaa4384610a9c => generated 148 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:37:42.422541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff516a8d-54fe-4d85-b519-a8098362becd tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] Calling method '.version_select at 0x7f9b691751f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:42.517768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=87,nova_api:UPDATE=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:42.584538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff516a8d-54fe-4d85-b519-a8098362becd tempest-QuotasAdminTestV257-1068069931 tempest-QuotasAdminTestV257-1068069931-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5?user_id=8fd9f93b07bb412d814eaa4384610a9c" status: 200 len: 190 microversion: 2.57 time: 0.166162 Nov 02 21:37:42.589751 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1698/3520] 10.222.0.25 () {60 vars in 1364 bytes} [Wed Nov 2 21:37:42 2022] GET /compute/v2.1/os-quota-sets/81e145b58e7d4ff789705bb0abde4df5?user_id=8fd9f93b07bb412d814eaa4384610a9c => generated 190 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:37:43.010449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:43.015643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:43.028387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:43.030127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:43.030942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:43.031914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:43.032558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:43.033222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:43.093245 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82297d81-c96a-40dd-840d-bc4b06c5feea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.091901 Nov 02 21:37:43.097134 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1823/3521] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:42 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:44.106729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:44.110003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:44.118350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:44.119224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:44.119915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:44.120768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:44.121281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:44.121903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:44.166996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-621b57eb-b560-4224-9ee6-6b002cc39708 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.065498 Nov 02 21:37:44.359831 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1699/3522] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:44 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:44.902499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-588f8930-0aec-421e-9706-433b936660f3 req-8ab201d4-5607-4a17-a82b-089abe609827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "tag": "8ef8f96f-40d1-4605-8ab7-0fb83406c4aa"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:44.949325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-588f8930-0aec-421e-9706-433b936660f3 req-8ab201d4-5607-4a17-a82b-089abe609827 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:44.952077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-588f8930-0aec-421e-9706-433b936660f3 req-8ab201d4-5607-4a17-a82b-089abe609827 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:44.953526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-588f8930-0aec-421e-9706-433b936660f3 req-8ab201d4-5607-4a17-a82b-089abe609827 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:45.026559 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-588f8930-0aec-421e-9706-433b936660f3 req-8ab201d4-5607-4a17-a82b-089abe609827 service nova] Creating event network-changed:8ef8f96f-40d1-4605-8ab7-0fb83406c4aa for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:37:45.036069 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-588f8930-0aec-421e-9706-433b936660f3 req-8ab201d4-5607-4a17-a82b-089abe609827 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137876 Nov 02 21:37:45.037612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1824/3523] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:45.368019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:45.370360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:45.418368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:45.418861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:45.419335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:45.420132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:45.420685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:45.421154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:45.583959 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9bf49e58-b159-4a3d-b3a4-98e8277b914f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.219539 Nov 02 21:37:45.589543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1700/3524] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:45 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:46.605642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:46.611273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:46.627893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:46.628560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:46.630219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:46.631094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:46.636813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:46.639995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:46.739609 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d8a0b62-4be1-4282-9ede-f3d01d40cb1c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.148011 Nov 02 21:37:46.741067 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1825/3525] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:46 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:47.763193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:47.766530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:47.792741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:47.795260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:47.797922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:47.801343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:47.809364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:47.809364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:47.882164 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e16cd288-6b82-4e8f-b73f-ac435138fa51 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.131393 Nov 02 21:37:47.883350 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1701/3526] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:47 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:48.897804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:48.901020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:48.911285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:48.912121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:48.912992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:48.913953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:48.914780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:48.915447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:49.008807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-741ad508-9ae7-4770-b5de-a3601b21d829 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 14 microversion: 2.1 time: 0.116856 Nov 02 21:37:49.015280 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1826/3527] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:48 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:37:49.196527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:49.197967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:49.224785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:49.225707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:49.226765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:49.227754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:49.229120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:49.229800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:49.276354 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f59a5cb-4ca7-4201-a4e2-8587705a5c07 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/ips" status: 200 len: 149 microversion: 2.1 time: 0.084801 Nov 02 21:37:49.280826 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1702/3528] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:37:49 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/ips => generated 149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:50.435733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:50.438789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:50.447270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:50.450230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:50.450230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:50.450230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:50.450230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:50.450230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:50.504911 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f48dd5dd-a9d3-43fe-a465-bfb4b5d083a6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action" status: 200 len: 8205 microversion: 2.1 time: 0.486303 Nov 02 21:37:50.505766 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1827/3529] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:50 2022] POST /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99/action => generated 8205 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:50.517870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:50.518677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:50.555626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:50.557078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:50.558944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:50.562643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:50.563320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:50.563961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:51.213067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:51.227266 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-65a1fa86-4dcb-46dc-a8d5-84a7cc2fff54 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.715351 Nov 02 21:37:51.230148 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1703/3530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:50 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:51.268904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:51.269652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:51.291365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:51.291866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:51.294631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:51.301814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:51.302418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:51.303401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:52.095477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:52.109390 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0ee893b-ee94-480d-8467-a52942875a6e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.846052 Nov 02 21:37:52.115552 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1828/3531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:51 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:52.145597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:52.146939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:52.150184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:52.164966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:52.170767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:52.171476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:52.172860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:52.174237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:52.175710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:52.241510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=7 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:52.385431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=24 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:52.461879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-284e8af4-bb84-432a-ab47-6b2c7796b370 tempest-FloatingIPDetailsNegativeTestJSON-883563718 tempest-FloatingIPDetailsNegativeTestJSON-883563718-project] Calling method '.version_select at 0x7f9b682718b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:52.566258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:52.656536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-284e8af4-bb84-432a-ab47-6b2c7796b370 tempest-FloatingIPDetailsNegativeTestJSON-883563718 tempest-FloatingIPDetailsNegativeTestJSON-883563718-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP bdfea56e-3625-4be2-98d5-e607343b7bc4 could not be found", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:37:52.656536 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-284e8af4-bb84-432a-ab47-6b2c7796b370 tempest-FloatingIPDetailsNegativeTestJSON-883563718 tempest-FloatingIPDetailsNegativeTestJSON-883563718-project] HTTP exception thrown: Floating IP not found for ID bdfea56e-3625-4be2-98d5-e607343b7bc4 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-284e8af4-bb84-432a-ab47-6b2c7796b370 tempest-FloatingIPDetailsNegativeTestJSON-883563718 tempest-FloatingIPDetailsNegativeTestJSON-883563718-project] Request method failure captured: Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-floating-ips/bdfea56e-3625-4be2-98d5-e607343b7bc4 HTTP/1.1 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuMvILI0YlB06-OkPa1OzrnyNMl_shtjXJ217gkgFCOXu7QV8A_MUlWuqjMpTVkOVqXSat6Cj9z-4qbnBS7fIMb5kGSddxVGjAZmMPRRri82Xw04akSjwlgmIPfDeSsTxui1UKdwCOlfx04PsH2vEPEj5oj2xVhG55ZCK-lzQ_g5thM Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 7765f42966a84d2f8a3a56c08384284b Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-883563718 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7765f42966a84d2f8a3a56c08384284b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7765f42966a84d2f8a3a56c08384284b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7765f42966a84d2f8a3a56c08384284b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7765f42966a84d2f8a3a56c08384284b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-883563718 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 7765f42966a84d2f8a3a56c08384284b Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-883563718 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-883563718-project Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 034108709b264f33ac7c661e520f5478 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-883563718-project Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: exception: Floating IP not found for ID bdfea56e-3625-4be2-98d5-e607343b7bc4 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'bdfea56e-3625-4be2-98d5-e607343b7bc4'} Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP bdfea56e-3625-4be2-98d5-e607343b7bc4 could not be found Nov 02 21:37:52.668069 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fcf24db-c0b1-400b-9ca7-e05c8ac94a6a'] Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID bdfea56e-3625-4be2-98d5-e607343b7bc4. Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID bdfea56e-3625-4be2-98d5-e607343b7bc4 Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID bdfea56e-3625-4be2-98d5-e607343b7bc4 Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:37:52.679764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-284e8af4-bb84-432a-ab47-6b2c7796b370 tempest-FloatingIPDetailsNegativeTestJSON-883563718 tempest-FloatingIPDetailsNegativeTestJSON-883563718-project] Returning 404 to user: Floating IP not found for ID bdfea56e-3625-4be2-98d5-e607343b7bc4 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:37:52.683590 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-284e8af4-bb84-432a-ab47-6b2c7796b370 tempest-FloatingIPDetailsNegativeTestJSON-883563718 tempest-FloatingIPDetailsNegativeTestJSON-883563718-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/bdfea56e-3625-4be2-98d5-e607343b7bc4" status: 404 len: 111 microversion: 2.1 time: 0.483430 Nov 02 21:37:52.684154 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1829/3532] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:37:52 2022] GET /compute/v2.1/os-floating-ips/bdfea56e-3625-4be2-98d5-e607343b7bc4 => generated 111 bytes in 488 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:37:52.907038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:52.926399 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1de2b2d0-3b83-4e12-a68e-00d486a0fd5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.786033 Nov 02 21:37:52.957301 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1704/3533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:52 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:52.957692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:52.958424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:52.972910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:52.977658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:52.978307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:52.979160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:52.979917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:52.980471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:53.471001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:53.484644 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-64a7754c-c37b-4817-ab8d-a1956ab16c26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.530903 Nov 02 21:37:53.513603 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1830/3534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:52 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:53.516083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1381440766", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:53.523228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:53.524090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:53.533750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:53.534444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:53.535068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:53.536494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:53.538215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:53.538858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:53.615932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:37:53.737766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Locking {{(pid=121040) lock /opt/stack/nova/nova/compute/api.py:4845}} Nov 02 21:37:54.041412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4291f45-7d28-458f-8dc1-e76f3e3cad90 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.525429 Nov 02 21:37:54.041982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1831/3535] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:53 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:37:54.048729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9c25261-7ff5-4865-b58d-05b537d84c46"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:54.052238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:54.059160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:54.060519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:54.061190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:54.062103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:54.062739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:54.063363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:54.201935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:54.466866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:37:54.467549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:37:54.475338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:37:54.475338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:37:54.475338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:37:54.480352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:54.480836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:54.481314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:54.482640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:54.483097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:54.483665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:54.503447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Getting quotas for project 595893889f0d49498bfbcf599239a3e3. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:37:54.509888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Getting quotas for user 21836846005a443eaed3d5099ea0e2d8 and project 595893889f0d49498bfbcf599239a3e3. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:37:54.531719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:37:54.537871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:37:54.833801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-535a5fdf-faac-4398-aee2-8a66560be1c5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.622027 Nov 02 21:37:54.836748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1705/3536] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:37:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:37:54.847986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:54.848968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:54.874153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:54.874731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:54.875266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:54.876054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:54.876587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:54.877157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:54.938128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:55.201221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:55.214128 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fa39bb92-ab8e-41e5-910e-477e82f8e64d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.369690 Nov 02 21:37:55.215485 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1706/3537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:54 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:55.234573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f059845-6856-47ea-bb07-d803600b99c9 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:55.237459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f059845-6856-47ea-bb07-d803600b99c9 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:55.331593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f059845-6856-47ea-bb07-d803600b99c9 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:55.342144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f059845-6856-47ea-bb07-d803600b99c9 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1223 microversion: 2.1 time: 0.124395 Nov 02 21:37:55.346672 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1707/3538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:55 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:55.372312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:55.381282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:55.381792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:55.382236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:55.454234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] HTTP exception thrown: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b is locked Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Request method failure captured: Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action HTTP/1.1 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 15 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuICmgsutKLBn3A1VQBVeIMqaqPLCozBHwENec2FoXNZH1thBa8VAspfhHCRd4hIuoupNyoL8SJ0dM1AruSM3oPDYf5rO7XDFUzOfoi4jr-myFlioMa7BKPs4-cHvuEagLpr4HwEOsT0UuEG6xMP2EC9rk-cT79g8zJb9PmG4-hUyjE Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 368ab16b50f84f0d9cf6e79e039dc257 Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: {"os-stop": {}} Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b is locked Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '143a3b24-a0ff-43d1-b25f-83137a325d5b', 'body': {'os-stop': {}}} Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b is locked Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b is locked Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b is locked Nov 02 21:37:55.457894 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:37:55.468835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Returning 409 to user: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b is locked {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:37:55.472627 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3691c5f1-d840-4c3f-9a2f-24d3d3f5318c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 409 len: 107 microversion: 2.1 time: 0.118862 Nov 02 21:37:55.479347 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1708/3539] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:55 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 107 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:37:55.489310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:55.491870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:55.502839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:55.507617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:55.508279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:55.509475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:55.509941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:55.510374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:55.602686 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4284a9ae-d954-48e7-8eca-c33985498ecf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.559231 Nov 02 21:37:55.612298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1832/3540] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:37:54 2022] POST /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 194 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:37:55.848615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Unlocking {{(pid=121039) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 21:37:56.112230 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48c79164-f034-4267-b83a-ae4fd1130b72 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.631442 Nov 02 21:37:56.113704 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1709/3541] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:55 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:37:56.124336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2e180e1-a27b-4b27-98ef-b8ca28324995 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:37:56.137120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e180e1-a27b-4b27-98ef-b8ca28324995 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:56.137641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e180e1-a27b-4b27-98ef-b8ca28324995 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:56.142754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e180e1-a27b-4b27-98ef-b8ca28324995 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:56.196009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2e180e1-a27b-4b27-98ef-b8ca28324995 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:37:56.371315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-08d35c89-8b42-461f-af5c-62df422c288f tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:56.372584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-08d35c89-8b42-461f-af5c-62df422c288f tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:56.552120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-08d35c89-8b42-461f-af5c-62df422c288f tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:56.564251 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-08d35c89-8b42-461f-af5c-62df422c288f tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1223 microversion: 2.1 time: 0.195822 Nov 02 21:37:56.572193 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2e180e1-a27b-4b27-98ef-b8ca28324995 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.452975 Nov 02 21:37:56.576841 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1833/3542] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:37:56 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:37:56.595731 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1710/3543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:56 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1223 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:56.598279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:56.601210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:56.609581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=7,nova_api:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:37:56.629169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:56.629901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:56.630516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:56.631421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:56.632083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:56.632686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:57.128814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:57.146784 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-515343e4-a90a-4d50-98b7-d00f2e80ac2c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.557446 Nov 02 21:37:57.165172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1834/3544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:56 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:57.602293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:57.602992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:57.619951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:57.627764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:57.627764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:57.627764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:57.627764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:57.627764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:57.729393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:57.754170 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7622277a-06db-495d-9ab7-b119ef3ccd3a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1227 microversion: 2.1 time: 0.157978 Nov 02 21:37:57.755077 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1711/3545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:57 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1227 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:37:58.180904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:58.181725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:58.200225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:58.205879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:58.210544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:58.213303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:58.214560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:58.221637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:58.612718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:58.671096 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c9a9cb2-cb56-4041-bdfc-30303f8b3336 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.491140 Nov 02 21:37:58.674324 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1835/3546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:58 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:58.782621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:58.784994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:58.802728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:58.803259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:58.804493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:58.806299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:58.810803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:58.816314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:58.934466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:37:58.971333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de1de0c1-fe23-4140-a826-306f0fffb2a5 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1275 microversion: 2.1 time: 0.193743 Nov 02 21:37:58.976028 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1712/3547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:58 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:37:59.705939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:37:59.707372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:37:59.721355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:59.722318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:59.723014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:59.729760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:37:59.730510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:37:59.731201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:37:59.998568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:00.000750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:00.043646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:00.047378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:00.048812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:00.051295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:00.054213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:00.056741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:00.176431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:00.184576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7145c5a1-d75c-41e9-8754-087405734ccd tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.486075 Nov 02 21:38:00.185727 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1836/3548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:59 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:00.225107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:00.239516 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca31d0ed-5999-458e-80de-e194d137b0eb tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1281 microversion: 2.1 time: 0.247372 Nov 02 21:38:00.255742 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1713/3549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:37:59 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1281 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:01.209568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:01.211336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:01.221556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:01.222803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:01.223523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:01.224359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:01.225254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:01.226033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:01.269077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:01.270808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:01.306899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:01.310876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:01.311423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:01.313369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:01.317112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:01.317617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:01.510448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:01.522726 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fcdd591-04a6-4509-899b-10c20632a292 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1281 microversion: 2.1 time: 0.263120 Nov 02 21:38:01.523459 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1714/3550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:01 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1281 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:01.781139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:01.811489 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2377d9d3-44cb-4268-b211-4ef82abb59c1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.594199 Nov 02 21:38:01.811489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1837/3551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:01 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:02.546556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:02.547604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:02.573881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:02.574422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:02.575826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:02.577189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:02.578141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:02.578597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:02.849043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:02.849043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:02.861543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:02.862078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:02.862768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:02.864330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:02.864980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:02.869489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:02.964159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:02.982954 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-484b7dd7-6646-4cc4-9142-e1bfdaf722dc tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.440729 Nov 02 21:38:02.985925 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1715/3552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:02 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:03.202930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:03.218192 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-146fd4cc-9499-4793-806a-8353f1c960f2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.382972 Nov 02 21:38:03.221259 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1838/3553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:02 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:03.998191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-625673c8-b363-43d3-b7ad-be6308e98912 req-bd43da66-32ea-4da5-8607-719b416d4959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b506bd26-9fef-4b2a-b283-dcb5f8aac492", "tag": "d3a4057e-7bd0-4d72-931d-d30b6f15a1ff"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:04.007791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:04.008499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:04.018501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:04.019143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:04.019669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:04.021730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:04.022182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-625673c8-b363-43d3-b7ad-be6308e98912 req-bd43da66-32ea-4da5-8607-719b416d4959 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:04.022660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:04.022815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-625673c8-b363-43d3-b7ad-be6308e98912 req-bd43da66-32ea-4da5-8607-719b416d4959 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:04.026729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:04.026866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-625673c8-b363-43d3-b7ad-be6308e98912 req-bd43da66-32ea-4da5-8607-719b416d4959 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:04.041385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-625673c8-b363-43d3-b7ad-be6308e98912 req-bd43da66-32ea-4da5-8607-719b416d4959 service nova] Creating event network-changed:d3a4057e-7bd0-4d72-931d-d30b6f15a1ff for instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 on n-h2-860863-4 Nov 02 21:38:04.047053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-625673c8-b363-43d3-b7ad-be6308e98912 req-bd43da66-32ea-4da5-8607-719b416d4959 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054052 Nov 02 21:38:04.047660 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1716/3554] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:04.248202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:04.249270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:04.256110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:04.256890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:04.257554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:04.258474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:04.259126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:04.260039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:04.287053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:04.302139 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2688f640-de95-46cf-9c76-0d3c85221f76 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.298362 Nov 02 21:38:04.302742 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1839/3555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:04 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:04.494065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:04.583864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:04.592533 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b5b7d8cc-803f-44ab-b440-5fda7f3a86e3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.351409 Nov 02 21:38:04.594079 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1717/3556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:04 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:04.982731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78dcd5ff-0a69-42f6-8cca-4299b77185db tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b6882f940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbn7D5aV01Wtiiig1JYhLVZj3meiyhCUZTuwgWJ6a6ZwVvO2yZMMn8/YFP/xYohTySlVWZZxGi4/bUMn1l2DDFQ70A8NSihg5v4IP9WQB3b54QAVkDVPLU+gs1+psluHQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78dcd5ff-0a69-42f6-8cca-4299b77185db tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 257 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbn7D5aV01Wtiiig1JYhLVZj3meiyhCUZTuwgWJ6a6ZwVvO2yZMMn8/YFP/xYohTySlVWZZxGi4/bUMn1l2DDFQ70A8NSihg5v4IP9WQB3b54QAVkDVPLU+gs1+psluHQ=="}} Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbn7D5aV01Wtiiig1JYhLVZj3meiyhCUZTuwgWJ6a6ZwVvO2yZMMn8/YFP/xYohTySlVWZZxGi4/bUMn1l2DDFQ70A8NSihg5v4IP9WQB3b54QAVkDVPLU+gs1+psluHQ=='}}} Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 02 21:38:04.989598 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 21:38:04.995067 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:04.997915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78dcd5ff-0a69-42f6-8cca-4299b77185db tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:04.999292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78dcd5ff-0a69-42f6-8cca-4299b77185db tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.200077 Nov 02 21:38:04.999531 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1840/3557] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:38:04 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:05.010606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cf0b91e-62a9-4cb6-b9b4-133164283c0a tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b694200d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-656099455", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:05.043768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8cf0b91e-62a9-4cb6-b9b4-133164283c0a tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:05.062420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-8cf0b91e-62a9-4cb6-b9b4-133164283c0a tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for user 34ca7a194edc4ca1b1c87100bc87faa3 and project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:05.092968 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8cf0b91e-62a9-4cb6-b9b4-133164283c0a tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cf0b91e-62a9-4cb6-b9b4-133164283c0a tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 2166 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-656099455", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:38:05.121088 n-d-860863-4 devstack@n-api.service[121039]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-656099455', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:05.125200 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.129565 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.132716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cf0b91e-62a9-4cb6-b9b4-133164283c0a tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:05.134709 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cf0b91e-62a9-4cb6-b9b4-133164283c0a tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.129475 Nov 02 21:38:05.136760 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1718/3558] 10.222.0.25 () {60 vars in 1160 bytes} [Wed Nov 2 21:38:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:38:05.151796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79c58d26-1cd6-48dc-bc1c-ac009cb80d55 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b6d11e9d0>, body: {"keypair": {"name": "tempest-keypair-1281405932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH8XHd9OmIMJynVS+ctumnO48TECj15fRrHvno6naESLdur5Rc02S4d9RENx1xSMpl8sWSLtz3gPZKSbLBTtHtlCUPeTWJydN7rRiXNb1JTxuPWG1GgQPXaS9aL5CITDQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:05.199546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-79c58d26-1cd6-48dc-bc1c-ac009cb80d55 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:05.208095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-79c58d26-1cd6-48dc-bc1c-ac009cb80d55 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for user 34ca7a194edc4ca1b1c87100bc87faa3 and project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:05.325994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:05.326621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:05.334109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:05.334610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:05.335049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:05.335750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:05.336448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:05.337073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:05.430553 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79c58d26-1cd6-48dc-bc1c-ac009cb80d55 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.285010 Nov 02 21:38:05.431381 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1841/3559] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:38:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:05.445345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63514105-74af-491f-8a05-dd787c50280e tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b68220c10>, body: {"keypair": {"name": "tempest-keypair-1281405932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFA1/g7Pl3MbY9V+jdfZtYHRdNbM54KfPHMPpk4CmNhIXZqL/LF+5tRbTMmpwxsaVvGBcUNkLXS4nBsjQXJpMJV0pElreZ5JtcEcLqxZsDmJhUY1jPzfSlcB8ZkyZOE03A=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:05.481298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-63514105-74af-491f-8a05-dd787c50280e tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:05.487651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-63514105-74af-491f-8a05-dd787c50280e tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for user 34ca7a194edc4ca1b1c87100bc87faa3 and project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:05.567708 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-63514105-74af-491f-8a05-dd787c50280e tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] HTTP exception thrown: Key pair 'tempest-keypair-1281405932' already exists. Nov 02 21:38:05.576809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63514105-74af-491f-8a05-dd787c50280e tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 273 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: {"keypair": {"name": "tempest-keypair-1281405932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFA1/g7Pl3MbY9V+jdfZtYHRdNbM54KfPHMPpk4CmNhIXZqL/LF+5tRbTMmpwxsaVvGBcUNkLXS4nBsjQXJpMJV0pElreZ5JtcEcLqxZsDmJhUY1jPzfSlcB8ZkyZOE03A=="}} Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: exception: Key pair 'tempest-keypair-1281405932' already exists. Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1281405932', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFA1/g7Pl3MbY9V+jdfZtYHRdNbM54KfPHMPpk4CmNhIXZqL/LF+5tRbTMmpwxsaVvGBcUNkLXS4nBsjQXJpMJV0pElreZ5JtcEcLqxZsDmJhUY1jPzfSlcB8ZkyZOE03A=='}}} Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result.read() Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34ca7a194edc4ca1b1c87100bc87faa3-tempest-keypair-1281405932' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 21:38:05.585698 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result.read() Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 21:38:05.595967 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34ca7a194edc4ca1b1c87100bc87faa3-tempest-keypair-1281405932' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 21, 38, 5, 513709), 'updated_at': None, 'name': 'tempest-keypair-1281405932', 'user_id': '34ca7a194edc4ca1b1c87100bc87faa3', 'fingerprint': '89:ab:d3:e8:b4:eb:85:f1:42:a7:e3:e6:60:98:40:8c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFA1/g7Pl3MbY9V+jdfZtYHRdNbM54KfPHMPpk4CmNhIXZqL/LF+5tRbTMmpwxsaVvGBcUNkLXS4nBsjQXJpMJV0pElreZ5JtcEcLqxZsDmJhUY1jPzfSlcB8ZkyZOE03A==', 'type': 'ssh'}] Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi keypair.create() Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._create() Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1281405932' already exists. Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 02 21:38:05.612237 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1281405932' already exists. Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1281405932' already exists. Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63514105-74af-491f-8a05-dd787c50280e tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 409 to user: Key pair 'tempest-keypair-1281405932' already exists. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63514105-74af-491f-8a05-dd787c50280e tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.147434 Nov 02 21:38:05.616250 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1842/3560] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:38:05 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:38:05.618534 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c9996ed-a36d-48b3-9364-6922b3136131 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.276802 Nov 02 21:38:05.618534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1719/3561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:05 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:05.619119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5669fcf-fa9f-43aa-b748-71c8d94c93a5 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Calling method '.version_select at 0x7f9b6822cd30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:05.624672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:05.628865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:05.637035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:05.640084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:05.640903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:05.642266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:05.642947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:05.643486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:05.735932 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5669fcf-fa9f-43aa-b748-71c8d94c93a5 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281405932" status: 202 len: 0 microversion: 2.1 time: 0.138308 Nov 02 21:38:05.737241 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1843/3562] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1281405932 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:05.769073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e95c5bf8-bea9-41e2-8d7a-29c9e121cd06 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b68220f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9Ybh9mUFR2/QXWuekOPOkyKUteKjY1q0y7ymQ6U1+b9bl7rTyskhmg1LpFALixnVKhvkEeet68o1alYgvDFwupkJWevKs85I743OYMqn7wp4KGvEE436XWjxkos0rsow=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e95c5bf8-bea9-41e2-8d7a-29c9e121cd06 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 247 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9Ybh9mUFR2/QXWuekOPOkyKUteKjY1q0y7ymQ6U1+b9bl7rTyskhmg1LpFALixnVKhvkEeet68o1alYgvDFwupkJWevKs85I743OYMqn7wp4KGvEE436XWjxkos0rsow=="}} Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9Ybh9mUFR2/QXWuekOPOkyKUteKjY1q0y7ymQ6U1+b9bl7rTyskhmg1LpFALixnVKhvkEeet68o1alYgvDFwupkJWevKs85I743OYMqn7wp4KGvEE436XWjxkos0rsow=='}}} Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '' Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:38:05.774112 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e95c5bf8-bea9-41e2-8d7a-29c9e121cd06 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e95c5bf8-bea9-41e2-8d7a-29c9e121cd06 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.032263 Nov 02 21:38:05.785344 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1844/3563] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:38:05 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:05.791603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89a9e9f6-665d-40a8-9e04-005f0cdeee89 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b68216040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1982820782", "public_key": " "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:05.804352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:05.814549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f75c88a6-2c64-4886-9568-98fb49b3c412 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.194412 Nov 02 21:38:05.815716 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1720/3564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:05 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:05.841829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-89a9e9f6-665d-40a8-9e04-005f0cdeee89 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:05.848588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-89a9e9f6-665d-40a8-9e04-005f0cdeee89 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for user 34ca7a194edc4ca1b1c87100bc87faa3 and project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:05.869915 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-89a9e9f6-665d-40a8-9e04-005f0cdeee89 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89a9e9f6-665d-40a8-9e04-005f0cdeee89 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 95 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1982820782", "public_key": " "}} Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1982820782', 'public_key': ' '}}} Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.872818 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89a9e9f6-665d-40a8-9e04-005f0cdeee89 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89a9e9f6-665d-40a8-9e04-005f0cdeee89 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.087403 Nov 02 21:38:05.879884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1845/3565] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Nov 2 21:38:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:38:05.889861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a418fcc-1e4e-4fee-aaa9-9c9e351b48e8 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b689368b0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiFjdfsTpxM4ioG0Xt3t/dpwGQsvhS0A6ByIgQFrlCrgYVjrISE5k+689EbFH30TpSbga8ltVaGtydaX8y8ODoYh4Dd4me/JWKCvWHbUU062xNQX1DOz9lq+sV43bVWww=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a418fcc-1e4e-4fee-aaa9-9c9e351b48e8 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 507 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiFjdfsTpxM4ioG0Xt3t/dpwGQsvhS0A6ByIgQFrlCrgYVjrISE5k+689EbFH30TpSbga8ltVaGtydaX8y8ODoYh4Dd4me/JWKCvWHbUU062xNQX1DOz9lq+sV43bVWww=="}} Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiFjdfsTpxM4ioG0Xt3t/dpwGQsvhS0A6ByIgQFrlCrgYVjrISE5k+689EbFH30TpSbga8ltVaGtydaX8y8ODoYh4Dd4me/JWKCvWHbUU062xNQX1DOz9lq+sV43bVWww=='}}} Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 21:38:05.894506 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a418fcc-1e4e-4fee-aaa9-9c9e351b48e8 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a418fcc-1e4e-4fee-aaa9-9c9e351b48e8 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011855 Nov 02 21:38:05.898774 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1721/3566] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:38:05 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:05.910066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58acbd27-510d-4ef8-8bcf-b965e3ccfbea tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Action: 'create', calling method: .version_select at 0x7f9b68216430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1244826639", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:05.933000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-58acbd27-510d-4ef8-8bcf-b965e3ccfbea tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:05.940768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-58acbd27-510d-4ef8-8bcf-b965e3ccfbea tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Getting quotas for user 34ca7a194edc4ca1b1c87100bc87faa3 and project 906de8eda3414e7cb68b86584e1a93cd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:05.964543 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-58acbd27-510d-4ef8-8bcf-b965e3ccfbea tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58acbd27-510d-4ef8-8bcf-b965e3ccfbea tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 118 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1244826639", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1244826639', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 21:38:05.967260 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58acbd27-510d-4ef8-8bcf-b965e3ccfbea tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58acbd27-510d-4ef8-8bcf-b965e3ccfbea tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065272 Nov 02 21:38:05.974241 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1846/3567] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:38:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:38:05.984898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aac0a1d7-017f-42ce-8cd5-01538311ad20 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Calling method '.version_select at 0x7f9b689c3040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:06.018455 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-aac0a1d7-017f-42ce-8cd5-01538311ad20 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-927774186 not found for user 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aac0a1d7-017f-42ce-8cd5-01538311ad20 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Request method failure captured: Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-927774186 HTTP/1.1 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuM8Rx1QHDhfK_YeyUAfcJCrFX1jkHHFzvNaNK0wh4vdny_e3dNIaaap5kXYaDjnfmlx2k2UsDeiTCaX_Rsu-JJsTqMKRHh11j03YEvjNzDtC2rjK--UwAndk9GtPVoQnr1Qh3Pts0OIAZxdxLWkwT0RoyGKiHUfbULcWZh6Mpemvn8 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/906de8eda3414e7cb68b86584e1a93cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 906de8eda3414e7cb68b86584e1a93cd Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1031742243 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1031742243-project Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: exception: Keypair tempest-keypair-non-existent-927774186 not found for user 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'tempest-keypair-non-existent-927774186'} Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-927774186 not found for user 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:06.020115 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-927774186 not found for user 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-927774186 not found for user 34ca7a194edc4ca1b1c87100bc87faa3 Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aac0a1d7-017f-42ce-8cd5-01538311ad20 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] Returning 404 to user: Keypair tempest-keypair-non-existent-927774186 not found for user 34ca7a194edc4ca1b1c87100bc87faa3 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aac0a1d7-017f-42ce-8cd5-01538311ad20 tempest-KeyPairsNegativeTestJSON-1031742243 tempest-KeyPairsNegativeTestJSON-1031742243-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-927774186" status: 404 len: 144 microversion: 2.1 time: 0.041527 Nov 02 21:38:06.025233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1722/3568] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 21:38:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-927774186 => generated 144 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:38:06.623030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:06.624731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:06.644306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:06.645981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:06.647201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:06.649269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:06.653540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:06.654819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:06.845995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:06.847076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:06.877082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:06.877616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:06.878064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:06.878812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:06.879269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:06.879753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:07.602863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:07.616258 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d4c7dadd-702a-4c48-be84-9511d33a35dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.776399 Nov 02 21:38:07.617798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1723/3569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:06 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:07.676515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:07.688464 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e929f238-a79d-46d3-a447-bd76769889a2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 1.071195 Nov 02 21:38:07.691556 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1847/3570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:06 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:08.649979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:08.653257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:08.671292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:08.672145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:08.672859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:08.674625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:08.675396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:08.676378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:08.734526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:08.735051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:08.750951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:08.751461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:08.751918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:08.759946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:08.760715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:08.763920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:09.317294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:09.332679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:09.333416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8940afe-e8e2-459f-9eb0-910869de3132 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1655 microversion: 2.1 time: 0.691710 Nov 02 21:38:09.334876 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1724/3571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:08 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1655 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:09.346482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41fa8594-c9e4-4f58-8453-d13489b8d800 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.631816 Nov 02 21:38:09.348489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1848/3572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:08 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:09.381878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f2e9ca3-d7d8-4499-9d13-15077d4b3067 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:09.395372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f2e9ca3-d7d8-4499-9d13-15077d4b3067 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:09.399578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f2e9ca3-d7d8-4499-9d13-15077d4b3067 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:09.400364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f2e9ca3-d7d8-4499-9d13-15077d4b3067 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:09.450165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f2e9ca3-d7d8-4499-9d13-15077d4b3067 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Going to try to start instance {{(pid=121039) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 21:38:09.502754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:09.697649 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f2e9ca3-d7d8-4499-9d13-15077d4b3067 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.334962 Nov 02 21:38:09.698632 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1725/3573] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:38:09 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:09.707031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:09.707920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:09.715295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:09.716675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:09.717404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:09.718803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:09.719610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:09.720221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:09.931861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:09.948110 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2277b131-ebc0-4820-8192-2f57b73b583d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1664 microversion: 2.1 time: 0.241117 Nov 02 21:38:09.948763 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1849/3574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:09 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1664 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:10.305359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cec81c62-4fe1-412b-8335-d0aba43b418a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: .version_select at 0x7f9b691af280>, body: {"keypair": {"name": "tempest-keypair-1072593288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrCuwvkSBpGKofLfQW6bTWVCaLCxSASRamDW4vCI+hfPvvzAHHU599CVAKf1NUm5cnfNxFaWd4Wjee8x8ZvXY3HfSoDx7nx56Wg+2SqM65uFo5KlS6r7aF1z22LYkxVEg=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:10.349540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-cec81c62-4fe1-412b-8335-d0aba43b418a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:10.362644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-cec81c62-4fe1-412b-8335-d0aba43b418a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:10.382008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:10.382640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:10.402745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:10.424772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:10.428448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:10.429492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:10.430134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:10.430931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:10.644392 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cec81c62-4fe1-412b-8335-d0aba43b418a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.343829 Nov 02 21:38:10.645183 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1726/3575] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:38:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:10.656292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:10.664764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1a1a9cb8-246f-443e-977c-9f2f91c57f60 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.292593 Nov 02 21:38:10.669918 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1850/3576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:10 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:10.973888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:10.974754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:10.993645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:10.994371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:10.994999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:10.996247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:10.997510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:10.998136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:11.401964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:11.428915 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f9a2fc3-29cd-48cb-a4c5-46f7ddb4034c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1664 microversion: 2.1 time: 0.456576 Nov 02 21:38:11.430983 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1727/3577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:10 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1664 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:11.690782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:11.694393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:11.703295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:11.709142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:11.709784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:11.710701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:11.717913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:11.718641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:12.422901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:12.458700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:12.459318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:12.459505 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e4d4347-eb5f-4e27-9b34-603ef554f926 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.772420 Nov 02 21:38:12.460485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1851/3578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:11 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:12.471422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:12.473511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:12.479324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:12.479474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:12.479963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:12.480421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:13.195680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a7031ee6-f13b-4531-89e8-68a9eb1b12ef req-8403e7a4-0f1f-42bb-91a1-332d580df766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b506bd26-9fef-4b2a-b283-dcb5f8aac492", "name": "network-vif-plugged", "status": "completed", "tag": "d3a4057e-7bd0-4d72-931d-d30b6f15a1ff"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:13.214871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a7031ee6-f13b-4531-89e8-68a9eb1b12ef req-8403e7a4-0f1f-42bb-91a1-332d580df766 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:13.219313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a7031ee6-f13b-4531-89e8-68a9eb1b12ef req-8403e7a4-0f1f-42bb-91a1-332d580df766 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:13.219313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a7031ee6-f13b-4531-89e8-68a9eb1b12ef req-8403e7a4-0f1f-42bb-91a1-332d580df766 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:13.258817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a7031ee6-f13b-4531-89e8-68a9eb1b12ef req-8403e7a4-0f1f-42bb-91a1-332d580df766 service nova] Creating event network-vif-plugged:d3a4057e-7bd0-4d72-931d-d30b6f15a1ff for instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 on n-h2-860863-4 Nov 02 21:38:13.272987 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a7031ee6-f13b-4531-89e8-68a9eb1b12ef req-8403e7a4-0f1f-42bb-91a1-332d580df766 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086509 Nov 02 21:38:13.274629 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1852/3579] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:38:13.485574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:13.486570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:13.503012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:13.503012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:13.503012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:13.503012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:13.503521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:13.504732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:13.535934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:13.556601 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e033219-b770-4a5e-a18c-ad68d2435498 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.101835 Nov 02 21:38:13.557243 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1728/3580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:12 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:13.589889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:13.590828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:13.599170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:13.609827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:13.609827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:13.609827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:13.613594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:13.614312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:13.615259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:14.226826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:14.238763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33644a8a-3ae4-4167-bc49-6d955235dd07 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.759877 Nov 02 21:38:14.239359 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1853/3581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:13 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:14.377195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:14.385550 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4fb068ab-daf9-4cab-a539-4830b6a89ba9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.800578 Nov 02 21:38:14.388099 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1729/3582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:13 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:14.419645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:14.420877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:14.439402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:14.440526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:14.441314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:14.442908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:14.451209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:14.456670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:14.519174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:14.704274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Unlocking {{(pid=121040) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 02 21:38:14.973254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-652092679", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633e65a1-5eb1-4582-84ab-e86a0d55a55b"}], "security_groups": [{"name": "tempest-securitygroup--1219981354"}], "key_name": "tempest-keypair-1072593288", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:14.995832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aaff493a-bc9d-46c9-918c-ec0b7557771c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.586486 Nov 02 21:38:14.996753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1854/3583] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:38:14 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:15.015900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:15.019238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:15.032849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:15.034578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:15.034578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:15.035134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:15.035814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:15.036444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:15.430963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] validate_networks() for [('633e65a1-5eb1-4582-84ab-e86a0d55a55b', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:38:15.563037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:15.567990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09d0f838-cb81-4394-9fe5-d05c063220ea tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.562195 Nov 02 21:38:15.568591 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1855/3584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:15 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:15.573163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:15.573990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:15.580889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:15.581687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:15.582334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:15.583230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:15.583874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:15.584310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:15.952761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:16.053051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:16.063991 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cada1bf8-b975-4ffe-a52c-faff77ed8a1e tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1323 microversion: 2.1 time: 0.494287 Nov 02 21:38:16.064682 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1856/3585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:15 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:16.073800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:16.078639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:16.096255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:16.096754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:16.097218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:16.097925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:16.098380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:16.098810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:16.831033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:16.836686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:38:16.837560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:38:16.838066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:38:16.838194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:38:16.838693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:38:16.852452 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc7afc40-cc09-46b2-b022-ea6200af0434 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.785022 Nov 02 21:38:16.854163 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1857/3586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:16 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:16.860180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:16.864379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:16.865060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:16.866025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:16.866663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:16.870737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:16.883982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:16.885679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:16.894085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:16.895675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:16.896603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:16.897674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:16.898721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:16.900606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:16.916107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:16.922213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:16.939342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:38:16.941694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:38:17.150718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1dfb605d-f911-4e9d-8a39-c3e63262e4b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.182624 Nov 02 21:38:17.154082 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1730/3587] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:38:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:38:17.171704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:17.178208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:17.193070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:17.199762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:17.201070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:17.203411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:17.204686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:17.210029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:17.459732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:17.483037 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-573a6a2d-3da8-420b-bfbe-034188671ace tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.606829 Nov 02 21:38:17.489847 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1858/3588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:16 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:17.500859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab9707a4-7815-4425-94ec-d753957eac41 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:17.512632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab9707a4-7815-4425-94ec-d753957eac41 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:17.771958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab9707a4-7815-4425-94ec-d753957eac41 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:17.782495 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab9707a4-7815-4425-94ec-d753957eac41 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1241 microversion: 2.1 time: 0.285730 Nov 02 21:38:17.798930 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1859/3589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:17 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1241 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:17.809137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:17.809788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:17.828116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:17.829032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:17.830441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:17.835119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:17.838313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:17.838875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:17.915383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:17.925056 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f21d19ff-95c8-40c5-8b1e-e00719069cc7 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1471 microversion: 2.1 time: 0.769569 Nov 02 21:38:17.926236 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1731/3590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:17 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1471 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:17.955056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:17.957760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:17.974172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:17.975017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:17.976381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:17.977395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:17.978540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:17.979745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.025424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Request method failure captured: Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492/diagnostics HTTP/1.1 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuMvAqMjKz117fXKIC6YnVkuJRnzB_gNVdXZ7qsNXmFXQ_sc1jvcOJTn75Ya8iACk7ZazbxMmnQS8ppJCJOvW6CNoSXlhr8SUI6oYu2zA77hd5gXwMyQgTHZT4p4gYGr4BPH0qIDq0hzQJC1fwAl3DxR3Irhyeu7f2JbQj2KwnDh9aI Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 595893889f0d49498bfbcf599239a3e3 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1668766575 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_595893889f0d49498bfbcf599239a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/595893889f0d49498bfbcf599239a3e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/595893889f0d49498bfbcf599239a3e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/595893889f0d49498bfbcf599239a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1668766575 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 595893889f0d49498bfbcf599239a3e3 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1668766575 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerDiagnosticsNegativeTest-1668766575-project Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 21836846005a443eaed3d5099ea0e2d8 Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1668766575-project Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': 'b506bd26-9fef-4b2a-b283-dcb5f8aac492'} Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:18.034570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b2e84ac-87bd-4b87-bbe2-c916bfc6b0d2 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.093269 Nov 02 21:38:18.048658 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1732/3591] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:38:17 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492/diagnostics => generated 117 bytes in 95 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:38:18.058901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:18.059472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:18.077065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.082727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.083439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.084814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.085893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.086903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.113192 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e18b2368-10ca-4b28-b1e1-7c7392e02304 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.310911 Nov 02 21:38:18.114116 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1860/3592] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:38:17 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:18.123177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:18.126368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:18.149489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.150223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.153236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.154475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.156401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.159206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.176576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:38:18.557310 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2b2cb6d5-5e16-4fd4-ab95-b5fa92f7e245 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 204 len: 0 microversion: 2.1 time: 0.505532 Nov 02 21:38:18.557946 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1733/3593] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:38:18 2022] DELETE /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:38:18.574690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:18.583139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:18.591861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.596612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.596612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.596612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.596612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.596612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.694884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:18.709616 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-948431de-ef3f-4f84-9c23-548372ef8da5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1673 microversion: 2.1 time: 0.590204 Nov 02 21:38:18.711883 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1861/3594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:18 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1673 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:18.813929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:18.816161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:18.866769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.868170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.870216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:18.872865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:18.877188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:18.882241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:19.031314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:19.041227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:19.047427 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6641ce2d-23e2-473c-8ad3-4bab1c5a6c5a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1245 microversion: 2.1 time: 0.240103 Nov 02 21:38:19.048207 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1862/3595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:18 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1245 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:19.054900 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f22f539-bee6-4afb-a720-b3ef649abd69 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1477 microversion: 2.1 time: 0.491667 Nov 02 21:38:19.065326 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1734/3596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:18 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1477 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:19.738973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:19.740910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:19.754002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:19.755603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:19.759346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:19.763900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:19.763900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:19.763900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:20.081113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:20.082387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:20.105373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:20.106881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:20.107763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:20.109400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:20.110047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:20.110686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:20.248434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:20.258820 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a1ea401-cbe1-4aa9-85f6-e962209e3c9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1293 microversion: 2.1 time: 0.181505 Nov 02 21:38:20.268516 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1735/3597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:20 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1293 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:20.281073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:20.281947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:20.292457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:20.293202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:20.295038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:20.296071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:20.296969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:20.297599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:20.599050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:20.607355 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-80c0ce80-f074-4c89-a231-b5c0ef206140 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1653 microversion: 2.1 time: 0.873052 Nov 02 21:38:20.616781 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1863/3598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:19 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1653 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:20.654649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:20.655227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:20.674443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:20.674955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:20.675404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:20.676126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:20.676590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:20.679598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:20.954073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:20.962393 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63c5bcd0-03aa-4194-a1de-44582dbf3293 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1477 microversion: 2.1 time: 0.692407 Nov 02 21:38:20.963219 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1736/3599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:20 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1477 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:21.086862 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-73beea8f-fd17-4e4a-b592-49635f4ba869 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.441343 Nov 02 21:38:21.101870 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1864/3600] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:38:20 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:21.111336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:21.111960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:21.129844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:21.130346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:21.130973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:21.132023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:21.132650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:21.133272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:21.305230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:21.311102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:21.327038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:21.329713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:21.329713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:21.331639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:21.332606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:21.342799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:21.761941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:21.785044 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9174b47c-9ef3-4a73-86d4-197994b7b175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1301 microversion: 2.1 time: 0.496876 Nov 02 21:38:21.786913 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1865/3601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:21 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1301 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:21.989257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:21.989432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:21.990966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:21.998408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:22.000062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:22.000733 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e17648e-338e-46df-90ac-4deda6ada058 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1660 microversion: 2.1 time: 0.894354 Nov 02 21:38:22.001202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:22.001828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:22.002293 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1737/3602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:21 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1660 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:22.003027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:22.003494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:22.003928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:22.235618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:22.243843 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78735c6a-5e14-4d99-8fb8-a9994236f8b3 tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1435 microversion: 2.1 time: 0.261514 Nov 02 21:38:22.247885 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1866/3603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:21 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1435 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:38:22.553345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2915f4b3-c611-408e-adc4-c2b2b7cdcf77 req-d9d55e58-25a7-4578-b00e-78e7af219963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b506bd26-9fef-4b2a-b283-dcb5f8aac492", "name": "network-vif-deleted", "tag": "d3a4057e-7bd0-4d72-931d-d30b6f15a1ff"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:22.580359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2915f4b3-c611-408e-adc4-c2b2b7cdcf77 req-d9d55e58-25a7-4578-b00e-78e7af219963 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:22.581370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2915f4b3-c611-408e-adc4-c2b2b7cdcf77 req-d9d55e58-25a7-4578-b00e-78e7af219963 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:22.582065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2915f4b3-c611-408e-adc4-c2b2b7cdcf77 req-d9d55e58-25a7-4578-b00e-78e7af219963 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:22.610773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2915f4b3-c611-408e-adc4-c2b2b7cdcf77 req-d9d55e58-25a7-4578-b00e-78e7af219963 service nova] Creating event network-vif-deleted:d3a4057e-7bd0-4d72-931d-d30b6f15a1ff for instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 on n-h2-860863-4 Nov 02 21:38:22.623900 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2915f4b3-c611-408e-adc4-c2b2b7cdcf77 req-d9d55e58-25a7-4578-b00e-78e7af219963 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087362 Nov 02 21:38:22.625580 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1738/3604] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:22.817452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:22.818071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:22.847379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:22.847379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:22.847379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:22.847379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:22.850256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:22.856283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:23.045850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:23.047700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:23.092606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:23.094287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:23.094748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:23.101152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:23.101152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:23.102851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:23.161451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:23.172430 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b58df224-0212-44b8-940f-5b3a2a760d23 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1299 microversion: 2.1 time: 0.364488 Nov 02 21:38:23.177311 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1867/3605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:22 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1299 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:23.271317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:23.272108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:23.282136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:23.283739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:23.284464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:23.286228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:23.288278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:23.290588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:23.296955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:23.412006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:23.413601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:23.414238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:23.414874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lazy-loading 'fault' on Instance uuid b506bd26-9fef-4b2a-b283-dcb5f8aac492 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:38:23.542313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21836846005a443eaed3d5099ea0e2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595893889f0d49498bfbcf599239a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:23.550973 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-708aebef-458f-4096-af8b-a47391b33b4a tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 200 len: 1313 microversion: 2.1 time: 0.283750 Nov 02 21:38:23.554150 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1868/3606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:23 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:23.810036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:23.827354 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36fbc389-f051-40a4-9eba-02e62ad70360 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.805139 Nov 02 21:38:23.827943 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1739/3607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:23 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:23.857570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:23.858402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:23.870449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:23.871297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:23.872005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:23.873071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:23.873708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:23.874443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:24.203453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:24.204087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:24.217351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:24.218838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:24.219115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:24.219837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:24.220652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:24.221191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:24.379587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:24.392305 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b23899d-5ca3-43b2-a6f9-a6454e28a1e3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1299 microversion: 2.1 time: 0.191618 Nov 02 21:38:24.394912 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1740/3608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:24 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:24.586329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:24.587403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] [instance: b506bd26-9fef-4b2a-b283-dcb5f8aac492] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:24.595745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:24.596350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:24.597480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:24.598008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:24.598687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:24.599338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:24.617287 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] HTTP exception thrown: Instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 could not be found. Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Request method failure captured: Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 HTTP/1.1 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuMvAqMjKz117fXKIC6YnVkuJRnzB_gNVdXZ7qsNXmFXQ_sc1jvcOJTn75Ya8iACk7ZazbxMmnQS8ppJCJOvW6CNoSXlhr8SUI6oYu2zA77hd5gXwMyQgTHZT4p4gYGr4BPH0qIDq0hzQJC1fwAl3DxR3Irhyeu7f2JbQj2KwnDh9aI Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 595893889f0d49498bfbcf599239a3e3 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1668766575 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_595893889f0d49498bfbcf599239a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/595893889f0d49498bfbcf599239a3e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/595893889f0d49498bfbcf599239a3e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/595893889f0d49498bfbcf599239a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1668766575 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 595893889f0d49498bfbcf599239a3e3 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1668766575 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerDiagnosticsNegativeTest-1668766575-project Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 21836846005a443eaed3d5099ea0e2d8 Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1668766575-project Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 could not be found. Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b506bd26-9fef-4b2a-b283-dcb5f8aac492'} Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 could not be found. Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 could not be found. Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:24.619329 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 could not be found. Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:24.626382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] Returning 404 to user: Instance b506bd26-9fef-4b2a-b283-dcb5f8aac492 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:24.627697 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-11c15e15-3870-4e57-8a78-fb5215f3a7ec tempest-ServerDiagnosticsNegativeTest-1668766575 tempest-ServerDiagnosticsNegativeTest-1668766575-project] 10.222.0.25 "GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492" status: 404 len: 111 microversion: 2.1 time: 0.043399 Nov 02 21:38:24.628519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1741/3609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:24 2022] GET /compute/v2.1/servers/b506bd26-9fef-4b2a-b283-dcb5f8aac492 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:38:24.666509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:24.674744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2fa4e55b-95ce-4be7-a37e-23b2fb059568 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.824382 Nov 02 21:38:24.689753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1869/3610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:23 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:24.708068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:24.708991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:24.719178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:24.724493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:24.725280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:24.726199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:24.727030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:24.727656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:25.939617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-62b30cb2-c737-4bee-b278-a1b40c17d5af tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b6821e160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-339554266", "description": "tempest-description-313768413"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:26.176906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:26.201998 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-70fb5122-e940-4422-ac7c-2b5cad3a691f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.502781 Nov 02 21:38:26.208115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1742/3611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:24 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:26.219538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:26.220175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:26.240576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:26.241117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:26.246463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:26.246463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:26.246463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:26.246463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:26.890839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:26.930049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=24 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:27.029009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:27.034535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:27.041324 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7d6708c-9cc8-4284-a0b4-098782c1498d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.831939 Nov 02 21:38:27.042975 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1743/3612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:26 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:27.062701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:27.065579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:27.100331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:27.108501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:27.110012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:27.112301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:27.114061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:27.114866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:27.670944 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-62b30cb2-c737-4bee-b278-a1b40c17d5af tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 2.306895 Nov 02 21:38:27.672592 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1870/3613] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:38:25 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:38:27.687507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bcf9c7d-58a4-40bf-aa4a-15ae161ec5f0 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b68220940>, body: {"security_group_rule": {"parent_group_id": "951d0402-7143-4dcb-9048-8cfaf377ccae", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:27.776416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:27.942481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:27.960532 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b4c41f88-8f1f-48fe-9152-e8e639d6a499 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.912097 Nov 02 21:38:27.973186 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1744/3614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:27 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:27.981179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1f4bb85-1bdd-4e93-8643-b614390b8d4b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Action: 'create', calling method: .version_select at 0x7f9b6d24c5e0>, body: {"keypair": {"name": "tempest-keypair-1194597330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC08CRYnYvlIvjq1WObg/jVyZTt08DZA3aHZdlrOZDugsglFjvhlh29yfgtCZ8SCeZp5ujC6TG9i/N9GUyF6oLlObbcksCu4kWwUYF4EvUv83o76AL4r4yRGbA0nYRRMQQ=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:28.023423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e1f4bb85-1bdd-4e93-8643-b614390b8d4b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Getting quotas for project e324e71765694763955a4468458bd7f2. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:28.029949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e1f4bb85-1bdd-4e93-8643-b614390b8d4b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Getting quotas for user 315ca0c90d5d48b98ec3d3b8d13a0fe9 and project e324e71765694763955a4468458bd7f2. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:28.157821 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1f4bb85-1bdd-4e93-8643-b614390b8d4b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.183178 Nov 02 21:38:28.158728 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1745/3615] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:38:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:38:28.165177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:28.166336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:28.183456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:28.184438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:28.185430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:28.187261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:28.188529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:28.193109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:29.348090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:29.369064 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a45e4d33-b581-4bca-9de3-75858bac6142 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.200730 Nov 02 21:38:29.370515 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1746/3616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:28 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:29.381595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:29.383419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:29.403519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:29.407263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:29.408630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:29.411167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:29.412069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:29.412918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:29.904833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:29.914586 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a148a0f-2135-46ae-9241-78b20df686c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.539809 Nov 02 21:38:29.923129 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1747/3617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:29 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:29.934742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:29.949328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:29.949328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:29.949328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:29.949328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:29.949328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:29.949328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:29.949328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:29.964487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bcf9c7d-58a4-40bf-aa4a-15ae161ec5f0 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.282420 Nov 02 21:38:29.966858 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1871/3618] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:29.979969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27f0ab0a-0ef3-41c4-8c88-6acf9e08a348 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b6822e550>, body: {"security_group_rule": {"parent_group_id": "951d0402-7143-4dcb-9048-8cfaf377ccae", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:30.294845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-27f0ab0a-0ef3-41c4-8c88-6acf9e08a348 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: This rule already exists in group 951d0402-7143-4dcb-9048-8cfaf377ccae Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27f0ab0a-0ef3-41c4-8c88-6acf9e08a348 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 138 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: {"security_group_rule": {"parent_group_id": "951d0402-7143-4dcb-9048-8cfaf377ccae", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: exception: This rule already exists in group 951d0402-7143-4dcb-9048-8cfaf377ccae Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'security_group_rule': {'parent_group_id': '951d0402-7143-4dcb-9048-8cfaf377ccae', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 951d0402-7143-4dcb-9048-8cfaf377ccae Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 951d0402-7143-4dcb-9048-8cfaf377ccae Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:30.297022 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:30.305160 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:30.305160 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:30.305160 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 951d0402-7143-4dcb-9048-8cfaf377ccae Nov 02 21:38:30.305160 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:30.305160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27f0ab0a-0ef3-41c4-8c88-6acf9e08a348 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 400 to user: This rule already exists in group 951d0402-7143-4dcb-9048-8cfaf377ccae {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:30.305160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27f0ab0a-0ef3-41c4-8c88-6acf9e08a348 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.324600 Nov 02 21:38:30.305160 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1872/3619] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:29 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 326 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:38:30.307896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c00b3ba9-1f45-49fe-98f3-532e03c7079c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Calling method '.version_select at 0x7f9b6d13bb80>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:30.791237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:30.805933 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f4ab5a48-e0ef-4b2e-a2f3-dd519d79d949 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.879942 Nov 02 21:38:30.806755 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1748/3620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:29 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:30.942924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:30.943729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:30.962845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:30.967322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:30.967785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:30.976574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:30.976574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:30.976574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.099432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:32.111169 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c49ab61a-7b8b-42d3-8fda-7cb36454c8f7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 1.175737 Nov 02 21:38:32.111775 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1749/3621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:30 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:32.125009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-955a6a42-4ac4-4887-a18d-64c08f6d2982 req-f3034284-5f4e-41a2-a195-eb2c6c8878b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0b51d7-2245-416b-910a-3824bd7a2234", "tag": "57181828-67e9-4d95-8c9e-d817dfed69f4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:32.145166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-955a6a42-4ac4-4887-a18d-64c08f6d2982 req-f3034284-5f4e-41a2-a195-eb2c6c8878b9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.145714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-955a6a42-4ac4-4887-a18d-64c08f6d2982 req-f3034284-5f4e-41a2-a195-eb2c6c8878b9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.146157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-955a6a42-4ac4-4887-a18d-64c08f6d2982 req-f3034284-5f4e-41a2-a195-eb2c6c8878b9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.159438 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-955a6a42-4ac4-4887-a18d-64c08f6d2982 req-f3034284-5f4e-41a2-a195-eb2c6c8878b9 service nova] Creating event network-changed:57181828-67e9-4d95-8c9e-d817dfed69f4 for instance 9b0b51d7-2245-416b-910a-3824bd7a2234 on n-h1-860863-4 Nov 02 21:38:32.165349 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-955a6a42-4ac4-4887-a18d-64c08f6d2982 req-f3034284-5f4e-41a2-a195-eb2c6c8878b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049895 Nov 02 21:38:32.166180 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1750/3622] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:32.233537 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c00b3ba9-1f45-49fe-98f3-532e03c7079c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/e8de5a6e-657b-47e6-9c32-42555b143d89" status: 202 len: 0 microversion: 2.1 time: 1.927905 Nov 02 21:38:32.239640 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1873/3623] 10.222.0.25 () {58 vars in 1287 bytes} [Wed Nov 2 21:38:30 2022] DELETE /compute/v2.1/os-security-group-rules/e8de5a6e-657b-47e6-9c32-42555b143d89 => generated 0 bytes in 1936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:32.246279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63180d35-81e7-4425-88f7-b1262c85d685 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b6821e820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1324180658", "description": "tempest-description-1763715359"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:32.337115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Action: 'update', calling method: .version_select at 0x7f9b68762dc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:32.343476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.344713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.350521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.355144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.355683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.357067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.389571 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] HTTP exception thrown: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Request method failure captured: Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839 HTTP/1.1 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 56 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuNXVNgwhX3adTQd_QV0Il3LMvJssTO3_gtQNwD-vV7w-uveLurJGwqsCj4ANOTgKBcH42CkL0rAFKG929mZRRw6HXsTZQ6BH4750Rpuh6CWlchw57b32juvesrzbncTV8MPXF04VAQmFwqVwwOSxZa2_ftXUtaIWKVDd2OsKjaApkQ Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 53fdd6be9a09427e9219709381daae38 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53fdd6be9a09427e9219709381daae38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53fdd6be9a09427e9219709381daae38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53fdd6be9a09427e9219709381daae38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53fdd6be9a09427e9219709381daae38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 53fdd6be9a09427e9219709381daae38 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: ecbc560e7e814f619027032ea8bbe074 Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: exception: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0dcd62e9-4a84-460b-9c20-39226be56839', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:32.400233 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.406956 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.408314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Returning 404 to user: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:32.417214 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a01a5094-804f-4e74-8c36-956ad6fbcca3 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839" status: 404 len: 110 microversion: 2.53 time: 0.240886 Nov 02 21:38:32.419985 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1751/3624] 10.222.0.25 () {62 vars in 1309 bytes} [Wed Nov 2 21:38:32 2022] PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839 => generated 110 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:32.433345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Action: 'update', calling method: .version_select at 0x7f9b68960820>, body: {"status": "disabled"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:32.445711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.446197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.446649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.457954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.461635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.464243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.473612 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] HTTP exception thrown: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Request method failure captured: Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839 HTTP/1.1 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 22 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuNXVNgwhX3adTQd_QV0Il3LMvJssTO3_gtQNwD-vV7w-uveLurJGwqsCj4ANOTgKBcH42CkL0rAFKG929mZRRw6HXsTZQ6BH4750Rpuh6CWlchw57b32juvesrzbncTV8MPXF04VAQmFwqVwwOSxZa2_ftXUtaIWKVDd2OsKjaApkQ Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 53fdd6be9a09427e9219709381daae38 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53fdd6be9a09427e9219709381daae38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53fdd6be9a09427e9219709381daae38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53fdd6be9a09427e9219709381daae38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53fdd6be9a09427e9219709381daae38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 53fdd6be9a09427e9219709381daae38 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: ecbc560e7e814f619027032ea8bbe074 Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: {"status": "disabled"} Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: exception: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0dcd62e9-4a84-460b-9c20-39226be56839', 'body': {'status': 'disabled'}} Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:32.475972 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Returning 404 to user: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48d689e5-e32f-437d-a254-e461eca77f1b tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839" status: 404 len: 110 microversion: 2.53 time: 0.052319 Nov 02 21:38:32.482424 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1752/3625] 10.222.0.25 () {62 vars in 1309 bytes} [Wed Nov 2 21:38:32 2022] PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839 => generated 110 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:32.489715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Action: 'update', calling method: .version_select at 0x7f9b68766c10>, body: {"status": "enabled"} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:32.502346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.502852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.503713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.514593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.515086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.515560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.524819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] HTTP exception thrown: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Request method failure captured: Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839 HTTP/1.1 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 21 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuNXVNgwhX3adTQd_QV0Il3LMvJssTO3_gtQNwD-vV7w-uveLurJGwqsCj4ANOTgKBcH42CkL0rAFKG929mZRRw6HXsTZQ6BH4750Rpuh6CWlchw57b32juvesrzbncTV8MPXF04VAQmFwqVwwOSxZa2_ftXUtaIWKVDd2OsKjaApkQ Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 53fdd6be9a09427e9219709381daae38 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_53fdd6be9a09427e9219709381daae38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53fdd6be9a09427e9219709381daae38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/53fdd6be9a09427e9219709381daae38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/53fdd6be9a09427e9219709381daae38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 53fdd6be9a09427e9219709381daae38 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: ecbc560e7e814f619027032ea8bbe074 Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: {"status": "enabled"} Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: exception: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0dcd62e9-4a84-460b-9c20-39226be56839', 'body': {'status': 'enabled'}} Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:38:32.526759 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Returning 404 to user: Service 0dcd62e9-4a84-460b-9c20-39226be56839 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ac18f73-9bd6-4b19-9cc3-db7879953a8e tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839" status: 404 len: 110 microversion: 2.53 time: 0.045534 Nov 02 21:38:32.541756 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1753/3626] 10.222.0.25 () {62 vars in 1309 bytes} [Wed Nov 2 21:38:32 2022] PUT /compute/v2.1/os-services/0dcd62e9-4a84-460b-9c20-39226be56839 => generated 110 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:32.546137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:32.552084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.553020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.553475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.568971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.568971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.568971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.587587 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-699726b7-23a7-421c-bf1e-f05e14fb2f50 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049541 Nov 02 21:38:32.588428 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1754/3627] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 21:38:32 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:32.603779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:32.608265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.608809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.609472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.610561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.611458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.612136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.641950 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5314e23e-2f4a-43e3-89fb-b9f49ecdc43a tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043633 Nov 02 21:38:32.643575 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1755/3628] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Nov 2 21:38:32 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:32.660472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:32.665490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.666001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.666455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.667287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:32.667648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:32.668102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:32.717387 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4318bf89-6a76-4a33-a14c-7f0a82b6bdf2 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.064812 Nov 02 21:38:32.718447 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1756/3629] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 21:38:32 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:32.723760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-837612763", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e369ed6f-dca8-4667-bb09-8298df618ce1"}, {"port": "45da1dad-8e70-4b0c-be39-da4ceee9c79f", "tag": "port-1"}, {"port": "7039bf5d-1ca8-4170-b36c-088ec0a791f4", "tag": "port-2"}, {"uuid": "115e8fe0-9502-46da-9ec2-55948cb56668", "tag": "net-1"}, {"uuid": "115e8fe0-9502-46da-9ec2-55948cb56668"}, {"uuid": "f46e7ec3-a54b-4696-9930-062c3f4e709f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f46e7ec3-a54b-4696-9930-062c3f4e709f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5c8a6ab5-490b-45ef-a552-3b3fafebbfcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ebac4852-297a-4df8-b6eb-26a18e322f45", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "eb349b43-90bc-47ab-951f-1ba200061707", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1972893835"}], "key_name": "tempest-keypair-1194597330", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:32.978010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] validate_networks() for [('e369ed6f-dca8-4667-bb09-8298df618ce1', None, None, None, None, None), (None, None, '45da1dad-8e70-4b0c-be39-da4ceee9c79f', None, None, None), (None, None, '7039bf5d-1ca8-4170-b36c-088ec0a791f4', None, None, None), ('115e8fe0-9502-46da-9ec2-55948cb56668', None, None, None, None, None), ('115e8fe0-9502-46da-9ec2-55948cb56668', None, None, None, None, None), ('f46e7ec3-a54b-4696-9930-062c3f4e709f', '10.2.2.100', None, None, None, None), ('f46e7ec3-a54b-4696-9930-062c3f4e709f', '10.2.2.200', None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:38:33.037948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63180d35-81e7-4425-88f7-b1262c85d685 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.796725 Nov 02 21:38:33.038891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1874/3630] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:38:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:33.057047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:33.064259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.073374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.075341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.075341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.076555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.077186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.115927 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82db2409-ae7e-4c9a-8889-f29ece68f574 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=n-d-860863-4&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.075915 Nov 02 21:38:33.116569 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1875/3631] 10.222.0.25 () {60 vars in 1235 bytes} [Wed Nov 2 21:38:33 2022] GET /compute/v2.1/os-services?host=n-d-860863-4&binary=xxx => generated 16 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:33.132035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9a9e4384-4f17-4a89-853c-eed728743f48 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b68216310>, body: {"security_group_rule": {"parent_group_id": "a1afeca6-880c-4196-a173-2cdfe3095728", "ip_protocol": "tcp", "from_port": 717053503, "to_port": 22}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:33.467817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9a9e4384-4f17-4a89-853c-eed728743f48 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: Invalid port range 717053503:22. Former value cannot be greater than the later Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9a9e4384-4f17-4a89-853c-eed728743f48 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 145 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: {"security_group_rule": {"parent_group_id": "a1afeca6-880c-4196-a173-2cdfe3095728", "ip_protocol": "tcp", "from_port": 717053503, "to_port": 22}} Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid port range 717053503:22. Former value cannot be greater than the later Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a1afeca6-880c-4196-a173-2cdfe3095728', 'ip_protocol': 'tcp', 'from_port': 717053503, 'to_port': 22}}} Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 717053503:22. Former value cannot be greater than the later Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 717053503:22. Former value cannot be greater than the later Nov 02 21:38:33.469777 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 717053503:22. Former value cannot be greater than the later Nov 02 21:38:33.474998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.475938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9a9e4384-4f17-4a89-853c-eed728743f48 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 400 to user: Invalid port range 717053503:22. Former value cannot be greater than the later {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:33.476951 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9a9e4384-4f17-4a89-853c-eed728743f48 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.348862 Nov 02 21:38:33.480213 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1876/3632] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:33 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 361 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:33.485356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:33.490324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.490903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.492078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.492967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.494164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.494821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.544889 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e779ac8d-64fb-4422-90d2-bc760727ac44 tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063923 Nov 02 21:38:33.547614 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1877/3633] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 21:38:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:33.555719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:33.556906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:33.565825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.569121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.569121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.569121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.569121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.569121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.837928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:33.846471 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26ac4d3a-dca4-4996-9558-eb2f061477a9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.295724 Nov 02 21:38:33.847118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1878/3634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:33 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:33.851946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4afefb1e-5a09-4e9a-b5aa-c132244608ca tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b68814c10>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-560760687", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:33.853999 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4afefb1e-5a09-4e9a-b5aa-c132244608ca tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: Security group id should be uuid Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4afefb1e-5a09-4e9a-b5aa-c132244608ca tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 130 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-560760687", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group id should be uuid Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-560760687', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:33.855697 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:33.864245 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 02 21:38:33.864245 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:33.864245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4afefb1e-5a09-4e9a-b5aa-c132244608ca tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 400 to user: Security group id should be uuid {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:33.864245 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4afefb1e-5a09-4e9a-b5aa-c132244608ca tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009610 Nov 02 21:38:33.864903 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1879/3635] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:33 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:38:33.869907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:33.874363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.875120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.875600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.876519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:33.877313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:33.877909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:33.910521 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15f15b39-6138-43ad-a251-b2ace33a1bdb tempest-ServicesAdminNegativeV253TestJSON-1876474202 tempest-ServicesAdminNegativeV253TestJSON-1876474202-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.044645 Nov 02 21:38:33.917129 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1880/3636] 10.222.0.25 () {60 vars in 1239 bytes} [Wed Nov 2 21:38:33 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:33.917129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8c1562f-41e6-42b1-a881-871584e69d3f tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b681c89d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-553278779", "description": "tempest-description-654515236"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:34.595632 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8c1562f-41e6-42b1-a881-871584e69d3f tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.683364 Nov 02 21:38:34.597195 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1881/3637] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:38:33 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:34.762183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5705fce-3c12-49a9-b272-9b9c3da7794f tempest-ServicesAdminNegativeV253TestJSON-371539132 tempest-ServicesAdminNegativeV253TestJSON-371539132-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:34.766291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5705fce-3c12-49a9-b272-9b9c3da7794f tempest-ServicesAdminNegativeV253TestJSON-371539132 tempest-ServicesAdminNegativeV253TestJSON-371539132-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fe97a19d5aff4e13b27a71efa1d74a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24686bb65d1c466b9befc6d5200ef412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5705fce-3c12-49a9-b272-9b9c3da7794f tempest-ServicesAdminNegativeV253TestJSON-371539132 tempest-ServicesAdminNegativeV253TestJSON-371539132-project] Request method failure captured: Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNWf5EYVLd-oGWDgK7_YIcealvPNOrB2zrmn0XuoeD_0rWEJDpQd43Eo7mpbMmWdxOXT8gL1HVNxUxvf2YXoSlxM2gWDycDOTj31yNBboje0LqfAkSwkWwJ-UWVgDMcKxlIsBm9JfIKuGMMUJz4txeJM9zwlWee8ydXWFVfL3joCXc Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 24686bb65d1c466b9befc6d5200ef412 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-371539132 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24686bb65d1c466b9befc6d5200ef412"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24686bb65d1c466b9befc6d5200ef412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24686bb65d1c466b9befc6d5200ef412"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24686bb65d1c466b9befc6d5200ef412"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-371539132 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 24686bb65d1c466b9befc6d5200ef412 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-371539132 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServicesAdminNegativeV253TestJSON-371539132-project Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: fe97a19d5aff4e13b27a71efa1d74a06 Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-371539132-project Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: action_args: {} Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 21:38:34.768144 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 21:38:34.773509 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.775000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5705fce-3c12-49a9-b272-9b9c3da7794f tempest-ServicesAdminNegativeV253TestJSON-371539132 tempest-ServicesAdminNegativeV253TestJSON-371539132-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:34.776032 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5705fce-3c12-49a9-b272-9b9c3da7794f tempest-ServicesAdminNegativeV253TestJSON-371539132 tempest-ServicesAdminNegativeV253TestJSON-371539132-project] 10.222.0.25 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.177428 Nov 02 21:38:34.777074 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1882/3638] 10.222.0.25 () {60 vars in 1178 bytes} [Wed Nov 2 21:38:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:34.783816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb1a41c0-185f-4a69-b9ad-21fcad9a9c0e tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b681e4820>, body: {"security_group_rule": {"parent_group_id": "b23fe906-acb4-4658-88d4-e798a004d18b", "ip_protocol": "tempest-999-1999893173", "from_port": 22, "to_port": 22}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:34.978582 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-cb1a41c0-185f-4a69-b9ad-21fcad9a9c0e tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: Invalid IP protocol tempest-999-1999893173. Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb1a41c0-185f-4a69-b9ad-21fcad9a9c0e tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 157 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: {"security_group_rule": {"parent_group_id": "b23fe906-acb4-4658-88d4-e798a004d18b", "ip_protocol": "tempest-999-1999893173", "from_port": 22, "to_port": 22}} Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid IP protocol tempest-999-1999893173. Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b23fe906-acb4-4658-88d4-e798a004d18b', 'ip_protocol': 'tempest-999-1999893173', 'from_port': 22, 'to_port': 22}}} Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1999893173. Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1999893173. Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.982951 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1999893173. Nov 02 21:38:34.989774 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:34.993483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb1a41c0-185f-4a69-b9ad-21fcad9a9c0e tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 400 to user: Invalid IP protocol tempest-999-1999893173. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:34.994766 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb1a41c0-185f-4a69-b9ad-21fcad9a9c0e tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.216304 Nov 02 21:38:34.996008 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1883/3639] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:34 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:38:35.001876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:35.003429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:35.010872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:35.011657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:35.014843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:35.015805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:35.016638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:35.017312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:35.406958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:35.417905 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d186b914-3364-4331-81c0-9a16d60f76ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.420279 Nov 02 21:38:35.419185 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1884/3640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:34 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:35.459803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-daaf5856-ce91-4377-a3ec-362b87687ba3 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b681c85e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-679994570", "description": "tempest-description-2070025571"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:36.371346 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-daaf5856-ce91-4377-a3ec-362b87687ba3 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.950086 Nov 02 21:38:36.372023 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1885/3641] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:38:35 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:36.388407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-518e2d36-7467-4c8f-95f1-442ead177956 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b681e4dc0>, body: {"security_group_rule": {"parent_group_id": "073c8c4e-9285-4797-8281-17f2a4faffa3", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-518e2d36-7467-4c8f-95f1-442ead177956 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-518e2d36-7467-4c8f-95f1-442ead177956 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 138 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: {"security_group_rule": {"parent_group_id": "073c8c4e-9285-4797-8281-17f2a4faffa3", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'security_group_rule': {'parent_group_id': '073c8c4e-9285-4797-8281-17f2a4faffa3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:36.854981 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-518e2d36-7467-4c8f-95f1-442ead177956 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-518e2d36-7467-4c8f-95f1-442ead177956 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.473771 Nov 02 21:38:36.864830 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1886/3642] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:36 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 475 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:36.870598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:36.871218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:36.877897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:36.888496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:36.890182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:36.891701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:36.893524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:36.894988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:37.268742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:37.280879 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29bd9c7a-e50c-482b-9c9b-819f1c7cb5a7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.422121 Nov 02 21:38:37.281505 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1887/3643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:36 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:37.291241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60d8dbc1-8ef0-4b4c-ac5b-418ec56bdc82 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b681d70d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-564890402", "description": "tempest-description-1951377717"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:37.970449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60d8dbc1-8ef0-4b4c-ac5b-418ec56bdc82 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.684440 Nov 02 21:38:37.980799 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1888/3644] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:38:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:37.992370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3030e854-fe03-476d-ac6b-7cfc818866a3 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b681e48b0>, body: {"security_group_rule": {"parent_group_id": "ac37cef2-ceab-4918-a175-691ade4c8bb9", "ip_protocol": "tcp", "from_port": 22, "to_port": 1187874088}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:38.042156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:38.181974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:38:38.181974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:38:38.181974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:38:38.181974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:38:38.181974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:38:38.183398 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3030e854-fe03-476d-ac6b-7cfc818866a3 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: Invalid port range 22:1187874088. Valid TCP ports should be between 1-65535 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3030e854-fe03-476d-ac6b-7cfc818866a3 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 146 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: {"security_group_rule": {"parent_group_id": "ac37cef2-ceab-4918-a175-691ade4c8bb9", "ip_protocol": "tcp", "from_port": 22, "to_port": 1187874088}} Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid port range 22:1187874088. Valid TCP ports should be between 1-65535 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ac37cef2-ceab-4918-a175-691ade4c8bb9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1187874088}}} Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1187874088. Valid TCP ports should be between 1-65535 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1187874088. Valid TCP ports should be between 1-65535 Nov 02 21:38:38.185436 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1187874088. Valid TCP ports should be between 1-65535 Nov 02 21:38:38.190782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.193276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3030e854-fe03-476d-ac6b-7cfc818866a3 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 400 to user: Invalid port range 22:1187874088. Valid TCP ports should be between 1-65535 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:38.194342 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3030e854-fe03-476d-ac6b-7cfc818866a3 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.210927 Nov 02 21:38:38.195410 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1889/3645] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:37 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:38:38.211210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7859369-762f-4211-ba91-95e12b44275c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Action: 'create', calling method: .version_select at 0x7f9b682509d0>, body: {"security_group_rule": {"parent_group_id": "e163cf73-33e5-47f9-802a-a8826e6d93e5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:38.229482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:38.230265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:38.232143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:38.233069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:38.233603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:38.239400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:38.256689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Getting quotas for project e324e71765694763955a4468458bd7f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:38:38.263668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Getting quotas for user 315ca0c90d5d48b98ec3d3b8d13a0fe9 and project e324e71765694763955a4468458bd7f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:38:38.279831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:38.287839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-e7859369-762f-4211-ba91-95e12b44275c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:38:38.289596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-e7859369-762f-4211-ba91-95e12b44275c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Neutron security group e163cf73-33e5-47f9-802a-a8826e6d93e5 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:38:38.290405 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e7859369-762f-4211-ba91-95e12b44275c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist Nov 02 21:38:38.290405 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-f980eed5-eef1-4d47-ae7e-31070667f7c9'] Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7859369-762f-4211-ba91-95e12b44275c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 138 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: {"security_group_rule": {"parent_group_id": "e163cf73-33e5-47f9-802a-a8826e6d93e5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-f980eed5-eef1-4d47-ae7e-31070667f7c9'] Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e163cf73-33e5-47f9-802a-a8826e6d93e5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:38:38.294917 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f980eed5-eef1-4d47-ae7e-31070667f7c9'] Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f980eed5-eef1-4d47-ae7e-31070667f7c9'] Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f980eed5-eef1-4d47-ae7e-31070667f7c9'] Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f980eed5-eef1-4d47-ae7e-31070667f7c9'] Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7859369-762f-4211-ba91-95e12b44275c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 404 to user: Security group e163cf73-33e5-47f9-802a-a8826e6d93e5 does not exist Nov 02 21:38:38.302550 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-f980eed5-eef1-4d47-ae7e-31070667f7c9'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:38.311988 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7859369-762f-4211-ba91-95e12b44275c tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.095157 Nov 02 21:38:38.312520 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1890/3646] 10.222.0.25 () {60 vars in 1195 bytes} [Wed Nov 2 21:38:38 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:38:38.321512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:38.322540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:38.333207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:38.333965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:38.334778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:38.337219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:38.337924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:38.338607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:38.566276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:38:38.570228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5c8a6ab5-490b-45ef-a552-3b3fafebbfcb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ebac4852-297a-4df8-b6eb-26a18e322f45',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb349b43-90bc-47ab-951f-1ba200061707',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:38:38.675139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:38.682907 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1960d72f-95de-473b-a4b8-04421b09df56 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.369081 Nov 02 21:38:38.683476 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1891/3647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:38 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:38.688553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b5f78d0-4fb3-4989-84a9-616a673033d4 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Calling method '.version_select at 0x7f9b681d74c0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:38.709829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-3b5f78d0-4fb3-4989-84a9-616a673033d4 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:38:38.710421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-3b5f78d0-4fb3-4989-84a9-616a673033d4 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Neutron security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 not found {{(pid=121040) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 02 21:38:38.710949 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3b5f78d0-4fb3-4989-84a9-616a673033d4 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] HTTP exception thrown: Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist Nov 02 21:38:38.710949 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-d676324b-c1f8-4b54-a36b-143923b2d64b'] Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b5f78d0-4fb3-4989-84a9-616a673033d4 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Request method failure captured: Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-security-group-rules/9c81677b-3f34-4a64-bbf5-8645e758c414 HTTP/1.1 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuNRxppoAyA8VDHXf_13I4-20jxAg48ZWqhbzN1KSt9tkxfi1WVCJLBM0S4wV6UMCmvhLEKe3adWyevMrEiodHM72YtR1bfaNoHSgGCbDDssod164RbVu61bx_dsBhRNemxE_76oArZ7cip-3rHmZH1X5CDUAvoqq_x7TNWudRH_PYA Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0ffc85e62f504ce2875490e40fe7c5c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0ffc85e62f504ce2875490e40fe7c5c0 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 2ef90551abbc4de4b2aeebf312802403 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-d676324b-c1f8-4b54-a36b-143923b2d64b'] Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9c81677b-3f34-4a64-bbf5-8645e758c414'} Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:38:38.712793 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d676324b-c1f8-4b54-a36b-143923b2d64b'] Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d676324b-c1f8-4b54-a36b-143923b2d64b'] Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d676324b-c1f8-4b54-a36b-143923b2d64b'] Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d676324b-c1f8-4b54-a36b-143923b2d64b'] Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b5f78d0-4fb3-4989-84a9-616a673033d4 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Returning 404 to user: Security group rule 9c81677b-3f34-4a64-bbf5-8645e758c414 does not exist Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-d676324b-c1f8-4b54-a36b-143923b2d64b'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b5f78d0-4fb3-4989-84a9-616a673033d4 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-group-rules/9c81677b-3f34-4a64-bbf5-8645e758c414" status: 404 len: 199 microversion: 2.1 time: 0.029181 Nov 02 21:38:38.718712 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1892/3648] 10.222.0.25 () {58 vars in 1287 bytes} [Wed Nov 2 21:38:38 2022] DELETE /compute/v2.1/os-security-group-rules/9c81677b-3f34-4a64-bbf5-8645e758c414 => generated 199 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:38:38.725931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc6afa87-e05f-44ee-8c97-e912534c8ebf tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Calling method '.version_select at 0x7f9b68250550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:39.257295 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc6afa87-e05f-44ee-8c97-e912534c8ebf tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/ac37cef2-ceab-4918-a175-691ade4c8bb9" status: 202 len: 0 microversion: 2.1 time: 0.536354 Nov 02 21:38:39.261110 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1893/3649] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:38:38 2022] DELETE /compute/v2.1/os-security-groups/ac37cef2-ceab-4918-a175-691ade4c8bb9 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:38:39.266382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d6424dd-d8eb-4d6e-bebf-18bda3390493 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Calling method '.version_select at 0x7f9b68250940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:39.826296 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d6424dd-d8eb-4d6e-bebf-18bda3390493 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/073c8c4e-9285-4797-8281-17f2a4faffa3" status: 202 len: 0 microversion: 2.1 time: 0.563919 Nov 02 21:38:39.827052 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1894/3650] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:38:39 2022] DELETE /compute/v2.1/os-security-groups/073c8c4e-9285-4797-8281-17f2a4faffa3 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:38:39.843070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:39.844742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:39.861978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:39.863000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:39.863707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:39.864829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:39.865529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:39.866167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:40.052535 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b184dbd-0353-4bbe-86eb-ee76d30269de tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.332332 Nov 02 21:38:40.054386 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1757/3651] 10.222.0.25 () {62 vars in 1189 bytes} [Wed Nov 2 21:38:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 7335 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:38:40.060567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55863d4e-652d-49c0-9713-fb740f6463cc tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Calling method '.version_select at 0x7f9b6893fee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:40.305364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:40.314325 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd97a8cc-6740-456f-bf4e-e33b2a697b77 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.482053 Nov 02 21:38:40.314973 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1895/3652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:39 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:40.326362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bd5c2831-31a0-4f7a-9bce-c474361cd641 req-9491357e-130e-4bb0-b579-e54be8a14b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0b51d7-2245-416b-910a-3824bd7a2234", "name": "network-vif-plugged", "status": "completed", "tag": "57181828-67e9-4d95-8c9e-d817dfed69f4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:40.337209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bd5c2831-31a0-4f7a-9bce-c474361cd641 req-9491357e-130e-4bb0-b579-e54be8a14b91 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:40.337691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bd5c2831-31a0-4f7a-9bce-c474361cd641 req-9491357e-130e-4bb0-b579-e54be8a14b91 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:40.338126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bd5c2831-31a0-4f7a-9bce-c474361cd641 req-9491357e-130e-4bb0-b579-e54be8a14b91 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:40.350195 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bd5c2831-31a0-4f7a-9bce-c474361cd641 req-9491357e-130e-4bb0-b579-e54be8a14b91 service nova] Creating event network-vif-plugged:57181828-67e9-4d95-8c9e-d817dfed69f4 for instance 9b0b51d7-2245-416b-910a-3824bd7a2234 on n-h1-860863-4 Nov 02 21:38:40.355558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bd5c2831-31a0-4f7a-9bce-c474361cd641 req-9491357e-130e-4bb0-b579-e54be8a14b91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039222 Nov 02 21:38:40.360345 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1896/3653] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:40.366482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0337335f-d27e-4698-a0cb-62fbfd20694a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:40.367263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0337335f-d27e-4698-a0cb-62fbfd20694a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:40.479894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0337335f-d27e-4698-a0cb-62fbfd20694a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:40.500062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0337335f-d27e-4698-a0cb-62fbfd20694a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:40.502320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0337335f-d27e-4698-a0cb-62fbfd20694a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:40.503790 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0337335f-d27e-4698-a0cb-62fbfd20694a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1285 microversion: 2.42 time: 0.142038 Nov 02 21:38:40.505591 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1897/3654] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:40 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:40.680086 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55863d4e-652d-49c0-9713-fb740f6463cc tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/b23fe906-acb4-4658-88d4-e798a004d18b" status: 202 len: 0 microversion: 2.1 time: 0.623465 Nov 02 21:38:40.681199 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1758/3655] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:38:40 2022] DELETE /compute/v2.1/os-security-groups/b23fe906-acb4-4658-88d4-e798a004d18b => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:40.689850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e4eeca71-e068-4888-afb1-41e3f4370df1 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Calling method '.version_select at 0x7f9b6822e5e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:41.251470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e4eeca71-e068-4888-afb1-41e3f4370df1 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a1afeca6-880c-4196-a173-2cdfe3095728" status: 202 len: 0 microversion: 2.1 time: 0.565412 Nov 02 21:38:41.256073 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1898/3656] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:38:40 2022] DELETE /compute/v2.1/os-security-groups/a1afeca6-880c-4196-a173-2cdfe3095728 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:41.261157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-375d3ce9-8789-4536-9718-0c7b009b5e07 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] Calling method '.version_select at 0x7f9b6926f700>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:41.341718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:41.341718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:41.356710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:41.364164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:41.370221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:41.370221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:41.373490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:41.374253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:41.727332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:41.745688 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d7ef638-6377-429d-a16d-0cc8dfa8aca7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1367 microversion: 2.1 time: 0.411040 Nov 02 21:38:41.747129 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1899/3657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:41 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:41.754915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-372f7ac4-528e-455c-9900-bcb3509cd9a3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:41.755770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-372f7ac4-528e-455c-9900-bcb3509cd9a3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:41.916984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-372f7ac4-528e-455c-9900-bcb3509cd9a3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:41.928216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-372f7ac4-528e-455c-9900-bcb3509cd9a3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:41.929704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-372f7ac4-528e-455c-9900-bcb3509cd9a3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:41.930847 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-372f7ac4-528e-455c-9900-bcb3509cd9a3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1285 microversion: 2.42 time: 0.182158 Nov 02 21:38:41.931410 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1900/3658] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:41 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:42.010269 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-375d3ce9-8789-4536-9718-0c7b009b5e07 tempest-SecurityGroupRulesNegativeTestJSON-1093790730 tempest-SecurityGroupRulesNegativeTestJSON-1093790730-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/951d0402-7143-4dcb-9048-8cfaf377ccae" status: 202 len: 0 microversion: 2.1 time: 0.752958 Nov 02 21:38:42.012781 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1759/3659] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:38:41 2022] DELETE /compute/v2.1/os-security-groups/951d0402-7143-4dcb-9048-8cfaf377ccae => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:42.771602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:42.772376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:42.785152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:42.785921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:42.786606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:42.787588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:42.788337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:42.788964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:42.958984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:42.959605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:42.971990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:42.972440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:42.972888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:42.984216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:42.984716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:42.985189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:43.145834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:43.161628 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-afb4d567-6abe-461b-b83f-909eecf862ef tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1556 microversion: 2.1 time: 0.395102 Nov 02 21:38:43.162388 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1901/3660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:42 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1556 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:43.192271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:43.192816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:43.216916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:43.217885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:43.218545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:43.219568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:43.220197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:43.221151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:43.380421 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83812876-3b79-4e82-91ba-7ad71e7e0777 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198228 Nov 02 21:38:43.381057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1902/3661] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:38:43 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:43.384042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:43.397626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:43.417259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:43.417259 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dd6ba08a-2752-4391-b608-be2873963a0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1519 microversion: 2.42 time: 0.446090 Nov 02 21:38:43.417259 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1760/3662] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:42 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1519 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:44.429953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:44.435402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:44.436028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:44.461356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:44.465970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:44.465970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:44.466388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:44.466985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:44.470320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:44.727321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:44.741814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:44.744242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:44.745887 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c81c423-e0dd-40fe-b622-108e5f2a171a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1583 microversion: 2.42 time: 0.317941 Nov 02 21:38:44.763735 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1903/3663] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:44 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1583 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:45.777113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:45.778851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:45.804768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:45.807163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:45.807890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:45.809788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:45.810469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:45.811109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:46.055023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:46.073146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:46.078018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:46.079580 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30b5cede-df77-4595-b00b-1cda4ae71edb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1593 microversion: 2.42 time: 0.306504 Nov 02 21:38:46.080753 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1761/3664] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:45 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1593 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:47.114058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:47.115715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:47.133747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:47.136375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:47.142491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:47.148034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:47.148034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:47.148034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:47.623726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:47.639451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:47.641059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:47.655026 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-00e61bd3-5835-48ab-955a-f0f3078e22a8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1593 microversion: 2.42 time: 0.545563 Nov 02 21:38:47.665771 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1904/3665] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:47 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1593 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:47.781751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-29e313f4-8a75-43b1-b646-bd8af3c1d4b0 req-091179ef-13c0-480a-897a-29dc27a612f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0b51d7-2245-416b-910a-3824bd7a2234", "tag": "57181828-67e9-4d95-8c9e-d817dfed69f4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:47.799835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-29e313f4-8a75-43b1-b646-bd8af3c1d4b0 req-091179ef-13c0-480a-897a-29dc27a612f4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:47.803641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-29e313f4-8a75-43b1-b646-bd8af3c1d4b0 req-091179ef-13c0-480a-897a-29dc27a612f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:47.803641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-29e313f4-8a75-43b1-b646-bd8af3c1d4b0 req-091179ef-13c0-480a-897a-29dc27a612f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:47.843757 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-29e313f4-8a75-43b1-b646-bd8af3c1d4b0 req-091179ef-13c0-480a-897a-29dc27a612f4 service nova] Creating event network-changed:57181828-67e9-4d95-8c9e-d817dfed69f4 for instance 9b0b51d7-2245-416b-910a-3824bd7a2234 on n-h1-860863-4 Nov 02 21:38:47.849680 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-29e313f4-8a75-43b1-b646-bd8af3c1d4b0 req-091179ef-13c0-480a-897a-29dc27a612f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071596 Nov 02 21:38:47.850615 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1762/3666] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:38:48.698720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:48.700713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:48.709806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:48.723263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:48.723263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:48.723263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:48.723263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:48.723263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:49.463217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:49.501000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:49.504549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:49.507963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec10300b-6024-4608-aa93-10f2a4f630d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1593 microversion: 2.42 time: 0.813132 Nov 02 21:38:49.513761 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1905/3667] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:48 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1593 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:50.539269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=14 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:50.540391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:50.549110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:50.549828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:50.572511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:50.573795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:50.574239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:50.575118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:50.575573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:50.576003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:50.981693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:50.996056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:50.999193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:51.000582 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-af21e855-a31a-4a90-a88f-9d7d66095c0c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1661 microversion: 2.42 time: 0.462289 Nov 02 21:38:51.007162 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1763/3668] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:50 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1661 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:52.033513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:52.033513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:52.039986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:52.057351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:52.060533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:52.060533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:52.060533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:52.064285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:52.064816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:52.402280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:52.425621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:52.432005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:52.439705 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3297671-fdf4-43d6-82c1-8ecc7590c989 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1661 microversion: 2.42 time: 0.407494 Nov 02 21:38:52.442386 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1906/3669] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:52 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1661 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:53.222861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:38:53.228500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:53.244995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:53.247875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:53.250527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:53.252730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:53.255607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:53.259019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:53.477835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:53.479164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:53.487498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:53.488262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:53.488701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:53.489445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:53.489900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:53.490325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:53.591149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d88dff2b-8cad-4a7e-8d26-c7088d88652a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.373947 Nov 02 21:38:53.594982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1764/3670] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:38:53 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:38:53.613016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:53.613745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:53.639251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:53.639877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:53.640182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:53.640941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:53.641388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:53.641814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:54.471931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:54.482496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c7c02b2-228b-4f00-bdd8-f40af28897c5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1670 microversion: 2.1 time: 0.884850 Nov 02 21:38:54.483454 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1765/3671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:53 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1670 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:54.600059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:54.621150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:54.623392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:54.624828 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9908c006-5aa7-4d6f-929b-e70dcedc15dd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1708 microversion: 2.42 time: 1.154757 Nov 02 21:38:54.628016 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1907/3672] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:53 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1708 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:55.508522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:55.509175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:55.526841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:55.531220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:55.534831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:55.538681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:55.539347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:55.547459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:55.656610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:55.658247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:55.660448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=58 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:55.685141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:55.686068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:55.686771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:55.687723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:55.688766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:55.689917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:55.693218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:56.044508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:56.053608 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-45bf6f92-7405-479a-aa86-b9d68a78070d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1670 microversion: 2.1 time: 0.549092 Nov 02 21:38:56.059658 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1766/3673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:55 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1670 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:56.131688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:56.157737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:56.163028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:56.168433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b3a35e7-f324-4d6e-a587-c9b4aef1ba27 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1708 microversion: 2.42 time: 0.514743 Nov 02 21:38:56.171442 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1908/3674] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:55 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1708 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:57.087082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:57.087791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:57.101659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:57.102173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:57.102624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:57.103348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:57.103882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:57.104299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:57.205911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:57.207092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:57.226950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:57.226950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:57.226950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:57.230596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:57.231386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:57.231855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:57.982837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:57.997947 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8fd60515-6690-4db9-b7cb-bc27821ac79f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1675 microversion: 2.1 time: 0.915551 Nov 02 21:38:57.999339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1767/3675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:57 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1675 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:38:58.332586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:58.343358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:58.344823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:58.366353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-927570bf-d9b1-4eac-9f3a-d37635777a0e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1755 microversion: 2.42 time: 1.168958 Nov 02 21:38:58.366954 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1909/3676] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:57 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1755 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:38:59.028797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:59.029628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:59.042844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:59.047319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:59.047319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:59.047319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:59.049188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:59.049995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:59.061970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:38:59.398253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:38:59.398867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:38:59.419772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:59.420325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:59.420727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:59.421554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:38:59.422017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:38:59.422451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:38:59.826406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:38:59.838319 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f85942f-a671-4e05-a8d3-b696daaff876 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1675 microversion: 2.1 time: 0.812708 Nov 02 21:38:59.839439 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1768/3677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:38:59 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1675 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:00.009370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:00.028620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:00.030337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:00.031549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-101e2b88-a5aa-4d6b-b7cc-6e3d66ea4f6f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1755 microversion: 2.42 time: 0.637584 Nov 02 21:39:00.037265 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1910/3678] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:38:59 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1755 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:39:00.869691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:00.869691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:00.893372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:00.893883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:00.894316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:00.895032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:00.904666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:00.907696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:01.067378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:01.068415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:01.086946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:01.087529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:01.088478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:01.089230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:01.089694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:01.090179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:01.573317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:01.602924 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83be75d4-d934-45ae-9717-eb9d590e6452 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1675 microversion: 2.1 time: 0.740895 Nov 02 21:39:01.606470 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1769/3679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:00 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1675 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:01.639301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:01.651982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:01.655267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:01.657702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ded79109-8bfd-45c0-9def-21ad9e0c99f5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1802 microversion: 2.42 time: 0.595444 Nov 02 21:39:01.658971 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1911/3680] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:01 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1802 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:02.630992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:02.632267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:02.643552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:02.648733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:02.649547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:02.650486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:02.653805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:02.654458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:02.690150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:02.691973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:02.710816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:02.711029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:02.711491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:02.719513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:02.722539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:02.736094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:03.464028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:03.485320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:03.490264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:03.497552 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71e6f5c9-fb1a-45ae-bc77-d692cc134506 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1849 microversion: 2.42 time: 0.807755 Nov 02 21:39:03.498501 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1912/3681] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:02 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1849 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:03.752777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:03.772788 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1efaf5f4-5dff-4c2b-92da-70dc09135486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.146211 Nov 02 21:39:03.774763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1770/3682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:02 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:04.526966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:04.529603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:04.552463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:04.554855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:04.557663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:04.563755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:04.564923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:04.565680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:04.999161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:05.019210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:05.021438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:05.025203 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df4ef607-f0d6-43ad-96a9-a70da4effbdc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1849 microversion: 2.42 time: 0.502839 Nov 02 21:39:05.027886 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1913/3683] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:04 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1849 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:05.607937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-768e7af0-7364-417e-90d6-0f738564de44 req-07072a07-fcab-4204-85cc-5fb3f3e8dcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "cfb7a0d6-5668-4202-bf4b-e203c9b5c97d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:05.647673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-768e7af0-7364-417e-90d6-0f738564de44 req-07072a07-fcab-4204-85cc-5fb3f3e8dcd8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:05.652873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-768e7af0-7364-417e-90d6-0f738564de44 req-07072a07-fcab-4204-85cc-5fb3f3e8dcd8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:05.660107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-768e7af0-7364-417e-90d6-0f738564de44 req-07072a07-fcab-4204-85cc-5fb3f3e8dcd8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:05.686768 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-768e7af0-7364-417e-90d6-0f738564de44 req-07072a07-fcab-4204-85cc-5fb3f3e8dcd8 service nova] Creating event network-changed:cfb7a0d6-5668-4202-bf4b-e203c9b5c97d for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:39:05.699530 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-768e7af0-7364-417e-90d6-0f738564de44 req-07072a07-fcab-4204-85cc-5fb3f3e8dcd8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096004 Nov 02 21:39:05.702499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1771/3684] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:06.057856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:06.058516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:06.085023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:06.085844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:06.087673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:06.092521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:06.095078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:06.096831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:07.658247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:07.686332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:07.691450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:07.693729 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7117dc83-d33e-4087-af60-506ff33719af tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1849 microversion: 2.42 time: 1.641495 Nov 02 21:39:07.694870 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1914/3685] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:06 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1849 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:08.232008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1580840982", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "67397ffc-44ab-44e4-a584-afec269f9e55"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:08.302049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] validate_networks() for [('67397ffc-44ab-44e4-a584-afec269f9e55', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:39:08.723574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:08.725597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:08.741662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:08.745251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:08.746034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:08.747274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:08.751090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:08.751789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:09.752445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:09.770705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:09.774259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:09.777329 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17377339-88dd-430a-9c77-248bdda28d3d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1870 microversion: 2.42 time: 1.058933 Nov 02 21:39:09.779161 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1915/3686] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:08 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1870 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:39:10.178850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:39:10.180217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:39:10.181117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:39:10.181789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:39:10.182489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:39:10.198179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:10.213412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-87e5af46-80b8-40d8-9907-9bffe582c4af req-ac4e50b6-29d5-4322-94f8-db5f44c025bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "45da1dad-8e70-4b0c-be39-da4ceee9c79f"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:10.239041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-87e5af46-80b8-40d8-9907-9bffe582c4af req-ac4e50b6-29d5-4322-94f8-db5f44c025bf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:10.250056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-87e5af46-80b8-40d8-9907-9bffe582c4af req-ac4e50b6-29d5-4322-94f8-db5f44c025bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:10.250617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:10.250617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:10.250617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:10.251092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-87e5af46-80b8-40d8-9907-9bffe582c4af req-ac4e50b6-29d5-4322-94f8-db5f44c025bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:10.259377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:10.260559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:10.261259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:10.301588 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-87e5af46-80b8-40d8-9907-9bffe582c4af req-ac4e50b6-29d5-4322-94f8-db5f44c025bf service nova] Creating event network-changed:45da1dad-8e70-4b0c-be39-da4ceee9c79f for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:39:10.318980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Getting quotas for project e8837c38b318491182101a3e6e9d9851. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:39:10.327057 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-87e5af46-80b8-40d8-9907-9bffe582c4af req-ac4e50b6-29d5-4322-94f8-db5f44c025bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119263 Nov 02 21:39:10.330182 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1916/3687] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:39:10.344986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Getting quotas for user 62fe8c2232f147f0a3e1f3a7211236dd and project e8837c38b318491182101a3e6e9d9851. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:39:10.378372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Going to run 3 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:39:10.380945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:39:10.551403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=91dfa776-3955-470e-a284-e11b07dda568,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:39:10.789998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=56a87762-1d21-4b74-8fa8-02260aaf7118,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:39:10.821292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:10.830665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:10.856799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:10.860084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:10.860814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:10.863761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:10.866886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:10.867540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:11.055350 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-80314aba-1af7-4ae2-8aa0-ce02d13d9dd7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.070194 Nov 02 21:39:11.068106 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1772/3688] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:39:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:39:11.078281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:11.089027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:11.090188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:11.140409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:11.141274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:11.141908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:11.142853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:11.146402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:11.147105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:11.184496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e7df263-daf6-4e6b-b1cd-e22c8ba4674f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.113693 Nov 02 21:39:11.185896 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1773/3689] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:39:11 2022] GET /compute/v2.1/servers => generated 1018 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:11.206138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0bfc1e7-13ea-4542-84ac-2a3059e03d11 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:11.207127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0bfc1e7-13ea-4542-84ac-2a3059e03d11 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:12.052544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0bfc1e7-13ea-4542-84ac-2a3059e03d11 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:12.062891 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0bfc1e7-13ea-4542-84ac-2a3059e03d11 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1223 microversion: 2.1 time: 0.860309 Nov 02 21:39:12.065763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1774/3690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:11 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1223 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:12.493084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:12.511298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:12.514779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:12.532232 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d5dd8950-3fcf-4480-8e53-96ff25598da8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1891 microversion: 2.42 time: 1.717187 Nov 02 21:39:12.536982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1917/3691] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:10 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1891 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:39:13.090304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-845fe484-7769-4bc5-bc92-a76e3606fb43 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:13.091205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-845fe484-7769-4bc5-bc92-a76e3606fb43 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:13.221889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-845fe484-7769-4bc5-bc92-a76e3606fb43 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:13.231830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-845fe484-7769-4bc5-bc92-a76e3606fb43 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1223 microversion: 2.1 time: 0.146002 Nov 02 21:39:13.244961 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1775/3692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:13 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:13.245192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c023b3db-23a2-4a41-825e-cadd43a8543e req-327c577f-91c1-444c-9255-8e39a5c410a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "7039bf5d-1ca8-4170-b36c-088ec0a791f4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:13.264217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c023b3db-23a2-4a41-825e-cadd43a8543e req-327c577f-91c1-444c-9255-8e39a5c410a0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:13.264751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c023b3db-23a2-4a41-825e-cadd43a8543e req-327c577f-91c1-444c-9255-8e39a5c410a0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:13.265328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c023b3db-23a2-4a41-825e-cadd43a8543e req-327c577f-91c1-444c-9255-8e39a5c410a0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:13.276991 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c023b3db-23a2-4a41-825e-cadd43a8543e req-327c577f-91c1-444c-9255-8e39a5c410a0 service nova] Creating event network-changed:7039bf5d-1ca8-4170-b36c-088ec0a791f4 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:39:13.283307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c023b3db-23a2-4a41-825e-cadd43a8543e req-327c577f-91c1-444c-9255-8e39a5c410a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045166 Nov 02 21:39:13.284393 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1918/3693] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:39:13.567097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:13.568204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:13.592871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:13.593774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:13.594388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:13.595311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:13.596071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:13.596798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:13.983522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:13.997655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:14.005172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:14.007291 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-11fec4ba-0c34-4b60-bfd4-d61fae2b1341 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1891 microversion: 2.42 time: 0.447951 Nov 02 21:39:14.009075 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1776/3694] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:13 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1891 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:14.270373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2c502c0-6f6f-4abb-bdb0-58eaca5ac3fd tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:14.272650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2c502c0-6f6f-4abb-bdb0-58eaca5ac3fd tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:14.364127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2c502c0-6f6f-4abb-bdb0-58eaca5ac3fd tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:14.372524 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2c502c0-6f6f-4abb-bdb0-58eaca5ac3fd tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1223 microversion: 2.1 time: 0.113575 Nov 02 21:39:14.374826 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1919/3695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:14 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1223 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:15.039329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:15.040087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:15.050748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:15.053174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:15.053644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:15.081495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:15.082125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:15.084491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:15.376637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ef2de87f-2b2b-4567-826c-6a171f47b67f req-b81ff185-4cf3-4646-8357-c2bc5881d60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "52468c6f-da2b-4db6-a97a-61a7be94b9cd"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:15.408027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef2de87f-2b2b-4567-826c-6a171f47b67f req-b81ff185-4cf3-4646-8357-c2bc5881d60e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:15.417641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef2de87f-2b2b-4567-826c-6a171f47b67f req-b81ff185-4cf3-4646-8357-c2bc5881d60e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:15.418342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef2de87f-2b2b-4567-826c-6a171f47b67f req-b81ff185-4cf3-4646-8357-c2bc5881d60e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:15.433791 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ef2de87f-2b2b-4567-826c-6a171f47b67f req-b81ff185-4cf3-4646-8357-c2bc5881d60e service nova] Creating event network-changed:52468c6f-da2b-4db6-a97a-61a7be94b9cd for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:39:15.447440 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ef2de87f-2b2b-4567-826c-6a171f47b67f req-b81ff185-4cf3-4646-8357-c2bc5881d60e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073991 Nov 02 21:39:15.448426 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1920/3696] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:39:15.455518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:15.456677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:15.465812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:15.466901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:15.467582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:15.468904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:15.469601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:15.470270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:15.681379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:15.706259 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c9f80a44-2d89-43e3-9840-22c053a47706 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1219 microversion: 2.1 time: 0.255767 Nov 02 21:39:15.707295 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1921/3697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:15 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:15.899034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:15.927424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:15.934811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:15.939831 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-84ccf45a-b3cd-42a4-b3af-4dd4aa91e255 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.899015 Nov 02 21:39:15.941551 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1777/3698] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:15 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:16.733040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:16.734568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:16.753815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:16.757850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:16.757850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:16.763283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:16.766958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:16.767726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:16.973175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:16.974831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:16.992285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:16.996288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:16.996866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:16.999903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:17.000617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:17.003287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:17.073120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:17.093712 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c389b638-d2f0-4730-9039-43cb2ce9a8c5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1275 microversion: 2.1 time: 0.354426 Nov 02 21:39:17.096293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1922/3699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:16 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:17.680133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:17.700546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:17.703029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:17.704662 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f903fc02-a643-4f2d-beed-bd237cd4c47c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.736091 Nov 02 21:39:17.706108 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1778/3700] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:16 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:17.894539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-63864479-5596-49ec-b3d7-cfa9190b7192 req-64c137ee-77d1-4f10-891a-cf346f351eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "9367ad21-601b-4cdf-9414-940e3aa0430b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:17.926998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-63864479-5596-49ec-b3d7-cfa9190b7192 req-64c137ee-77d1-4f10-891a-cf346f351eb6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:17.927989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-63864479-5596-49ec-b3d7-cfa9190b7192 req-64c137ee-77d1-4f10-891a-cf346f351eb6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:17.928649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-63864479-5596-49ec-b3d7-cfa9190b7192 req-64c137ee-77d1-4f10-891a-cf346f351eb6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:17.944230 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-63864479-5596-49ec-b3d7-cfa9190b7192 req-64c137ee-77d1-4f10-891a-cf346f351eb6 service nova] Creating event network-changed:9367ad21-601b-4cdf-9414-940e3aa0430b for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:39:17.951072 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-63864479-5596-49ec-b3d7-cfa9190b7192 req-64c137ee-77d1-4f10-891a-cf346f351eb6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060008 Nov 02 21:39:17.952736 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1923/3701] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:18.135668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:18.138238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:18.161520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:18.164047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:18.164047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:18.164047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:18.164047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:18.169395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:18.738460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:18.746281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:18.750955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:18.753169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:18.755338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:18.757818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:18.759638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:18.765579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:19.464650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:19.496507 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3394734-0b96-4d09-977f-da3a086a1360 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1281 microversion: 2.1 time: 1.354347 Nov 02 21:39:19.501458 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1779/3702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:18 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1281 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:19.747572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:19.770700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:19.772495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:19.773748 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f61d96e4-d2a7-472b-ba2d-b4c98537340a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.045860 Nov 02 21:39:19.774432 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1924/3703] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:18 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:39:20.526453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:20.529551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:20.551698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:20.553462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:20.559442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:20.560605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:20.561341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:20.563974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:20.741320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:20.753165 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-815d6f79-31b8-4fc1-aef7-369ab98563cf tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1281 microversion: 2.1 time: 0.231152 Nov 02 21:39:20.756849 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1780/3704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:20 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:20.805980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:20.806597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:20.828803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:20.829644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:20.832450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:20.833471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:20.846345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:20.847617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:21.168907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:21.169692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:21.173042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:21.189638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:21.192485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:21.193174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:21.194105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:21.201510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:21.202275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:21.256405 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8804ee1c-071c-47c7-a7a6-484b1157615e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234/ips" status: 200 len: 148 microversion: 2.1 time: 0.091348 Nov 02 21:39:21.262453 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1781/3705] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:39:21 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234/ips => generated 148 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:21.274902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9c25261-7ff5-4865-b58d-05b537d84c46"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:21.282355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:21.297666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:21.298160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:21.298599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:21.299298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:21.303734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:21.304428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:21.477438 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Invalid volume: volume f9c25261-7ff5-4865-b58d-05b537d84c46 is already attached to instances: 9478ec40-75b3-43e3-88b3-f8ff18b6c267 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234/os-volume_attachments HTTP/1.1 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 74 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: {"volumeAttachment": {"volumeId": "f9c25261-7ff5-4865-b58d-05b537d84c46"}} Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid volume: volume f9c25261-7ff5-4865-b58d-05b537d84c46 is already attached to instances: 9478ec40-75b3-43e3-88b3-f8ff18b6c267 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': '9b0b51d7-2245-416b-910a-3824bd7a2234', 'body': {'volumeAttachment': {'volumeId': 'f9c25261-7ff5-4865-b58d-05b537d84c46'}}} Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f9c25261-7ff5-4865-b58d-05b537d84c46 is already attached to instances: 9478ec40-75b3-43e3-88b3-f8ff18b6c267 Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:39:21.480341 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f9c25261-7ff5-4865-b58d-05b537d84c46 is already attached to instances: 9478ec40-75b3-43e3-88b3-f8ff18b6c267 Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f9c25261-7ff5-4865-b58d-05b537d84c46 is already attached to instances: 9478ec40-75b3-43e3-88b3-f8ff18b6c267 Nov 02 21:39:21.486035 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:21.490127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 400 to user: Invalid volume: volume f9c25261-7ff5-4865-b58d-05b537d84c46 is already attached to instances: 9478ec40-75b3-43e3-88b3-f8ff18b6c267 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:21.491237 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d7936229-2753-48ef-8429-f61d51e28660 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.221269 Nov 02 21:39:21.492377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1782/3706] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:39:21 2022] POST /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:39:21.502168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:21.502976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:21.512411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:21.513225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:21.513851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:21.514720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:21.515432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:21.516043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:21.562597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:39:22.000440 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d91ee080-814f-4605-b851-3126269af8fe tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 204 len: 0 microversion: 2.1 time: 0.502794 Nov 02 21:39:22.001454 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1783/3707] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:39:21 2022] DELETE /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:39:22.008181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:22.009059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:22.033369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:22.033874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:22.034814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:22.037525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:22.037525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:22.037525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:22.099932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:22.110700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:22.112151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:22.129067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c834d2a-b563-490f-887f-afbafd109886 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.311234 Nov 02 21:39:22.140964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1925/3708] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:20 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:39:22.153181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:22.153181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:22.175877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:22.176741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:22.176876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:22.177589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:22.178037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:22.178465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:23.227092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:23.349097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:23.362073 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-75ad6764-58b9-47df-a7a4-659a710c0da0 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 1.359027 Nov 02 21:39:23.365269 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1784/3709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:22 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:23.373798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-87e4f5bf-1cce-454a-93cc-9fcf2fee071f req-8a48abd9-c767-434e-aa56-92da89d21e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "045e9332-9988-4cf9-bff0-a3d66cbd93c5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:23.399001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-87e4f5bf-1cce-454a-93cc-9fcf2fee071f req-8a48abd9-c767-434e-aa56-92da89d21e3d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:23.409344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-87e4f5bf-1cce-454a-93cc-9fcf2fee071f req-8a48abd9-c767-434e-aa56-92da89d21e3d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:23.409979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-87e4f5bf-1cce-454a-93cc-9fcf2fee071f req-8a48abd9-c767-434e-aa56-92da89d21e3d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:23.481008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:23.570116 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5f7181f-b930-44f7-ba4d-9750a585ec4d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1680 microversion: 2.1 time: 1.434501 Nov 02 21:39:23.581732 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1926/3710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:22 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1680 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:23.585414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-87e4f5bf-1cce-454a-93cc-9fcf2fee071f req-8a48abd9-c767-434e-aa56-92da89d21e3d service nova] Creating event network-changed:045e9332-9988-4cf9-bff0-a3d66cbd93c5 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:39:23.600182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:23.600444 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-87e4f5bf-1cce-454a-93cc-9fcf2fee071f req-8a48abd9-c767-434e-aa56-92da89d21e3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233839 Nov 02 21:39:23.603867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1785/3711] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:23.604287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:23.640783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:23.642398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:23.646098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:23.646578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:23.647049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:23.647482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:24.376474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:24.393692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:24.395089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:24.413811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:24.419249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:24.420301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:24.423139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:24.423833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:24.425528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:24.696656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:24.726959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:24.729374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:24.734863 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1d10146-8434-4117-afc1-f38ee13ff17f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.148062 Nov 02 21:39:24.746854 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1927/3712] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:23 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:24.788274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:24.805003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:24.831552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:24.833320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:24.833320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:24.834089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:24.838047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:24.838745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:24.920451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:24.978647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:24.986813 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8381ffd-9abf-4240-8df8-f673d76bf260 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 0.598638 Nov 02 21:39:25.001772 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1786/3713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:24 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:25.791225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:25.793879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:25.804533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:25.805514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:25.806391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:25.807280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:25.807897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:25.808588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:26.571990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:26.601561 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-106d572b-7277-4968-a53e-a2cb89a884ec tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1680 microversion: 2.1 time: 1.853027 Nov 02 21:39:26.612159 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1928/3714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:24 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1680 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:26.641288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:26.647318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:26.673942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:26.680445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:26.682544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:26.684821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:26.692555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:26.692555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:26.764527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:26.780377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:26.793895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:26.795191 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55275f44-2e31-4ad5-ba2f-dbff121a689e tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.023301 Nov 02 21:39:26.802212 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1787/3715] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:25 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:26.845544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ecb9999b-1af2-49e7-b579-8538f89496f7 req-2ddc36bf-c84b-4d33-bb7b-a4ca72db7ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91dfa776-3955-470e-a284-e11b07dda568", "tag": "39ace072-dbe8-4f69-b44e-e26d14386789"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:26.862499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ecb9999b-1af2-49e7-b579-8538f89496f7 req-2ddc36bf-c84b-4d33-bb7b-a4ca72db7ced service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:26.862890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ecb9999b-1af2-49e7-b579-8538f89496f7 req-2ddc36bf-c84b-4d33-bb7b-a4ca72db7ced service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:26.863340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ecb9999b-1af2-49e7-b579-8538f89496f7 req-2ddc36bf-c84b-4d33-bb7b-a4ca72db7ced service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:26.879994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:26.916256 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ecb9999b-1af2-49e7-b579-8538f89496f7 req-2ddc36bf-c84b-4d33-bb7b-a4ca72db7ced service nova] Creating event network-changed:39ace072-dbe8-4f69-b44e-e26d14386789 for instance 91dfa776-3955-470e-a284-e11b07dda568 on n-h2-860863-4 Nov 02 21:39:26.936140 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ecb9999b-1af2-49e7-b579-8538f89496f7 req-2ddc36bf-c84b-4d33-bb7b-a4ca72db7ced service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124418 Nov 02 21:39:26.936753 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1788/3716] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:27.091555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-4162c589-c0eb-413a-8412-b36a7ab88688 req-daefdc19-e188-4a59-a96e-821b16abcb83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56a87762-1d21-4b74-8fa8-02260aaf7118", "tag": "eae8cb1c-5984-4d3d-a74b-dac6823506bf"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:27.122477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4162c589-c0eb-413a-8412-b36a7ab88688 req-daefdc19-e188-4a59-a96e-821b16abcb83 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:27.123530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4162c589-c0eb-413a-8412-b36a7ab88688 req-daefdc19-e188-4a59-a96e-821b16abcb83 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:27.125433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4162c589-c0eb-413a-8412-b36a7ab88688 req-daefdc19-e188-4a59-a96e-821b16abcb83 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:27.157852 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-4162c589-c0eb-413a-8412-b36a7ab88688 req-daefdc19-e188-4a59-a96e-821b16abcb83 service nova] Creating event network-changed:eae8cb1c-5984-4d3d-a74b-dac6823506bf for instance 56a87762-1d21-4b74-8fa8-02260aaf7118 on n-h1-860863-4 Nov 02 21:39:27.168417 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-4162c589-c0eb-413a-8412-b36a7ab88688 req-daefdc19-e188-4a59-a96e-821b16abcb83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085063 Nov 02 21:39:27.172297 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1789/3717] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:27.249117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:27.259320 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f7b07b8f-4cf9-431f-b232-6bb99deab3fb tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 0.645987 Nov 02 21:39:27.259916 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1929/3718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:26 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:27.693511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:27.844809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:27.846182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:27.849202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=46 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:27.861953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:27.862222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:27.865565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:27.866575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:27.871743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:27.872451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:27.873076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:27.875578 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-033a8883-62fb-420c-a101-3d224ecf1644 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1612 microversion: 2.1 time: 0.243430 Nov 02 21:39:27.889440 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1790/3719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:27 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1612 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:28.929852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:28.950552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:28.956033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:28.959826 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-445ccb81-dc58-4e03-bef8-ef35fc0bb839 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.119191 Nov 02 21:39:28.997514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1930/3720] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:27 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:29.013425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:29.014273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:29.021637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:29.022340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:29.022921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:29.023769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:29.024361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:29.024970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:29.068224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:29.069670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:29.088222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:29.091272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:29.091899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:29.097678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:29.098709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:29.099702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:29.707714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:29.740829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:29.750232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:29.756356 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-50448038-060a-4fc1-8063-7d7c819c00ad tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2948 microversion: 2.32 time: 1.549811 Nov 02 21:39:29.774669 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1791/3721] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:28 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2948 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:39:29.799550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:29.800174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:29.813213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:29.813712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:29.814182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:29.820161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:29.821167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:29.821626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:29.913193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:29.915809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:29.916507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:29.927501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lazy-loading 'fault' on Instance uuid 9b0b51d7-2245-416b-910a-3824bd7a2234 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:39:30.060225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:30.092423 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d768ecce-1870-4700-9cb9-a7cd299d41cd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 200 len: 1331 microversion: 2.1 time: 0.303204 Nov 02 21:39:30.103351 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1792/3722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:29 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 1331 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:30.124233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-61e3527d-fe24-4deb-892b-6f74b847cddd req-88761556-ae03-4a58-bc1e-ec01d21da530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "9f51a648-5f20-411a-a7b2-b20f02126167"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:30.148550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-61e3527d-fe24-4deb-892b-6f74b847cddd req-88761556-ae03-4a58-bc1e-ec01d21da530 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:30.150667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-61e3527d-fe24-4deb-892b-6f74b847cddd req-88761556-ae03-4a58-bc1e-ec01d21da530 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:30.151272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-61e3527d-fe24-4deb-892b-6f74b847cddd req-88761556-ae03-4a58-bc1e-ec01d21da530 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:30.188488 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-61e3527d-fe24-4deb-892b-6f74b847cddd req-88761556-ae03-4a58-bc1e-ec01d21da530 service nova] Creating event network-changed:9f51a648-5f20-411a-a7b2-b20f02126167 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:39:30.195751 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-61e3527d-fe24-4deb-892b-6f74b847cddd req-88761556-ae03-4a58-bc1e-ec01d21da530 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090626 Nov 02 21:39:30.197072 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1793/3723] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:30.204333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-75838ce8-1139-404d-86b6-d19de72beda9 req-08066120-211e-47b4-b45d-c71d750c4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0b51d7-2245-416b-910a-3824bd7a2234", "name": "network-vif-deleted", "tag": "57181828-67e9-4d95-8c9e-d817dfed69f4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:30.217949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-75838ce8-1139-404d-86b6-d19de72beda9 req-08066120-211e-47b4-b45d-c71d750c4f6b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:30.218625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-75838ce8-1139-404d-86b6-d19de72beda9 req-08066120-211e-47b4-b45d-c71d750c4f6b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:30.219396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-75838ce8-1139-404d-86b6-d19de72beda9 req-08066120-211e-47b4-b45d-c71d750c4f6b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:30.255608 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-75838ce8-1139-404d-86b6-d19de72beda9 req-08066120-211e-47b4-b45d-c71d750c4f6b service nova] Creating event network-vif-deleted:57181828-67e9-4d95-8c9e-d817dfed69f4 for instance 9b0b51d7-2245-416b-910a-3824bd7a2234 on n-h1-860863-4 Nov 02 21:39:30.266370 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-75838ce8-1139-404d-86b6-d19de72beda9 req-08066120-211e-47b4-b45d-c71d750c4f6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066739 Nov 02 21:39:30.268122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1794/3724] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:30.276506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:30.278359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:30.285723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:30.286464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:30.287481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:30.289512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:30.290162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:30.291424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:31.603035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:31.619199 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94478f46-b5b2-45e1-aafd-0ac1498c8657 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 2.616559 Nov 02 21:39:31.633788 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1931/3725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:28 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:31.655239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:31.663515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:31.663873 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-983a1253-b8c8-468a-8fcb-dcc1c5ca0537 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b/os-interface" status: 200 len: 1831 microversion: 2.32 time: 1.393990 Nov 02 21:39:31.670266 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1795/3726] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:39:30 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b/os-interface => generated 1831 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:31.679116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:31.679116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:31.685088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:31.685949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:31.686392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:31.687291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:31.687810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:31.688244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:31.700517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:31.702834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:31.702834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:31.705180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:31.709694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:31.710174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:31.749014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 HTTP/1.1 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9b0b51d7-2245-416b-910a-3824bd7a2234'} Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:31.763121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:31.766289 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d41deb3b-7c0d-4b07-be9d-feb26ca14bd1 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 404 len: 111 microversion: 2.1 time: 0.099222 Nov 02 21:39:31.772863 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1796/3727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:31 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:39:31.779006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5180e590-5911-46d2-b761-9fb6386e8f16 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '.version_select at 0x7f9b68762550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:31.974290 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5180e590-5911-46d2-b761-9fb6386e8f16 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072593288" status: 202 len: 0 microversion: 2.1 time: 0.200313 Nov 02 21:39:31.978225 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1797/3728] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:39:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1072593288 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:39:32.358647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2b4abbf9-f1f1-4da3-acc8-f32678bb3998 req-d47381d6-27ba-4c92-82d3-f4b15f5e1f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a59286-bb6c-4575-83d6-2318c544cfda", "tag": "d778515b-45d0-4b5f-830b-68e8cdd02079"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:32.421609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2b4abbf9-f1f1-4da3-acc8-f32678bb3998 req-d47381d6-27ba-4c92-82d3-f4b15f5e1f67 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:32.422522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2b4abbf9-f1f1-4da3-acc8-f32678bb3998 req-d47381d6-27ba-4c92-82d3-f4b15f5e1f67 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:32.425641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2b4abbf9-f1f1-4da3-acc8-f32678bb3998 req-d47381d6-27ba-4c92-82d3-f4b15f5e1f67 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:32.463786 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2b4abbf9-f1f1-4da3-acc8-f32678bb3998 req-d47381d6-27ba-4c92-82d3-f4b15f5e1f67 service nova] Creating event network-changed:d778515b-45d0-4b5f-830b-68e8cdd02079 for instance 46a59286-bb6c-4575-83d6-2318c544cfda on n-h2-860863-4 Nov 02 21:39:32.477007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2b4abbf9-f1f1-4da3-acc8-f32678bb3998 req-d47381d6-27ba-4c92-82d3-f4b15f5e1f67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148665 Nov 02 21:39:32.478431 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1798/3729] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:39:32.534288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:32.560134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:32.586835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:32.593075 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-296b6624-9256-433d-a8d0-1c16ba61b3cb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.957015 Nov 02 21:39:32.596039 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1932/3730] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:31 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:32.669122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:32.670553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:32.706720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:32.706720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:32.706720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:32.706720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:32.706720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:32.706720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:33.143924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:33.158535 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a86687b2-7531-428d-98c8-047008391ca7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 0.497775 Nov 02 21:39:33.165972 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1799/3731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:32 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:33.518130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3c558066-97e8-4d42-bd86-ccc8ea8a251c req-51552598-8c24-411c-bcfb-0b0460beadf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91dfa776-3955-470e-a284-e11b07dda568", "name": "network-vif-plugged", "status": "completed", "tag": "39ace072-dbe8-4f69-b44e-e26d14386789"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:33.550942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3c558066-97e8-4d42-bd86-ccc8ea8a251c req-51552598-8c24-411c-bcfb-0b0460beadf2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:33.558814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3c558066-97e8-4d42-bd86-ccc8ea8a251c req-51552598-8c24-411c-bcfb-0b0460beadf2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:33.559321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3c558066-97e8-4d42-bd86-ccc8ea8a251c req-51552598-8c24-411c-bcfb-0b0460beadf2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:33.596261 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3c558066-97e8-4d42-bd86-ccc8ea8a251c req-51552598-8c24-411c-bcfb-0b0460beadf2 service nova] Creating event network-vif-plugged:39ace072-dbe8-4f69-b44e-e26d14386789 for instance 91dfa776-3955-470e-a284-e11b07dda568 on n-h2-860863-4 Nov 02 21:39:33.602967 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3c558066-97e8-4d42-bd86-ccc8ea8a251c req-51552598-8c24-411c-bcfb-0b0460beadf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088111 Nov 02 21:39:33.605404 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1933/3732] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:33.652867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:33.653537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:33.681979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:33.686307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:33.688552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:33.693364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:33.696410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:33.697963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:34.021362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:34.038728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:34.040481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:34.041855 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-25a0b2ff-6472-4f3e-91fc-2d375c2adcb2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.405152 Nov 02 21:39:34.044282 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1800/3733] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:33 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:34.185678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:34.187461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:34.206794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:34.210455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:34.210455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:34.216237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:34.216774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:34.227755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:34.708863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:34.709999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:34.733438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:34.738001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:34.739020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:34.740888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:34.746154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:34.746940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:34.946026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lazy-loading 'services' on Instance uuid 9478ec40-75b3-43e3-88b3-f8ff18b6c267 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:39:34.968075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:35.002050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-694c0a32-c947-4ecc-bb01-5bd449988077 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 0.820576 Nov 02 21:39:35.053539 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1934/3734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:34 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:35.072617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:35.078335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:35.096294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:35.100171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:35.100171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:35.100171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:35.100171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:35.103388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:35.257831 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3baab05d-0d65-43e5-94d0-ec5e755bd4c4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments/f9c25261-7ff5-4865-b58d-05b537d84c46" status: 202 len: 0 microversion: 2.1 time: 0.548291 Nov 02 21:39:35.257831 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1801/3735] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:39:34 2022] DELETE /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments/f9c25261-7ff5-4865-b58d-05b537d84c46 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:39:35.270420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:35.275160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:35.286856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:35.289597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:35.289597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:35.289766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:35.290535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:35.291302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:35.393620 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3ff1e56-2850-4e52-a862-f06471a4ed9c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133229 Nov 02 21:39:35.395349 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1802/3736] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:35 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:35.801876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:35.808461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:35.824248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:35.826403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:35.828995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:35.830035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:35.831518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:35.833133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:35.903853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:35.933758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:35.937878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:35.939640 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fe4a8ce-c55d-4abc-9fc7-2050932f1d9a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.872427 Nov 02 21:39:35.945647 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1935/3737] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:35 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:36.053007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:36.054268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:36.062175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:36.062971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:36.063775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:36.065182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:36.065953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:36.066583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:36.399485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:36.413863 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dce2ea76-7c50-47f3-8460-9b8a0d24c317 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.616751 Nov 02 21:39:36.415185 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1803/3738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:35 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:36.423641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:36.427334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:36.434977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:36.435752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:36.436701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:36.437678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:36.438350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:36.439006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:36.476712 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f09b878-60ee-4dc7-8edf-d7820a95fe3c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060002 Nov 02 21:39:36.478774 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1804/3739] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:36 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:36.483979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:36.491599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:36.492817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:36.494611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:36.496110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:36.497143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:36.498104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:36.498787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:36.499669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:37.044125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:37.054549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d887d6f8-ad77-4241-8145-9a81e3ffc056 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.574449 Nov 02 21:39:37.058684 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1805/3740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:36 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:37.068434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:37.068434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:37.078055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:37.085810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:37.090809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:37.091784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:37.092454 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-66118ed3-9a17-447c-827f-bf23c9a9c004 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 1.043733 Nov 02 21:39:37.092845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:37.093603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:37.093950 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1936/3741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:36 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:39:37.095812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:37.105060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:37.107304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:37.115494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:37.116297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:37.123245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:37.125015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:37.126370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:37.129303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:37.769717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:37.794261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:37.796009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:37.797497 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1f6c98a0-45f3-4f4e-9715-7d2c4e19b181 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.737262 Nov 02 21:39:37.808962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1806/3742] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:37 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:37.811289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a7f73e7a-7a20-4080-abb1-44600c2e6c51 req-4504f556-f764-4491-9c65-80c338e316b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a87762-1d21-4b74-8fa8-02260aaf7118", "name": "network-vif-plugged", "status": "completed", "tag": "eae8cb1c-5984-4d3d-a74b-dac6823506bf"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:37.829607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a7f73e7a-7a20-4080-abb1-44600c2e6c51 req-4504f556-f764-4491-9c65-80c338e316b2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:37.830084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a7f73e7a-7a20-4080-abb1-44600c2e6c51 req-4504f556-f764-4491-9c65-80c338e316b2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:37.841882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a7f73e7a-7a20-4080-abb1-44600c2e6c51 req-4504f556-f764-4491-9c65-80c338e316b2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:37.866505 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a7f73e7a-7a20-4080-abb1-44600c2e6c51 req-4504f556-f764-4491-9c65-80c338e316b2 service nova] Creating event network-vif-plugged:eae8cb1c-5984-4d3d-a74b-dac6823506bf for instance 56a87762-1d21-4b74-8fa8-02260aaf7118 on n-h1-860863-4 Nov 02 21:39:37.876898 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a7f73e7a-7a20-4080-abb1-44600c2e6c51 req-4504f556-f764-4491-9c65-80c338e316b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075304 Nov 02 21:39:37.877926 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1807/3743] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:37.907158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:37.928020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:37.943725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:37.945077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:37.945809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:37.946837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:37.948136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:37.949249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:38.001750 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7900419-5e0b-41b7-bc86-7e3deefb869e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122477 Nov 02 21:39:38.002612 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1808/3744] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:37 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:38.121506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:38.123293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:38.139229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:38.140678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:38.141697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:38.147802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:38.150831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:38.152221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:38.667139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:38.676412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7493e97e-4d9d-4a7e-8ae1-21aeaa82a38e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.581071 Nov 02 21:39:38.683449 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1937/3745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:37 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:38.709297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:38.710129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:38.722937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:38.723658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:38.724339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:38.725247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:38.726000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:38.726568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:39.228782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:39.240589 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd8aba34-7550-4cad-acbb-21d2276bc2ce tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.535329 Nov 02 21:39:39.246707 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1938/3746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:38 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:39:39.255214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:39.256580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:39.263149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:39.265830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:39.278482 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-105e47cf-e5b1-49ed-a9b9-198087614619 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 1.161519 Nov 02 21:39:39.287466 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1809/3747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:38 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:39.294563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:39.300143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:39.300143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:39.300143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:39.300519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:39.301280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:39.305008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:39.315386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:39.334495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:39.340240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:39.340971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:39.341742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:39.344055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:39.344795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:39.447727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91e14205-2aee-47be-9a02-b1a767fb55b2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158850 Nov 02 21:39:39.456058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1810/3748] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:39 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:39.480636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1166967596", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "abf3b988-f5ac-44d9-9b37-c74857f22c78"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:39.592234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] validate_networks() for [('abf3b988-f5ac-44d9-9b37-c74857f22c78', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:39:39.901582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:39.921615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:39.923555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:39.927874 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d5db7c2-71b5-4563-9061-f66f51a9914a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.682632 Nov 02 21:39:39.929242 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1939/3749] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:39 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:40.213050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9d033199-8fd9-464f-ba46-ca8129c7ff89 req-ee7ff7e0-bfc3-46f9-819c-c9f905c9226e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a59286-bb6c-4575-83d6-2318c544cfda", "name": "network-vif-plugged", "status": "completed", "tag": "d778515b-45d0-4b5f-830b-68e8cdd02079"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:40.239473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9d033199-8fd9-464f-ba46-ca8129c7ff89 req-ee7ff7e0-bfc3-46f9-819c-c9f905c9226e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:40.240215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9d033199-8fd9-464f-ba46-ca8129c7ff89 req-ee7ff7e0-bfc3-46f9-819c-c9f905c9226e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:40.240853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9d033199-8fd9-464f-ba46-ca8129c7ff89 req-ee7ff7e0-bfc3-46f9-819c-c9f905c9226e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:40.268197 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9d033199-8fd9-464f-ba46-ca8129c7ff89 req-ee7ff7e0-bfc3-46f9-819c-c9f905c9226e service nova] Creating event network-vif-plugged:d778515b-45d0-4b5f-830b-68e8cdd02079 for instance 46a59286-bb6c-4575-83d6-2318c544cfda on n-h2-860863-4 Nov 02 21:39:40.281860 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9d033199-8fd9-464f-ba46-ca8129c7ff89 req-ee7ff7e0-bfc3-46f9-819c-c9f905c9226e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072259 Nov 02 21:39:40.289209 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1940/3750] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:39:40.314731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:40.318273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:40.332414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:40.333289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:40.333928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:40.334816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:40.335451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:40.337518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:41.185145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:41.201497 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d08fb4e-affd-4391-990a-0df9fdea702b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 0.890775 Nov 02 21:39:41.221865 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1941/3751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:40 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:41.227561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:41.231043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:41.238815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:41.239596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:41.240438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:41.241391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:41.242202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:41.242892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:41.285295 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-334585ac-8e1c-4341-9a97-b3389590eb7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061869 Nov 02 21:39:41.287461 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1942/3752] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:41 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:41.293330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:41.294208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:41.300978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:41.301797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:41.302470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:41.303395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:41.304063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:41.304690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:42.082025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:39:42.082975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:39:42.083616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:39:42.084182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:39:42.084759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:39:42.113672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:42.120903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:42.121764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:42.122787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:42.125425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:42.126103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:42.161367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:39:42.168412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for user 368ab16b50f84f0d9cf6e79e039dc257 and project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:39:42.190103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:39:42.193009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:39:42.208004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:42.236953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:42.241872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:42.248947 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f463e3ff-6eb7-4ea6-9bc6-aa560efcb148 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.956516 Nov 02 21:39:42.252778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1943/3753] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:41 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:42.261206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:42.262112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:42.277627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:42.277627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:42.277627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:42.277627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:42.277627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:42.277627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:42.425675 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab808f5d-3c06-43ff-aedf-a2650db28010 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.949627 Nov 02 21:39:42.434661 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1811/3754] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:39:42.446629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:42.456744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:42.476840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:42.488073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:42.496465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:42.497695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:42.499018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:42.500714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:42.578765 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a36ee1a8-7c5a-4703-b080-abed50608cb7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142810 Nov 02 21:39:42.582338 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1812/3755] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:42 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:42.593671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d3857174-cb55-4daa-b094-d5d4d161873b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:42.594521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d3857174-cb55-4daa-b094-d5d4d161873b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:42.773126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d3857174-cb55-4daa-b094-d5d4d161873b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:42.786499 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d3857174-cb55-4daa-b094-d5d4d161873b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1215 microversion: 2.1 time: 0.202781 Nov 02 21:39:42.789381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1813/3756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:42 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:42.915126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:42.923277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4ef1324-25e1-4022-96a6-c0e5805816f4 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1323 microversion: 2.1 time: 0.669153 Nov 02 21:39:42.943547 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1944/3757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:42 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:43.285491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:43.286934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:43.302615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:43.306189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:43.306334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:43.307078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:43.307551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:43.309895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:43.592501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:43.595384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:43.599052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:43.609836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:43.613924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:43.617582 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1bde9278-66b3-469b-b712-0a199570f0f7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.336444 Nov 02 21:39:43.619619 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1814/3758] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:43 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:43.629548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:43.630074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:43.633697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:43.634471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:43.634938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:43.635373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:43.702912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aad674cf-a190-454e-bd5a-f6ea77f6ba2d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111482 Nov 02 21:39:43.703414 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1945/3759] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:43 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:39:43.812540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6460e25e-73b5-461f-994a-8c62ad0ee75c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:43.813197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6460e25e-73b5-461f-994a-8c62ad0ee75c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:43.952679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:43.957159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:43.971740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:43.977387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:43.977387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:43.977387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:43.977387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:43.977387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:44.002288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:44.008651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6460e25e-73b5-461f-994a-8c62ad0ee75c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:44.032277 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6460e25e-73b5-461f-994a-8c62ad0ee75c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1215 microversion: 2.1 time: 0.223218 Nov 02 21:39:44.033614 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1815/3760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:43 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:39:44.263737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:44.283244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0b15df0-c0f5-4eab-9d97-f672e973c373 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 200 len: 1516 microversion: 2.1 time: 0.332775 Nov 02 21:39:44.285327 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1946/3761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:43 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 1516 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:44.310823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:44.317825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:44.337263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:44.350606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:44.352170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:44.357987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:44.357987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:44.360980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:44.657076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:44.661588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:44.679119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:44.680026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:44.682223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:44.686281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:44.687021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:44.688090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.171869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:45.180219 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c6b7a3f-e47c-4654-b1ee-da8c0daae9f1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118" status: 200 len: 1516 microversion: 2.1 time: 0.876770 Nov 02 21:39:45.185520 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1816/3762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:44 2022] GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 => generated 1516 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:45.190784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:45.197917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:45.219005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.219853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.220546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.221481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.222111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.222690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.315973 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7f8d02fe-0acc-4808-9311-bea0825cf9c7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129045 Nov 02 21:39:45.320953 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1817/3763] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:45 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:45.327844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:45.328479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:45.331021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:45.344386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:45.346062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:45.349845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffe5f06b-a10d-45c5-ae9c-e9b1900a5a32 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.702010 Nov 02 21:39:45.361744 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1947/3764] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:44 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:45.366824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:45.373169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:45.377777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.381962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.381962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.382985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.384443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.387672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.390058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.390559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.391738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.392389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.392871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.393337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.600237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:45.608850 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-40714fa9-0e7a-4519-82e9-31b604afb0da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1267 microversion: 2.1 time: 0.288403 Nov 02 21:39:45.609498 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1818/3765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:45 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:45.663968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:45.679074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d7bac97-e364-46ef-8103-bfdcf3fc6737 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 200 len: 1516 microversion: 2.1 time: 0.315845 Nov 02 21:39:45.685264 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1948/3766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:45 2022] GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:45.704618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:45.706498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:45.712143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.712826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.714243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.715130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:45.715732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:45.716304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:45.777793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:39:46.188261 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c8cdd81-94b3-4191-b035-75f50c411ef9 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "DELETE /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 204 len: 0 microversion: 2.1 time: 0.489611 Nov 02 21:39:46.188867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1819/3767] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:39:45 2022] DELETE /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:39:46.198550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:46.200876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:46.213023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:46.216676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:46.217423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:46.218392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:46.219054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:46.219787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:46.332279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:46.338491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:46.364972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:46.365479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:46.371626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:46.373954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:46.377406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:46.378751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:46.481227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-371ec3d3-d582-46d8-b8be-e147cc05fba0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155575 Nov 02 21:39:46.485921 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1820/3768] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:39:46 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:39:46.513672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:46.514864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:46.522224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:46.523578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:46.524265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:46.525221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:46.526947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:46.527609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:47.278897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:47.289536 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba7d2755-cc9f-4185-8a9c-ec41e923651e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 200 len: 1522 microversion: 2.1 time: 1.096355 Nov 02 21:39:47.290153 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1949/3769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:46 2022] GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 1522 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:39:47.295522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:47.296013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:47.312716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:47.314603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:47.318083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:47.318616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:47.319094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:47.319529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:47.356349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:39:47.370682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:47.382698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:47.384508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:47.387170 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d9c1fe1c-98b2-4181-ae47-81a0fa501f7b tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.899737 Nov 02 21:39:47.388042 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1821/3770] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:46 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:47.413937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:47.414766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:47.423037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:47.423685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:47.424234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:47.425264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:47.425945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:47.426473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:47.513564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:47.522812 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad47daa0-6e95-4a97-a3b5-73be3e53bcac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1273 microversion: 2.1 time: 0.119883 Nov 02 21:39:47.525783 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1822/3771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:47 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:47.675592 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a1d6625-543e-4a6f-a8db-c0e96181e959 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 204 len: 0 microversion: 2.1 time: 0.382880 Nov 02 21:39:47.679909 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1950/3772] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:39:47 2022] DELETE /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:39:47.685218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:47.685841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:47.692511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:47.692864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:47.693336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:47.694017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:47.694676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:47.695111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:47.882532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:47.893461 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5cae21ba-7b71-4049-bff0-33b8c0afb724 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1681 microversion: 2.1 time: 0.212420 Nov 02 21:39:47.895800 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1823/3773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:47 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:48.314813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:48.315669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:48.325873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:48.326851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:48.327389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:48.328190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:48.328851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:48.329649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:48.420834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:48.422890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:48.435099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:48.436120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:48.437381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:48.438531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:48.439615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:48.440472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:48.591061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:48.606698 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-443ec37c-4f5d-4db2-b2a9-0e9038cede47 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 200 len: 1522 microversion: 2.1 time: 0.296425 Nov 02 21:39:48.625403 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1951/3774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:48 2022] GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:48.634581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:48.636478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:48.643933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:48.644660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:48.645355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:48.646677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:48.647278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:48.647852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:49.087612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:49.104131 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72d1b99e-d46f-4159-bc3b-a379ca2bff68 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.477252 Nov 02 21:39:49.116854 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1952/3775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:48 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:49.132208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:49.133470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:49.151874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:49.152891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:49.153673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:49.154664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:49.157621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:49.158556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:49.227494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:49.253625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:49.255423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:49.256893 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44fc7ff9-572d-4bd5-bc00-587fd03a4e8d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.841963 Nov 02 21:39:49.257641 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1824/3776] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:48 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:49.525346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:49.535237 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-203da406-91ed-47e0-b5fb-89910fc43847 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1681 microversion: 2.1 time: 0.416683 Nov 02 21:39:49.539382 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1953/3777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:49 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1681 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:49.647978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:49.647978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:49.654756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:49.659491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:49.660272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:49.661640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:49.662344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:49.662873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:50.139905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:50.140585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:50.154753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:50.158476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:50.159055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:50.169534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:50.176248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:50.176248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:50.176248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:50.183815 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f90e6193-da56-4ee4-b691-f7386b65b216 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 200 len: 1522 microversion: 2.1 time: 0.549315 Nov 02 21:39:50.186908 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1825/3778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:49 2022] GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:50.294493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:50.305139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:50.330311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:50.335413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:50.337995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:50.339195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:50.351475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:50.351475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:50.474844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:50.487652 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53b4c76c-03ad-419a-93cb-c44f491f7b34 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.350702 Nov 02 21:39:50.489682 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1954/3779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:50 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:39:50.565521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:50.567068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:50.575151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:50.577761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:50.580247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:50.581258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:50.584037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:50.584667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:51.156636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:51.176578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:51.180126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:51.187150 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f5694ebd-bdcf-4d9c-b3d4-3c24a8072889 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.901715 Nov 02 21:39:51.188247 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1826/3780] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:50 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:51.201036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d2a813d2-c7be-4bda-b13d-319d64d16e03 req-172243d3-0c29-497b-bacc-1aea1f802a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91dfa776-3955-470e-a284-e11b07dda568", "name": "network-vif-deleted", "tag": "39ace072-dbe8-4f69-b44e-e26d14386789"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:51.219911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d2a813d2-c7be-4bda-b13d-319d64d16e03 req-172243d3-0c29-497b-bacc-1aea1f802a63 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:51.220738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d2a813d2-c7be-4bda-b13d-319d64d16e03 req-172243d3-0c29-497b-bacc-1aea1f802a63 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:51.221344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d2a813d2-c7be-4bda-b13d-319d64d16e03 req-172243d3-0c29-497b-bacc-1aea1f802a63 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:51.247531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d2a813d2-c7be-4bda-b13d-319d64d16e03 req-172243d3-0c29-497b-bacc-1aea1f802a63 service nova] Creating event network-vif-deleted:39ace072-dbe8-4f69-b44e-e26d14386789 for instance 91dfa776-3955-470e-a284-e11b07dda568 on n-h2-860863-4 Nov 02 21:39:51.264007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d2a813d2-c7be-4bda-b13d-319d64d16e03 req-172243d3-0c29-497b-bacc-1aea1f802a63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074289 Nov 02 21:39:51.264862 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1827/3781] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:51.275739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:51.278450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:51.292235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:51.293970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:51.300176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:51.301365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:51.302026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:51.302652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:51.335946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:51.348478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab649e98-0bad-40a9-84f7-961c351c3c65 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1681 microversion: 2.1 time: 0.787087 Nov 02 21:39:51.349805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:51.350906 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1955/3782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:50 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1681 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:51.402329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:51.414797 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-58ec09b7-78d9-4cf7-a944-b4dc41cce815 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 200 len: 1308 microversion: 2.1 time: 0.147380 Nov 02 21:39:51.415488 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1828/3783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:51 2022] GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 1308 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:51.525911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:51.526881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:51.534659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:51.535378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:51.536024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:51.536918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:51.539401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:51.539844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:51.921953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:51.931566 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b022d59d-a9c2-4e84-9f3a-25b36e7f3e12 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.417871 Nov 02 21:39:51.933464 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1956/3784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:51 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:52.164852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f0b7875a-37f7-4ea9-81a0-0e9048df4f71 req-927699f6-4eed-45ca-92d6-8b488cc1813c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9478ec40-75b3-43e3-88b3-f8ff18b6c267", "name": "network-vif-deleted", "tag": "4faf4586-71a6-4fa1-89a2-85f11d5b72fd"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:52.171363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:52.195529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f0b7875a-37f7-4ea9-81a0-0e9048df4f71 req-927699f6-4eed-45ca-92d6-8b488cc1813c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.201378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f0b7875a-37f7-4ea9-81a0-0e9048df4f71 req-927699f6-4eed-45ca-92d6-8b488cc1813c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.216012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f0b7875a-37f7-4ea9-81a0-0e9048df4f71 req-927699f6-4eed-45ca-92d6-8b488cc1813c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.219670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:52.221012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:52.258379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.260471 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f0b7875a-37f7-4ea9-81a0-0e9048df4f71 req-927699f6-4eed-45ca-92d6-8b488cc1813c service nova] Creating event network-vif-deleted:4faf4586-71a6-4fa1-89a2-85f11d5b72fd for instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 on n-h2-860863-4 Nov 02 21:39:52.261688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.267548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.267548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.271723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.272362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.277020 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f0b7875a-37f7-4ea9-81a0-0e9048df4f71 req-927699f6-4eed-45ca-92d6-8b488cc1813c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119723 Nov 02 21:39:52.297931 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1829/3785] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:52.384158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:52.386662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:52.415665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.418197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.418197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.419187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.419740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.420243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.713977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:52.737419 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2106f7c-1f34-4f08-b445-efef3896067f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 200 len: 1326 microversion: 2.1 time: 0.361392 Nov 02 21:39:52.742082 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1830/3786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:52 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 1326 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:39:52.751961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:52.754506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:52.771745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.772495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.773179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.775754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.779234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.779992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.812576 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] HTTP exception thrown: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 HTTP/1.1 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '91dfa776-3955-470e-a284-e11b07dda568'} Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:52.814481 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:52.818391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:52.819517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 404 to user: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:52.829149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b7ba90c0-d793-4198-89b6-d7322068451e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 404 len: 111 microversion: 2.1 time: 0.078550 Nov 02 21:39:52.834473 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1831/3787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:52 2022] GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:39:52.851099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:52.872685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:52.873665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:52.891550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.892048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.892489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.893246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:52.893716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:52.894124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:52.909088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:52.939795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:52.951107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:52.957354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3cf7aad8-633a-4e64-8231-d16b880c3404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.742006 Nov 02 21:39:52.957825 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1957/3788] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:52 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:52.982028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:52.990661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:53.017565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.028151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.028713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.034901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.045595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.047287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.302211 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-373d01fe-bf69-4621-bd05-aff83c9b22af tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.465356 Nov 02 21:39:53.308007 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1832/3789] 10.222.0.25 () {58 vars in 1230 bytes} [Wed Nov 2 21:39:52 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:39:53.329998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a76837d4-a8c5-4e09-88d9-9224429207f6 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a76837d4-a8c5-4e09-88d9-9224429207f6 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: action_args: {} Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi '2011/01/01' Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 21:39:53.368880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 21:39:53.372967 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.376632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a76837d4-a8c5-4e09-88d9-9224429207f6 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:53.376632 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a76837d4-a8c5-4e09-88d9-9224429207f6 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.058426 Nov 02 21:39:53.377775 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1833/3790] 10.222.0.25 () {58 vars in 1182 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:39:53.387835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.402444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:53.404470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:53.419446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.423983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.427290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.428418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.433631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.433631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.476140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:53.490476 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca72c4ed-afc9-4496-af6f-ef66ad5b583f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.531533 Nov 02 21:39:53.497890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:39:53.504108 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1958/3791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:52 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:53.575323 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63aafbd6-2ddc-44ab-9902-387eee8cd740 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.192391 Nov 02 21:39:53.584767 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1834/3792] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers => generated 683 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:39:53.588156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.594110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:53.594807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.servers [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Removing options 'limit' from query {{(pid=121040) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 21:39:53.595776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:53.601985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.602715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.603345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.610087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.611242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.612068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.663142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:39:53.742682 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f76ab3c4-414f-4b4d-8927-ebfdbe5d91a7 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.157355 Nov 02 21:39:53.750553 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1959/3793] 10.222.0.25 () {58 vars in 1144 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:53.765239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d3812a83-46d3-4cbd-b2c9-1d5dfe9ce348 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.768496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.769228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d3812a83-46d3-4cbd-b2c9-1d5dfe9ce348 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: action_args: {} Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi '-1' Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 21:39:53.771280 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d3812a83-46d3-4cbd-b2c9-1d5dfe9ce348 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d3812a83-46d3-4cbd-b2c9-1d5dfe9ce348 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.013764 Nov 02 21:39:53.775133 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1835/3794] 10.222.0.25 () {58 vars in 1142 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:39:53.791040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.793607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.795633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.796587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad4c282e-148f-4632-acc3-78df1bd44743 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.796701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.797958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.800746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad4c282e-148f-4632-acc3-78df1bd44743 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: action_args: {} Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'testing' Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 21:39:53.825837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad4c282e-148f-4632-acc3-78df1bd44743 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:53.829362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad4c282e-148f-4632-acc3-78df1bd44743 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.035528 Nov 02 21:39:53.835886 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1836/3795] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:39:53.845172 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:39:53.845846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7ba13d78-66e7-42e7-9f35-f61376a87734 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 HTTP/1.1 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9478ec40-75b3-43e3-88b3-f8ff18b6c267'} Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:53.846496 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:53.849978 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5e4a9c2-95d5-4a17-a7c8-c73f6c659a79 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 404 len: 111 microversion: 2.1 time: 0.084407 Nov 02 21:39:53.856636 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1960/3796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:39:53.861530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7ba13d78-66e7-42e7-9f35-f61376a87734 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:53.863619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ba13d78-66e7-42e7-9f35-f61376a87734 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:53.873868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-878e4cfb-65d6-4fbe-ae8a-1f4c90db06f8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '.version_select at 0x7f9b681f14c0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.876304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.servers [None req-7ba13d78-66e7-42e7-9f35-f61376a87734 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Flavor 'non_existing_flavor' could not be found {{(pid=121039) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Nov 02 21:39:53.878125 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7ba13d78-66e7-42e7-9f35-f61376a87734 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039759 Nov 02 21:39:53.879208 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1837/3797] 10.222.0.25 () {58 vars in 1178 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:39:53.894314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:53.907607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:53.907607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:53.918808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.919168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.919616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.920358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:53.920815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:53.921280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:53.955022 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-878e4cfb-65d6-4fbe-ae8a-1f4c90db06f8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-162619605" status: 202 len: 0 microversion: 2.1 time: 0.095185 Nov 02 21:39:53.959770 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1961/3798] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:39:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-162619605 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:39:53.965209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1da04cc3-33cf-4500-937a-7bc21da95252 req-c453fc95-cada-4c92-ad3b-8804c31725e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e539db0-3690-47f4-b809-025a95d727a9", "tag": "852366f9-eed2-4587-b777-e3c0c519a785"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:54.012151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1da04cc3-33cf-4500-937a-7bc21da95252 req-c453fc95-cada-4c92-ad3b-8804c31725e5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.016503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1da04cc3-33cf-4500-937a-7bc21da95252 req-c453fc95-cada-4c92-ad3b-8804c31725e5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.022167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1da04cc3-33cf-4500-937a-7bc21da95252 req-c453fc95-cada-4c92-ad3b-8804c31725e5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.056446 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1da04cc3-33cf-4500-937a-7bc21da95252 req-c453fc95-cada-4c92-ad3b-8804c31725e5 service nova] Creating event network-changed:852366f9-eed2-4587-b777-e3c0c519a785 for instance 7e539db0-3690-47f4-b809-025a95d727a9 on n-h1-860863-4 Nov 02 21:39:54.060038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:54.074184 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de7c981c-8262-4939-815a-dac758cb623b tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.181993 Nov 02 21:39:54.075214 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1838/3799] 10.222.0.25 () {58 vars in 1174 bytes} [Wed Nov 2 21:39:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 21:39:54.078424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1da04cc3-33cf-4500-937a-7bc21da95252 req-c453fc95-cada-4c92-ad3b-8804c31725e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117593 Nov 02 21:39:54.083462 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1962/3800] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:54.087779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:54.088482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:54.097583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:54.101302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.105428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.106150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.106960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.109927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.110469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.122255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:54.134558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:54.153934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.162028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.165386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.168407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.170310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.172497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.451347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ea0d06c-a566-4b3b-9be9-c95b9c61f2dc tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.363076 Nov 02 21:39:54.457853 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1963/3801] 10.222.0.25 () {58 vars in 1184 bytes} [Wed Nov 2 21:39:54 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:39:54.470552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:54.486645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:54.491670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:54.513353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.514610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.515429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.516539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.517230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.517925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.549672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:54.577383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:39:54.613364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:54.638263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:54.648627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:54.652699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:54.653948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05d03116-b0bd-4ebd-a268-3f533368d1c0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.574744 Nov 02 21:39:54.654520 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1839/3802] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:54 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:54.656588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.657091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.658434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.680893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:54.681654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:54.692787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.693323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.693768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.694476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:54.694932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:54.695362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:54.981348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:54.989347 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54a856fc-83ec-4cd9-ab04-d391e653340f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.331483 Nov 02 21:39:55.004562 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1840/3803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:54 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:55.004921 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ada8bd28-e968-4642-8860-e90e3dfc8056 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.536243 Nov 02 21:39:55.012399 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1964/3804] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:39:54 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:39:55.026086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3be218fb-d070-4122-975d-df822c05f122 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:55.032081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3be218fb-d070-4122-975d-df822c05f122 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:55.032633 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3be218fb-d070-4122-975d-df822c05f122 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010456 Nov 02 21:39:55.045887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:55.050702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:55.051369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Searching by: {'deleted': False, 'project_id': 'e8837c38b318491182101a3e6e9d9851'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:39:55.053942 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1841/3805] 10.222.0.25 () {58 vars in 1178 bytes} [Wed Nov 2 21:39:55 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:39:55.057225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.058221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.058659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:55.059383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.059836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.060259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:55.111447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:39:55.164813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d0b02c1c-2d11-4bb5-a707-d595a46f4730 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.122917 Nov 02 21:39:55.165674 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1965/3806] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:39:55 2022] GET /compute/v2.1/servers => generated 683 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:55.184302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:55.189354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:55.216035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.216529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.219154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:55.222937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.223611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.224202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] HTTP exception thrown: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 HTTP/1.1 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '91dfa776-3955-470e-a284-e11b07dda568'} Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:39:55.261298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:55.264326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:39:55.267959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 404 to user: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:55.269536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d123daf-c596-42fd-9d96-cfe560d00ac2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "DELETE /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 404 len: 111 microversion: 2.1 time: 0.093158 Nov 02 21:39:55.280891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:55.287759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:55.287887 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1842/3807] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:39:55 2022] DELETE /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:39:55.295036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.295816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.297671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:55.300815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.308145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.315540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:55.355565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:39:55.682231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:55.684163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:55.693170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.709739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.710437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:55.711373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:55.712214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:55.712793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.012997 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8243942c-c253-4bb0-97d1-9be56d883ba1 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "DELETE /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118" status: 204 len: 0 microversion: 2.1 time: 0.735032 Nov 02 21:39:56.015532 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1966/3808] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:39:55 2022] DELETE /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:39:56.020900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b995987-6231-450d-839b-b8c568ff02b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: .version_select at 0x7f9b681f10d0>, body: {"keypair": {"name": "tempest-keypair-1364944310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONVCZMCDV9miPvX+Bi3EnenTY7cKZAotCPpzaubbK8MOE+HtUPsbGlBNup8+f+9qEr9dL+1DvdbkdcHiW8CcRRKI5gK1V2szER5RLEe3S2RYinsq8TRUEAZBlEmdBG+sQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:39:56.049276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7b995987-6231-450d-839b-b8c568ff02b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:39:56.058328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7b995987-6231-450d-839b-b8c568ff02b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:39:56.101910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:56.167324 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b995987-6231-450d-839b-b8c568ff02b5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149873 Nov 02 21:39:56.183436 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1967/3809] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:39:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:39:56.183436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:56.194225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:56.209632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.211629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.214882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.215761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.216308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.216815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.220653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:56.235082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:56.238780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:56.242650 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-32813d8d-ce8b-4e56-9807-7691824412f2 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.564376 Nov 02 21:39:56.254116 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1843/3810] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:55 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:39:56.269074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:56.269936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:56.288953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.295838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.296604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.299303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.306185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.306926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.376943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:39:56.652087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:56.665137 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad3c4826-81c3-4986-84be-82399b22d90a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.484480 Nov 02 21:39:56.685311 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1968/3811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:56 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:56.729125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:39:56.806332 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c644923-3f1f-4c5b-84c2-03c915f4c4c2 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 204 len: 0 microversion: 2.1 time: 0.550727 Nov 02 21:39:56.807337 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1844/3812] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:39:56 2022] DELETE /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:39:56.820142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:56.820905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 91dfa776-3955-470e-a284-e11b07dda568] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:56.862322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.869479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.876730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.878956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.883613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.884536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.945692 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] HTTP exception thrown: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 HTTP/1.1 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '91dfa776-3955-470e-a284-e11b07dda568'} Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:56.947621 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:39:56.952057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 404 to user: Instance 91dfa776-3955-470e-a284-e11b07dda568 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:39:56.959740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-061103b1-b8fe-4bfd-847f-46af77f7abc5 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568" status: 404 len: 111 microversion: 2.1 time: 0.136866 Nov 02 21:39:56.959740 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1969/3813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:56 2022] GET /compute/v2.1/servers/91dfa776-3955-470e-a284-e11b07dda568 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:39:56.965561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:56.966408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:56.985437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.986251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.989893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:56.992593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:56.994776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:56.997364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:57.286829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:57.287625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:57.302985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:57.303469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:57.304029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:57.304883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:57.305504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:57.309554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:57.381055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:57.389601 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c261c8ba-0638-4c33-91a6-59e51becae74 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118" status: 200 len: 1522 microversion: 2.1 time: 0.428269 Nov 02 21:39:57.390711 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1845/3814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:56 2022] GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:57.692171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:57.693096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:57.708065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:57.709297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:57.709908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:57.713560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:57.714784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:57.715357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:58.111245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:58.141366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:58.157088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:58.184316 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f575a8f-af81-4e09-8e91-d59eb4aa03dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.874673 Nov 02 21:39:58.198665 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1970/3815] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:57 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:39:58.435165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:58.436956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:58.441941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:58.463172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:58.465255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:58.467581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:58.468056 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38c53314-0c87-49b9-b2ac-c8c59a0d8515 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.779821 Nov 02 21:39:58.468777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:58.469118 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1846/3816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:57 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:58.471117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:58.471802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:58.875838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:39:58.888203 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2085787-6fc2-4363-ad59-5c1336bad911 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118" status: 200 len: 1522 microversion: 2.1 time: 0.475391 Nov 02 21:39:58.903186 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1971/3817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:58 2022] GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:39:59.218748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:59.219503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:59.238567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:59.247868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:59.254693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:59.255757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:59.267561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:59.271777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:59.498582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:39:59.499303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:39:59.521156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:59.523949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:59.528484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:39:59.529575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:39:59.530220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:39:59.530835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:00.683948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:00.707229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-312a5b60-063f-45a5-b4d9-fb08e200501a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 1.213680 Nov 02 21:40:00.720953 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1972/3818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:39:59 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:00.720953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:00.721666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:00.747771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:00.748273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:00.751474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:00.752263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:00.752742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:00.755544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:00.794520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:00.825285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:00.827388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:00.838074 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e797b320-b242-4254-b779-21c8e9bada52 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.616717 Nov 02 21:40:00.842968 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1847/3819] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:39:59 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:01.042022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:01.052761 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65ca0527-1665-432e-8dcb-f8effded7da8 tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118" status: 200 len: 1480 microversion: 2.1 time: 0.340806 Nov 02 21:40:01.062955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1973/3820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:00 2022] GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 => generated 1480 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:01.068972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2ff4d4b6-de6c-40cb-b922-63c482aa8f75 req-32d08d3a-c18d-4006-8984-ea8f1d70dc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a87762-1d21-4b74-8fa8-02260aaf7118", "name": "network-vif-deleted", "tag": "eae8cb1c-5984-4d3d-a74b-dac6823506bf"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:01.101043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2ff4d4b6-de6c-40cb-b922-63c482aa8f75 req-32d08d3a-c18d-4006-8984-ea8f1d70dc73 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:01.101982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2ff4d4b6-de6c-40cb-b922-63c482aa8f75 req-32d08d3a-c18d-4006-8984-ea8f1d70dc73 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:01.102954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2ff4d4b6-de6c-40cb-b922-63c482aa8f75 req-32d08d3a-c18d-4006-8984-ea8f1d70dc73 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:01.134793 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2ff4d4b6-de6c-40cb-b922-63c482aa8f75 req-32d08d3a-c18d-4006-8984-ea8f1d70dc73 service nova] Creating event network-vif-deleted:eae8cb1c-5984-4d3d-a74b-dac6823506bf for instance 56a87762-1d21-4b74-8fa8-02260aaf7118 on n-h1-860863-4 Nov 02 21:40:01.146498 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2ff4d4b6-de6c-40cb-b922-63c482aa8f75 req-32d08d3a-c18d-4006-8984-ea8f1d70dc73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088208 Nov 02 21:40:01.149440 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1974/3821] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:01.368038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f5102a9-92f1-4f76-899c-c3d516895b34 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Action: 'create', calling method: .version_select at 0x7f9b683e2670>, body: {"keypair": {"name": "tempest-keypair-673340851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMq+7Jh7iJXEGZ8AwfkcpeLdJ8TrAZBGsxTPbo71MhIw5tH948rIrl1V/Bc0zxg8WEteqRS+iD/UUQJCEuC+cz0mfXR33zJumHfT8gmbow9MVoKS49XZvtNUnlNo9EECA=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:01.412129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2f5102a9-92f1-4f76-899c-c3d516895b34 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Getting quotas for project d463e0b630fb42618874738bd8f30457. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:40:01.420899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2f5102a9-92f1-4f76-899c-c3d516895b34 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Getting quotas for user f0fbc084afdc4243a6dc363a0204f6e9 and project d463e0b630fb42618874738bd8f30457. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:40:01.596719 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f5102a9-92f1-4f76-899c-c3d516895b34 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.755066 Nov 02 21:40:01.597767 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1848/3822] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:40:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:01.737714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:01.749794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:01.749794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:01.749794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:01.749794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:01.749794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:01.749794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:01.749794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:01.878656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:01.882103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:01.915761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:01.916274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:01.918854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:01.919808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:01.922559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:01.926222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:02.203393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:02.220016 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6bb1d5db-bf74-452e-b3dc-549eee1700af tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.486776 Nov 02 21:40:02.222442 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1975/3823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:01 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:02.231106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:02.231938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:02.247795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:02.248561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:02.249969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:02.270011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:02.270011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:02.270011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:02.390140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:02.390631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:02.391071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:02.391611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lazy-loading 'fault' on Instance uuid 56a87762-1d21-4b74-8fa8-02260aaf7118 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:40:02.410075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:02.424786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:02.426826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:02.428362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c79bf23-0cd4-4226-b55e-d4c68464bf60 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.563492 Nov 02 21:40:02.429708 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1849/3824] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:01 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:40:02.475208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62fe8c2232f147f0a3e1f3a7211236dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8837c38b318491182101a3e6e9d9851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:02.490818 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-225f160a-54e2-4393-b2f1-2fe109bc289e tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118" status: 200 len: 1313 microversion: 2.1 time: 0.267000 Nov 02 21:40:02.491663 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1976/3825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:02 2022] GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:02.808110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-88bdd70f-1752-44a2-91bc-6dcde31015d4 req-7d4a917b-cb88-4a31-9b7c-0d23bbfc9660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e539db0-3690-47f4-b809-025a95d727a9", "name": "network-vif-plugged", "status": "completed", "tag": "852366f9-eed2-4587-b777-e3c0c519a785"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:02.829225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-88bdd70f-1752-44a2-91bc-6dcde31015d4 req-7d4a917b-cb88-4a31-9b7c-0d23bbfc9660 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:02.829841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-88bdd70f-1752-44a2-91bc-6dcde31015d4 req-7d4a917b-cb88-4a31-9b7c-0d23bbfc9660 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:02.830336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-88bdd70f-1752-44a2-91bc-6dcde31015d4 req-7d4a917b-cb88-4a31-9b7c-0d23bbfc9660 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:02.842844 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-88bdd70f-1752-44a2-91bc-6dcde31015d4 req-7d4a917b-cb88-4a31-9b7c-0d23bbfc9660 service nova] Creating event network-vif-plugged:852366f9-eed2-4587-b777-e3c0c519a785 for instance 7e539db0-3690-47f4-b809-025a95d727a9 on n-h1-860863-4 Nov 02 21:40:02.848510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-88bdd70f-1752-44a2-91bc-6dcde31015d4 req-7d4a917b-cb88-4a31-9b7c-0d23bbfc9660 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044109 Nov 02 21:40:02.850318 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1850/3826] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:03.182211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-40325b5f-6d2d-4804-ae52-953d58ab0b44 req-ca4e0c9b-6832-4928-a8e1-26ae8f489d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a59286-bb6c-4575-83d6-2318c544cfda", "name": "network-vif-deleted", "tag": "d778515b-45d0-4b5f-830b-68e8cdd02079"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:03.200973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-40325b5f-6d2d-4804-ae52-953d58ab0b44 req-ca4e0c9b-6832-4928-a8e1-26ae8f489d4e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:03.206825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-40325b5f-6d2d-4804-ae52-953d58ab0b44 req-ca4e0c9b-6832-4928-a8e1-26ae8f489d4e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:03.207272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-40325b5f-6d2d-4804-ae52-953d58ab0b44 req-ca4e0c9b-6832-4928-a8e1-26ae8f489d4e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:03.225355 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-40325b5f-6d2d-4804-ae52-953d58ab0b44 req-ca4e0c9b-6832-4928-a8e1-26ae8f489d4e service nova] Creating event network-vif-deleted:d778515b-45d0-4b5f-830b-68e8cdd02079 for instance 46a59286-bb6c-4575-83d6-2318c544cfda on n-h2-860863-4 Nov 02 21:40:03.234872 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-40325b5f-6d2d-4804-ae52-953d58ab0b44 req-ca4e0c9b-6832-4928-a8e1-26ae8f489d4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057041 Nov 02 21:40:03.235797 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1977/3827] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:03.249975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:03.250787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:03.265875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1912654832", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633e65a1-5eb1-4582-84ab-e86a0d55a55b"}], "security_groups": [{"name": "tempest-securitygroup--931723608"}], "key_name": "tempest-keypair-1364944310", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:03.274203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:03.275177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:03.275776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:03.278251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:03.281827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:03.282712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:03.534470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] validate_networks() for [('633e65a1-5eb1-4582-84ab-e86a0d55a55b', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:40:03.603376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:03.616685 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-116abfe0-dced-4da5-924f-8dd399d8e787 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1315 microversion: 2.1 time: 0.372543 Nov 02 21:40:03.623515 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1851/3828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:03 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:03.638143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:03.638143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:03.655884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:03.656395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:03.656842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:03.659929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:03.660519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:03.660639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:03.951593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:03.955060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:03.971456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:03.975370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:03.979912 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e03b4617-2387-4204-9158-cb264e11af18 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.348640 Nov 02 21:40:03.982838 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1852/3829] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:03 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:03.989459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:03.990315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 56a87762-1d21-4b74-8fa8-02260aaf7118] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:03.998221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:04.000042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.000755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.002037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.002989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.003652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.005179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.024054 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] HTTP exception thrown: Instance 56a87762-1d21-4b74-8fa8-02260aaf7118 could not be found. Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 HTTP/1.1 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 56a87762-1d21-4b74-8fa8-02260aaf7118 could not be found. Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '56a87762-1d21-4b74-8fa8-02260aaf7118'} Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56a87762-1d21-4b74-8fa8-02260aaf7118 could not be found. Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56a87762-1d21-4b74-8fa8-02260aaf7118 could not be found. Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.028721 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56a87762-1d21-4b74-8fa8-02260aaf7118 could not be found. Nov 02 21:40:04.032081 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.037298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 404 to user: Instance 56a87762-1d21-4b74-8fa8-02260aaf7118 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:40:04.037298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f892240b-7ac2-49a4-b716-94b9ed87b62f tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118" status: 404 len: 111 microversion: 2.1 time: 0.051499 Nov 02 21:40:04.038123 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1853/3830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:03 2022] GET /compute/v2.1/servers/56a87762-1d21-4b74-8fa8-02260aaf7118 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:40:04.045911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:04.047849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] [instance: 46a59286-bb6c-4575-83d6-2318c544cfda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:04.055935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.056737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.058439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.062579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.062579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.062579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.078108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] HTTP exception thrown: Instance 46a59286-bb6c-4575-83d6-2318c544cfda could not be found. Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Request method failure captured: Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda HTTP/1.1 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuN7MkzbBmAASkRFrhscqnfZusZJgVgXS-Jc1olWUJ21Flt8ZACU5qkSK4Edwxlcem7Djk_Jpo1DtdfpC69B3oaGzmEFQDMdF9g0wDn6nua_vQnaraWJuOQ2_mGa7k_xk-RXuYcJ6NhuoOwP22Kt2Gg-Pqf6ILzYIVaTGESaioYUt48 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8837c38b318491182101a3e6e9d9851"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8837c38b318491182101a3e6e9d9851"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e8837c38b318491182101a3e6e9d9851 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-605548597 Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 62fe8c2232f147f0a3e1f3a7211236dd Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServersNegativeTestJSON-605548597-project Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 46a59286-bb6c-4575-83d6-2318c544cfda could not be found. Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '46a59286-bb6c-4575-83d6-2318c544cfda'} Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a59286-bb6c-4575-83d6-2318c544cfda could not be found. Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a59286-bb6c-4575-83d6-2318c544cfda could not be found. Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.079869 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a59286-bb6c-4575-83d6-2318c544cfda could not be found. Nov 02 21:40:04.083618 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:40:04.085405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] Returning 404 to user: Instance 46a59286-bb6c-4575-83d6-2318c544cfda could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:40:04.086470 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7556e764-7609-444f-a63f-0ff291e2c7da tempest-ListServersNegativeTestJSON-605548597 tempest-ListServersNegativeTestJSON-605548597-project] 10.222.0.25 "GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda" status: 404 len: 111 microversion: 2.1 time: 0.045330 Nov 02 21:40:04.087339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1854/3831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:04 2022] GET /compute/v2.1/servers/46a59286-bb6c-4575-83d6-2318c544cfda => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:40:04.468319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:40:04.469722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:40:04.470348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:40:04.470901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:40:04.471501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:40:04.491794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.493364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.494155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.500130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.500783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.501408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.524549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:40:04.531127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:40:04.559751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:40:04.562526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:40:04.650406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:04.651142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:04.665001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.665686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.666331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.667316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:04.667928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:04.668549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:04.791637 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd10bea4-a796-4ac4-94e2-5752b3956d7f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.530091 Nov 02 21:40:04.794713 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1978/3832] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:40:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:40:04.812574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f31f039e-27bd-4703-84f7-fb333b1f7f88 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:04.813514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f31f039e-27bd-4703-84f7-fb333b1f7f88 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:04.983744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f31f039e-27bd-4703-84f7-fb333b1f7f88 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:04.996372 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f31f039e-27bd-4703-84f7-fb333b1f7f88 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1242 microversion: 2.1 time: 0.187709 Nov 02 21:40:05.001306 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1979/3833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:04 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:05.012967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:05.013581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:05.060920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:05.061637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:05.062147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:05.064055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:05.064544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:05.066131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:05.282008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:05.291203 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf3b6e07-4997-47c8-9f0e-2b6ae2945ce7 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1502 microversion: 2.1 time: 0.642075 Nov 02 21:40:05.292713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1855/3834] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:04 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1502 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:05.324479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:05.326833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:05.338467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:05.339227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:05.339813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:05.342914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:05.343539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:05.344121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:05.515430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:05.531864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:05.540789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:05.544978 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ce2156d-0431-4bbc-b99e-9491e142f337 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.536644 Nov 02 21:40:05.547753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1980/3835] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:05 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:05.650611 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.network.security_group_api [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Removing security group 087c88c7-4ec5-4217-b005-5bd847047c2a from port 852366f9-eed2-4587-b777-e3c0c519a785 Nov 02 21:40:06.032518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ff88def-5b10-4b21-ac69-38bd7fb6d694 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:06.033185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ff88def-5b10-4b21-ac69-38bd7fb6d694 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:06.176634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ff88def-5b10-4b21-ac69-38bd7fb6d694 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:06.187869 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ff88def-5b10-4b21-ac69-38bd7fb6d694 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1242 microversion: 2.1 time: 0.160517 Nov 02 21:40:06.211058 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1981/3836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:06 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1242 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:06.577336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:06.578618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:06.606719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:06.609113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:06.609595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:06.612620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:06.615451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:06.626509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:06.823332 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-827a6b9c-27de-4005-94af-f7924ddab213 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9/action" status: 202 len: 0 microversion: 2.1 time: 1.502947 Nov 02 21:40:06.824062 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1856/3837] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:40:05 2022] POST /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9/action => generated 0 bytes in 1505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:40:06.833196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-996049785", "imageRef": "97f61a18-1419-4e85-9bf1-0374947abc47", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ab6aa3fc-8381-4a61-ab72-f423f7cb2b67"}], "security_groups": [{"name": "tempest-securitygroup--1424357933"}], "key_name": "tempest-keypair-673340851", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:07.159583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] validate_networks() for [('ab6aa3fc-8381-4a61-ab72-f423f7cb2b67', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:40:07.259341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:07.282256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:07.296218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:07.298235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33c29dd5-d71e-4676-af2c-80866f0b9fe7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.727289 Nov 02 21:40:07.308956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1982/3838] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:06 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:40:07.320550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:07.320550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:07.335420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:07.335933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:07.338296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:07.338296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:07.338296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:07.338296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:07.408195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:07.550823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:07.567899 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c5d6eeec-3653-4935-894b-5179a5e4667f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1460 microversion: 2.1 time: 0.266082 Nov 02 21:40:07.569913 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1983/3839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:07 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1460 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:07.587974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-56902f67-f5c9-4d5f-82b2-73709ee497bb req-effd0e02-4f22-416a-91dd-5b0860a4bb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e539db0-3690-47f4-b809-025a95d727a9", "tag": "852366f9-eed2-4587-b777-e3c0c519a785"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:07.603097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-56902f67-f5c9-4d5f-82b2-73709ee497bb req-effd0e02-4f22-416a-91dd-5b0860a4bb52 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:07.603828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-56902f67-f5c9-4d5f-82b2-73709ee497bb req-effd0e02-4f22-416a-91dd-5b0860a4bb52 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:07.605435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-56902f67-f5c9-4d5f-82b2-73709ee497bb req-effd0e02-4f22-416a-91dd-5b0860a4bb52 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:07.634030 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-56902f67-f5c9-4d5f-82b2-73709ee497bb req-effd0e02-4f22-416a-91dd-5b0860a4bb52 service nova] Creating event network-changed:852366f9-eed2-4587-b777-e3c0c519a785 for instance 7e539db0-3690-47f4-b809-025a95d727a9 on n-h1-860863-4 Nov 02 21:40:07.648975 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-56902f67-f5c9-4d5f-82b2-73709ee497bb req-effd0e02-4f22-416a-91dd-5b0860a4bb52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077227 Nov 02 21:40:07.650496 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1984/3840] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:07.665874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:07.667022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:07.685573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:07.686212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:07.687384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:07.691521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:07.692271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:07.692889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:07.886634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:07.919062 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3494af8-9bf6-4dc2-bb7b-4fc5836ad925 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1294 microversion: 2.1 time: 0.261468 Nov 02 21:40:07.920544 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1985/3841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:07 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1294 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:07.935053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:07.935990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:07.949881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:07.954008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:07.954751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:07.955757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:07.959916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:07.960600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:08.779496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:40:08.780017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:40:08.780406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:40:08.780850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:40:08.781296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:40:08.797149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:08.797870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:08.798758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:08.799929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:08.801023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:08.801797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:08.849688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Getting quotas for project d463e0b630fb42618874738bd8f30457. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:40:08.858460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Getting quotas for user f0fbc084afdc4243a6dc363a0204f6e9 and project d463e0b630fb42618874738bd8f30457. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:40:08.876651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:40:08.880477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97f61a18-1419-4e85-9bf1-0374947abc47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:40:09.105428 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-96ea7c5d-bb5a-4a5f-b527-337486c04757 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.278476 Nov 02 21:40:09.107279 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1857/3842] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:40:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:40:09.112806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:09.113719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:09.122531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:09.123321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:09.124030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:09.125066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:09.125701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:09.126301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:09.150442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:09.163577 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f90bdd9a-e972-4928-b5c9-ec7178642b73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.241393 Nov 02 21:40:09.164703 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1986/3843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:07 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:09.175812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:09.191702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:09.204570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:09.205423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:09.206096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:09.207009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:09.207665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:09.208344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:09.400442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:09.420544 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b31bdea6-85c9-4576-9fe9-4dc4657e97a6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1300 microversion: 2.1 time: 0.251786 Nov 02 21:40:09.430288 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1987/3844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:09 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1300 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:09.443264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b368bfaf-4bf2-44f4-bd4a-175adc951453 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:09.443924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b368bfaf-4bf2-44f4-bd4a-175adc951453 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:09.908613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b368bfaf-4bf2-44f4-bd4a-175adc951453 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:09.916234 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b368bfaf-4bf2-44f4-bd4a-175adc951453 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1244 microversion: 2.1 time: 0.489037 Nov 02 21:40:09.918357 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1988/3845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:09 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1244 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:09.929917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:09.930758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:09.949274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:09.950022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:09.950620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:09.953681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:09.957692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:09.958362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:10.259109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:10.282166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:10.283801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:10.285029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-280be790-72b4-4100-81c9-f1af18b37554 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.176634 Nov 02 21:40:10.285594 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1858/3846] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:09 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:10.456532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:10.457177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:10.467046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:10.479819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:10.482068 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfd99398-abf5-4d77-bee7-7c889ced79ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.561772 Nov 02 21:40:10.490634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:10.491544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:10.492436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:10.547203 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1989/3847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:09 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:10.547314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:10.547415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:10.547506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:10.547590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:10.547590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:10.547590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:10.547590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:10.548886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:10.550027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:10.555364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:10.848298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:10.860892 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab30b929-8eef-422e-bf11-361dd95662d6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1300 microversion: 2.1 time: 0.408579 Nov 02 21:40:10.866383 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1859/3848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:10 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1300 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:10.947677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:10.948881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:10.955896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:10.956452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:10.957577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:10.963096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:10.963096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:10.963096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.083122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:11.117501 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17d44f7e-7c08-435c-8911-07bf16dd5dfb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.608019 Nov 02 21:40:11.120477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:11.122524 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1990/3849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:10 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:11.152567 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-28035f4d-018d-4c9a-aadd-c3fae4050c47 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1248 microversion: 2.1 time: 0.210152 Nov 02 21:40:11.155752 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1860/3850] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:10 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1248 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:11.163332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:11.164043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:11.171376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-54871b2f-7583-4794-9320-bbbb9c97bfc7 req-cb265643-6408-47c2-8d1f-a12cd08451a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-plugged", "status": "completed", "tag": "9f51a648-5f20-411a-a7b2-b20f02126167"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:11.190001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:11.194951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:11.195509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.196333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:11.197332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:11.206529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.222867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-54871b2f-7583-4794-9320-bbbb9c97bfc7 req-cb265643-6408-47c2-8d1f-a12cd08451a8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:11.223619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-54871b2f-7583-4794-9320-bbbb9c97bfc7 req-cb265643-6408-47c2-8d1f-a12cd08451a8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:11.224258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-54871b2f-7583-4794-9320-bbbb9c97bfc7 req-cb265643-6408-47c2-8d1f-a12cd08451a8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.257368 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-54871b2f-7583-4794-9320-bbbb9c97bfc7 req-cb265643-6408-47c2-8d1f-a12cd08451a8 service nova] Creating event network-vif-plugged:9f51a648-5f20-411a-a7b2-b20f02126167 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:11.274076 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-54871b2f-7583-4794-9320-bbbb9c97bfc7 req-cb265643-6408-47c2-8d1f-a12cd08451a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149756 Nov 02 21:40:11.286870 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1991/3851] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:11.315366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:11.316088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:11.339924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:11.340444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:11.340913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.346505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:11.346505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:11.346505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.757328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:11.773923 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b3adb4d-449c-40e5-9562-6840a3383f71 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.615610 Nov 02 21:40:11.774726 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1861/3852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:11 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:11.799634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:11.813080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:11.819902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:11.822359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c67eb9b-6580-4e9e-9222-9e4e92b34fb7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.511274 Nov 02 21:40:11.833394 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1992/3853] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:11 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:40:11.891526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:11.892141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:11.903614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:11.904116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:11.907888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.908709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:11.909219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:11.909659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:11.973368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1464710532", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "abf3b988-f5ac-44d9-9b37-c74857f22c78"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:12.057729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] validate_networks() for [('abf3b988-f5ac-44d9-9b37-c74857f22c78', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:40:12.445671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:12.458144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b6156a67-d6dd-4002-91c5-354dfac6afc2 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1367 microversion: 2.1 time: 0.571084 Nov 02 21:40:12.469620 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1862/3854] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:11 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1367 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:12.482207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:12.483267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:12.490335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:12.491095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:12.491670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:12.492535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:12.493162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:12.493828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:12.696559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:12.726539 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ede0d632-2e22-48e7-9546-913d2e052b68 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1304 microversion: 2.1 time: 0.248832 Nov 02 21:40:12.728223 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1863/3855] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:12 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1304 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:12.850715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:12.851332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:12.861707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:12.869112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:12.869898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:12.870861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:12.871329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:12.871758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:13.442040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:13.456996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:13.458784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:13.460183 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7bfda677-7c46-4c69-b942-0a6c7e93397d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.613596 Nov 02 21:40:13.460745 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1864/3856] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:12 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:40:13.466330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6e636b5c-aacf-43a3-960f-aafd3dc65a90 req-718f3a6b-e9e5-45f4-8efb-d6f5f9240332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-plugged", "status": "completed", "tag": "45da1dad-8e70-4b0c-be39-da4ceee9c79f"}, {"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-plugged", "status": "completed", "tag": "045e9332-9988-4cf9-bff0-a3d66cbd93c5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:13.481168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6e636b5c-aacf-43a3-960f-aafd3dc65a90 req-718f3a6b-e9e5-45f4-8efb-d6f5f9240332 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:13.481852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6e636b5c-aacf-43a3-960f-aafd3dc65a90 req-718f3a6b-e9e5-45f4-8efb-d6f5f9240332 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:13.489947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6e636b5c-aacf-43a3-960f-aafd3dc65a90 req-718f3a6b-e9e5-45f4-8efb-d6f5f9240332 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:13.496746 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6e636b5c-aacf-43a3-960f-aafd3dc65a90 req-718f3a6b-e9e5-45f4-8efb-d6f5f9240332 service nova] Creating event network-vif-plugged:45da1dad-8e70-4b0c-be39-da4ceee9c79f for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:13.497467 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6e636b5c-aacf-43a3-960f-aafd3dc65a90 req-718f3a6b-e9e5-45f4-8efb-d6f5f9240332 service nova] Creating event network-vif-plugged:045e9332-9988-4cf9-bff0-a3d66cbd93c5 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:13.506086 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6e636b5c-aacf-43a3-960f-aafd3dc65a90 req-718f3a6b-e9e5-45f4-8efb-d6f5f9240332 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043161 Nov 02 21:40:13.513123 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1865/3857] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:13.515899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:13.517238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:13.524950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:13.526365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:13.527003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:13.528437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:13.529082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:13.536104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:13.664499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:40:13.667761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:40:13.668782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:40:13.669448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:40:13.670008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:40:13.694835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:13.695547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:13.696144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:13.702298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:13.702298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:13.702298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:13.725521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:40:13.733446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Getting quotas for user 368ab16b50f84f0d9cf6e79e039dc257 and project c5033ea63e4242f6a2a8b82466c3bc46. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:40:13.766833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:40:13.787948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:40:13.948589 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed93413f-3442-4a2c-8cc5-35cf5b99aa1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979278 Nov 02 21:40:13.953419 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1993/3858] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:40:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:40:13.968837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:13.970579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:13.989050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:13.991676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:13.993897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:13.999462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:14.000258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:14.001137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:14.601884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:14.614049 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e5bb50d-ec8c-4bca-9b15-6e8f16ff12bc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1302 microversion: 2.1 time: 0.659244 Nov 02 21:40:14.621517 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1994/3859] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:13 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1302 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:14.627955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9ddcf5c-3241-452a-842c-8aa7ee55723b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:14.627955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9ddcf5c-3241-452a-842c-8aa7ee55723b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:14.809864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:14.829617 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62a29d13-8ec6-40c5-91a9-316efb591e7c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1367 microversion: 2.1 time: 1.319715 Nov 02 21:40:14.830224 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1866/3860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:13 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1367 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:14.856602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:14.857437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:14.864655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:14.865217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:14.865654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:14.866345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:14.866972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:14.867397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:14.881242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e9ddcf5c-3241-452a-842c-8aa7ee55723b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:14.890788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=25 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:14.895569 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9ddcf5c-3241-452a-842c-8aa7ee55723b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1215 microversion: 2.1 time: 0.270468 Nov 02 21:40:14.905017 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1995/3861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:14 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1215 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:15.025446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-df8a873b-c194-4ecc-b38e-11de36c929d1 req-b5ccc948-0b91-4316-bfdb-69c2b625c6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75b7954-00b0-4504-88c7-6e5c0e4b21b6", "tag": "3f060e99-6b84-41c5-96cd-4b1133955aa1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:15.046373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-df8a873b-c194-4ecc-b38e-11de36c929d1 req-b5ccc948-0b91-4316-bfdb-69c2b625c6b7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:15.046868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-df8a873b-c194-4ecc-b38e-11de36c929d1 req-b5ccc948-0b91-4316-bfdb-69c2b625c6b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:15.047301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-df8a873b-c194-4ecc-b38e-11de36c929d1 req-b5ccc948-0b91-4316-bfdb-69c2b625c6b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:15.093240 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-df8a873b-c194-4ecc-b38e-11de36c929d1 req-b5ccc948-0b91-4316-bfdb-69c2b625c6b7 service nova] Creating event network-changed:3f060e99-6b84-41c5-96cd-4b1133955aa1 for instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 on n-h2-860863-4 Nov 02 21:40:15.098410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-df8a873b-c194-4ecc-b38e-11de36c929d1 req-b5ccc948-0b91-4316-bfdb-69c2b625c6b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076574 Nov 02 21:40:15.099531 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1996/3862] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:15.570358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5e9c707a-813b-4da6-8fff-febf974eeeeb req-1fc7227a-e70e-4944-9ae7-e733d072fa02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-plugged", "status": "completed", "tag": "9367ad21-601b-4cdf-9414-940e3aa0430b"}, {"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-plugged", "status": "completed", "tag": "7039bf5d-1ca8-4170-b36c-088ec0a791f4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:15.610281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:15.623656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5e9c707a-813b-4da6-8fff-febf974eeeeb req-1fc7227a-e70e-4944-9ae7-e733d072fa02 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:15.625308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5e9c707a-813b-4da6-8fff-febf974eeeeb req-1fc7227a-e70e-4944-9ae7-e733d072fa02 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:15.627497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5e9c707a-813b-4da6-8fff-febf974eeeeb req-1fc7227a-e70e-4944-9ae7-e733d072fa02 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:15.658042 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5e9c707a-813b-4da6-8fff-febf974eeeeb req-1fc7227a-e70e-4944-9ae7-e733d072fa02 service nova] Creating event network-vif-plugged:9367ad21-601b-4cdf-9414-940e3aa0430b for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:15.658816 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5e9c707a-813b-4da6-8fff-febf974eeeeb req-1fc7227a-e70e-4944-9ae7-e733d072fa02 service nova] Creating event network-vif-plugged:7039bf5d-1ca8-4170-b36c-088ec0a791f4 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:15.679913 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5e9c707a-813b-4da6-8fff-febf974eeeeb req-1fc7227a-e70e-4944-9ae7-e733d072fa02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119239 Nov 02 21:40:15.681591 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1997/3863] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:40:15.688360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:15.694121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:15.696224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:15.701213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:15.702044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:15.703197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:15.703825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:15.704434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:15.774329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:15.802812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:15.802812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:15.803347 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-747f9d92-9dc2-4c76-ac70-10bf042e4cfd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.956418 Nov 02 21:40:15.809806 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1867/3864] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:14 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:15.861862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:15.863888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:15.880384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:15.882977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:15.883743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:15.884854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:15.887485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:15.888114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:15.935262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:15.954419 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71e89d20-617e-480b-9bde-0ec8d0cd65b0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1302 microversion: 2.1 time: 0.270956 Nov 02 21:40:15.959950 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1998/3865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:15 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1302 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:15.992540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:15.997519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:16.018400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:16.019252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:16.021495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:16.022751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:16.031284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:16.032724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:16.406869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:16.443136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e99c14e-ef3c-4dfc-ac0e-caeb5b71d203 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1367 microversion: 2.1 time: 0.579957 Nov 02 21:40:16.445015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1868/3866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:15 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:16.564763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:16.579387 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c70c23ec-2b62-4521-ba36-f3be02eea6da tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1219 microversion: 2.1 time: 0.614821 Nov 02 21:40:16.588829 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1999/3867] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:15 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1219 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:16.839384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:16.840303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:16.847519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:16.848431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:16.849116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:16.850279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:16.850945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:16.851581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:16.998562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:16.998562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:17.000317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:17.055335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:17.055335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:17.055335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:17.055335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:17.055335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:17.413748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:17.427735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:17.433466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:17.438247 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3b559d2-95b0-48ba-ae59-0a1ffcf99d96 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 0.603147 Nov 02 21:40:17.454150 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1869/3868] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:16 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:17.474503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:17.475373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:17.485536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:17.486789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:17.488825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:17.489741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:17.492882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:17.493556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:17.700450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:17.708947 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-560be66f-db80-4718-898a-9344dcc147ae tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.732713 Nov 02 21:40:17.717464 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2000/3869] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:16 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:17.734992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:17.735819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:17.764383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:17.764656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:17.765025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:17.766065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:17.766720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:17.768114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:17.823602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:17.838102 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c11b939e-4070-4fbe-9373-c8f8d5208175 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1367 microversion: 2.1 time: 0.367254 Nov 02 21:40:17.838949 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1870/3870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:17 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:17.843639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2db015b0-43b2-4c7e-a381-aff0cfa94591 req-41054d16-462e-4d18-af9c-a4c8c1c5304a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-plugged", "status": "completed", "tag": "52468c6f-da2b-4db6-a97a-61a7be94b9cd"}, {"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-plugged", "status": "completed", "tag": "cfb7a0d6-5668-4202-bf4b-e203c9b5c97d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:17.871565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2db015b0-43b2-4c7e-a381-aff0cfa94591 req-41054d16-462e-4d18-af9c-a4c8c1c5304a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:17.874058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2db015b0-43b2-4c7e-a381-aff0cfa94591 req-41054d16-462e-4d18-af9c-a4c8c1c5304a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:17.874058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2db015b0-43b2-4c7e-a381-aff0cfa94591 req-41054d16-462e-4d18-af9c-a4c8c1c5304a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:17.904874 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2db015b0-43b2-4c7e-a381-aff0cfa94591 req-41054d16-462e-4d18-af9c-a4c8c1c5304a service nova] Creating event network-vif-plugged:52468c6f-da2b-4db6-a97a-61a7be94b9cd for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:17.905591 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2db015b0-43b2-4c7e-a381-aff0cfa94591 req-41054d16-462e-4d18-af9c-a4c8c1c5304a service nova] Creating event network-vif-plugged:cfb7a0d6-5668-4202-bf4b-e203c9b5c97d for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:17.914603 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2db015b0-43b2-4c7e-a381-aff0cfa94591 req-41054d16-462e-4d18-af9c-a4c8c1c5304a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074239 Nov 02 21:40:17.920094 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1871/3871] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:17.936146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:17.951800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8fa8a522-d898-40ad-9cf5-9c29e2369f69 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1275 microversion: 2.1 time: 0.232417 Nov 02 21:40:17.973522 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2001/3872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:17 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:18.474839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:18.476378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:18.498604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:18.499586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:18.500196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:18.501142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:18.501746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:18.502343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:18.743504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:18.744185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:18.772391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:18.777305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:18.779211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:18.782960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:18.783484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:18.783945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:18.820293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:18.870572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:19.688235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:19.699371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ac5a1e03-9ed1-4e07-8795-471a94403bf2 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.959459 Nov 02 21:40:19.700507 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2002/3873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:18 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:19.714791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:19.718973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:19.722315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:19.722815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:19.723264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:19.724095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:19.724466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:19.724841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:19.839168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:19.867061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:19.871064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:19.876548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86fbe1cd-7df7-4493-b355-47275e2e80d7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.406909 Nov 02 21:40:19.894959 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1872/3874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:18 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:19.894959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:19.894959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:19.921453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:19.922001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:19.926861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:19.927786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:19.928277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:19.928997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:19.940079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:20.069287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:20.085402 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e3c470a-a392-4f7b-ac6f-b59ef8d499f6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1273 microversion: 2.1 time: 0.207086 Nov 02 21:40:20.089228 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1873/3875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:19 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:20.378701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:20.393142 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d45eefa-204c-46bc-88d7-371754409c46 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1367 microversion: 2.1 time: 0.691635 Nov 02 21:40:20.394100 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2003/3876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:19 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1367 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:20.723922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:20.724812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:20.736456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:20.737494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:20.741781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:20.743070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:20.743752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:20.745586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:20.902838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:20.903838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:20.952491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:20.954960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:20.956897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:20.963467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:20.964122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:20.967146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:21.955422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:21.966077 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-50a3fe72-0ed3-41b8-862f-d02f0b198ac0 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 1.246010 Nov 02 21:40:21.968460 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1874/3877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:20 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:21.977445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f49e18ed-072d-4d92-a961-29fbe3e815cb req-a4eaefd6-a0a0-4bcd-b224-87a2d7d5b22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4919de14-4362-4d7b-ba9c-9679717b62a4", "tag": "3b045895-4443-4ef3-bfb1-40527c0c2ac6"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:22.003522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f49e18ed-072d-4d92-a961-29fbe3e815cb req-a4eaefd6-a0a0-4bcd-b224-87a2d7d5b22b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:22.006390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f49e18ed-072d-4d92-a961-29fbe3e815cb req-a4eaefd6-a0a0-4bcd-b224-87a2d7d5b22b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:22.006390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f49e18ed-072d-4d92-a961-29fbe3e815cb req-a4eaefd6-a0a0-4bcd-b224-87a2d7d5b22b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:22.029678 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f49e18ed-072d-4d92-a961-29fbe3e815cb req-a4eaefd6-a0a0-4bcd-b224-87a2d7d5b22b service nova] Creating event network-changed:3b045895-4443-4ef3-bfb1-40527c0c2ac6 for instance 4919de14-4362-4d7b-ba9c-9679717b62a4 on n-h1-860863-4 Nov 02 21:40:22.042820 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f49e18ed-072d-4d92-a961-29fbe3e815cb req-a4eaefd6-a0a0-4bcd-b224-87a2d7d5b22b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070354 Nov 02 21:40:22.044909 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1875/3878] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:22.059220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:22.059991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:22.074772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:22.076793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:22.077452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:22.080816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:22.081549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:22.083141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:22.238033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:22.253970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:22.262409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:22.262409 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a795a019-1be9-45ed-b7fe-5655fdac7aef tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1879 microversion: 2.42 time: 1.358208 Nov 02 21:40:22.265271 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2004/3879] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:20 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1879 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:40:22.270365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-53a1d687-6d65-46a2-8b30-b6d98b2840bd req-09dcbc5b-587d-4063-800d-1d9019ed40cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75b7954-00b0-4504-88c7-6e5c0e4b21b6", "name": "network-vif-plugged", "status": "completed", "tag": "3f060e99-6b84-41c5-96cd-4b1133955aa1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:22.281108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53a1d687-6d65-46a2-8b30-b6d98b2840bd req-09dcbc5b-587d-4063-800d-1d9019ed40cc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:22.281985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53a1d687-6d65-46a2-8b30-b6d98b2840bd req-09dcbc5b-587d-4063-800d-1d9019ed40cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:22.282601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53a1d687-6d65-46a2-8b30-b6d98b2840bd req-09dcbc5b-587d-4063-800d-1d9019ed40cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:22.295601 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-53a1d687-6d65-46a2-8b30-b6d98b2840bd req-09dcbc5b-587d-4063-800d-1d9019ed40cc service nova] Creating event network-vif-plugged:3f060e99-6b84-41c5-96cd-4b1133955aa1 for instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 on n-h2-860863-4 Nov 02 21:40:22.301845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-53a1d687-6d65-46a2-8b30-b6d98b2840bd req-09dcbc5b-587d-4063-800d-1d9019ed40cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034876 Nov 02 21:40:22.310288 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2005/3880] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:22.315988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:22.316901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:22.334484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:22.335422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:22.337346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:22.339469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:22.340203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:22.342258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:22.347254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:22.671331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:22.679727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4bd7311a-36b6-44cf-b1b8-d02b5f5bab29 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 0.633375 Nov 02 21:40:22.680324 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1876/3881] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:22 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:22.790626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:22.811676 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-416f0961-9562-400f-a4bc-b2142de4158d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1367 microversion: 2.1 time: 0.499764 Nov 02 21:40:22.825347 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2006/3882] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:22 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:22.992909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:22.993547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:23.005534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:23.009646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:23.010923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:23.012192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:23.021514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:23.022243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:23.297017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:23.299786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:23.315405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:23.319862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:23.328256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:23.328256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:23.328256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:23.328256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:23.530996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:23.569898 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d6ebc64-15ad-4361-9c8c-c0c36ca79ead tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.580421 Nov 02 21:40:23.572618 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1877/3883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:22 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:23.707105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:23.707731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:23.711175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:23.723737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:23.724169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:23.727933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:23.729883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:23.732912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:23.734047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:23.914481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:23.930980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:23.935833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:23.940397 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27c652aa-6a7e-4976-9497-3a87fb3c04ff tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2838 microversion: 2.42 time: 0.649104 Nov 02 21:40:23.960112 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2007/3884] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:40:23 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2838 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:40:23.973501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:23.974525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:23.987353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:23.987860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:23.988310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:24.018035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:24.018531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:24.019532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:24.341890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:24.381568 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df88c0fe-5860-4e38-a801-2f4fda2c2aaa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 0.674179 Nov 02 21:40:24.383696 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1878/3885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:23 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:24.394392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:24.397364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:24.406930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:24.407686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:24.408388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:24.409288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:24.409916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:24.410496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:24.658536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:24.687355 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-512dc094-912e-4ad1-bf79-37bc16e40d4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1367 microversion: 2.1 time: 0.721128 Nov 02 21:40:24.695484 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2008/3886] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:23 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1367 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:24.727426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:24.730572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:24.768831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:24.769430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:24.769888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:24.770624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:24.771198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:24.771578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:24.973765 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-57916dd1-eca4-499c-8889-c949d87ebecd tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.588740 Nov 02 21:40:24.980115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1879/3887] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:40:24 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505/os-interface => generated 1831 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:40:25.419278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:25.426674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:25.439566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:25.441889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:25.442502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:25.448234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:25.448234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:25.448234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:25.615971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:25.827975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:25.842963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d761ba41-e0e6-4c57-af97-445fabc1f45c tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 1.143074 Nov 02 21:40:25.851228 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2009/3888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:24 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:25.857048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:25.861018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:25.891845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:25.893244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:25.944275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:25.944275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:25.945365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:25.948712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:26.180892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:26.214902 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2022de1c-3f9f-4a77-a8d4-4672807c9b0d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 0.799546 Nov 02 21:40:26.215522 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1880/3889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:25 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:26.876162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:26.876162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:26.895176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:26.906178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:26.906693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:26.913767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:26.914679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:26.920746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:26.921370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:27.617128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:27.631681 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aef8d63e-3b69-485e-a668-7594c3d58098 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1556 microversion: 2.1 time: 1.778901 Nov 02 21:40:27.632716 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2010/3890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:25 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1556 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:27.642677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:27.643321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:27.660327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:27.667775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:27.668418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:27.671172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:27.671712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:27.672147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:28.174394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:28.174394 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4b505c51-7e0b-4f9c-be56-53a1e3f66514 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 1.297065 Nov 02 21:40:28.174394 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1881/3891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:26 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:28.191505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-045f9867-f6cc-4845-ae12-c19051825299 req-4f015811-7d53-48c3-9b64-c3ab3ab63c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889e113c-b228-4f42-adc8-e91298522ae5", "tag": "c6c5387e-b503-44b2-be6e-fdf5de38ac8a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:28.204349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-045f9867-f6cc-4845-ae12-c19051825299 req-4f015811-7d53-48c3-9b64-c3ab3ab63c03 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:28.205393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-045f9867-f6cc-4845-ae12-c19051825299 req-4f015811-7d53-48c3-9b64-c3ab3ab63c03 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:28.206231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-045f9867-f6cc-4845-ae12-c19051825299 req-4f015811-7d53-48c3-9b64-c3ab3ab63c03 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:28.277937 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-045f9867-f6cc-4845-ae12-c19051825299 req-4f015811-7d53-48c3-9b64-c3ab3ab63c03 service nova] Creating event network-changed:c6c5387e-b503-44b2-be6e-fdf5de38ac8a for instance 889e113c-b228-4f42-adc8-e91298522ae5 on n-h2-860863-4 Nov 02 21:40:28.297114 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-045f9867-f6cc-4845-ae12-c19051825299 req-4f015811-7d53-48c3-9b64-c3ab3ab63c03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131654 Nov 02 21:40:28.300680 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1882/3892] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:28.338877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:28.341452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:28.358732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:28.360844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:28.362301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:28.364075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:28.381901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:28.385458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:28.388996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:28.396586 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aaa7eae9-f046-411e-bc26-afbd24f921b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 0.757937 Nov 02 21:40:28.397385 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2011/3893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:27 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:28.658680 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aac15ccd-30d2-463b-ab7f-6f825fbc459e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.355089 Nov 02 21:40:28.659555 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1883/3894] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:40:28 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-interface => generated 284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:29.197083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:29.197083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:29.211315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:29.215048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:29.215725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:29.218040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:29.227104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:29.232050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:29.438969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:29.439594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:29.453822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:29.454384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:29.454830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:29.455541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:29.456000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:29.456427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:29.654148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:29.687353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e05bb5e-d688-4df5-8da9-08d098b44a82 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.498832 Nov 02 21:40:29.690045 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2012/3895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:29 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:29.777562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:29.787568 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6ef1fc36-b04a-4a9a-9797-a3adec6d7d22 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 0.353781 Nov 02 21:40:29.791797 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1884/3896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:29 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:30.321840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-03e1843e-a7ac-4560-b162-3bd963874375 req-e15fdd2d-6112-4e4a-b83b-ccd8346291e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "tag": "cfb7a0d6-5668-4202-bf4b-e203c9b5c97d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:30.349746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-03e1843e-a7ac-4560-b162-3bd963874375 req-e15fdd2d-6112-4e4a-b83b-ccd8346291e8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:30.350551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-03e1843e-a7ac-4560-b162-3bd963874375 req-e15fdd2d-6112-4e4a-b83b-ccd8346291e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:30.355335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-03e1843e-a7ac-4560-b162-3bd963874375 req-e15fdd2d-6112-4e4a-b83b-ccd8346291e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:30.395894 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-03e1843e-a7ac-4560-b162-3bd963874375 req-e15fdd2d-6112-4e4a-b83b-ccd8346291e8 service nova] Creating event network-changed:cfb7a0d6-5668-4202-bf4b-e203c9b5c97d for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:40:30.404593 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-03e1843e-a7ac-4560-b162-3bd963874375 req-e15fdd2d-6112-4e4a-b83b-ccd8346291e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086562 Nov 02 21:40:30.405715 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2013/3897] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:40:30.711396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:30.711963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:30.738114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:30.738651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:30.739097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:30.745643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:30.746168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:30.746654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:30.816803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:30.820543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:30.830258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:30.831109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:30.831903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:30.832915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:30.837787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:30.837787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:31.397512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:31.412025 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e67b44f-dfe3-4d69-9051-8ca523cab95d tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.700541 Nov 02 21:40:31.412706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1885/3898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:30 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:31.477999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:31.492998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2165a0ac-6f2a-434e-90f0-c5f381a62a77 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 0.682553 Nov 02 21:40:31.496079 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2014/3899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:30 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:32.439848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:32.440469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:32.465618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:32.466453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:32.468833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:32.470013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:32.471837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:32.474022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:32.522752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:32.523560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:32.545642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:32.549352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:32.551737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:32.556629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:32.558225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:32.565064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:33.542437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:33.552975 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-516705a9-4ee3-4a01-b927-a8a583f3f0b4 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 1.121004 Nov 02 21:40:33.557323 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1886/3900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:32 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:33.568486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dfd86571-32a7-4403-9a8a-b05dd73918f0 req-d6651701-5d5e-4603-8be1-37a0c2870ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75b7954-00b0-4504-88c7-6e5c0e4b21b6", "tag": "3f060e99-6b84-41c5-96cd-4b1133955aa1"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:33.592863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dfd86571-32a7-4403-9a8a-b05dd73918f0 req-d6651701-5d5e-4603-8be1-37a0c2870ff6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:33.594136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dfd86571-32a7-4403-9a8a-b05dd73918f0 req-d6651701-5d5e-4603-8be1-37a0c2870ff6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:33.594615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dfd86571-32a7-4403-9a8a-b05dd73918f0 req-d6651701-5d5e-4603-8be1-37a0c2870ff6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:33.624964 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dfd86571-32a7-4403-9a8a-b05dd73918f0 req-d6651701-5d5e-4603-8be1-37a0c2870ff6 service nova] Creating event network-changed:3f060e99-6b84-41c5-96cd-4b1133955aa1 for instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 on n-h2-860863-4 Nov 02 21:40:33.639422 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dfd86571-32a7-4403-9a8a-b05dd73918f0 req-d6651701-5d5e-4603-8be1-37a0c2870ff6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078826 Nov 02 21:40:33.641023 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1887/3901] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:33.738858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:33.752106 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e1c4a3d-bf8e-4784-85ad-94ea46e41e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 1.230733 Nov 02 21:40:33.754344 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2015/3902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:32 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:34.094870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f2a0d8db-11d2-4044-97fa-669b3fe321f9 req-13d6eb0f-0bdd-4b0b-93b7-5d19758b251b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889e113c-b228-4f42-adc8-e91298522ae5", "name": "network-vif-plugged", "status": "completed", "tag": "c6c5387e-b503-44b2-be6e-fdf5de38ac8a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:34.103391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1180066901", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:34.123102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f2a0d8db-11d2-4044-97fa-669b3fe321f9 req-13d6eb0f-0bdd-4b0b-93b7-5d19758b251b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:34.127143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f2a0d8db-11d2-4044-97fa-669b3fe321f9 req-13d6eb0f-0bdd-4b0b-93b7-5d19758b251b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:34.129220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f2a0d8db-11d2-4044-97fa-669b3fe321f9 req-13d6eb0f-0bdd-4b0b-93b7-5d19758b251b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:34.192486 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f2a0d8db-11d2-4044-97fa-669b3fe321f9 req-13d6eb0f-0bdd-4b0b-93b7-5d19758b251b service nova] Creating event network-vif-plugged:c6c5387e-b503-44b2-be6e-fdf5de38ac8a for instance 889e113c-b228-4f42-adc8-e91298522ae5 on n-h2-860863-4 Nov 02 21:40:34.221703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] validate_networks() for [('ff24d271-215e-4ac8-a089-45fadb53a44f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:40:34.223471 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f2a0d8db-11d2-4044-97fa-669b3fe321f9 req-13d6eb0f-0bdd-4b0b-93b7-5d19758b251b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134926 Nov 02 21:40:34.225213 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2016/3903] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:40:34.585971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:34.586961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:34.602596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:34.603344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:34.604641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:34.605808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:34.606492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:34.607088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:35.128817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:35.168128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf126b98-1641-4db5-987b-7551d7db5fe5 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.587916 Nov 02 21:40:35.171573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2017/3904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:34 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:35.194979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:35.199007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:35.219143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:35.220144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:35.220760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:35.233212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:35.234502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:35.235790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:35.351258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:40:35.352325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:40:35.352816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:40:35.353258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:40:35.354915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:40:35.364543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:35.365523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:35.366701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:35.367908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:35.368293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:35.368943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:35.397156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Getting quotas for project b54336bd203349df8f80e3d58b44ff6c. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:40:35.406263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Getting quotas for user dd770afb196045d49b37ccb05c6afcd7 and project b54336bd203349df8f80e3d58b44ff6c. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:40:35.429576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:40:35.433462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:40:35.607490 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-787b3e58-816e-4380-bb56-28281972e247 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.962929 Nov 02 21:40:35.609015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1888/3905] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:40:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:40:35.622332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dbf481ee-33d4-4dbc-ab40-9ad284223af3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:35.623561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dbf481ee-33d4-4dbc-ab40-9ad284223af3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:35.626443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:35.639388 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-30acf473-dcb9-4de2-86e7-ce292a097e73 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1315 microversion: 2.1 time: 0.465339 Nov 02 21:40:35.640678 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2018/3906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:35 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:35.726764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dbf481ee-33d4-4dbc-ab40-9ad284223af3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:35.734716 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dbf481ee-33d4-4dbc-ab40-9ad284223af3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1223 microversion: 2.1 time: 0.117790 Nov 02 21:40:35.751418 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1889/3907] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:35 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:36.198998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:36.199654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:36.217032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:36.217760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:36.218208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:36.218918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:36.219377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:36.219808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:36.443123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:36.454230 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89548e66-771a-4997-9a86-b17d71363ba7 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.259490 Nov 02 21:40:36.456439 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2019/3908] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:36 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:36.665604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:36.666781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:36.691628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:36.692133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:36.692583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:36.694865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:36.695366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:36.696697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:36.766034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-caa1a312-173f-4fc3-acc3-df57f60caaaa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:36.766855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-caa1a312-173f-4fc3-acc3-df57f60caaaa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:36.937886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-caa1a312-173f-4fc3-acc3-df57f60caaaa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:36.945529 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-caa1a312-173f-4fc3-acc3-df57f60caaaa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1223 microversion: 2.1 time: 0.189078 Nov 02 21:40:36.951580 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2020/3909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:36 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1223 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:36.975524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3e21c93a-2436-4e6a-9717-c2b263f07815 req-0a2fc671-c376-429e-8693-e9deed8d2b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4919de14-4362-4d7b-ba9c-9679717b62a4", "name": "network-vif-plugged", "status": "completed", "tag": "3b045895-4443-4ef3-bfb1-40527c0c2ac6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:37.029589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3e21c93a-2436-4e6a-9717-c2b263f07815 req-0a2fc671-c376-429e-8693-e9deed8d2b99 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:37.032649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3e21c93a-2436-4e6a-9717-c2b263f07815 req-0a2fc671-c376-429e-8693-e9deed8d2b99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:37.033352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3e21c93a-2436-4e6a-9717-c2b263f07815 req-0a2fc671-c376-429e-8693-e9deed8d2b99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:37.058480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:37.070348 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e8a20e40-15db-4e7a-908a-90aa1dc60d5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1501 microversion: 2.1 time: 0.410408 Nov 02 21:40:37.073646 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3e21c93a-2436-4e6a-9717-c2b263f07815 req-0a2fc671-c376-429e-8693-e9deed8d2b99 service nova] Creating event network-vif-plugged:3b045895-4443-4ef3-bfb1-40527c0c2ac6 for instance 4919de14-4362-4d7b-ba9c-9679717b62a4 on n-h1-860863-4 Nov 02 21:40:37.090965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3e21c93a-2436-4e6a-9717-c2b263f07815 req-0a2fc671-c376-429e-8693-e9deed8d2b99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131765 Nov 02 21:40:37.095179 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1890/3910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:36 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1501 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:37.096120 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2021/3911] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:37.101714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:37.122147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:37.131494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:37.132191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:37.132790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:37.133773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:37.134551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:37.138545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:37.345953 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e83a11dc-839f-42bc-a336-964633de15e0 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.248341 Nov 02 21:40:37.347057 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1891/3912] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:40:37 2022] POST /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:40:37.356850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:37.357769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:37.371055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:37.376014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:37.376014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:37.376014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:37.376014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:37.376014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:37.485233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:37.486260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:37.497879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:37.498509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:37.499059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:37.507221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:37.509030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:37.510291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:37.788448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:37.830205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98a530ff-e9b5-4a98-b9f5-75b5ffdcc1fb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1506 microversion: 2.1 time: 0.474797 Nov 02 21:40:37.834956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2022/3913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:37 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:37.935482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:37.951555 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ae189a9-b90a-408f-a006-27402fd7a75a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1370 microversion: 2.1 time: 0.470876 Nov 02 21:40:37.952162 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1892/3914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:37 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1370 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:37.983785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:37.984658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:38.003810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:38.004351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:38.005055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:38.007012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:38.007701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:38.009009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:38.126028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:38.140190 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd6c484d-536a-4ab4-807e-131ba15720ce tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1219 microversion: 2.1 time: 0.162970 Nov 02 21:40:38.140817 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2023/3915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:37 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:38.866099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:38.871364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:38.887061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:38.887061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:38.887061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:38.890567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:38.891157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:38.891614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:38.930389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:38.975349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:38.976115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:38.991448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:38.992757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:38.993400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:38.994345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:38.994957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:38.995540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.172610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:39.182915 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9a3fbe8-413a-4d20-b445-69387f963833 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1486 microversion: 2.1 time: 0.328032 Nov 02 21:40:39.193124 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1893/3916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:38 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1486 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:39.199122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:39.200009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:39.207862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.208698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.209233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.212671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.212671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.212671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.238507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:39.251533 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6a220ae3-8bec-4cef-843c-fc7141ac9dde tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1556 microversion: 2.1 time: 0.280286 Nov 02 21:40:39.254103 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2024/3917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:38 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1556 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:39.262542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:39.263288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:39.271945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.272905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.273910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.274968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.276158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.276975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.301300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lazy-loading 'flavor' on Instance uuid 889e113c-b228-4f42-adc8-e91298522ae5 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:40:39.307235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:39.357963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:39.369574 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92914bf6-c946-4fcd-9c26-470351beb095 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1283 microversion: 2.1 time: 0.184684 Nov 02 21:40:39.391944 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1894/3918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:39 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:39.398454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:39.412452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:39.425315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.426160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.426827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.427818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.429427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.430288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.568971 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-448be3b7-c8f3-4b03-b062-ddffd3851e15 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177045 Nov 02 21:40:39.569556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1895/3919] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:40:39 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:39.909770 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-87874edc-2123-41f3-8790-4ca89b22f759 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.654119 Nov 02 21:40:39.910385 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2025/3920] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:40:39 2022] POST /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:40:39.920362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:39.921023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:39.931400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.932475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.932880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:39.937839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:39.938571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:39.939745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:40.402985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:40.406338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:40.415016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:40.415584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:40.419044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:40.419044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:40.419044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:40.419044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:40.589203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:40.597548 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-803710f9-3579-43d5-ad76-de8010de6669 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1281 microversion: 2.1 time: 0.200989 Nov 02 21:40:40.598154 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2026/3921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:40 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:40.653083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:40.663011 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-13640d13-b82e-440f-921d-1b6578553e4a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1492 microversion: 2.1 time: 0.747427 Nov 02 21:40:40.667804 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1896/3922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:39 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1492 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:40.921327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7cab45f7-515f-4bda-b1f1-2aec0ac57cf6 req-d1c46ebf-190d-4eca-bd37-bcef28039f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4919de14-4362-4d7b-ba9c-9679717b62a4", "tag": "3b045895-4443-4ef3-bfb1-40527c0c2ac6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:40.947994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7cab45f7-515f-4bda-b1f1-2aec0ac57cf6 req-d1c46ebf-190d-4eca-bd37-bcef28039f38 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:40.954326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7cab45f7-515f-4bda-b1f1-2aec0ac57cf6 req-d1c46ebf-190d-4eca-bd37-bcef28039f38 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:40.954865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7cab45f7-515f-4bda-b1f1-2aec0ac57cf6 req-d1c46ebf-190d-4eca-bd37-bcef28039f38 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:40.976483 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7cab45f7-515f-4bda-b1f1-2aec0ac57cf6 req-d1c46ebf-190d-4eca-bd37-bcef28039f38 service nova] Creating event network-changed:3b045895-4443-4ef3-bfb1-40527c0c2ac6 for instance 4919de14-4362-4d7b-ba9c-9679717b62a4 on n-h1-860863-4 Nov 02 21:40:40.987728 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7cab45f7-515f-4bda-b1f1-2aec0ac57cf6 req-d1c46ebf-190d-4eca-bd37-bcef28039f38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075881 Nov 02 21:40:40.990844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2027/3923] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:41.626554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:41.627089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:41.639976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:41.640759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:41.642053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:41.642963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:41.649776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:41.651024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:41.691841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:41.693129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:41.710987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:41.721729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:41.725510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:41.726418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:41.730256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:41.730256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:42.189030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:42.200856 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5b3a3e83-bfc4-4e5f-9605-242810d34b4c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1323 microversion: 2.1 time: 0.582411 Nov 02 21:40:42.219053 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1897/3924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:41 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1323 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:42.243852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:42.279721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f71effbf-d086-4e79-9c46-738734699f40 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1513 microversion: 2.1 time: 0.591941 Nov 02 21:40:42.280995 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2028/3925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:41 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1513 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:42.929889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f89ed145-1a10-47d9-bb45-e0848be50b65 req-456674d2-6dab-4ddc-8770-fddb5896ff8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dd2951-b13b-4c9b-b5bb-304607ec7a26", "tag": "bd873c1a-a8dc-4aac-9b91-45b8032f5400"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:42.972424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f89ed145-1a10-47d9-bb45-e0848be50b65 req-456674d2-6dab-4ddc-8770-fddb5896ff8f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:42.978187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f89ed145-1a10-47d9-bb45-e0848be50b65 req-456674d2-6dab-4ddc-8770-fddb5896ff8f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:42.978187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f89ed145-1a10-47d9-bb45-e0848be50b65 req-456674d2-6dab-4ddc-8770-fddb5896ff8f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:42.989259 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f89ed145-1a10-47d9-bb45-e0848be50b65 req-456674d2-6dab-4ddc-8770-fddb5896ff8f service nova] Creating event network-changed:bd873c1a-a8dc-4aac-9b91-45b8032f5400 for instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 on n-h2-860863-4 Nov 02 21:40:42.996124 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f89ed145-1a10-47d9-bb45-e0848be50b65 req-456674d2-6dab-4ddc-8770-fddb5896ff8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069423 Nov 02 21:40:42.996962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1898/3926] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:43.230859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:43.231783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:43.234959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-17333e4b-a3c6-49fb-b531-9463ac32a389 req-97393640-b047-4e9a-ad69-6574ccc03e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889e113c-b228-4f42-adc8-e91298522ae5", "name": "network-vif-plugged", "status": "completed", "tag": "c6c5387e-b503-44b2-be6e-fdf5de38ac8a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:43.243704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:43.245169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:43.247271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:43.248029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:43.248499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:43.250290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-17333e4b-a3c6-49fb-b531-9463ac32a389 req-97393640-b047-4e9a-ad69-6574ccc03e76 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:43.250770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-17333e4b-a3c6-49fb-b531-9463ac32a389 req-97393640-b047-4e9a-ad69-6574ccc03e76 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:43.251203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-17333e4b-a3c6-49fb-b531-9463ac32a389 req-97393640-b047-4e9a-ad69-6574ccc03e76 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:43.253598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:43.274779 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-17333e4b-a3c6-49fb-b531-9463ac32a389 req-97393640-b047-4e9a-ad69-6574ccc03e76 service nova] Creating event network-vif-plugged:c6c5387e-b503-44b2-be6e-fdf5de38ac8a for instance 889e113c-b228-4f42-adc8-e91298522ae5 on n-h2-860863-4 Nov 02 21:40:43.285433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-17333e4b-a3c6-49fb-b531-9463ac32a389 req-97393640-b047-4e9a-ad69-6574ccc03e76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059300 Nov 02 21:40:43.293539 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2029/3927] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:40:43.311199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:43.312735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:43.321624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:43.323174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:43.323873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:43.324804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:43.325510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:43.326396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:43.707322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:43.721718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:43.732135 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-49eedc2b-fe05-43cb-a9e7-2a3937c4902a tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1323 microversion: 2.1 time: 0.506144 Nov 02 21:40:43.732818 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1899/3928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:43 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1323 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:43.734343 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-06c6db58-a191-4b7e-8864-184442a7eb5f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.431811 Nov 02 21:40:43.752462 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2030/3929] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:43 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:44.757157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:44.757778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:44.761221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:44.763168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:44.769957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:44.770741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:44.771354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:44.778147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:44.778147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:44.778352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:44.778468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:44.778546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:44.778546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:44.778788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:44.778788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:44.778788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:45.052581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:45.064291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:45.064487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50f02742-0faf-49f8-aa73-00cd1a4e50c3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.307551 Nov 02 21:40:45.064487 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2031/3930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:44 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:45.074037 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f473ded6-528d-48b0-b4f8-8ac78998f2cc tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1323 microversion: 2.1 time: 0.319903 Nov 02 21:40:45.074638 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1900/3931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:44 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:46.107197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:46.107812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:46.112390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:46.115289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:46.121057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:46.124634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:46.124634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:46.124634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:46.124634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:46.124634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:46.135964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:46.137465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:46.140402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:46.141308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:46.142052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:46.143411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:46.144040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:46.144680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:46.576707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:46.591488 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7eb0cdd0-fbb7-4b1d-b99a-bf7898398e58 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1323 microversion: 2.1 time: 0.487657 Nov 02 21:40:46.618664 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2032/3932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:46 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:46.626720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:46.635518 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-848a2405-5c49-4cb2-92fe-e803111cf44b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.530428 Nov 02 21:40:46.640681 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1901/3933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:46 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:47.621675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:47.623047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:47.630685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:47.633891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=74 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:47.639212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:47.642608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:47.643240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:47.648360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:47.648360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:47.648360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:47.666924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:47.676287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:47.683180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:47.683900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:47.684495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:47.685446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:47.688861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:47.689498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:48.209835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:48.221858 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97f6dc41-187f-4acc-b7c7-8552c9407689 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.558789 Nov 02 21:40:48.223604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:48.241374 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1902/3934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:47 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:48.247274 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c405458c-c4cb-4a9a-9e9a-298939e5fa43 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1323 microversion: 2.1 time: 0.630156 Nov 02 21:40:48.248043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2033/3935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:47 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1323 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:49.253425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:49.254160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:49.277324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:49.281300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:49.284336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:49.284857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:49.286936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:49.291924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:49.292643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:49.297051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:49.309181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:49.310399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:49.311387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:49.312726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:49.316001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:49.316797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:49.679733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:49.702057 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48cbd6aa-8b07-41e9-95be-536ac8f7af21 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1323 microversion: 2.1 time: 0.428974 Nov 02 21:40:49.703459 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2034/3936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:49 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:49.777882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:49.787952 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e6a941ac-18ee-4617-9773-7e9463b0ab0e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.541847 Nov 02 21:40:49.814133 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1903/3937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:49 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:50.026257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e368aed9-8092-48af-9aab-0093e7bbe3eb req-0bb46cd8-96ca-4fd9-b7ee-306fffca4f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dd2951-b13b-4c9b-b5bb-304607ec7a26", "name": "network-vif-plugged", "status": "completed", "tag": "bd873c1a-a8dc-4aac-9b91-45b8032f5400"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:50.044896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e368aed9-8092-48af-9aab-0093e7bbe3eb req-0bb46cd8-96ca-4fd9-b7ee-306fffca4f68 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:50.045817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e368aed9-8092-48af-9aab-0093e7bbe3eb req-0bb46cd8-96ca-4fd9-b7ee-306fffca4f68 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:50.046439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e368aed9-8092-48af-9aab-0093e7bbe3eb req-0bb46cd8-96ca-4fd9-b7ee-306fffca4f68 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:50.059128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e368aed9-8092-48af-9aab-0093e7bbe3eb req-0bb46cd8-96ca-4fd9-b7ee-306fffca4f68 service nova] Creating event network-vif-plugged:bd873c1a-a8dc-4aac-9b91-45b8032f5400 for instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 on n-h2-860863-4 Nov 02 21:40:50.064664 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e368aed9-8092-48af-9aab-0093e7bbe3eb req-0bb46cd8-96ca-4fd9-b7ee-306fffca4f68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045531 Nov 02 21:40:50.065863 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2035/3938] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:40:50.728810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:50.730192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:50.761946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:50.763652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:50.764340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:50.766686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:50.767484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:50.768559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:50.826925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:50.827663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:50.852249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:50.858701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:50.859621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:50.863454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:50.863454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:50.863454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:51.214890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:51.223762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-214afea9-03bd-458f-b035-ed603bc301aa tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1323 microversion: 2.1 time: 0.501571 Nov 02 21:40:51.226207 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1904/3939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:50 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:51.343140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:51.357229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7629622-f0bc-4d7b-82f2-7be8a4e3fde2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.538289 Nov 02 21:40:51.361903 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2036/3940] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:50 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:52.249679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:52.251032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:52.261361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:52.262783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:52.263444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:52.264555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:52.265369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:52.266050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:52.391206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:52.391924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:52.414423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:52.427102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:52.428821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:52.432050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:52.433586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:52.435985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:52.530267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:52.538814 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb0c8cad-3b44-46b3-901e-bc635566e8c2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1519 microversion: 2.1 time: 0.293282 Nov 02 21:40:52.553205 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1905/3941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:52 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:52.567623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:40:52.570178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:52.593238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:52.593736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:52.594172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:52.594881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:52.595335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:52.595759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:52.680753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lazy-loading 'flavor' on Instance uuid 10dd2951-b13b-4c9b-b5bb-304607ec7a26 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:40:53.147011 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b795651-f121-4bb0-82c7-4038486e0274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action" status: 200 len: 32 microversion: 2.1 time: 0.583290 Nov 02 21:40:53.152854 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1906/3942] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:40:52 2022] POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action => generated 32 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 21:40:53.160582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:53.161559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:53.171117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:53.172503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:53.173173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:53.174014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:53.176401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:53.177099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:53.227849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:53.239726 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60f049ee-9fc4-4783-9fce-1a5b34eb7e19 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.852807 Nov 02 21:40:53.253298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2037/3943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:52 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:53.458967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:53.473948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-84a603ae-f10d-4b22-9a52-d1ae0241434b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.317881 Nov 02 21:40:53.474912 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1907/3944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:53 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:54.281023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:54.282406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:54.298069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:54.299464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:54.300025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:54.303149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:54.303740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:54.304391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:54.500240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:54.501605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:54.502465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:54.508695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:54.509207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:54.510488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:54.511420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:54.511980 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f0b94cc-8fd9-460d-9689-fd15bac46a86 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.235194 Nov 02 21:40:54.512301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:54.512723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:54.512852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2038/3945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:54 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:54.665442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:54.667997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:54.675392 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cde5e2bf-ec31-4991-a340-ab784948871f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.179017 Nov 02 21:40:54.676127 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1908/3946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:54 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:55.538227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:55.540092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:55.561834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:55.562917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:55.563873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:55.564979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:55.565809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:55.566594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:55.713086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:55.713086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:55.716857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:55.717649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:55.718263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:55.719223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:55.719915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:55.720675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:55.849451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:55.860698 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-115a84d8-88d1-440a-bad5-b2a078abb8ac tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.326292 Nov 02 21:40:55.883990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2039/3947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:55 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:55.969962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:55.977028 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-33f5174f-cce0-4405-a496-d6d9e2c3a48d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.280606 Nov 02 21:40:55.978211 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1909/3948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:55 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:56.893279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:56.893859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:56.927674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:56.928257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:56.928705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:56.929636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:56.930265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:56.930852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:57.006369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:57.007007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:57.023898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:57.026012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:57.029631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:57.030456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:57.030942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:57.034005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:57.747402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:57.770491 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52aeef1c-7e52-40cb-8df6-78223ff54bc2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.881865 Nov 02 21:40:57.771920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:57.798015 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2040/3949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:56 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:57.798194 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1a333b9-b759-479c-8788-c5b5e9c7ed6d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.795077 Nov 02 21:40:57.799220 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1910/3950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:57 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:40:58.801562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:58.802901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:58.816071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:58.820080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:58.820892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:58.823967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:58.824701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:58.825056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:40:58.826369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:40:58.827257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:58.833791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:40:58.835807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:58.836728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:58.837484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:58.838512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:40:58.839161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:40:58.839788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:40:59.128121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:59.156791 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61d60b17-4f9d-411c-bac4-063c556e3206 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.336786 Nov 02 21:40:59.170147 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1911/3951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:58 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:40:59.194706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:40:59.207158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b19f7c0f-f4fe-4706-8ec1-e7bb1d45b046 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.410452 Nov 02 21:40:59.208808 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2041/3952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:40:58 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:00.188780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:00.189523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:00.203052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:00.203899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:00.204561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:00.205540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:00.206167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:00.206930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:00.242889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:00.243773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:00.254089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:00.256806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:00.258368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:00.259977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:00.262041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:00.263990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:00.302434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:00.602014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:00.602014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a5604a6b-4042-4a40-8f15-013f98ff0528 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.394431 Nov 02 21:41:00.602014 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1912/3953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:00 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:00.602470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:00.602470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-614fd02a-083b-406c-af26-c3acd395e9de tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.350372 Nov 02 21:41:00.602470 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2042/3954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:00 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:01.623625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:01.624179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:01.624563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:01.625493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:01.633808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:01.634903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:01.635267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:01.635966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:01.636513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:01.644662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:01.645466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:01.645466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:01.645904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:01.647072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:01.647702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:01.648687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:01.857861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:01.862173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:01.878528 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3daac5e4-a13c-40c3-a817-7f262ddf118c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.259478 Nov 02 21:41:01.879223 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1913/3955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:01 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:01.882881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-096ff87d-e613-4ebe-981f-3632b4e8841c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.262788 Nov 02 21:41:01.883523 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2043/3956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:01 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:02.904760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:02.906094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:02.913452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:02.915657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:02.929643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:02.930425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:02.930770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:02.931401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:02.934271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:02.934398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:02.934569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:02.934713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:02.934815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:02.934925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:02.935361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:02.935972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:03.217007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:03.237390 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1e56d17-ea79-4eb8-8d62-200df1bf00a8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1505 microversion: 2.1 time: 0.336681 Nov 02 21:41:03.239300 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1914/3957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:02 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:03.308500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:03.317516 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-419f8043-b41f-42c0-bb4a-c8798ea5966d tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.408231 Nov 02 21:41:03.318280 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2044/3958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:02 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:04.269265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:04.270559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:04.278975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:04.279482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:04.279926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:04.280629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:04.281212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:04.281650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:04.349143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:04.351135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:04.359143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:04.359634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:04.360076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:04.361021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:04.361513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:04.361949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:04.900406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:04.920521 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a745326d-5ed6-401f-a825-6e88a1f3168d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1505 microversion: 2.1 time: 0.654260 Nov 02 21:41:04.924572 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1915/3959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:04 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1505 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:04.941630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:04.962060 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-59ca5218-2305-4d0b-97e7-f3f33c6b76e7 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.621042 Nov 02 21:41:04.963550 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2045/3960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:04 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:05.476901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:05.478579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:05.486254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:05.487050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:05.487653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:05.488836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:05.489489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:05.490079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:05.517977 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e029f37f-dfe9-4ae2-a240-0e17aec4f52e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/ips" status: 200 len: 148 microversion: 2.1 time: 0.044843 Nov 02 21:41:05.519182 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1916/3961] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:41:05 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:05.833566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-81c6e67f-998f-4d56-b9e3-2f0c4668baa4 req-728bdf10-0c9d-49e3-8289-76e84e3533c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889e113c-b228-4f42-adc8-e91298522ae5", "name": "network-vif-unplugged", "status": "completed", "tag": "c6c5387e-b503-44b2-be6e-fdf5de38ac8a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:05.858624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-81c6e67f-998f-4d56-b9e3-2f0c4668baa4 req-728bdf10-0c9d-49e3-8289-76e84e3533c5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:05.859475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-81c6e67f-998f-4d56-b9e3-2f0c4668baa4 req-728bdf10-0c9d-49e3-8289-76e84e3533c5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:05.860036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-81c6e67f-998f-4d56-b9e3-2f0c4668baa4 req-728bdf10-0c9d-49e3-8289-76e84e3533c5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:05.873182 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-81c6e67f-998f-4d56-b9e3-2f0c4668baa4 req-728bdf10-0c9d-49e3-8289-76e84e3533c5 service nova] Creating event network-vif-unplugged:c6c5387e-b503-44b2-be6e-fdf5de38ac8a for instance 889e113c-b228-4f42-adc8-e91298522ae5 on n-h2-860863-4 Nov 02 21:41:05.880599 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-81c6e67f-998f-4d56-b9e3-2f0c4668baa4 req-728bdf10-0c9d-49e3-8289-76e84e3533c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050625 Nov 02 21:41:05.881894 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2046/3962] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:05.946528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:05.947722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:05.956772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:05.957302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:05.957792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:05.958460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:05.958924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:05.959357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:05.994220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:05.996151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:06.018458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:06.020478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:06.022901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:06.023910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:06.026254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:06.027819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:06.467846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:06.483163 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3608e7d9-6dc9-4bd1-ab79-93ca7c73f265 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.493093 Nov 02 21:41:06.488505 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2047/3963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:05 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:06.530245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:06.542316 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-892a3f22-261d-43f6-81a0-ba472cc5b9b5 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 200 len: 1508 microversion: 2.1 time: 0.598486 Nov 02 21:41:06.543267 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1917/3964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:05 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 1508 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:06.578784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:06.578784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:06.579163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:06.579669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:06.580152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:06.581682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:06.582156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:06.582595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.062632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:07.072319 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0518f1fd-198f-4898-829f-372cc07bed64 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.507061 Nov 02 21:41:07.073977 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2048/3965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:06 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:07.102305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:07.103234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:07.109549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.110312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.110924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.111633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.112181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.112614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.355044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:07.363397 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1217fed-a3ff-4c84-8b8e-b2d94e10e94b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.264936 Nov 02 21:41:07.364071 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1918/3966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:07 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:07.392708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:07.393513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:07.401861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.402449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.402970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.403778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.404309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.404815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.514536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:07.515464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:07.522550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.523049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.523488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.524425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.525074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.525664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.676992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:07.686022 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf3f7b07-2ffe-4386-a560-5a2cdbc8e5b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.297200 Nov 02 21:41:07.686837 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2049/3967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:07 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:07.708503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:07.709272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:07.715892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.717520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.718050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.718852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:07.719395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:07.719898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:07.831655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:07.857253 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-148dcfc7-4b8e-445e-ae15-06ce67f04bc1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.346987 Nov 02 21:41:07.872448 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1919/3968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:07 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:07.992127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:08.001474 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0e9a545-95c3-4a23-8e99-6012b00bc438 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.296563 Nov 02 21:41:08.002818 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2050/3969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:07 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:08.028863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c900284a-7fad-4a03-bfb3-dca3c5157b5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:08.039488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c900284a-7fad-4a03-bfb3-dca3c5157b5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:08.039990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c900284a-7fad-4a03-bfb3-dca3c5157b5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:08.040601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c900284a-7fad-4a03-bfb3-dca3c5157b5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:08.065867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c900284a-7fad-4a03-bfb3-dca3c5157b5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Going to try to stop instance {{(pid=121039) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:41:08.334499 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c900284a-7fad-4a03-bfb3-dca3c5157b5e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.311444 Nov 02 21:41:08.335812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1920/3970] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:08 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:08.351589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:08.352362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:08.367961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:08.369486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:08.369916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:08.370629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:08.371090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:08.371519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:08.526273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:08.534607 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61a05d49-c8e8-48bd-aa45-7d733723a3cc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.194706 Nov 02 21:41:08.535467 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2051/3971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:08 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:08.724446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88e12f37-aa6b-41f0-a5d0-5ef04f26cce8"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:08.727028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:08.735993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:08.736638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:08.737547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:08.738570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:08.739166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:08.739736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:08.882646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:08.883188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:08.891216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:08.891628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:08.892067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:08.892764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:08.893246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:08.893729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:09.056505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:09.067747 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a73d8d57-af20-449a-9b63-ac2788fbd096 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.188672 Nov 02 21:41:09.069007 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2052/3972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:08 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:09.562845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:09.564540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:09.573198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:09.574655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:09.575350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:09.582425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:09.582425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:09.582425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:09.655208 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24e23877-98de-4330-a43e-6c4c6c0ce185 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.934857 Nov 02 21:41:09.655827 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1921/3973] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:41:08 2022] POST /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:09.788909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:09.797881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1b56a84-c7f6-4d7b-8571-9ac68d668192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.243035 Nov 02 21:41:09.798474 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2053/3974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:09 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:10.097317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:10.098052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:10.116778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:10.119152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:10.119152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:10.119152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:10.119152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:10.119531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:10.362731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:10.372525 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da7227a7-bb01-44f1-9b20-1b1fa284696f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.281528 Nov 02 21:41:10.373507 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1922/3975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:10 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:10.823954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:10.825266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:10.836739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:10.839506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:10.839905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:10.840641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:10.845028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:10.845780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:11.165212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:11.178166 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16270bb5-3f4a-40bf-915e-fade6611d376 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.358630 Nov 02 21:41:11.194340 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2054/3976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:10 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:11.397888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:11.398573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:11.407922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:11.408713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:11.409327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:11.410085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:11.410718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:11.411148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:11.426544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:11.553555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:11.563288 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-efa0ac11-e532-4d5c-a939-1e08bb47869c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.169116 Nov 02 21:41:11.585763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1923/3977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:11 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:12.218780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:12.219375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:12.226498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:12.226993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:12.227447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:12.228940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:12.229409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:12.230231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:12.416974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:12.433391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09246a13-9137-4f36-8316-235912d0c461 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.219944 Nov 02 21:41:12.434641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2055/3978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:12 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:12.595877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:12.597151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:12.610043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:12.610915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:12.611444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:12.613262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:12.614324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:12.615033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:12.822901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:12.834229 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-66822a83-3c2f-4401-9001-bcbade725ced tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.241740 Nov 02 21:41:12.847113 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1924/3979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:12 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:13.470045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:13.471376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:13.489341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:13.490900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:13.491486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:13.494247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:13.495141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:13.496438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:13.704269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:13.715347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2da8cdbe-9138-4933-bbd6-d022b48b45f4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.252059 Nov 02 21:41:13.716634 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2056/3980] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:13 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:13.871888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:13.872467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:13.880871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:13.881382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:13.881829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:13.882541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:13.883142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:13.883762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:14.075262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:14.085816 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fdfb4dac-0cf3-48f8-a318-877a7d0f4aab tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.218094 Nov 02 21:41:14.086941 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1925/3981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:13 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:14.744229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:14.745257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:14.752393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:14.753214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:14.753777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:14.754783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:14.755351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:14.756070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:14.982930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:14.997433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-129e5a35-e522-48ec-81df-95f731133754 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.257491 Nov 02 21:41:14.998897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2057/3982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:14 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:15.110800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:15.112434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:15.122406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:15.122957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:15.123663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:15.124584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:15.125250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:15.125702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:15.313875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:15.324124 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3cb43343-c11c-475b-8adb-b51778d87a48 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.217635 Nov 02 21:41:15.325261 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1926/3983] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:15 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:16.024187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:16.025442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:16.041833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:16.042336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:16.042781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:16.043497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:16.043952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:16.044388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:16.229277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:16.246620 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a8431b6-d2d8-4511-bc6d-c69af7da0eb9 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.227900 Nov 02 21:41:16.254818 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2058/3984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:16 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:16.357100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:16.357730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:16.388823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:16.389354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:16.397396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:16.401580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:16.402271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:16.402891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:16.686077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:16.694096 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f4225a56-3f0e-4ebc-aefa-48139ef6ae9c tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.350036 Nov 02 21:41:16.694674 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1927/3985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:16 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:17.273214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:17.274032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:17.283152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:17.284028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:17.284758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:17.285756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:17.286434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:17.287081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:17.450523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:17.453031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:17.459392 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdee5739-c54e-4924-a233-9ad4466276b3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.191264 Nov 02 21:41:17.464537 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2059/3986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:17 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:17.718076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:17.718692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:17.725790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:17.726286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:17.726729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:17.727466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:17.728904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:17.729367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:17.911046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:17.919364 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2627226b-f822-47e7-a340-b28f5c6cfce3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.205167 Nov 02 21:41:17.919939 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1928/3987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:17 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:18.485754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:18.487044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:18.493733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=54 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:18.495556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:18.496267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:18.496923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:18.497865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:18.498550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:18.499434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:18.764408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:18.779120 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b6ca5cfe-ab47-49c0-8d76-387415262b98 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1678 microversion: 2.1 time: 0.295131 Nov 02 21:41:18.784414 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2060/3988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:18 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1678 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:18.945599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:18.950548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:18.953678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:18.954345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:18.954973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:18.955903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:18.956705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:18.957375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:19.576964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:19.597546 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e2f48b0c-8725-4615-a6ff-eb6cd19b7ada tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.648681 Nov 02 21:41:19.600505 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1929/3989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:18 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:19.807833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:19.810838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:19.820005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:19.820683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:19.821151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:19.823783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:19.824503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:19.825046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:20.096686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:20.124414 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15d38f48-b37e-4865-8262-3f429e626c92 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1655 microversion: 2.1 time: 0.322352 Nov 02 21:41:20.126039 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2061/3990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:19 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1655 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:20.149548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8758c83d-0be4-4a39-908e-f531b434f5dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:20.159673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8758c83d-0be4-4a39-908e-f531b434f5dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:20.160627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8758c83d-0be4-4a39-908e-f531b434f5dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:20.161846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8758c83d-0be4-4a39-908e-f531b434f5dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:20.192276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8758c83d-0be4-4a39-908e-f531b434f5dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Going to try to start instance {{(pid=121039) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 21:41:20.416091 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8758c83d-0be4-4a39-908e-f531b434f5dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.269457 Nov 02 21:41:20.417993 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1930/3991] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:20 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:20.436114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:20.436837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:20.444486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:20.445029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:20.445477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:20.446217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:20.446788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:20.447312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:20.642782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:20.643904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:20.656276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:20.659164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:20.659844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:20.665765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:20.667767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:20.668402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:20.844008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:20.854080 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4df9b18b-a67d-4ba8-8cb2-28ffa807e7e2 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1664 microversion: 2.1 time: 0.427490 Nov 02 21:41:20.854961 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2062/3992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:20 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1664 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:20.859975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a02aa836-dc89-4870-b63a-fb17bce7cb96"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:20.863180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:20.869726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:20.870308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:20.870814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:20.871758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:20.872278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:20.872889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:21.031182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:21.038879 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4016500c-9c5d-4707-8ee3-ecce6d9d1cf1 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.413403 Nov 02 21:41:21.039452 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1931/3993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:20 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:21.708146 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4416ab28-65a4-4cf6-ae0d-d21160692988 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "POST /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851666 Nov 02 21:41:21.709304 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2063/3994] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:41:20 2022] POST /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:21.880966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:21.882300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:21.891345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:21.892630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:21.893180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:21.894112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:21.894930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:21.895576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:22.064015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:22.065103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:22.080842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:22.081645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:22.082092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:22.082816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:22.083271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:22.083906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:22.100084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:22.111607 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22d78f17-fab2-4d1c-868b-7d3842d89345 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1664 microversion: 2.1 time: 0.234418 Nov 02 21:41:22.128955 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1932/3995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:21 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1664 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:22.274466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:22.286754 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9943361b-55a7-48bb-a9c4-5a0872c798a6 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1525 microversion: 2.1 time: 0.227374 Nov 02 21:41:22.287750 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2064/3996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:22 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1525 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:23.143937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:23.144756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:23.159007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.159769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.160266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.163554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.166937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.172959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.307041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88e12f37-aa6b-41f0-a5d0-5ef04f26cce8"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:23.309674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:23.325403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.325918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.326372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.327118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.327615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.328064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.372035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:23.387708 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-927f48e4-46ad-4a18-b90e-7c954a10edf3 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.247641 Nov 02 21:41:23.397626 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1933/3997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:23 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:23.412300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:23.412955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:23.421390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.422761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.424155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.427851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.427851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.427851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.476227 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Invalid volume: volume 88e12f37-aa6b-41f0-a5d0-5ef04f26cce8 is already attached to instances: d75b7954-00b0-4504-88c7-6e5c0e4b21b6 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments HTTP/1.1 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 74 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: {"volumeAttachment": {"volumeId": "88e12f37-aa6b-41f0-a5d0-5ef04f26cce8"}} Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid volume: volume 88e12f37-aa6b-41f0-a5d0-5ef04f26cce8 is already attached to instances: d75b7954-00b0-4504-88c7-6e5c0e4b21b6 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': 'd75b7954-00b0-4504-88c7-6e5c0e4b21b6', 'body': {'volumeAttachment': {'volumeId': '88e12f37-aa6b-41f0-a5d0-5ef04f26cce8'}}} Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88e12f37-aa6b-41f0-a5d0-5ef04f26cce8 is already attached to instances: d75b7954-00b0-4504-88c7-6e5c0e4b21b6 Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:41:23.482530 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88e12f37-aa6b-41f0-a5d0-5ef04f26cce8 is already attached to instances: d75b7954-00b0-4504-88c7-6e5c0e4b21b6 Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88e12f37-aa6b-41f0-a5d0-5ef04f26cce8 is already attached to instances: d75b7954-00b0-4504-88c7-6e5c0e4b21b6 Nov 02 21:41:23.486429 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:23.489210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 400 to user: Invalid volume: volume 88e12f37-aa6b-41f0-a5d0-5ef04f26cce8 is already attached to instances: d75b7954-00b0-4504-88c7-6e5c0e4b21b6 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:41:23.492795 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d060b649-6398-4040-8042-9061ddd24e9a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.191159 Nov 02 21:41:23.501838 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2065/3998] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:41:23 2022] POST /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:41:23.506950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:23.507583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:23.520378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.520892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.521383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.525578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.526074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.526519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.621924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:23.631997 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f84496a5-30d5-4520-9163-be51d5775306 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1505 microversion: 2.1 time: 0.242514 Nov 02 21:41:23.632668 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1934/3999] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:23 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:23.655500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:23.656280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:23.663114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.663855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.664472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.666366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:23.667026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:23.667612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:23.738483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:23.742766 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ff2e5ea-dd91-4287-85ef-977d096081d8 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.239630 Nov 02 21:41:23.743974 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2066/4000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:23 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:23.769943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4d97eb9-ce73-4b21-8be8-fa97f292340b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'create', calling method: .version_select at 0x7f9b688063a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1914385589", "description": "tempest-description-325344739"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:23.831147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lazy-loading 'services' on Instance uuid d75b7954-00b0-4504-88c7-6e5c0e4b21b6 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:41:24.068132 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36a3c634-c969-41d2-913e-6b3a9185150b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments/88e12f37-aa6b-41f0-a5d0-5ef04f26cce8" status: 202 len: 0 microversion: 2.1 time: 0.434028 Nov 02 21:41:24.068958 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1935/4001] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:41:23 2022] DELETE /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments/88e12f37-aa6b-41f0-a5d0-5ef04f26cce8 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:24.074682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:24.075390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:24.105888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.106622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.113787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.113787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.113787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.113787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.277082 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4d97eb9-ce73-4b21-8be8-fa97f292340b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.526933 Nov 02 21:41:24.285885 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2067/4002] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:41:23 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:24.291295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:24.297616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:24.315100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.315786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.319060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.320829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.324168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.325496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.381116 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-91274a87-980f-4a9b-b319-ed2fb9cebd64 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093785 Nov 02 21:41:24.381704 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2068/4003] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:24 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:24.387506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1914385589"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:24.388363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:24.396253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.397368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.398025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.403816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.403816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.403816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.430367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:24.441959 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-66e3340e-9e24-43f8-9a44-fddbe208f0d4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.371067 Nov 02 21:41:24.442789 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1936/4004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:24 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:24.465273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:24.466130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:24.473493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.474264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.474855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.475717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.476754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.477390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.583190 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.security_group_api [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Adding security group 874fcf14-ace1-49c7-b330-cdc0884e74de to port bd873c1a-a8dc-4aac-9b91-45b8032f5400 Nov 02 21:41:24.729520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:24.738920 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-16aa6357-0a52-4b30-9fd7-d29704f7ecbc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.277819 Nov 02 21:41:24.740071 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1937/4005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:24 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:24.768492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:24.769874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:24.786555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.787063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.787517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.788238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:24.788706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:24.793491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:24.836376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:25.063267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:25.072701 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9121bcc9-0aef-4ed2-9119-31f59733b037 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.310594 Nov 02 21:41:25.076976 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1938/4006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:24 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:25.095606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:25.096262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:25.103350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.103975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.104414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.105097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.105547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.105969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.140130 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70e99159-91b1-46bb-b0f1-dd02395369e3 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action" status: 202 len: 0 microversion: 2.1 time: 0.756974 Nov 02 21:41:25.141956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2069/4007] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:24 2022] POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:25.150985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lazy-loading 'flavor' on Instance uuid 143a3b24-a0ff-43d1-b25f-83137a325d5b {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:41:25.151935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1914385589"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:25.155667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:25.162803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.163972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.164643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.166333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.167182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.167959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.354559 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.security_group_api [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Removing security group 874fcf14-ace1-49c7-b330-cdc0884e74de from port bd873c1a-a8dc-4aac-9b91-45b8032f5400 Nov 02 21:41:25.496040 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e1dfdbe-3e50-44b9-8964-f1431dc820ae tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.403848 Nov 02 21:41:25.499590 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1939/4008] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:25 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:41:25.509975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-fa9a35c9-6bd4-43db-89da-5cb7bca5024e req-944b7dc3-0ea9-4921-8669-044e0328da80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dd2951-b13b-4c9b-b5bb-304607ec7a26", "tag": "bd873c1a-a8dc-4aac-9b91-45b8032f5400"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:25.534600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa9a35c9-6bd4-43db-89da-5cb7bca5024e req-944b7dc3-0ea9-4921-8669-044e0328da80 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.535599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa9a35c9-6bd4-43db-89da-5cb7bca5024e req-944b7dc3-0ea9-4921-8669-044e0328da80 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.536692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa9a35c9-6bd4-43db-89da-5cb7bca5024e req-944b7dc3-0ea9-4921-8669-044e0328da80 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.553566 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-fa9a35c9-6bd4-43db-89da-5cb7bca5024e req-944b7dc3-0ea9-4921-8669-044e0328da80 service nova] Creating event network-changed:bd873c1a-a8dc-4aac-9b91-45b8032f5400 for instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 on n-h2-860863-4 Nov 02 21:41:25.560140 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-fa9a35c9-6bd4-43db-89da-5cb7bca5024e req-944b7dc3-0ea9-4921-8669-044e0328da80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058748 Nov 02 21:41:25.561463 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1940/4009] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:25.567454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:25.573034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:25.581507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.582676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.583326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.584197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.585878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.585878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.652128 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b8f549f-c632-417b-ad2d-a43d325eb61f tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089137 Nov 02 21:41:25.654109 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1941/4010] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:25 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:25.661695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:25.663821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:25.671870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.673025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.673677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:25.675502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:25.676193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:25.676830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:26.114827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:26.125871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-720f5048-e3be-4b3b-8aa5-63fc42541687 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1676 microversion: 2.1 time: 0.469903 Nov 02 21:41:26.127075 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1942/4011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:25 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1676 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:26.244236 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aeb891fd-52b8-4218-ab48-32fb46dd5df8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action" status: 202 len: 0 microversion: 2.1 time: 1.094100 Nov 02 21:41:26.246897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2070/4012] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:25 2022] POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action => generated 0 bytes in 1100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:26.254815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-180b9a9c-6155-464b-b620-59a25070d943 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'create', calling method: .version_select at 0x7f9b683ba3a0>, body: {"pool": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:26.667030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:26.670929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:26.678426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:26.693467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:26.693996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:26.694770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:26.695247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:26.695680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:26.738898 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0cf47cd8-94db-4f81-b92c-f2983d5caa29 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075891 Nov 02 21:41:26.740127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2071/4013] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:26 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:41:27.151522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:27.152135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:27.158451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.158865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.159485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.160357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.160979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.161570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.467534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:27.483001 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa3e41fd-6383-42f7-872e-e8d8bd913b3c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1659 microversion: 2.1 time: 0.335897 Nov 02 21:41:27.500917 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2072/4014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:27 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1659 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:27.518476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:27.519415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:27.527491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.528369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.529297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.530278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.531269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.531947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.802115 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-91a0d8d9-0f00-4c9b-8d7f-2ba0a7d97c82 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.289602 Nov 02 21:41:27.806100 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2073/4015] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:27 2022] POST /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:41:27.812788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0eafc00b-9f61-47f5-92d8-dc855eca1a60 req-9accd21a-648c-41ba-8a90-6735a060e008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dd2951-b13b-4c9b-b5bb-304607ec7a26", "tag": "bd873c1a-a8dc-4aac-9b91-45b8032f5400"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:27.827907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0eafc00b-9f61-47f5-92d8-dc855eca1a60 req-9accd21a-648c-41ba-8a90-6735a060e008 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.827907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0eafc00b-9f61-47f5-92d8-dc855eca1a60 req-9accd21a-648c-41ba-8a90-6735a060e008 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.828149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0eafc00b-9f61-47f5-92d8-dc855eca1a60 req-9accd21a-648c-41ba-8a90-6735a060e008 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.844410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0eafc00b-9f61-47f5-92d8-dc855eca1a60 req-9accd21a-648c-41ba-8a90-6735a060e008 service nova] Creating event network-changed:bd873c1a-a8dc-4aac-9b91-45b8032f5400 for instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 on n-h2-860863-4 Nov 02 21:41:27.849782 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0eafc00b-9f61-47f5-92d8-dc855eca1a60 req-9accd21a-648c-41ba-8a90-6735a060e008 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041813 Nov 02 21:41:27.850898 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2074/4016] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:27.857117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:27.859913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:27.867080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.867584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.868030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.869455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.870080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.870598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.908651 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc2e9e92-8308-4c33-90a6-d876b7ad6f09 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056333 Nov 02 21:41:27.914658 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2075/4017] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:27 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:27.920955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:27.921905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:27.932291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.933171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.939709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.939709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:27.939709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:27.939709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:27.954790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:28.579983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:28.590354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19696d57-0b47-4725-8a66-370e720d142b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1665 microversion: 2.1 time: 0.674253 Nov 02 21:41:28.592798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2076/4018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:27 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1665 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:28.922810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:28.925769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:28.934646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:28.935139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:28.935584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:28.936292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:28.936747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:28.937202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:28.974047 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1f146df-d156-4e69-bfa5-f0506e090783 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055680 Nov 02 21:41:28.974620 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2077/4019] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:28 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:41:29.616814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:29.617535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:29.624250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:29.626283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:29.626283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:29.626841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:29.627473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:29.627919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:30.096455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:30.107775 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-993f419d-cafb-4576-932e-ec87ef37a23a tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1665 microversion: 2.1 time: 0.494690 Nov 02 21:41:30.109115 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2078/4020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:29 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1665 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:30.115105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:30.117736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:30.125512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:30.126264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:30.126872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:30.127849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:30.128514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:30.129220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:30.169084 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c65b02b8-9bbe-40aa-814d-43b53fe2d877 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058115 Nov 02 21:41:30.169946 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2079/4021] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:30 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:30.197439 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-180b9a9c-6155-464b-b620-59a25070d943 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.946466 Nov 02 21:41:30.198466 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1943/4022] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:41:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:30.210589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.106"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:30.213962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:30.223952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:30.224770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:30.225605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:30.226628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:30.227180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:30.227646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:30.261557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "refresh_cache-10dd2951-b13b-4c9b-b5bb-304607ec7a26" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:41:30.263416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquired lock "refresh_cache-10dd2951-b13b-4c9b-b5bb-304607ec7a26" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:41:31.133940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:31.136005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:31.150100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=64 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:31.157752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:31.157752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:31.157752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:31.161221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:31.161963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:31.162944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:31.713229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:31.721864 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec37eb6e-8f78-4120-bcc9-1f5f1c89e52b tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 0.593880 Nov 02 21:41:31.722466 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1944/4023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:31 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:31.728345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:31.731197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:31.740430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:31.740649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:31.741295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:31.742205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:31.742893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:31.744457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:31.784629 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e23559bf-90a4-4e0b-8daa-a6549983c2fd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060839 Nov 02 21:41:31.785285 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1945/4024] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:31 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:41:31.797184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:31.798382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:31.805307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:31.806738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:31.807604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:31.808329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:31.808799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:31.809262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:33.076609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:33.085399 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05166270-7f73-4689-8c0a-66a58d81e705 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1668 microversion: 2.1 time: 1.292162 Nov 02 21:41:33.086282 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1946/4025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:31 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1668 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:33.096522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:33.096770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:33.121081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:33.121622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:33.122149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:33.122864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:33.123318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:33.123742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:33.185609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:33.708401 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1c57bb5-992e-4fdd-9cb0-8d0d5ba48d1c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 204 len: 0 microversion: 2.1 time: 0.621095 Nov 02 21:41:33.712707 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1947/4026] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:41:33 2022] DELETE /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:41:33.723114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:33.723114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:33.734935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:33.735765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:33.736446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:33.737414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:33.738063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:33.738863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:33.793993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:33.805950 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.api [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Working on deleting snapshot c8d0cc9c-0aa2-470c-b620-5245e704dd16 from shelved instance... Nov 02 21:41:34.113883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Building network info cache for instance {{(pid=121040) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:41:35.458716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Updating instance_info_cache with network_info: [{"id": "bd873c1a-a8dc-4aac-9b91-45b8032f5400", "address": "fa:16:3e:d6:9a:51", "network": {"id": "ff24d271-215e-4ac8-a089-45fadb53a44f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1660419301-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b54336bd203349df8f80e3d58b44ff6c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd873c1a-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121040) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:41:35.581946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Releasing lock "refresh_cache-10dd2951-b13b-4c9b-b5bb-304607ec7a26" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:41:35.582834 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16fd85ca-13ce-4435-8ed8-2e5bb843be30 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action" status: 202 len: 0 microversion: 2.1 time: 5.376411 Nov 02 21:41:35.583467 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2080/4027] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:30 2022] POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action => generated 0 bytes in 5378 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:41:35.596292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:35.605267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:35.616658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:35.617185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:35.617629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:35.618889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:35.619339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:35.619955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:35.735693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Doing local delete in cell 8809d7fb-a74e-4b3a-b326-8109cb51ca98(cell1) {{(pid=121039) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 21:41:35.737983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:35.738767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:35.739927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:35.740503 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.api [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 21:41:35.747502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] deallocate_for_instance() {{(pid=121039) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 21:41:35.944993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:35.955696 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e17f3d22-0f64-4202-9c26-1397c430efdb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1680 microversion: 2.1 time: 0.363134 Nov 02 21:41:35.957566 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2081/4028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:35 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1680 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:35.966130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b617e218-6363-4e80-a0da-3fad2f9f1aed req-886b324d-3588-4e6e-88ba-c41e30310567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dd2951-b13b-4c9b-b5bb-304607ec7a26", "tag": "bd873c1a-a8dc-4aac-9b91-45b8032f5400"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:35.996635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b617e218-6363-4e80-a0da-3fad2f9f1aed req-886b324d-3588-4e6e-88ba-c41e30310567 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:35.997571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b617e218-6363-4e80-a0da-3fad2f9f1aed req-886b324d-3588-4e6e-88ba-c41e30310567 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:35.999675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b617e218-6363-4e80-a0da-3fad2f9f1aed req-886b324d-3588-4e6e-88ba-c41e30310567 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:36.019177 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b617e218-6363-4e80-a0da-3fad2f9f1aed req-886b324d-3588-4e6e-88ba-c41e30310567 service nova] Creating event network-changed:bd873c1a-a8dc-4aac-9b91-45b8032f5400 for instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 on n-h2-860863-4 Nov 02 21:41:36.025280 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b617e218-6363-4e80-a0da-3fad2f9f1aed req-886b324d-3588-4e6e-88ba-c41e30310567 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065832 Nov 02 21:41:36.026334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2082/4029] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:36.040745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.106"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:36.659600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:36.682110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:36.689878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:36.690633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:36.691570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:36.693294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:36.693911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:37.097784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "refresh_cache-10dd2951-b13b-4c9b-b5bb-304607ec7a26" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 21:41:37.098190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquired lock "refresh_cache-10dd2951-b13b-4c9b-b5bb-304607ec7a26" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 21:41:37.495372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Updating instance_info_cache with network_info: [] {{(pid=121039) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:41:38.484883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=10,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:38.586479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Building network info cache for instance {{(pid=121040) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 21:41:38.615346 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e31debd0-2f7a-43ea-8e5e-8c7c7b5c0b8f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 204 len: 0 microversion: 2.1 time: 4.900461 Nov 02 21:41:38.615719 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1948/4030] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:41:33 2022] DELETE /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 0 bytes in 4902 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:41:38.624039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:38.624883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:38.632327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:38.632880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:38.633444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:38.635955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:38.635955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:38.635955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:38.765865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:38.776170 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2a31056-10f2-4638-b3a2-e73160198363 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 200 len: 1327 microversion: 2.1 time: 0.159352 Nov 02 21:41:38.777018 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1949/4031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:38 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:38.783300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:38.784009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:38.792437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:38.793280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:38.793927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:38.794841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:38.795449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:38.796087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:38.857116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:39.282631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Updating instance_info_cache with network_info: [{"id": "bd873c1a-a8dc-4aac-9b91-45b8032f5400", "address": "fa:16:3e:d6:9a:51", "network": {"id": "ff24d271-215e-4ac8-a089-45fadb53a44f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1660419301-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b54336bd203349df8f80e3d58b44ff6c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbd873c1a-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=121040) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 21:41:39.351995 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7082608-8705-4902-999c-92fe01376f42 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 204 len: 0 microversion: 2.32 time: 0.568276 Nov 02 21:41:39.351995 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1950/4032] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:41:38 2022] DELETE /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:41:39.356229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-cfb7b89f-198a-463e-ab01-202333933b1f req-0cd9ad1b-9e74-4912-ae9f-1851bc437a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889e113c-b228-4f42-adc8-e91298522ae5", "name": "network-vif-deleted", "tag": "c6c5387e-b503-44b2-be6e-fdf5de38ac8a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:39.366544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cfb7b89f-198a-463e-ab01-202333933b1f req-0cd9ad1b-9e74-4912-ae9f-1851bc437a3a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:39.373593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cfb7b89f-198a-463e-ab01-202333933b1f req-0cd9ad1b-9e74-4912-ae9f-1851bc437a3a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:39.378408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cfb7b89f-198a-463e-ab01-202333933b1f req-0cd9ad1b-9e74-4912-ae9f-1851bc437a3a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:39.390387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.server_external_events [req-cfb7b89f-198a-463e-ab01-202333933b1f req-0cd9ad1b-9e74-4912-ae9f-1851bc437a3a service nova] Unable to find a host for instance 889e113c-b228-4f42-adc8-e91298522ae5. Dropping event network-vif-deleted {{(pid=121039) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 21:41:39.391303 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-cfb7b89f-198a-463e-ab01-202333933b1f req-0cd9ad1b-9e74-4912-ae9f-1851bc437a3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.041419 Nov 02 21:41:39.394301 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1951/4033] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 21:41:39.407885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-24d4b825-9313-45c3-8b30-914d1c2e7412 req-1270da1b-82a5-46d2-902c-7e8d08f5c1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75b7954-00b0-4504-88c7-6e5c0e4b21b6", "name": "network-vif-deleted", "tag": "3f060e99-6b84-41c5-96cd-4b1133955aa1"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:39.434972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-24d4b825-9313-45c3-8b30-914d1c2e7412 req-1270da1b-82a5-46d2-902c-7e8d08f5c1de service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:39.435679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-24d4b825-9313-45c3-8b30-914d1c2e7412 req-1270da1b-82a5-46d2-902c-7e8d08f5c1de service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:39.436828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-24d4b825-9313-45c3-8b30-914d1c2e7412 req-1270da1b-82a5-46d2-902c-7e8d08f5c1de service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:39.449394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Releasing lock "refresh_cache-10dd2951-b13b-4c9b-b5bb-304607ec7a26" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 21:41:39.453487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3a90e80-4b40-4200-b8c4-f98912fd205f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action" status: 202 len: 0 microversion: 2.1 time: 3.422562 Nov 02 21:41:39.453487 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2083/4034] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:41:36 2022] POST /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26/action => generated 0 bytes in 3426 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 21:41:39.453665 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-24d4b825-9313-45c3-8b30-914d1c2e7412 req-1270da1b-82a5-46d2-902c-7e8d08f5c1de service nova] Creating event network-vif-deleted:3f060e99-6b84-41c5-96cd-4b1133955aa1 for instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 on n-h2-860863-4 Nov 02 21:41:39.458263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:39.458885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 889e113c-b228-4f42-adc8-e91298522ae5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:39.459455 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-24d4b825-9313-45c3-8b30-914d1c2e7412 req-1270da1b-82a5-46d2-902c-7e8d08f5c1de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060791 Nov 02 21:41:39.460066 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1952/4035] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:39.466731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:39.467606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:39.474673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:39.475402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:39.476119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:39.477020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:39.478446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:39.478897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:39.491378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:39.491747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:39.492193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:39.493565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:39.499236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:39.506990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:39.529431 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] HTTP exception thrown: Instance 889e113c-b228-4f42-adc8-e91298522ae5 could not be found. Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Request method failure captured: Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 HTTP/1.1 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuICmgsutKLBn3A1VQBVeIMqaqPLCozBHwENec2FoXNZH1thBa8VAspfhHCRd4hIuoupNyoL8SJ0dM1AruSM3oPDYf5rO7XDFUzOfoi4jr-myFlioMa7BKPs4-cHvuEagLpr4HwEOsT0UuEG6xMP2EC9rk-cT79g8zJb9PmG4-hUyjE Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 368ab16b50f84f0d9cf6e79e039dc257 Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 889e113c-b228-4f42-adc8-e91298522ae5 could not be found. Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '889e113c-b228-4f42-adc8-e91298522ae5'} Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 889e113c-b228-4f42-adc8-e91298522ae5 could not be found. Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 889e113c-b228-4f42-adc8-e91298522ae5 could not be found. Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:39.531126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:39.534991 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:39.534991 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:39.534991 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:39.534991 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:41:39.534991 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:41:39.534991 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 889e113c-b228-4f42-adc8-e91298522ae5 could not be found. Nov 02 21:41:39.534991 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:39.537518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Returning 404 to user: Instance 889e113c-b228-4f42-adc8-e91298522ae5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:41:39.538950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfb3a1cf-95f6-42c0-bc87-65cde1287cef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5" status: 404 len: 111 microversion: 2.1 time: 0.084843 Nov 02 21:41:39.540244 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2084/4036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:39 2022] GET /compute/v2.1/servers/889e113c-b228-4f42-adc8-e91298522ae5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:41:39.546506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e33784e-40c3-48af-bd12-643470df8d60 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '.version_select at 0x7f9b6878daf0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:40.440099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:40.453737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:40.455184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:40.456752 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d47dbb2-05e4-4863-a587-99c22f46bd1c tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2954 microversion: 2.32 time: 0.995568 Nov 02 21:41:40.457508 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1953/4037] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:39 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2954 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:41:40.464247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:40.465126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:40.478270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:40.478939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:40.479388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:40.480215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:40.480882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:40.485704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:40.523686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:40.909191 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1f4fc3a5-0d85-4064-ae8a-cff8aa140840 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 204 len: 0 microversion: 2.1 time: 0.450140 Nov 02 21:41:40.919174 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1954/4038] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:41:40 2022] DELETE /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:41:40.924749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:40.925490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:40.949478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:40.949974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:40.950727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:40.951726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:40.952396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:40.953141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:40.979014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 HTTP/1.1 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'd75b7954-00b0-4504-88c7-6e5c0e4b21b6'} Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:40.981121 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:40.985208 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:40.985208 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:40.985208 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:40.985208 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:41:40.985208 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:41:40.985208 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:41:40.985208 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:40.986765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:41:40.988046 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-66ccc539-db15-4dd9-b48d-1fd55255c0a3 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 404 len: 111 microversion: 2.1 time: 0.067517 Nov 02 21:41:40.989184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1955/4039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:40 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:41:40.997461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:40.998313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:41.010047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:41.010047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:41.010047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:41.010351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:41.010791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:41.011297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:41.174795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:41.183331 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-610f7ee1-3430-473a-b884-988496fda01d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1466 microversion: 2.1 time: 0.192858 Nov 02 21:41:41.187237 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1956/4040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:40 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1466 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:41.188338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0847e2a-33a6-409d-9b95-19e7c95309bd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '.version_select at 0x7f9b6832e5e0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:41.250451 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0847e2a-33a6-409d-9b95-19e7c95309bd tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364944310" status: 202 len: 0 microversion: 2.1 time: 0.064881 Nov 02 21:41:41.256243 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1957/4041] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:41:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364944310 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:41.406820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-809a364d-a624-4ddb-8077-449e76565fae req-17ae57d6-73b2-4ee8-9078-0fc24a7621f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10dd2951-b13b-4c9b-b5bb-304607ec7a26", "tag": "bd873c1a-a8dc-4aac-9b91-45b8032f5400"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:41.418001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-809a364d-a624-4ddb-8077-449e76565fae req-17ae57d6-73b2-4ee8-9078-0fc24a7621f6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:41.418473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-809a364d-a624-4ddb-8077-449e76565fae req-17ae57d6-73b2-4ee8-9078-0fc24a7621f6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:41.418901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-809a364d-a624-4ddb-8077-449e76565fae req-17ae57d6-73b2-4ee8-9078-0fc24a7621f6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:41.429123 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-809a364d-a624-4ddb-8077-449e76565fae req-17ae57d6-73b2-4ee8-9078-0fc24a7621f6 service nova] Creating event network-changed:bd873c1a-a8dc-4aac-9b91-45b8032f5400 for instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 on n-h2-860863-4 Nov 02 21:41:41.434582 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-809a364d-a624-4ddb-8077-449e76565fae req-17ae57d6-73b2-4ee8-9078-0fc24a7621f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032017 Nov 02 21:41:41.435186 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1958/4042] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:41:41.486455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:41.487207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:41.493457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:41.493948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:41.494399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:41.495093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:41.495553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:41.495989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:41.979260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:41.991616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:41.994092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:41.995564 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e32f66b-3687-4507-a4ae-7e0734a8f642 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2954 microversion: 2.32 time: 0.513368 Nov 02 21:41:42.010674 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1959/4043] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:41 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2954 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:41:42.097249 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e33784e-40c3-48af-bd12-643470df8d60 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/615d3ac8-c097-4f34-8933-b15508c985d4" status: 202 len: 0 microversion: 2.1 time: 2.555620 Nov 02 21:41:42.100324 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2085/4044] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:41:39 2022] DELETE /compute/v2.1/os-floating-ips/615d3ac8-c097-4f34-8933-b15508c985d4 => generated 0 bytes in 2557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:42.111403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e625c06-2898-4a13-9b5f-9d12c73fdf53 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '.version_select at 0x7f9b68333700>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:42.208077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:42.208712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:42.215255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.215760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.216204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.216913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.217401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.218268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.335324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:42.344647 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e14de7b-9146-4b0a-ba4d-9e588814f192 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1466 microversion: 2.1 time: 0.140563 Nov 02 21:41:42.345384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2086/4045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:42 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1466 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:42.598183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:42.600521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:42.607379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.608146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.608621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.609505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.610203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.610840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.616898 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e625c06-2898-4a13-9b5f-9d12c73fdf53 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/874fcf14-ace1-49c7-b330-cdc0884e74de" status: 202 len: 0 microversion: 2.1 time: 0.510563 Nov 02 21:41:42.617550 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1960/4046] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:41:42 2022] DELETE /compute/v2.1/os-security-groups/874fcf14-ace1-49c7-b330-cdc0884e74de => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:42.626057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:42.631275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:42.637758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.640397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.641113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.643601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.647281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.648016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.653621 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba1eb6d7-970f-4e75-a741-13d4d6ef936a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059271 Nov 02 21:41:42.666508 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2087/4047] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:42 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:41:42.672907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:42.679314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:42.697402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.697402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.697402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.697402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:42.697402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:42.697402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:42.726998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:42.904251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lazy-loading 'services' on Instance uuid 4919de14-4362-4d7b-ba9c-9679717b62a4 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:41:43.185132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52670b51-a805-4cb1-b632-cc6d3781ab8a tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments/a02aa836-dc89-4870-b63a-fb17bce7cb96" status: 202 len: 0 microversion: 2.1 time: 0.516877 Nov 02 21:41:43.185933 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2088/4048] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:41:42 2022] DELETE /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments/a02aa836-dc89-4870-b63a-fb17bce7cb96 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:41:43.195652 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71e3d387-1c9a-445d-8fcb-753549af1274 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "DELETE /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 204 len: 0 microversion: 2.1 time: 0.571073 Nov 02 21:41:43.198882 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1961/4049] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:41:42 2022] DELETE /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:41:43.201433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11f1a697-90ce-47f9-b5a0-ca0c791a4f21 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: .version_select at 0x7f9b6882c4c0>, body: {"keypair": {"name": "tempest-keypair-561670444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdMqun3XJ/6anEsgXIvHJxOwGrJ/2YGfFc0nV+7HZNo1AyTQ1F5SPTwBUEH47+FO8RDhr0cJ0Bsw2P2b/wi7XkT60kumR+8yfeUWyqGh9vXAENq/ACO3NyXMDHyVEJvtQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:43.212205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:43.212984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:43.225505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:43.226091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:43.226537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:43.227253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:43.227715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:43.228146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:43.237290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-11f1a697-90ce-47f9-b5a0-ca0c791a4f21 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:41:43.247947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-11f1a697-90ce-47f9-b5a0-ca0c791a4f21 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:41:43.400993 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11f1a697-90ce-47f9-b5a0-ca0c791a4f21 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.210721 Nov 02 21:41:43.402058 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2089/4050] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:41:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:43.410779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:43.412071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:43.423089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:43.424029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:43.425582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:43.426662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:43.427349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:43.427980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:43.570078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:43.587257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:43.588960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:43.590259 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b1b79f1-a41b-4c73-a005-dca479832d2d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2954 microversion: 2.32 time: 0.390383 Nov 02 21:41:43.590923 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1962/4051] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:43 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2954 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:41:43.609045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:43.609884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:43.616438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:43.617211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:43.618554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:43.619450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:43.619927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:43.620368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:43.653374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SELECT=83,nova_cell1:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:43.663844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:43.673732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17757460-740a-4db9-b4aa-e4c823cb117f tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1511 microversion: 2.1 time: 0.268912 Nov 02 21:41:43.690494 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2090/4052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:43 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:43.760646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:43.772644 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91737100-ecc8-4cbc-9599-5b5be8b7ce89 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1466 microversion: 2.1 time: 0.179309 Nov 02 21:41:43.773529 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1963/4053] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:43 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:44.629028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:44.629028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:44.638440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:44.641657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:44.642239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:44.643242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:44.649742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:44.652120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:44.698616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:44.699424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:44.722427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:44.722930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:44.732350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:44.733351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:44.733998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:44.734590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:45.670816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:45.690878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:45.695073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:45.698060 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-12119e15-9028-4816-a861-a3caf3208015 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2954 microversion: 2.32 time: 1.076239 Nov 02 21:41:45.701958 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2091/4054] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:44 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2954 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:41:45.713963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:45.716174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:45.741207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:45.741999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:45.742605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:45.743564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:45.745999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:45.746660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:45.885073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:45.903863 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-04c25672-0403-4006-8799-f3fb4b1b7fca tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1511 microversion: 2.1 time: 1.207167 Nov 02 21:41:45.919067 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1964/4055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:44 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1511 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:45.990991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:46.013335 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da54779f-7a15-4f39-b202-af769d6a0352 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1466 microversion: 2.1 time: 0.309057 Nov 02 21:41:46.014270 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2092/4056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:45 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1466 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:46.190696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-fa0296c0-2c32-4417-bf04-4b73ec3f681f req-36235684-6fe3-4b1f-b16a-cfe0543e6e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e539db0-3690-47f4-b809-025a95d727a9", "name": "network-vif-deleted", "tag": "852366f9-eed2-4587-b777-e3c0c519a785"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:46.209444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa0296c0-2c32-4417-bf04-4b73ec3f681f req-36235684-6fe3-4b1f-b16a-cfe0543e6e59 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:46.215484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa0296c0-2c32-4417-bf04-4b73ec3f681f req-36235684-6fe3-4b1f-b16a-cfe0543e6e59 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:46.219752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa0296c0-2c32-4417-bf04-4b73ec3f681f req-36235684-6fe3-4b1f-b16a-cfe0543e6e59 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:46.242660 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-fa0296c0-2c32-4417-bf04-4b73ec3f681f req-36235684-6fe3-4b1f-b16a-cfe0543e6e59 service nova] Creating event network-vif-deleted:852366f9-eed2-4587-b777-e3c0c519a785 for instance 7e539db0-3690-47f4-b809-025a95d727a9 on n-h1-860863-4 Nov 02 21:41:46.270665 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-fa0296c0-2c32-4417-bf04-4b73ec3f681f req-36235684-6fe3-4b1f-b16a-cfe0543e6e59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085290 Nov 02 21:41:46.278851 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1965/4057] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:46.732655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:46.733331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:46.745300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:46.745809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:46.746251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:46.751504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:46.754633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:46.757559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:46.932293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:46.933675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:46.946055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:46.948160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:46.949326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:46.950989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:46.953255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:46.954339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:47.170657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:47.185519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97eedd94-576e-43cc-ba5a-62866d2f5eb2 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1469 microversion: 2.1 time: 0.258190 Nov 02 21:41:47.201560 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1966/4058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:46 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:47.210930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:47.212735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:47.232495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:47.233245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:47.233859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:47.234693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:47.235288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:47.235886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:47.310845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:47.311568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:47.312459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:47.313096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lazy-loading 'fault' on Instance uuid 7e539db0-3690-47f4-b809-025a95d727a9 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:41:47.536113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:47.563847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d05f77a-32f3-4ad7-a15e-d59ec32e14ab tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 200 len: 1305 microversion: 2.1 time: 0.343055 Nov 02 21:41:47.566536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1967/4059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:47 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 1305 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:47.616023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7b19bdf7-74f5-4fef-b926-6ee4e34c4b37 req-d8915c41-7855-4046-9fd9-107254ff0acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10dd2951-b13b-4c9b-b5bb-304607ec7a26", "name": "network-vif-deleted", "tag": "bd873c1a-a8dc-4aac-9b91-45b8032f5400"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:47.648343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b19bdf7-74f5-4fef-b926-6ee4e34c4b37 req-d8915c41-7855-4046-9fd9-107254ff0acf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:47.648920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b19bdf7-74f5-4fef-b926-6ee4e34c4b37 req-d8915c41-7855-4046-9fd9-107254ff0acf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:47.658957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b19bdf7-74f5-4fef-b926-6ee4e34c4b37 req-d8915c41-7855-4046-9fd9-107254ff0acf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:47.696879 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7b19bdf7-74f5-4fef-b926-6ee4e34c4b37 req-d8915c41-7855-4046-9fd9-107254ff0acf service nova] Creating event network-vif-deleted:bd873c1a-a8dc-4aac-9b91-45b8032f5400 for instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 on n-h2-860863-4 Nov 02 21:41:47.706222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:47.723781 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7b19bdf7-74f5-4fef-b926-6ee4e34c4b37 req-d8915c41-7855-4046-9fd9-107254ff0acf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112072 Nov 02 21:41:47.734638 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1968/4060] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:41:47.738797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:47.745691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:47.752993 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae3a589b-71e4-4e77-9bdd-202fa0b65eac tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2933 microversion: 2.32 time: 1.024182 Nov 02 21:41:47.754643 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2093/4061] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:46 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2933 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:41:48.270511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:48.283800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:48.313216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.314267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.315044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.319269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.320309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.321610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.445589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.454977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.455646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.457277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lazy-loading 'fault' on Instance uuid 10dd2951-b13b-4c9b-b5bb-304607ec7a26 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:41:48.579992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:48.580621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 7e539db0-3690-47f4-b809-025a95d727a9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:48.589960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.598220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.601295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.605693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.606427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.608089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.626743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:48.647305 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] HTTP exception thrown: Instance 7e539db0-3690-47f4-b809-025a95d727a9 could not be found. Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Request method failure captured: Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 HTTP/1.1 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuICmgsutKLBn3A1VQBVeIMqaqPLCozBHwENec2FoXNZH1thBa8VAspfhHCRd4hIuoupNyoL8SJ0dM1AruSM3oPDYf5rO7XDFUzOfoi4jr-myFlioMa7BKPs4-cHvuEagLpr4HwEOsT0UuEG6xMP2EC9rk-cT79g8zJb9PmG4-hUyjE Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 368ab16b50f84f0d9cf6e79e039dc257 Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7e539db0-3690-47f4-b809-025a95d727a9 could not be found. Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7e539db0-3690-47f4-b809-025a95d727a9'} Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e539db0-3690-47f4-b809-025a95d727a9 could not be found. Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e539db0-3690-47f4-b809-025a95d727a9 could not be found. Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:48.655196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:48.659707 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:48.659707 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:48.659707 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:48.659707 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:41:48.659707 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:41:48.659707 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e539db0-3690-47f4-b809-025a95d727a9 could not be found. Nov 02 21:41:48.659707 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:48.661236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Returning 404 to user: Instance 7e539db0-3690-47f4-b809-025a95d727a9 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:41:48.662266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-501c9a1c-74ea-4da6-ba91-b6e8044c0f1e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9" status: 404 len: 111 microversion: 2.1 time: 0.086472 Nov 02 21:41:48.664170 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2094/4062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:48 2022] GET /compute/v2.1/servers/7e539db0-3690-47f4-b809-025a95d727a9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:41:48.676052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-834f050c-ddff-4196-a8e6-a388c7b0c571 req-63d2287b-3974-470c-8f29-d21185fade11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-unplugged", "status": "completed", "tag": "35d64f03-f33e-4ab9-8420-b891f3cc9308"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:48.699388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-834f050c-ddff-4196-a8e6-a388c7b0c571 req-63d2287b-3974-470c-8f29-d21185fade11 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.700127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-834f050c-ddff-4196-a8e6-a388c7b0c571 req-63d2287b-3974-470c-8f29-d21185fade11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.701310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-834f050c-ddff-4196-a8e6-a388c7b0c571 req-63d2287b-3974-470c-8f29-d21185fade11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.735103 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-834f050c-ddff-4196-a8e6-a388c7b0c571 req-63d2287b-3974-470c-8f29-d21185fade11 service nova] Creating event network-vif-unplugged:35d64f03-f33e-4ab9-8420-b891f3cc9308 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:48.746849 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-834f050c-ddff-4196-a8e6-a388c7b0c571 req-63d2287b-3974-470c-8f29-d21185fade11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074192 Nov 02 21:41:48.763738 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2095/4063] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:48.773851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:48.785418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:48.792358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:48.794035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.794533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.794973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.802684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:48.803605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:48.807640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:48.918623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:48.990936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd770afb196045d49b37ccb05c6afcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b54336bd203349df8f80e3d58b44ff6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:49.005998 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9653cd2-65f2-43d2-8794-5469a5f9fbb8 tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 200 len: 1313 microversion: 2.1 time: 0.791570 Nov 02 21:41:49.014616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1969/4064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:48 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:49.044706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:49.045611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:49.062513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:49.063177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:49.063756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:49.065433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:49.066079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:49.066653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:49.480226 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c7220b70-ac3f-405a-8636-1d4012638c96 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 204 len: 0 microversion: 2.1 time: 0.714782 Nov 02 21:41:49.482597 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2096/4065] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:41:48 2022] DELETE /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:41:49.490898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:49.491952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:49.505582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:49.506453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:49.507138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:49.509819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:49.510520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:49.515402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:49.538285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:49.550601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:49.565140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:49.568213 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1a1f9b9-57f1-4523-bd61-95e9903028fe tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2933 microversion: 2.32 time: 0.551077 Nov 02 21:41:49.570453 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1970/4066] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:49 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2933 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:41:49.951767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:49.964811 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1115a12c-cb90-47e8-9cf3-685ce0cd8bd1 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1507 microversion: 2.1 time: 0.478261 Nov 02 21:41:49.969785 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2097/4067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:49 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:50.044165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:50.045016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] [instance: 10dd2951-b13b-4c9b-b5bb-304607ec7a26] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:50.056483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:50.061710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:50.062204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:50.062880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:50.063335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:50.063760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:50.107216 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] HTTP exception thrown: Instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 could not be found. Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Request method failure captured: Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 HTTP/1.1 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuPRjtvsckej1PEMQyfLA8cXZIAh0pT95hKHTeSbSLEyQlGVXUBPBckS5IIYpsMIg1Qkhyi651nVdFJ1JMUm4iX82N1S-kloiE2--whKE9PvvI_yz19Z204De-yXwi4TsmafSqYEhes9sppuNjyJJp_lKEtm6SSYAfSGW3kRq8wPms4 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b54336bd203349df8f80e3d58b44ff6c Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1100254761 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b54336bd203349df8f80e3d58b44ff6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b54336bd203349df8f80e3d58b44ff6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b54336bd203349df8f80e3d58b44ff6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b54336bd203349df8f80e3d58b44ff6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1100254761 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b54336bd203349df8f80e3d58b44ff6c Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1100254761 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerRescueTestJSONUnderV235-1100254761-project Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: dd770afb196045d49b37ccb05c6afcd7 Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1100254761-project Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 could not be found. Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '10dd2951-b13b-4c9b-b5bb-304607ec7a26'} Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 could not be found. Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 could not be found. Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:50.114497 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 could not be found. Nov 02 21:41:50.118585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:41:50.121751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] Returning 404 to user: Instance 10dd2951-b13b-4c9b-b5bb-304607ec7a26 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:41:50.122794 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1acb6b4e-4baa-4dff-b054-56dd9908ca2b tempest-ServerRescueTestJSONUnderV235-1100254761 tempest-ServerRescueTestJSONUnderV235-1100254761-project] 10.222.0.25 "GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26" status: 404 len: 111 microversion: 2.1 time: 0.083141 Nov 02 21:41:50.128106 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1971/4068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:50 2022] GET /compute/v2.1/servers/10dd2951-b13b-4c9b-b5bb-304607ec7a26 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:41:50.601681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:50.602512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:50.614897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:50.623421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:50.624631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:50.625671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:50.629765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:50.630757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:50.782992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2dd53f3f-bedd-4778-bf37-9189df0f1160 req-8c40952c-fff0-4ae5-b6c8-3aca0245b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-unplugged", "status": "completed", "tag": "2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:50.821849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2dd53f3f-bedd-4778-bf37-9189df0f1160 req-8c40952c-fff0-4ae5-b6c8-3aca0245b0ed service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:50.823814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2dd53f3f-bedd-4778-bf37-9189df0f1160 req-8c40952c-fff0-4ae5-b6c8-3aca0245b0ed service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:50.824802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2dd53f3f-bedd-4778-bf37-9189df0f1160 req-8c40952c-fff0-4ae5-b6c8-3aca0245b0ed service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:50.849475 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2dd53f3f-bedd-4778-bf37-9189df0f1160 req-8c40952c-fff0-4ae5-b6c8-3aca0245b0ed service nova] Creating event network-vif-unplugged:2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:50.861066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2dd53f3f-bedd-4778-bf37-9189df0f1160 req-8c40952c-fff0-4ae5-b6c8-3aca0245b0ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081475 Nov 02 21:41:50.862626 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1972/4069] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:41:50.995170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:50.996115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:51.006874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:51.007590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:51.008181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:51.009630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:51.012174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:51.013090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:51.201113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:51.224039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:51.226073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:51.228943 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f65fc93d-35fe-4a30-a144-3e7e53588263 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2912 microversion: 2.32 time: 0.630207 Nov 02 21:41:51.249376 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2098/4070] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:50 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2912 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:41:51.437743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-975410727", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "633e65a1-5eb1-4582-84ab-e86a0d55a55b"}], "security_groups": [{"name": "tempest-securitygroup--708092166"}], "key_name": "tempest-keypair-561670444", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:51.771934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:51.793723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ad1bc2b-b897-45d1-89d7-37d67cd2520e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1507 microversion: 2.1 time: 0.800086 Nov 02 21:41:51.802108 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1973/4071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:50 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1507 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:51.847696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] validate_networks() for [('633e65a1-5eb1-4582-84ab-e86a0d55a55b', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:41:52.261852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:52.262772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:52.273478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:52.274817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:52.275453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:52.289327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:52.290760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:52.292770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:52.985298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:41:52.986334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:41:52.987450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:41:52.988044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:41:52.988635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:41:53.021651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:53.024607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:53.027328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:53.035381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:53.041933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:53.051145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:53.051718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:53.071481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:53.076437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:53.081484 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd065e5d-96e3-469e-bac8-b5f169c20791 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2865 microversion: 2.32 time: 0.823359 Nov 02 21:41:53.084905 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1974/4072] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:52 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2865 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:41:53.092615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2eb969ed-dd0f-4356-87c3-e464e6ce2b4f req-1d00060c-80e6-41d1-89d7-9af100b3703c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-deleted", "tag": "35d64f03-f33e-4ab9-8420-b891f3cc9308"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:53.126831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2eb969ed-dd0f-4356-87c3-e464e6ce2b4f req-1d00060c-80e6-41d1-89d7-9af100b3703c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:53.126831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2eb969ed-dd0f-4356-87c3-e464e6ce2b4f req-1d00060c-80e6-41d1-89d7-9af100b3703c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:53.126831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2eb969ed-dd0f-4356-87c3-e464e6ce2b4f req-1d00060c-80e6-41d1-89d7-9af100b3703c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:53.156368 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2eb969ed-dd0f-4356-87c3-e464e6ce2b4f req-1d00060c-80e6-41d1-89d7-9af100b3703c service nova] Creating event network-vif-deleted:35d64f03-f33e-4ab9-8420-b891f3cc9308 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:53.161158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:41:53.175513 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2eb969ed-dd0f-4356-87c3-e464e6ce2b4f req-1d00060c-80e6-41d1-89d7-9af100b3703c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088845 Nov 02 21:41:53.176460 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1975/4073] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:53.178111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Getting quotas for user 8520ce21dd03401685b8e65f8aefb205 and project 4e0636c756c24859b25db0144e50de92. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:41:53.203311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:53.206158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:53.211016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:41:53.214607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:41:53.229511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:53.231337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:53.232893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:53.233406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:53.234132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:53.234595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:53.235024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:53.339333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:53.339829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:53.340275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:53.340733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lazy-loading 'fault' on Instance uuid 5246e2d9-6502-4b53-b677-c95eaccb2c99 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:41:53.482490 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d16b649a-b29e-44ae-a581-37bb246b51d8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.051431 Nov 02 21:41:53.493888 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2099/4074] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:41:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:41:53.506634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f28c83dc-d7a2-4dc9-a3b3-fab9f41a8814 req-7808cc10-3da8-47a9-8442-a23862d26d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-unplugged", "status": "completed", "tag": "8ef8f96f-40d1-4605-8ab7-0fb83406c4aa"}, {"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-unplugged", "status": "completed", "tag": "52ef5d76-a38d-4aa9-95c4-e68c61c33135"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:53.526467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f28c83dc-d7a2-4dc9-a3b3-fab9f41a8814 req-7808cc10-3da8-47a9-8442-a23862d26d9e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:53.527410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f28c83dc-d7a2-4dc9-a3b3-fab9f41a8814 req-7808cc10-3da8-47a9-8442-a23862d26d9e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:53.528111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f28c83dc-d7a2-4dc9-a3b3-fab9f41a8814 req-7808cc10-3da8-47a9-8442-a23862d26d9e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:53.575411 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f28c83dc-d7a2-4dc9-a3b3-fab9f41a8814 req-7808cc10-3da8-47a9-8442-a23862d26d9e service nova] Creating event network-vif-unplugged:8ef8f96f-40d1-4605-8ab7-0fb83406c4aa for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:53.579112 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f28c83dc-d7a2-4dc9-a3b3-fab9f41a8814 req-7808cc10-3da8-47a9-8442-a23862d26d9e service nova] Creating event network-vif-unplugged:52ef5d76-a38d-4aa9-95c4-e68c61c33135 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:53.598957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f28c83dc-d7a2-4dc9-a3b3-fab9f41a8814 req-7808cc10-3da8-47a9-8442-a23862d26d9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.103497 Nov 02 21:41:53.599773 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2100/4075] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:53.617334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6845218c-758f-461c-a8f3-2a506c4d3346 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:53.623152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6845218c-758f-461c-a8f3-2a506c4d3346 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:53.751283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:53.765976 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2af5abf3-2ffa-445a-8255-32e4af3f7b3d tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 200 len: 1305 microversion: 2.1 time: 0.586732 Nov 02 21:41:53.770443 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1976/4076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:53 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 1305 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:54.122817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:54.123654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:54.136758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:54.138719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:54.143408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:54.144463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:54.145183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:54.145843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:54.282440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6845218c-758f-461c-a8f3-2a506c4d3346 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:54.291211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6845218c-758f-461c-a8f3-2a506c4d3346 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1240 microversion: 2.1 time: 0.687985 Nov 02 21:41:54.294999 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2101/4077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:53 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1240 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:54.799186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:54.804951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 5246e2d9-6502-4b53-b677-c95eaccb2c99] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:54.831875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:54.832915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:54.833461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:54.842689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:54.842689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:54.842689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:54.890966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:54.904961 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] HTTP exception thrown: Instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 could not be found. Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Request method failure captured: Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 HTTP/1.1 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuICmgsutKLBn3A1VQBVeIMqaqPLCozBHwENec2FoXNZH1thBa8VAspfhHCRd4hIuoupNyoL8SJ0dM1AruSM3oPDYf5rO7XDFUzOfoi4jr-myFlioMa7BKPs4-cHvuEagLpr4HwEOsT0UuEG6xMP2EC9rk-cT79g8zJb9PmG4-hUyjE Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 368ab16b50f84f0d9cf6e79e039dc257 Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 could not be found. Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '5246e2d9-6502-4b53-b677-c95eaccb2c99'} Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 could not be found. Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 could not be found. Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:41:54.907857 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:54.912686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:41:54.912686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:41:54.912686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:41:54.912686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:41:54.912686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:41:54.912686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 could not be found. Nov 02 21:41:54.912686 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:41:54.914989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Returning 404 to user: Instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:41:54.922431 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d5297a1b-48c5-40ce-8e5d-463a06f133c4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99" status: 404 len: 111 microversion: 2.1 time: 0.121221 Nov 02 21:41:54.923037 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2102/4078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:54 2022] GET /compute/v2.1/servers/5246e2d9-6502-4b53-b677-c95eaccb2c99 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:41:54.936064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:54.939784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:54.947661 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1120f2de-5e1f-4119-9f9f-613eb086af5e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2752 microversion: 2.32 time: 0.834893 Nov 02 21:41:54.952668 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1977/4079] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:54 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2752 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:41:54.953194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:54.953804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:54.976380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:54.978469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:54.980440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:54.983351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:54.984031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:54.986327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:55.079866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:55.239445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-80b3df91-b743-4b4c-907c-ee7bfbbdf20c req-c7f848f6-613c-4932-bf51-e80f53d46145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5246e2d9-6502-4b53-b677-c95eaccb2c99", "name": "network-vif-deleted", "tag": "3d772d58-1688-4351-8c3c-7485a3f89f0c"}, {"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-deleted", "tag": "4fe00742-6aa2-4e8c-afbd-8f04868461c0"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:55.264107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-80b3df91-b743-4b4c-907c-ee7bfbbdf20c req-c7f848f6-613c-4932-bf51-e80f53d46145 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:55.264596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-80b3df91-b743-4b4c-907c-ee7bfbbdf20c req-c7f848f6-613c-4932-bf51-e80f53d46145 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:55.275595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-80b3df91-b743-4b4c-907c-ee7bfbbdf20c req-c7f848f6-613c-4932-bf51-e80f53d46145 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:55.323353 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-80b3df91-b743-4b4c-907c-ee7bfbbdf20c req-c7f848f6-613c-4932-bf51-e80f53d46145 service nova] Creating event network-vif-deleted:3d772d58-1688-4351-8c3c-7485a3f89f0c for instance 5246e2d9-6502-4b53-b677-c95eaccb2c99 on n-h2-860863-4 Nov 02 21:41:55.331316 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-80b3df91-b743-4b4c-907c-ee7bfbbdf20c req-c7f848f6-613c-4932-bf51-e80f53d46145 service nova] Creating event network-vif-deleted:4fe00742-6aa2-4e8c-afbd-8f04868461c0 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:55.366207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-80b3df91-b743-4b4c-907c-ee7bfbbdf20c req-c7f848f6-613c-4932-bf51-e80f53d46145 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134864 Nov 02 21:41:55.367406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1978/4080] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:41:55.372905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c17e9eb-efab-4aeb-b2ae-d5c2e569949e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:55.391221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c17e9eb-efab-4aeb-b2ae-d5c2e569949e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:55.565682 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c6abb375-8682-4c83-b20e-5afd2f24b8bb tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 204 len: 0 microversion: 2.1 time: 0.636619 Nov 02 21:41:55.568321 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2103/4081] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:41:54 2022] DELETE /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:41:55.578245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:55.579506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:55.602469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:55.602747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c17e9eb-efab-4aeb-b2ae-d5c2e569949e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:55.603130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:55.603778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:55.608475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:55.609997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:55.610927 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c17e9eb-efab-4aeb-b2ae-d5c2e569949e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1240 microversion: 2.1 time: 0.241992 Nov 02 21:41:55.612208 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1979/4082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:55 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1240 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:55.614064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:55.637105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a0d883ae-c498-4477-aaab-ff27c81f7033 req-6b42907a-350f-41b2-aae2-ea84d7a321df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe00742-6aa2-4e8c-afbd-8f04868461c0"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:55.655719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a0d883ae-c498-4477-aaab-ff27c81f7033 req-6b42907a-350f-41b2-aae2-ea84d7a321df service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:55.657558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a0d883ae-c498-4477-aaab-ff27c81f7033 req-6b42907a-350f-41b2-aae2-ea84d7a321df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:55.659641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a0d883ae-c498-4477-aaab-ff27c81f7033 req-6b42907a-350f-41b2-aae2-ea84d7a321df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:55.695365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a0d883ae-c498-4477-aaab-ff27c81f7033 req-6b42907a-350f-41b2-aae2-ea84d7a321df service nova] Creating event network-vif-unplugged:4fe00742-6aa2-4e8c-afbd-8f04868461c0 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:55.701027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a0d883ae-c498-4477-aaab-ff27c81f7033 req-6b42907a-350f-41b2-aae2-ea84d7a321df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068391 Nov 02 21:41:55.702015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1980/4083] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:55.988114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:55.993431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:56.006614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.007072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.007521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:56.008791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.019274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.019742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:56.639945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:56.663484 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e966f983-0582-42e3-be1f-f94b08806e26 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1494 microversion: 2.1 time: 1.088782 Nov 02 21:41:56.666412 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2104/4084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:55 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1494 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:56.673266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:56.676287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:56.697405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:56.721473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.722765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:56.723329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.725360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:56.728535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.731402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:56.732704 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-16b67bc8-e49d-407b-b681-a7fcd452b7b1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2591 microversion: 2.32 time: 0.752237 Nov 02 21:41:56.733195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.737912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:56.739313 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1981/4085] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:55 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2591 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:41:56.760105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:56.777465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:56.786002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.786840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.787447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:56.788351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.789057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.791822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:56.836360 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9eb1a4d8-e5c3-4dc7-99b2-9dfbee05830e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.167650 Nov 02 21:41:56.836360 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2105/4086] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:56 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:41:56.968585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:56.972265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:56.988428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.989123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.989671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:56.990489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:56.991093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:56.993738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:57.001960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:57.019511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6ea4be0c-8a85-4cf9-b0e9-8ee6f2f2aa0e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1292 microversion: 2.1 time: 0.276979 Nov 02 21:41:57.030239 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1982/4087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:56 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1292 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:57.074610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb82ce01-01b8-433f-a729-556757b55008 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110121 Nov 02 21:41:57.075363 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2106/4088] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:41:56 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 21:41:57.186241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:57.186869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:57.201149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:57.202098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:57.202763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:57.203694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:57.204354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:57.205003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:57.255264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:41:57.335180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:41:57.691773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:57.695131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:57.707401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:57.720693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:57.721810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:57.724000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:57.728542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:57.734905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:57.818030 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2b3903c-870a-411c-8328-25a60dbb1849 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 204 len: 0 microversion: 2.1 time: 0.635266 Nov 02 21:41:57.818739 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1983/4089] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:41:57 2022] DELETE /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:41:57.826637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:57.837757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:57.849132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:57.859672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:57.860258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:57.865323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:57.868959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:57.869743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:58.463488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:58.476078 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35881120-d581-439b-a52f-945850f04486 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1452 microversion: 2.1 time: 0.788145 Nov 02 21:41:58.498881 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2107/4090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:57 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1452 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:41:58.506566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:58.509860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:58.527209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:58.528181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:58.528894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:58.529865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:58.530568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:58.531218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:59.085067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:59.109067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:59.110565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:59.121019 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6761e1ec-2f76-444a-8bd5-02e09de4f8e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2544 microversion: 2.32 time: 1.300725 Nov 02 21:41:59.123796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1984/4091] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:41:57 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2544 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:41:59.137220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b594999c-a287-4458-9cfa-ef27a1dc9ad4 req-d7cb6b33-1253-4318-b7b3-2f68d1fdd64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-deleted", "tag": "52ef5d76-a38d-4aa9-95c4-e68c61c33135"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:59.181781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b594999c-a287-4458-9cfa-ef27a1dc9ad4 req-d7cb6b33-1253-4318-b7b3-2f68d1fdd64c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:59.182270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b594999c-a287-4458-9cfa-ef27a1dc9ad4 req-d7cb6b33-1253-4318-b7b3-2f68d1fdd64c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:59.182708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b594999c-a287-4458-9cfa-ef27a1dc9ad4 req-d7cb6b33-1253-4318-b7b3-2f68d1fdd64c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:59.218710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b594999c-a287-4458-9cfa-ef27a1dc9ad4 req-d7cb6b33-1253-4318-b7b3-2f68d1fdd64c service nova] Creating event network-vif-deleted:52ef5d76-a38d-4aa9-95c4-e68c61c33135 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:41:59.258926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b594999c-a287-4458-9cfa-ef27a1dc9ad4 req-d7cb6b33-1253-4318-b7b3-2f68d1fdd64c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125298 Nov 02 21:41:59.260042 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1985/4092] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:59.271271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:59.274411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:59.276027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:59.280513 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b343cf58-c0c4-47a9-bd53-fb3ce987f43f tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1681 microversion: 2.1 time: 0.778782 Nov 02 21:41:59.281169 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2108/4093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:58 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1681 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:41:59.290405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:59.294005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:59.294005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:59.294005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:59.294005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:59.294781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-07cc5d01-1634-40e4-b140-7ed0c2cdf911 req-beda0bce-572a-4cd3-ba64-c4341d8fca8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d81595-7ffa-4bbe-8d6f-fe9196690b0b", "name": "network-vif-deleted", "tag": "0e635ff5-298e-48fd-8cf7-0efb0c3288d4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:41:59.299464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:59.321823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07cc5d01-1634-40e4-b140-7ed0c2cdf911 req-beda0bce-572a-4cd3-ba64-c4341d8fca8c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:59.326854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07cc5d01-1634-40e4-b140-7ed0c2cdf911 req-beda0bce-572a-4cd3-ba64-c4341d8fca8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:59.326854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07cc5d01-1634-40e4-b140-7ed0c2cdf911 req-beda0bce-572a-4cd3-ba64-c4341d8fca8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:59.358032 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-07cc5d01-1634-40e4-b140-7ed0c2cdf911 req-beda0bce-572a-4cd3-ba64-c4341d8fca8c service nova] Creating event network-vif-deleted:0e635ff5-298e-48fd-8cf7-0efb0c3288d4 for instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b on n-h1-860863-4 Nov 02 21:41:59.364456 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-07cc5d01-1634-40e4-b140-7ed0c2cdf911 req-beda0bce-572a-4cd3-ba64-c4341d8fca8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079861 Nov 02 21:41:59.367075 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2109/4094] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:41:59.522531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:41:59.526061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:41:59.543996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:59.544873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:59.548995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:59.550080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:41:59.550819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:41:59.552477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:41:59.873939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:41:59.883832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9d59326-a8bb-4356-a213-c7087e3a8bd6 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 200 len: 1287 microversion: 2.1 time: 0.376124 Nov 02 21:41:59.893152 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2110/4095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:59 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 1287 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:00.044711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:00.057674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a839300d-1366-49d3-a0ee-6cd4888467e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.796197 Nov 02 21:42:00.061482 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1986/4096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:41:59 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:00.155747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:00.156614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:00.168557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:00.169474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:00.170069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:00.171318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:00.174811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:00.175569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:00.316140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:00.321275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:00.344873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:00.354535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:00.355211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:00.355983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:00.368814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:00.369417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.155211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:01.163907 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-304f0c32-bc4d-43e6-9a6a-c176eb7903da tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1681 microversion: 2.1 time: 0.860411 Nov 02 21:42:01.175948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1987/4097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:00 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1681 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:01.175948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:01.175948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: e1d81595-7ffa-4bbe-8d6f-fe9196690b0b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:01.178089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.179095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.179688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.181544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.182284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.182940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.200822 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] HTTP exception thrown: Instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b could not be found. Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Request method failure captured: Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b HTTP/1.1 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuICmgsutKLBn3A1VQBVeIMqaqPLCozBHwENec2FoXNZH1thBa8VAspfhHCRd4hIuoupNyoL8SJ0dM1AruSM3oPDYf5rO7XDFUzOfoi4jr-myFlioMa7BKPs4-cHvuEagLpr4HwEOsT0UuEG6xMP2EC9rk-cT79g8zJb9PmG4-hUyjE Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 368ab16b50f84f0d9cf6e79e039dc257 Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b could not be found. Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e1d81595-7ffa-4bbe-8d6f-fe9196690b0b'} Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b could not be found. Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b could not be found. Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:01.202806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:01.207676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:01.207676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:01.207676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:01.207676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:01.207676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:01.207676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b could not be found. Nov 02 21:42:01.207676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:01.209186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Returning 404 to user: Instance e1d81595-7ffa-4bbe-8d6f-fe9196690b0b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:01.210246 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0fc60774-d942-4090-ba73-5dfc732a1463 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b" status: 404 len: 111 microversion: 2.1 time: 0.044331 Nov 02 21:42:01.211068 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1988/4098] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:01 2022] GET /compute/v2.1/servers/e1d81595-7ffa-4bbe-8d6f-fe9196690b0b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:42:01.217291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:01.220106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:01.225025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.226323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.227710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.228625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.229250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.229841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.309686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:01.321859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:01.323346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:01.324709 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-580408c7-270a-41c5-a949-1e4235624ca1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2386 microversion: 2.32 time: 1.173213 Nov 02 21:42:01.325519 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2111/4099] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:00 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2386 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:01.333344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:01.337280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:01.354803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.356408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.356408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.356921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.357508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.358014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.390110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:01.398815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:42:01.585234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:01.597463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f1d35c9-40b0-4873-bbe4-457f4c68c5df tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.384294 Nov 02 21:42:01.600287 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1989/4100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:01 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:01.610753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ad97252f-32d6-48b9-8044-0635f5ce60e2 req-734a7c39-7fea-4a40-9edb-755b473892e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-deleted", "tag": "2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:01.628349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ad97252f-32d6-48b9-8044-0635f5ce60e2 req-734a7c39-7fea-4a40-9edb-755b473892e8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.643412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ad97252f-32d6-48b9-8044-0635f5ce60e2 req-734a7c39-7fea-4a40-9edb-755b473892e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.645695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ad97252f-32d6-48b9-8044-0635f5ce60e2 req-734a7c39-7fea-4a40-9edb-755b473892e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.661843 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ad97252f-32d6-48b9-8044-0635f5ce60e2 req-734a7c39-7fea-4a40-9edb-755b473892e8 service nova] Creating event network-vif-deleted:2a9ffd0a-7853-44d7-9be8-a9f1fcb9ce47 for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:42:01.673769 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ad97252f-32d6-48b9-8044-0635f5ce60e2 req-734a7c39-7fea-4a40-9edb-755b473892e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071373 Nov 02 21:42:01.675373 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1990/4101] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:01.895132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36bac321-490a-47a5-aeb5-67826aed9ba4 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "DELETE /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 204 len: 0 microversion: 2.1 time: 0.565865 Nov 02 21:42:01.895132 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2112/4102] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:42:01 2022] DELETE /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:42:01.903920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:01.904987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:01.920369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.921999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.923071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:01.924589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:01.925467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:01.930179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.194075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:02.194972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:02.213543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:02.214576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:02.215166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.216045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:02.216647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:02.217261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.314979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:02.322225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:02.326477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-faab8b7f-73c1-49eb-a73d-87434f17a7fd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1613 microversion: 2.1 time: 0.136895 Nov 02 21:42:02.327334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2113/4103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:02 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1613 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:42:02.349016 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0b8b668a-55b4-45c0-961d-b350db0028dc tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1674 microversion: 2.1 time: 0.450033 Nov 02 21:42:02.359957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:02.360808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:02.362053 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1991/4104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:01 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1674 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:02.369371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:02.370091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:02.370675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.371565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:02.372172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:02.372751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.628131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:02.629425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:02.638817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:02.647315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:02.648027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.649542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:02.650153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:02.650745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.663483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:02.674932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:02.685057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:02.686815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8391e830-fa85-4bcc-8c5d-a46ef75d269d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2226 microversion: 2.32 time: 0.330921 Nov 02 21:42:02.709586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2114/4105] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:02 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2226 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:02.717731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-430a8fe1-a46a-47aa-8bad-a05ac086003d req-71452db8-02a6-468b-aad0-b849c6882d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4919de14-4362-4d7b-ba9c-9679717b62a4", "name": "network-vif-deleted", "tag": "3b045895-4443-4ef3-bfb1-40527c0c2ac6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:02.730463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-430a8fe1-a46a-47aa-8bad-a05ac086003d req-71452db8-02a6-468b-aad0-b849c6882d6a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:02.731255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-430a8fe1-a46a-47aa-8bad-a05ac086003d req-71452db8-02a6-468b-aad0-b849c6882d6a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:02.731874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-430a8fe1-a46a-47aa-8bad-a05ac086003d req-71452db8-02a6-468b-aad0-b849c6882d6a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:02.749219 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-430a8fe1-a46a-47aa-8bad-a05ac086003d req-71452db8-02a6-468b-aad0-b849c6882d6a service nova] Creating event network-vif-deleted:3b045895-4443-4ef3-bfb1-40527c0c2ac6 for instance 4919de14-4362-4d7b-ba9c-9679717b62a4 on n-h1-860863-4 Nov 02 21:42:02.756594 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-430a8fe1-a46a-47aa-8bad-a05ac086003d req-71452db8-02a6-468b-aad0-b849c6882d6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044996 Nov 02 21:42:02.757978 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2115/4106] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:03.014238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:03.023553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-908e1429-9c6d-4eb1-bdb1-1af6eccb035e tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.399827 Nov 02 21:42:03.024419 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1992/4107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:02 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:42:03.354430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:03.356459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:03.357214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:03.373828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:03.381670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:03.382651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:03.383811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:03.385578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:03.385705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:03.386369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:03.387921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:03.413488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:03.417033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:03.417392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:03.422269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:03.425567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:03.425567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:03.745704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:03.768037 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bb7c815b-8a53-46f0-9ece-27d75a96266e tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1325 microversion: 2.1 time: 0.417929 Nov 02 21:42:03.773707 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2116/4108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:03 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:03.786088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-acfbca74-e831-4877-bebf-dad1a9fb1b50 req-27780fa3-6ac8-49d6-8093-947b5f480c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21137e8-af03-4d2e-84a8-6d5755d84bf0", "tag": "c38e57ef-c213-4073-9dc4-74707fdab774"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:03.816195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-acfbca74-e831-4877-bebf-dad1a9fb1b50 req-27780fa3-6ac8-49d6-8093-947b5f480c0f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:03.816691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-acfbca74-e831-4877-bebf-dad1a9fb1b50 req-27780fa3-6ac8-49d6-8093-947b5f480c0f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:03.824251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-acfbca74-e831-4877-bebf-dad1a9fb1b50 req-27780fa3-6ac8-49d6-8093-947b5f480c0f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:03.847821 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-acfbca74-e831-4877-bebf-dad1a9fb1b50 req-27780fa3-6ac8-49d6-8093-947b5f480c0f service nova] Creating event network-changed:c38e57ef-c213-4073-9dc4-74707fdab774 for instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 on n-h2-860863-4 Nov 02 21:42:03.857297 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-acfbca74-e831-4877-bebf-dad1a9fb1b50 req-27780fa3-6ac8-49d6-8093-947b5f480c0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079553 Nov 02 21:42:03.858321 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2117/4109] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:03.865085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:03.867617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:03.876147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:03.877141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:03.877763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:03.878664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:03.879354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:03.879949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:04.078750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:04.094130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:04.096873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:04.102783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3938694c-15f8-4dbd-b2ae-77886f3b49d8 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 2158 microversion: 2.32 time: 0.243006 Nov 02 21:42:04.105692 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2118/4110] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:03 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 2158 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:04.112733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:04.116428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:04.135554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:04.135554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:04.135554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:04.135554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:04.136439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:04.141223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:04.290307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:04.302232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:04.339221 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4232cd3b-d3bf-4533-9b5f-a580b22cb10e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1674 microversion: 2.1 time: 0.963003 Nov 02 21:42:04.345460 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1993/4111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:03 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1674 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:04.796898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:04.798198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:04.812498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:04.813782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:04.814374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:04.815254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:04.815903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:04.816333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:04.856827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:04.857594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:04.858310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:04.858986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lazy-loading 'fault' on Instance uuid 4919de14-4362-4d7b-ba9c-9679717b62a4 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:42:05.080780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0fbc084afdc4243a6dc363a0204f6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd463e0b630fb42618874738bd8f30457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:05.094883 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36157902-3021-4d8e-bf19-9a881602cecd tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 200 len: 1330 microversion: 2.1 time: 0.298683 Nov 02 21:42:05.096732 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1994/4112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:04 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 1330 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:05.142797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:05.143736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:05.179038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:05.186734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:05.188709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:05.193517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:05.194558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:05.195258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:05.249352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:05.259068 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb16d2a4-c81b-4619-afd1-c7e21b93b57d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 1.151387 Nov 02 21:42:05.266942 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2119/4113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:04 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:05.372041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:05.372763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:05.399634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:05.401772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:05.405854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:05.407117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:05.407814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:05.408478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:05.534462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:05.537168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:05.538907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:05.540372 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e9dd155-963d-4775-8624-c9d7f545181f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.409030 Nov 02 21:42:05.557750 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1995/4114] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:05 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:05.942128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0fa7109b-8479-4c63-8c9a-dd420b74ba36 req-f0c33bdd-ffd3-42c2-87a0-b7f9a4846116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b", "name": "network-vif-deleted", "tag": "8ef8f96f-40d1-4605-8ab7-0fb83406c4aa"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:05.954502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:05.986716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0fa7109b-8479-4c63-8c9a-dd420b74ba36 req-f0c33bdd-ffd3-42c2-87a0-b7f9a4846116 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:05.987210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0fa7109b-8479-4c63-8c9a-dd420b74ba36 req-f0c33bdd-ffd3-42c2-87a0-b7f9a4846116 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:05.987644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0fa7109b-8479-4c63-8c9a-dd420b74ba36 req-f0c33bdd-ffd3-42c2-87a0-b7f9a4846116 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:06.030402 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0fa7109b-8479-4c63-8c9a-dd420b74ba36 req-f0c33bdd-ffd3-42c2-87a0-b7f9a4846116 service nova] Creating event network-vif-deleted:8ef8f96f-40d1-4605-8ab7-0fb83406c4aa for instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b on n-h1-860863-4 Nov 02 21:42:06.055903 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0fa7109b-8479-4c63-8c9a-dd420b74ba36 req-f0c33bdd-ffd3-42c2-87a0-b7f9a4846116 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116692 Nov 02 21:42:06.057576 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1996/4115] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:42:06.131701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:06.132626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:06.156060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:06.158117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:06.160008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:06.160789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:06.174291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:06.175734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:06.201103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:06.210396 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e782b3e-0ee3-4371-bb81-301f0e0a369c tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1674 microversion: 2.1 time: 0.842571 Nov 02 21:42:06.210580 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] HTTP exception thrown: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Request method failure captured: Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 HTTP/1.1 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuNzwxbR7FtRQy81Fq6bgW4_Zfd6p0OVvvU1dDOv5Ln5SlWluzBEEKcRx2-k2K6jX8BPkwWVTJh4rjIP6k1eIT-LNXqE7vnHDj4LyzuXrZPNkq-3SJgE8KD8IxQfKg9oC9ESrHSG-0w_zCp0j2QPvyMPxTDfSHxPRkwSDbFbdLkSb38 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: d463e0b630fb42618874738bd8f30457 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d463e0b630fb42618874738bd8f30457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d463e0b630fb42618874738bd8f30457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d463e0b630fb42618874738bd8f30457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d463e0b630fb42618874738bd8f30457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: d463e0b630fb42618874738bd8f30457 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachSCSIVolumeTestJSON-242723224-project Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f0fbc084afdc4243a6dc363a0204f6e9 Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-242723224-project Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4919de14-4362-4d7b-ba9c-9679717b62a4'} Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:06.213765 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Returning 404 to user: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:06.220046 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d4e0618-b5f2-4bd5-8c1d-41ca9136dbed tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 404 len: 111 microversion: 2.1 time: 0.092123 Nov 02 21:42:06.221735 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2120/4116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:05 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1674 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:06.224476 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1997/4117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:06 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:42:06.255003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-abaa0f4c-d8b4-43ee-b16f-6409509f11fc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '.version_select at 0x7f9b6931e9d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:06.295590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:06.296374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:06.312620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:06.313385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:06.317675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:06.327810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:06.329818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:06.330835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:06.397152 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-abaa0f4c-d8b4-43ee-b16f-6409509f11fc tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673340851" status: 202 len: 0 microversion: 2.1 time: 0.166659 Nov 02 21:42:06.397770 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2121/4118] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:42:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673340851 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:42:06.595178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:06.595849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:06.631674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:06.632593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:06.633867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:06.634937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:06.636102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:06.638298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:06.711378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:06.719885 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d42efc75-4b56-4f3a-8cc7-cd5fe0214a4c tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.429995 Nov 02 21:42:06.754624 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1998/4119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:06 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:06.851217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:06.887054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:06.893814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:06.896765 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3eacd74f-f1da-45bc-a406-0b05a313a998 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.313100 Nov 02 21:42:06.914501 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2122/4120] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:06 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:07.241696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:07.243195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:07.268131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:07.274172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:07.275066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:07.280474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:07.283422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:07.286990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:07.585373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:07.595272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b73d9757-5379-461b-a0de-be2a82d259ef tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1606 microversion: 2.1 time: 0.359893 Nov 02 21:42:07.604218 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 1999/4121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:07 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1606 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:07.748724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:07.749511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:07.772768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:07.785866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:07.787065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:07.788162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:07.788787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:07.792279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:07.935136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:07.935751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:07.957388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:07.957896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:07.958359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:07.959061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:07.959510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:07.959937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:08.259404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:08.281136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:08.285781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:08.288671 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc8d024a-a3c8-4f30-93e5-5229d11d3f57 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.359542 Nov 02 21:42:08.293758 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2000/4122] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:07 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:08.483907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e3c748ff-0a20-41e9-a25f-5af3c95c3f54 req-67877855-57d6-4329-847e-a6b060c9ef6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143a3b24-a0ff-43d1-b25f-83137a325d5b", "name": "network-vif-deleted", "tag": "9434aeaa-db39-41a1-890f-55cf542fa875"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:08.499621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e3c748ff-0a20-41e9-a25f-5af3c95c3f54 req-67877855-57d6-4329-847e-a6b060c9ef6d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:08.503455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e3c748ff-0a20-41e9-a25f-5af3c95c3f54 req-67877855-57d6-4329-847e-a6b060c9ef6d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:08.504094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e3c748ff-0a20-41e9-a25f-5af3c95c3f54 req-67877855-57d6-4329-847e-a6b060c9ef6d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:08.527634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e3c748ff-0a20-41e9-a25f-5af3c95c3f54 req-67877855-57d6-4329-847e-a6b060c9ef6d service nova] Creating event network-vif-deleted:9434aeaa-db39-41a1-890f-55cf542fa875 for instance 143a3b24-a0ff-43d1-b25f-83137a325d5b on n-h1-860863-4 Nov 02 21:42:08.532636 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e3c748ff-0a20-41e9-a25f-5af3c95c3f54 req-67877855-57d6-4329-847e-a6b060c9ef6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052356 Nov 02 21:42:08.533589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2001/4123] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:42:08.580498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:08.589158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a667f18-1d6a-406c-a8ee-211026109a3a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.845430 Nov 02 21:42:08.601794 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2123/4124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:07 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:08.631229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:08.631940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:08.640434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:08.641304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:08.641993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:08.642916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:08.643583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:08.644238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:08.726447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:08.734588 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1ba4a13-04a1-4251-9233-d55f8a7922fa tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1606 microversion: 2.1 time: 0.108292 Nov 02 21:42:08.741049 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2002/4125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:08 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:09.316903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:09.318766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:09.337509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:09.338112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:09.338563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:09.339618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:09.340256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:09.340874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:09.632269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:09.633534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:09.651899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:09.652419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:09.652869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:09.653634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:09.654065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:09.663779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:09.730690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:09.798997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:09.818331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:09.824734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:09.826053 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e306774-e415-44a1-9edb-213713fa0945 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.513071 Nov 02 21:42:09.837414 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2124/4126] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:09 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:09.857667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:09.872909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:09.896281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:09.897142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:09.897822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:09.903497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:09.904304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:09.905107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:10.019266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:10.021810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:10.021810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:10.021810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lazy-loading 'fault' on Instance uuid 143a3b24-a0ff-43d1-b25f-83137a325d5b {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:42:10.062234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:10.072382 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed892fd9-bafe-41f1-bd1a-8048bf7c816a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.444494 Nov 02 21:42:10.087637 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2003/4127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:09 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:42:10.155419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368ab16b50f84f0d9cf6e79e039dc257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5033ea63e4242f6a2a8b82466c3bc46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:10.164565 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3044a39e-e8b0-4459-9301-0833681eb43e tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 200 len: 1328 microversion: 2.1 time: 0.325606 Nov 02 21:42:10.165497 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2125/4128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:09 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 1328 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:10.868880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:10.876130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:10.889451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:10.890303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:10.890925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:10.891997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:10.892833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:10.893536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:11.082125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:11.093198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:11.094977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:11.097144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7446aa5f-bb59-427d-8f4d-82b2feb65fe2 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.232791 Nov 02 21:42:11.099076 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2004/4129] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:10 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:11.112506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:11.114023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:11.127993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:11.127993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:11.127993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:11.127993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:11.129004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:11.129636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:11.130569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:11.190811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:11.191427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] [instance: 143a3b24-a0ff-43d1-b25f-83137a325d5b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:11.207813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:11.209836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:11.212398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:11.213403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:11.215523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:11.216803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:11.272564 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] HTTP exception thrown: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b could not be found. Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Request method failure captured: Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b HTTP/1.1 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuICmgsutKLBn3A1VQBVeIMqaqPLCozBHwENec2FoXNZH1thBa8VAspfhHCRd4hIuoupNyoL8SJ0dM1AruSM3oPDYf5rO7XDFUzOfoi4jr-myFlioMa7BKPs4-cHvuEagLpr4HwEOsT0UuEG6xMP2EC9rk-cT79g8zJb9PmG4-hUyjE Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c5033ea63e4242f6a2a8b82466c3bc46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: c5033ea63e4242f6a2a8b82466c3bc46 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-1786781026 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 368ab16b50f84f0d9cf6e79e039dc257 Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-1786781026-project Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b could not be found. Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '143a3b24-a0ff-43d1-b25f-83137a325d5b'} Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b could not be found. Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b could not be found. Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:11.279955 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:11.284812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:11.284812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:11.284812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:11.284812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:11.284812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:11.284812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b could not be found. Nov 02 21:42:11.284812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:11.287451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Returning 404 to user: Instance 143a3b24-a0ff-43d1-b25f-83137a325d5b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:11.288357 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ec18361-266e-4079-a2f8-6eeaa6db9525 tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b" status: 404 len: 111 microversion: 2.1 time: 0.103435 Nov 02 21:42:11.291690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2005/4130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:11 2022] GET /compute/v2.1/servers/143a3b24-a0ff-43d1-b25f-83137a325d5b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:42:11.303363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5125d2e0-4ce0-48ec-9edd-b0e19efde76f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] Calling method '.version_select at 0x7f9b682acc10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:11.404219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:11.420058 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-389dbb1b-aaeb-4c6a-b072-20ef601754e5 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.312987 Nov 02 21:42:11.424180 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2126/4131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:11 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:11.470976 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5125d2e0-4ce0-48ec-9edd-b0e19efde76f tempest-ServerActionsTestJSON-1786781026 tempest-ServerActionsTestJSON-1786781026-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834069955" status: 202 len: 0 microversion: 2.1 time: 0.176049 Nov 02 21:42:11.472140 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2006/4132] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834069955 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:42:12.144067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:12.144067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:12.167033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:12.167033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:12.167033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:12.167033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:12.167033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:12.167033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:12.335269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:12.370240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:12.373929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:12.375469 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-795c6036-72b6-4e99-b6e0-1b28c2cdb5cc tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.240371 Nov 02 21:42:12.377601 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2127/4133] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:12 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:12.448269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:12.448900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:12.461858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:12.461858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:12.461858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:12.461858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:12.461858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:12.461858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:13.094486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:13.101247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:13.126031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:13.127593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:13.134706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:13.141553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:13.141553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:13.141553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:13.328847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:13.357639 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8de98ac-6a54-4039-b806-ec56f6647c02 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.912061 Nov 02 21:42:13.373406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2007/4134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:12 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:42:13.441961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:13.446580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:13.479176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:13.480134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:13.481615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:13.483522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:13.484424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:13.485167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:13.831343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:13.877102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:13.885116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:13.897167 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4f2cc487-8937-438d-9712-bbc2e4d48eae tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2957 microversion: 2.42 time: 0.801653 Nov 02 21:42:13.897167 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2128/4135] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:13 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2957 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:13.919373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:13.920016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:13.932357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:13.932875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:13.937153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:13.937932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:13.938410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:13.938853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:13.996366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:14.086226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:14.104261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:14.107495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:14.111146 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7697476c-d807-4f19-bb2b-687214a100bd tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.683400 Nov 02 21:42:14.121379 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2008/4136] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:13 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:14.198501 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-313b95c6-f45f-4f88-b735-7f0500f4262c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.285445 Nov 02 21:42:14.199373 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2129/4137] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:42:13 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505/os-interface => generated 1831 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:14.417452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:14.419956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:14.430956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:14.433447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:14.434573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:14.436565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:14.437503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:14.440162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:14.925109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:14.935252 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-534b6c5e-bc25-474a-abec-8b175384bd6d tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.522422 Nov 02 21:42:14.939835 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2009/4138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:14 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:15.142815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:15.144428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:15.162778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:15.162778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:15.162778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:15.165531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:15.166892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:15.168601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:15.335739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:15.358764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:15.364736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:15.366946 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88279fb3-3582-4229-adc8-35d7d4a4dfec tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.227896 Nov 02 21:42:15.384551 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2130/4139] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:15 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:15.783333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b3ecd57b-fc82-4566-af26-d23f024cd0c5 req-08e7a90c-c07d-4435-ae6b-497358a7cee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21137e8-af03-4d2e-84a8-6d5755d84bf0", "name": "network-vif-plugged", "status": "completed", "tag": "c38e57ef-c213-4073-9dc4-74707fdab774"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:15.809884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3ecd57b-fc82-4566-af26-d23f024cd0c5 req-08e7a90c-c07d-4435-ae6b-497358a7cee7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:15.810387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3ecd57b-fc82-4566-af26-d23f024cd0c5 req-08e7a90c-c07d-4435-ae6b-497358a7cee7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:15.811388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b3ecd57b-fc82-4566-af26-d23f024cd0c5 req-08e7a90c-c07d-4435-ae6b-497358a7cee7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:15.829864 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b3ecd57b-fc82-4566-af26-d23f024cd0c5 req-08e7a90c-c07d-4435-ae6b-497358a7cee7 service nova] Creating event network-vif-plugged:c38e57ef-c213-4073-9dc4-74707fdab774 for instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 on n-h2-860863-4 Nov 02 21:42:15.837042 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b3ecd57b-fc82-4566-af26-d23f024cd0c5 req-08e7a90c-c07d-4435-ae6b-497358a7cee7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068630 Nov 02 21:42:15.838350 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2010/4140] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:15.972634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:15.974176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:15.991335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:15.993207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:15.993897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:15.995214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:15.996545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:15.998402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:16.405415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:16.407082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:16.423159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:16.428501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:16.429286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:16.430649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:16.431368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:16.431982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:16.750885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:16.767298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:16.770749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:16.772089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:16.775962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ef8d6188-f3dd-4d73-94a5-7807f7993e5d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.375415 Nov 02 21:42:16.779945 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2011/4141] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:16 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:16.822096 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b17def8c-589d-4061-b6d6-a4600c0892d0 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1365 microversion: 2.1 time: 0.858060 Nov 02 21:42:16.825416 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2131/4142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:15 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1365 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:17.818517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:17.818517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:17.824884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:17.825258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:17.825706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:17.826423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:17.826889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:17.827313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:17.850923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:17.853124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:17.876678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:17.878041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:17.878521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:17.881354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:17.882189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:17.886402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:19.000196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:19.011712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:19.013386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:19.014614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ea33d243-b163-41f2-a0b0-e2e1093cf02d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 1.209760 Nov 02 21:42:19.043049 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2012/4143] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:17 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:19.062613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:19.063129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:19.079725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:19.080244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:19.080692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:19.089704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:19.090221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:19.090673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:19.118187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] HTTP exception thrown: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Request method failure captured: Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 HTTP/1.1 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuNzwxbR7FtRQy81Fq6bgW4_Zfd6p0OVvvU1dDOv5Ln5SlWluzBEEKcRx2-k2K6jX8BPkwWVTJh4rjIP6k1eIT-LNXqE7vnHDj4LyzuXrZPNkq-3SJgE8KD8IxQfKg9oC9ESrHSG-0w_zCp0j2QPvyMPxTDfSHxPRkwSDbFbdLkSb38 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: d463e0b630fb42618874738bd8f30457 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d463e0b630fb42618874738bd8f30457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d463e0b630fb42618874738bd8f30457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d463e0b630fb42618874738bd8f30457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d463e0b630fb42618874738bd8f30457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: d463e0b630fb42618874738bd8f30457 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachSCSIVolumeTestJSON-242723224-project Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f0fbc084afdc4243a6dc363a0204f6e9 Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-242723224-project Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4919de14-4362-4d7b-ba9c-9679717b62a4'} Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:19.119929 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Returning 404 to user: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:19.123766 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-57b0dd5b-f5a8-4ee8-bcad-a1d2f4b48dbb tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 404 len: 111 microversion: 2.1 time: 0.078803 Nov 02 21:42:19.135646 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2013/4144] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:42:19 2022] DELETE /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:42:19.141753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:19.142393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] [instance: 4919de14-4362-4d7b-ba9c-9679717b62a4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:19.156561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:19.156561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:19.157165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:19.158107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:19.158756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:19.159494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:19.194105 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] HTTP exception thrown: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Request method failure captured: Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 HTTP/1.1 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuNzwxbR7FtRQy81Fq6bgW4_Zfd6p0OVvvU1dDOv5Ln5SlWluzBEEKcRx2-k2K6jX8BPkwWVTJh4rjIP6k1eIT-LNXqE7vnHDj4LyzuXrZPNkq-3SJgE8KD8IxQfKg9oC9ESrHSG-0w_zCp0j2QPvyMPxTDfSHxPRkwSDbFbdLkSb38 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: d463e0b630fb42618874738bd8f30457 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d463e0b630fb42618874738bd8f30457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d463e0b630fb42618874738bd8f30457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d463e0b630fb42618874738bd8f30457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d463e0b630fb42618874738bd8f30457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: d463e0b630fb42618874738bd8f30457 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-242723224 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachSCSIVolumeTestJSON-242723224-project Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f0fbc084afdc4243a6dc363a0204f6e9 Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-242723224-project Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4919de14-4362-4d7b-ba9c-9679717b62a4'} Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:19.201323 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.205196 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:19.205196 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:19.205196 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:19.205196 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:19.205196 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:19.205196 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. Nov 02 21:42:19.205196 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:19.209530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] Returning 404 to user: Instance 4919de14-4362-4d7b-ba9c-9679717b62a4 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:19.210587 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b41c1437-1685-4957-8b4e-11ffa6cf4950 tempest-AttachSCSIVolumeTestJSON-242723224 tempest-AttachSCSIVolumeTestJSON-242723224-project] 10.222.0.25 "GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4" status: 404 len: 111 microversion: 2.1 time: 0.073783 Nov 02 21:42:19.223122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2014/4145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:19 2022] GET /compute/v2.1/servers/4919de14-4362-4d7b-ba9c-9679717b62a4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:42:19.842406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:19.909057 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8812ea8-d079-4dd8-ac7b-703aa5e871ea tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1555 microversion: 2.1 time: 2.062576 Nov 02 21:42:19.910213 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2132/4146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:17 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1555 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:19.934083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:19.934588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:19.954083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:19.954581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:19.955028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:19.955749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:19.956208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:19.956644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:20.075193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:20.075737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:20.094317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:20.103714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:20.103714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:20.103714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:20.103714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:20.103714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:20.229840 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b3e3e27-285e-43c1-8ad9-d0a1e036e34a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.300300 Nov 02 21:42:20.231128 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2015/4147] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:42:19 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-interface => generated 285 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:20.432462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:20.448694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:20.451661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:20.455634 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f2e39e4-9844-4006-97f3-1f1695504757 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.384701 Nov 02 21:42:20.459293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2133/4148] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:20 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:21.491155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:21.491790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:21.515145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:21.515663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:21.516114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:21.527040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:21.527552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:21.528013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:21.863908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:21.886323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:21.888570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:21.893833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff6a3c6e-a302-4b4e-baa8-74549f3e8f7d tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.408532 Nov 02 21:42:21.927633 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2016/4149] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:21 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:22.950223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:22.952136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:22.965622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:22.966380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:22.967048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:22.968257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:22.976104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:22.976104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:23.309585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:23.331911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:23.337423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:23.342985 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-012ce9a6-e624-4999-97e7-93170066a2c3 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.400517 Nov 02 21:42:23.345327 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2134/4150] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:22 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:24.376298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:24.376917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:24.393164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:24.394662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:24.395319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:24.396233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:24.397652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:24.399596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:24.560324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:24.584096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:24.592048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:24.593866 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9bc60240-47d1-463d-b3a1-dfe48ce1caea tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.217575 Nov 02 21:42:24.594594 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2017/4151] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:24 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:25.623149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:25.624122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:25.643433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:25.645374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:25.647846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:25.648521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:25.654124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:25.661349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:25.663744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-49a122e4-1539-4e0a-92e2-9759e1a756f9 req-abeab578-9548-4be3-ac5e-c4b9df033e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21137e8-af03-4d2e-84a8-6d5755d84bf0", "tag": "c38e57ef-c213-4073-9dc4-74707fdab774"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:25.664790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:25.715877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49a122e4-1539-4e0a-92e2-9759e1a756f9 req-abeab578-9548-4be3-ac5e-c4b9df033e12 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:25.716439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49a122e4-1539-4e0a-92e2-9759e1a756f9 req-abeab578-9548-4be3-ac5e-c4b9df033e12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:25.718057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49a122e4-1539-4e0a-92e2-9759e1a756f9 req-abeab578-9548-4be3-ac5e-c4b9df033e12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:25.753844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-49a122e4-1539-4e0a-92e2-9759e1a756f9 req-abeab578-9548-4be3-ac5e-c4b9df033e12 service nova] Creating event network-changed:c38e57ef-c213-4073-9dc4-74707fdab774 for instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 on n-h2-860863-4 Nov 02 21:42:25.794385 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-49a122e4-1539-4e0a-92e2-9759e1a756f9 req-abeab578-9548-4be3-ac5e-c4b9df033e12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417358 Nov 02 21:42:25.796177 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2135/4152] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:26.002304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:26.025033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:26.031755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:26.040473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-43fe970d-e7bc-48df-b6cd-ea383efaa0c1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.421160 Nov 02 21:42:26.043088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2018/4153] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:25 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:27.073602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:27.075506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:27.098524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:27.099447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:27.100099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:27.104205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:27.105809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:27.107062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:27.324787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:27.347585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:27.353923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:27.356031 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f315534a-0ba0-4be5-94cd-9a5a0b0e889f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.288121 Nov 02 21:42:27.357384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2136/4154] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:27 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:28.394563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:28.395406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:28.416697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:28.417431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:28.423334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:28.423334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:28.423334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:28.423334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:28.588863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:28.613626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:28.621864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:28.624309 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-899c6c6a-688e-48dd-983e-d5579a73867f tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.239049 Nov 02 21:42:28.626363 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2019/4155] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:28 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:29.171873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1854206095", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:29.280321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] validate_networks() for [('cad765a1-cacf-48e3-8563-6fc38217862b', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:42:29.655834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:29.656561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:29.672035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:29.686145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:29.687145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:29.692245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:29.693480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:29.694379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:30.144817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:30.163206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:30.174279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:30.182799 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a400de64-b415-4217-b671-f65ad4c370e4 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.530852 Nov 02 21:42:30.186198 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2020/4156] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:29 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:31.210511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:31.212247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:31.229199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:31.232604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:31.232604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:31.232604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:31.232604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:31.232604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:31.270808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:42:31.273320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:42:31.278435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:42:31.278435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:42:31.278435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:42:31.306529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:31.307610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:31.308854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:31.314510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:31.322682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:31.324077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:31.377596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for project df79cd574b99449bae4c4b82e1c698a0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:42:31.394350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for user 887a362ce68547af87982d10a253bf97 and project df79cd574b99449bae4c4b82e1c698a0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:42:31.408291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:42:31.411583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:42:31.565680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:31.584860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:31.597573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:31.599087 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-deb68838-c66d-4a55-ad4f-0be6bdd68de1 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.392469 Nov 02 21:42:31.613630 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2021/4157] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:31 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:31.625823 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-315f9d88-4e8c-4226-996f-742b08327d0b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.565466 Nov 02 21:42:31.626487 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2137/4158] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:42:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:42:31.667962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1ee69ace-3ce2-4c96-b14f-b4dba75686fe tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:31.676790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1ee69ace-3ce2-4c96-b14f-b4dba75686fe tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:32.205447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1ee69ace-3ce2-4c96-b14f-b4dba75686fe tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:32.235691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1ee69ace-3ce2-4c96-b14f-b4dba75686fe tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1222 microversion: 2.1 time: 0.585453 Nov 02 21:42:32.237423 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2022/4159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:31 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1222 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:32.608158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1916714907", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:32.626632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:32.627263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:32.660838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:32.664057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:32.664669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:32.665305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:32.665783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:32.666221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:32.776376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] validate_networks() for [('cad765a1-cacf-48e3-8563-6fc38217862b', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:42:32.928680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:32.949529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:32.951019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:32.952249 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-80a5db6f-cea5-4a83-9bb2-59073667306e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.329571 Nov 02 21:42:32.994310 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2023/4160] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:32 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:33.983648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:33.990911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:34.017230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:34.025166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:34.025166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:34.025166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:34.025166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:34.025166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:34.397836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:42:34.398361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:42:34.398962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:42:34.399377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:42:34.399799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:42:34.425210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:34.426617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:34.429957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:34.433749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:34.435694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:34.439791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:34.444819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:34.450237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:34.457436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:34.461515 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72fc80c3-b375-47c0-bc25-af2f58fd5573 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1603 microversion: 2.32 time: 0.484581 Nov 02 21:42:34.464391 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2024/4161] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:33 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1603 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:34.509177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for project df79cd574b99449bae4c4b82e1c698a0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:42:34.525143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for user 887a362ce68547af87982d10a253bf97 and project df79cd574b99449bae4c4b82e1c698a0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:42:34.566018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:42:34.571787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:42:34.831713 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e43685f7-7ced-41d6-8e16-fcfc0fad8bae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.228786 Nov 02 21:42:34.838254 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2138/4162] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:42:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:42:34.845775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d0fa3b3-d9c0-4d92-8fcd-baac7b47e0c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:34.846565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3d0fa3b3-d9c0-4d92-8fcd-baac7b47e0c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:34.990587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3d0fa3b3-d9c0-4d92-8fcd-baac7b47e0c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:34.999544 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d0fa3b3-d9c0-4d92-8fcd-baac7b47e0c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1222 microversion: 2.1 time: 0.157614 Nov 02 21:42:35.002512 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2025/4163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:34 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:35.495850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:35.496610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:35.510688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:35.511448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:35.512129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:35.515530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:35.516145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:35.516844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:35.603148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:35.603774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:35.606748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:35.607364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lazy-loading 'fault' on Instance uuid f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:42:35.706356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:35.718751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:35.723336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3b730f0403344adea9f279c0912749e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd81c8f14274b0e80039fc545be40d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:35.724778 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-10c71814-45aa-447f-8a50-5d4785b1c5b5 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 200 len: 1608 microversion: 2.32 time: 0.234261 Nov 02 21:42:35.745919 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2139/4164] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:35 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 1608 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:35.780914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-391411417", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": "none"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:35.936398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:42:35.938581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:42:35.939480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:42:35.940154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:42:35.941320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:42:35.962265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:35.962895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:35.969605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:35.973559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:35.984850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:35.985627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:36.003811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:36.030805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-217fbe27-551f-4997-9697-eac412277f00 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:36.031666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-217fbe27-551f-4997-9697-eac412277f00 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:36.074969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Getting quotas for project ee027b6455cd4df883191f410c415f0f. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:42:36.099962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Getting quotas for user 17bda08e43104a22a21db8ef07d48301 and project ee027b6455cd4df883191f410c415f0f. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:42:36.131659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:42:36.138299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:42:36.207052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-217fbe27-551f-4997-9697-eac412277f00 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:36.219901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-217fbe27-551f-4997-9697-eac412277f00 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1222 microversion: 2.1 time: 0.192584 Nov 02 21:42:36.221262 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2140/4165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:36 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:36.374149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-acfd5bba-7cfd-428d-aee2-44fd58b07486 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.832973 Nov 02 21:42:36.377156 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2026/4166] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:42:36.388981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af8129b5-e5c7-4d95-abd0-1435883449c3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:36.397887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af8129b5-e5c7-4d95-abd0-1435883449c3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:36.535492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af8129b5-e5c7-4d95-abd0-1435883449c3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:36.557795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af8129b5-e5c7-4d95-abd0-1435883449c3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:36.572208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af8129b5-e5c7-4d95-abd0-1435883449c3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:36.575036 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af8129b5-e5c7-4d95-abd0-1435883449c3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1277 microversion: 2.54 time: 0.189174 Nov 02 21:42:36.581666 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2141/4167] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:36 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:36.765291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:36.767270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:36.781640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:36.783993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:36.788081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:36.789869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:36.790771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:36.792070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:36.836514 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] HTTP exception thrown: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Request method failure captured: Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b HTTP/1.1 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuJNCJZGVaajV6vyiE7ElMgFzrW39VNA7QaJ6N_gAR2Qj0LhJHMQcyHZHugp-6hwYVwZWxuW8ch9MNYHEOLzXB1w5ZcAR6DZ_rDw6bCEdpFe_IKSN9uTVGitl8BJFNkERlnkbJwzQcjy1SKGe6Jd_aG5AkB6HwaMTnAuDW2_b-AtzDE Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: cdd81c8f14274b0e80039fc545be40d2 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: cdd81c8f14274b0e80039fc545be40d2 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TaggedBootDevicesTest-1815650486-project Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 3b730f0403344adea9f279c0912749e6 Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TaggedBootDevicesTest-1815650486-project Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b'} Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:36.840080 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:36.845211 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:36.846617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Returning 404 to user: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:36.852273 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9aedb56-05b6-4cff-b30c-3fae08791f3e tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 404 len: 111 microversion: 2.32 time: 0.093155 Nov 02 21:42:36.857370 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2027/4168] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:36 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:42:36.863176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd76e2f5-ef23-4d3b-a549-63c30e39e6c9 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '.version_select at 0x7f9b68f70af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:37.006845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd76e2f5-ef23-4d3b-a549-63c30e39e6c9 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988081662" status: 204 len: 0 microversion: 2.32 time: 0.147225 Nov 02 21:42:37.007534 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2142/4169] 10.222.0.25 () {60 vars in 1259 bytes} [Wed Nov 2 21:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988081662 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:42:37.244579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:37.245354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:37.251360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:37.251844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:37.252340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:37.257077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:37.258892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:37.259525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:37.548682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:37.567298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-917a194c-ee42-46e0-8154-53051ac4baf2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1218 microversion: 2.1 time: 0.321549 Nov 02 21:42:37.568635 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2028/4170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:37 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1218 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:37.619792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3795e0f4-e717-4ee4-9b5a-9ac1070009ed tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:37.620422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3795e0f4-e717-4ee4-9b5a-9ac1070009ed tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:37.784709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3795e0f4-e717-4ee4-9b5a-9ac1070009ed tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:37.798953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3795e0f4-e717-4ee4-9b5a-9ac1070009ed tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:37.802901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3795e0f4-e717-4ee4-9b5a-9ac1070009ed tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:37.807631 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3795e0f4-e717-4ee4-9b5a-9ac1070009ed tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1277 microversion: 2.54 time: 0.192008 Nov 02 21:42:37.810709 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2143/4171] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:37 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:38.592000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:38.593350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:38.606694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:38.607804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:38.608411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:38.609345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:38.610161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:38.610792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:38.727447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:38.742537 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77be27b6-ca0d-4033-a44f-c3224e5c5f21 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1282 microversion: 2.1 time: 0.151309 Nov 02 21:42:38.742537 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2029/4172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:38 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:38.839125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:38.840400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:38.848742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:38.850781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:38.852367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:38.853355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:38.854058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:38.854714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:38.952982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:38.967360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:38.971607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:38.982859 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4bcc4857-3a19-44d4-a340-9670d20acdd7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1273 microversion: 2.54 time: 0.139990 Nov 02 21:42:38.982859 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2144/4173] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:38 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:39.768397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:39.769137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:39.789178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:39.790155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:39.791448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:39.794296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:39.795041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:39.795657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:39.977605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:40.003296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e92aae26-2958-421c-b3cc-96fc74d07d88 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1280 microversion: 2.1 time: 0.240175 Nov 02 21:42:40.039794 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2030/4174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:39 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:40.047386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:40.048019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:40.063550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:40.065593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:40.069047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:40.070374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:40.071349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:40.071952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:40.146001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8499df4d-12fb-42e1-9a11-33819d681ab6 req-bceeb9e0-272c-499d-a6c8-fab3af5f7e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3062332-f0fb-4550-8833-d635f1a66ecd", "tag": "df8a5f26-1f77-4141-9b19-fd0a12030b75"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:40.169657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8499df4d-12fb-42e1-9a11-33819d681ab6 req-bceeb9e0-272c-499d-a6c8-fab3af5f7e4f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:40.175466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8499df4d-12fb-42e1-9a11-33819d681ab6 req-bceeb9e0-272c-499d-a6c8-fab3af5f7e4f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:40.175466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8499df4d-12fb-42e1-9a11-33819d681ab6 req-bceeb9e0-272c-499d-a6c8-fab3af5f7e4f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:40.188886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8499df4d-12fb-42e1-9a11-33819d681ab6 req-bceeb9e0-272c-499d-a6c8-fab3af5f7e4f service nova] Creating event network-changed:df8a5f26-1f77-4141-9b19-fd0a12030b75 for instance e3062332-f0fb-4550-8833-d635f1a66ecd on n-h1-860863-4 Nov 02 21:42:40.207619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:40.209578 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8499df4d-12fb-42e1-9a11-33819d681ab6 req-bceeb9e0-272c-499d-a6c8-fab3af5f7e4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220198 Nov 02 21:42:40.210204 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2145/4175] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:42:40.220138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:40.223040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:40.224676 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c411818-363c-4748-a777-9e503499b29a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1337 microversion: 2.54 time: 0.183604 Nov 02 21:42:40.237378 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2031/4176] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:40 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1337 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:41.029780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:41.030942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:41.044862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:41.048339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:41.049442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:41.064750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:41.065630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:41.066278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:41.177745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:41.195370 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4484c514-25c6-43a9-8917-39fb7b88400b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1280 microversion: 2.1 time: 0.169350 Nov 02 21:42:41.214076 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2146/4177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:41 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:41.265297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:41.266924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:41.274902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:41.275584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:41.276034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:41.276744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:41.277323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:41.277749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:41.360082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:41.380381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:41.384725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:41.386195 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e39c8eb1-adcf-48c6-8733-5f9652255bf6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1335 microversion: 2.54 time: 0.125765 Nov 02 21:42:41.387286 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2032/4178] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:41 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1335 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:42.220210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:42.221464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:42.241281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:42.242490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:42.248826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:42.248826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:42.248826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:42.248826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:42.416253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:42.417270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:42.433359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:42.443746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:42.443746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:42.443746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:42.443746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:42.443746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:42.709362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:42.747024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:42.748765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:42.755474 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b578555-1cd6-420b-bda4-8c3ac88cb903 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1335 microversion: 2.54 time: 0.344350 Nov 02 21:42:42.756581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2033/4179] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:42 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1335 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:43.307830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:43.325267 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecfd8a0c-c9d9-4c54-9154-7f16c878f49f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1322 microversion: 2.1 time: 1.108786 Nov 02 21:42:43.326682 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2147/4180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:42 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1322 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:43.793194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:43.793969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:43.810063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:43.814050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:43.814050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:43.814050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:43.814050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:43.814050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:44.023429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:44.036200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:44.043391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:44.058669 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-134fec53-1b62-4e4e-931f-8f75480f6dd6 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1356 microversion: 2.54 time: 0.269007 Nov 02 21:42:44.059994 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2034/4181] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:43 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:44.088254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da67967e-174a-4771-a218-9b7ef14c70b4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Action: 'create', calling method: .version_select at 0x7f9b6882c820>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-211091285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfn7GmQ15uugCjFGQtmbX8wsb8hReN36yztImvnE5isurpIJ41PxRln10S6q9U+a9/Dl2xgq9MfmMNC6oZI5KcVyWPiqMCKwWzSirAXJ6d10zJ94T1GMytFbiQL4jzaIQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:44.100749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:44.126082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-da67967e-174a-4771-a218-9b7ef14c70b4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Getting quotas for project ee027b6455cd4df883191f410c415f0f. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:42:44.145669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-da67967e-174a-4771-a218-9b7ef14c70b4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Getting quotas for user 17bda08e43104a22a21db8ef07d48301 and project ee027b6455cd4df883191f410c415f0f. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:42:44.318848 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da67967e-174a-4771-a218-9b7ef14c70b4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.235063 Nov 02 21:42:44.320853 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2148/4182] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:42:44 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:42:44.340918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-211091285", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:44.352396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:44.353267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:44.362127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:44.380164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:44.381196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:44.382581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:44.386084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:44.386697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:44.387385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:44.389254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:44.389820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:44.392571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:44.393581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:44.394403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:44.395310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:44.489679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:44.570463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:42:44.571518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:42:44.572359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:42:44.573034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:42:44.573669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:42:44.869671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:44.882893 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d75a733-a609-4dda-8ff3-3487f806ece8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1322 microversion: 2.1 time: 0.530174 Nov 02 21:42:44.885325 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2149/4183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:44 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:42:44.890547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c01f26a6-e5f3-44d7-b78b-dd4daeee7b89 req-e527bd60-204b-40c3-b987-b8871bf167a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd55ba83-9cae-44f7-8a0f-8cb4ed408dad", "tag": "7fd216f5-6a20-45d0-b169-f23f091c542c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:44.921859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c01f26a6-e5f3-44d7-b78b-dd4daeee7b89 req-e527bd60-204b-40c3-b987-b8871bf167a0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:44.922624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c01f26a6-e5f3-44d7-b78b-dd4daeee7b89 req-e527bd60-204b-40c3-b987-b8871bf167a0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:44.923226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c01f26a6-e5f3-44d7-b78b-dd4daeee7b89 req-e527bd60-204b-40c3-b987-b8871bf167a0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:44.935813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c01f26a6-e5f3-44d7-b78b-dd4daeee7b89 req-e527bd60-204b-40c3-b987-b8871bf167a0 service nova] Creating event network-changed:7fd216f5-6a20-45d0-b169-f23f091c542c for instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad on n-h1-860863-4 Nov 02 21:42:44.941415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c01f26a6-e5f3-44d7-b78b-dd4daeee7b89 req-e527bd60-204b-40c3-b987-b8871bf167a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054641 Nov 02 21:42:44.942411 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2150/4184] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:45.162706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:45.171564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:45.172444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:45.173167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:45.174115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:45.174787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:45.175454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:45.241280 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2daf0f5-81a0-4b6e-a987-ec098f6e0ffe tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "POST /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10/action" status: 202 len: 1138 microversion: 2.54 time: 0.905744 Nov 02 21:42:45.243282 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2035/4185] 10.222.0.25 () {62 vars in 1320 bytes} [Wed Nov 2 21:42:44 2022] POST /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10/action => generated 1138 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 21:42:45.269536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:45.270571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:45.304646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:45.305441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:45.308237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:45.308237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:45.308237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:45.308237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:45.485263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:45.498592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:45.500330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:45.504763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2f4652d-d614-45c7-8901-f40445265bbc tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.240505 Nov 02 21:42:45.508800 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2151/4186] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:45 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:45.605759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-467ffd57-3f18-4f78-899a-4391ba05ce82 req-6727d5cf-2ee3-4cd2-ba6f-55b4209b4757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3062332-f0fb-4550-8833-d635f1a66ecd", "name": "network-vif-plugged", "status": "completed", "tag": "df8a5f26-1f77-4141-9b19-fd0a12030b75"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:45.619304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-467ffd57-3f18-4f78-899a-4391ba05ce82 req-6727d5cf-2ee3-4cd2-ba6f-55b4209b4757 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:45.620049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-467ffd57-3f18-4f78-899a-4391ba05ce82 req-6727d5cf-2ee3-4cd2-ba6f-55b4209b4757 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:45.620637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-467ffd57-3f18-4f78-899a-4391ba05ce82 req-6727d5cf-2ee3-4cd2-ba6f-55b4209b4757 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:45.637591 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-467ffd57-3f18-4f78-899a-4391ba05ce82 req-6727d5cf-2ee3-4cd2-ba6f-55b4209b4757 service nova] Creating event network-vif-plugged:df8a5f26-1f77-4141-9b19-fd0a12030b75 for instance e3062332-f0fb-4550-8833-d635f1a66ecd on n-h1-860863-4 Nov 02 21:42:45.645041 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-467ffd57-3f18-4f78-899a-4391ba05ce82 req-6727d5cf-2ee3-4cd2-ba6f-55b4209b4757 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199472 Nov 02 21:42:45.646191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2036/4187] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:45.915731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:45.916161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:45.924943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:45.925458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:45.925906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:45.926620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:45.927266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:45.927580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:46.223604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:46.226287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=90 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:46.232675 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df8cb212-dd57-46bf-b7fa-5c9ca73defbb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1322 microversion: 2.1 time: 0.324569 Nov 02 21:42:46.233488 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2152/4188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:45 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:46.536200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:46.537603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:46.545506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:46.546664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:46.548610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:46.549329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:46.550239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:46.550957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:46.551564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:46.552132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:46.712275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:46.721719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:46.723310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:46.730967 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6bdb0702-d08d-4a70-81b7-40872b645f9f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.199191 Nov 02 21:42:46.733366 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2037/4189] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:46 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:47.259522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:47.260069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:47.278016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:47.278838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:47.279468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:47.280224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:47.280693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:47.284655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:47.765158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:47.766679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:47.779965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:47.788576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:47.788576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:47.788576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:47.788576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:47.788576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:47.800170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:47.812289 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a86f9afa-e237-4879-8feb-7e9aa6f1aebb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1322 microversion: 2.1 time: 0.558817 Nov 02 21:42:47.834133 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2153/4190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:47 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:47.967227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:47.978897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:47.981920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:47.994471 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab552dbd-f08d-4815-9bb2-5668ecd0f24e tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.233270 Nov 02 21:42:47.995591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2038/4191] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:47 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:48.422504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:48.423667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:48.437276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:48.449649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:48.450129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:48.462902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:48.463460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:48.463956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:48.539024 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] HTTP exception thrown: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Request method failure captured: Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b HTTP/1.1 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuJNCJZGVaajV6vyiE7ElMgFzrW39VNA7QaJ6N_gAR2Qj0LhJHMQcyHZHugp-6hwYVwZWxuW8ch9MNYHEOLzXB1w5ZcAR6DZ_rDw6bCEdpFe_IKSN9uTVGitl8BJFNkERlnkbJwzQcjy1SKGe6Jd_aG5AkB6HwaMTnAuDW2_b-AtzDE Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: cdd81c8f14274b0e80039fc545be40d2 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: cdd81c8f14274b0e80039fc545be40d2 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TaggedBootDevicesTest-1815650486-project Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 3b730f0403344adea9f279c0912749e6 Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TaggedBootDevicesTest-1815650486-project Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b'} Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:48.541834 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Returning 404 to user: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-45d470b1-b90e-46b1-bb6c-6e976d6d6ef7 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 404 len: 111 microversion: 2.32 time: 0.125935 Nov 02 21:42:48.550630 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2154/4192] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:42:48 2022] DELETE /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:42:48.565553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:48.567334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] [instance: f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:48.588500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:48.620335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:48.620815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:48.633448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:48.637394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:48.642532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:48.683435 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] HTTP exception thrown: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Request method failure captured: Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b HTTP/1.1 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuJNCJZGVaajV6vyiE7ElMgFzrW39VNA7QaJ6N_gAR2Qj0LhJHMQcyHZHugp-6hwYVwZWxuW8ch9MNYHEOLzXB1w5ZcAR6DZ_rDw6bCEdpFe_IKSN9uTVGitl8BJFNkERlnkbJwzQcjy1SKGe6Jd_aG5AkB6HwaMTnAuDW2_b-AtzDE Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: cdd81c8f14274b0e80039fc545be40d2 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cdd81c8f14274b0e80039fc545be40d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: cdd81c8f14274b0e80039fc545be40d2 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1815650486 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TaggedBootDevicesTest-1815650486-project Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 3b730f0403344adea9f279c0912749e6 Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TaggedBootDevicesTest-1815650486-project Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b'} Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.701415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. Nov 02 21:42:48.706475 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:42:48.707399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] Returning 404 to user: Instance f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:42:48.712417 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f2c0120-427c-41c0-8013-7579ad7c7474 tempest-TaggedBootDevicesTest-1815650486 tempest-TaggedBootDevicesTest-1815650486-project] 10.222.0.25 "GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b" status: 404 len: 111 microversion: 2.32 time: 0.159592 Nov 02 21:42:48.720709 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2039/4193] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:48 2022] GET /compute/v2.1/servers/f1ecf6ad-c4a9-4ed6-81ea-c8af9924877b => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:42:48.842274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:48.843147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:48.855837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:48.856361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:48.858575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:48.859531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:48.861227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:48.863174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:49.032163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:49.033442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:49.062523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:49.064269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:49.065321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:49.066790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:49.069269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:49.070170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:49.386043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:49.400262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:49.405735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:49.407565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-74885ed3-7bc3-46f8-8dcb-33a1a5405bb4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.387303 Nov 02 21:42:49.410110 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2040/4194] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:49 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:49.479753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:49.492272 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56439dfa-28d0-4971-9ba1-e52e845324db tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1322 microversion: 2.1 time: 0.655473 Nov 02 21:42:49.495117 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2155/4195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:48 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1322 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:49.624428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-db96b2f3-9aa0-4d10-95dc-38c3b924a38d req-697065d9-eb22-4e34-8bbe-f0c68ed8c20f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd55ba83-9cae-44f7-8a0f-8cb4ed408dad", "name": "network-vif-plugged", "status": "completed", "tag": "7fd216f5-6a20-45d0-b169-f23f091c542c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:49.645489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-db96b2f3-9aa0-4d10-95dc-38c3b924a38d req-697065d9-eb22-4e34-8bbe-f0c68ed8c20f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:49.650790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-db96b2f3-9aa0-4d10-95dc-38c3b924a38d req-697065d9-eb22-4e34-8bbe-f0c68ed8c20f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:49.653330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-db96b2f3-9aa0-4d10-95dc-38c3b924a38d req-697065d9-eb22-4e34-8bbe-f0c68ed8c20f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:49.674970 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-db96b2f3-9aa0-4d10-95dc-38c3b924a38d req-697065d9-eb22-4e34-8bbe-f0c68ed8c20f service nova] Creating event network-vif-plugged:7fd216f5-6a20-45d0-b169-f23f091c542c for instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad on n-h1-860863-4 Nov 02 21:42:49.700252 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-db96b2f3-9aa0-4d10-95dc-38c3b924a38d req-697065d9-eb22-4e34-8bbe-f0c68ed8c20f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067987 Nov 02 21:42:49.700252 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2041/4196] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:50.442231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:50.443047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:50.455527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:50.457855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:50.458578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:50.459556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:50.462926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:50.466795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:50.524138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:50.525476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:50.532840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:50.533695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:50.534305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:50.535173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:50.535784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:50.536446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:50.547039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:50.557180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:50.559069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:50.560273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f9dfb39-5881-4034-9a7b-44a24a158f07 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.124063 Nov 02 21:42:50.560842 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2156/4197] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:50 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:50.696179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:50.707933 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-502ca26a-1c23-4c19-bc9a-4dfead7a0dcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1322 microversion: 2.1 time: 0.189473 Nov 02 21:42:50.713134 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2042/4198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:50 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:50.823206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:50.823334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:50.832262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:50.836057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:50.839683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:50.840662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:50.845838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:50.845838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:50.909909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-972a01bf-57ab-4e30-802d-e82756cc5cd9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/ips" status: 200 len: 149 microversion: 2.1 time: 0.091693 Nov 02 21:42:50.934095 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2157/4199] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:42:50 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/ips => generated 149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:51.591495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:51.592405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:51.608122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:51.609019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:51.609707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:51.610660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:51.611319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:51.611932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:51.735830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:51.738423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:51.739158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:51.745171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:51.754856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:51.756418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:51.762175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:51.762307 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3c75496-e3bb-4e33-93c2-0955f7b4159f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.175891 Nov 02 21:42:51.762574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:51.763460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:51.777097 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2043/4200] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:51 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:51.777302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:51.777302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:51.777302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:52.153970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:52.162112 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-12b55e29-b0f5-45b6-8b2d-c79e4c5e54ae tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1516 microversion: 2.1 time: 0.427865 Nov 02 21:42:52.162694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2158/4201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:51 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:52.189498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:52.191687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:52.201866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:52.202372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:52.202868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:52.203523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:52.203997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:52.204437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:52.261735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lazy-loading 'flavor' on Instance uuid bd55ba83-9cae-44f7-8a0f-8cb4ed408dad {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:42:52.719055 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85b4074c-8933-48c0-896e-1a67a13967e2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action" status: 200 len: 32 microversion: 2.1 time: 0.528595 Nov 02 21:42:52.719055 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2044/4202] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:42:52 2022] POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action => generated 32 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:42:52.727494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:52.728138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:52.740576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:52.741225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:52.742105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:52.743112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:52.743580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:52.744028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:52.796398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:52.797507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:52.810734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:52.812374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:52.821726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:52.822848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:52.828964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:52.829617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:53.099372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:53.113027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:53.114834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:53.116320 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5633fc1f-44ca-4e3f-b1c1-ebc06e9dee3f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.324354 Nov 02 21:42:53.119124 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2045/4203] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:52 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:53.465314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:53.476962 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71bdeda2-d2cd-4db3-968b-ad0902b6f253 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.753555 Nov 02 21:42:53.489052 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2159/4204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:52 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:42:53.786990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a9878de-046f-4617-9f23-d4bd930d8456"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:42:53.791448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:53.801175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:53.802314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:53.803146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:53.804194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:53.804858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:53.805538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:54.160259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:54.163373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:54.172375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=22 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:54.177098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:54.178483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:54.180161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:54.181240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:54.182542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:54.183394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:54.410837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:54.421005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:54.426471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:54.432900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2c6d11c-6500-4e05-ba6e-68377d340808 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.283784 Nov 02 21:42:54.435938 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2160/4205] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:54 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:54.508672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:54.508672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:54.518033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:54.518533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:54.518973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:54.519690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:54.520184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:54.520649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:54.730188 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2603d068-d326-4b89-83f9-6f920741edd6 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "POST /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947078 Nov 02 21:42:54.731992 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2046/4206] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:42:53 2022] POST /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:42:54.995204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:55.003478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d779a9d7-eaaa-4906-8bac-1fbc75ecf936 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.501566 Nov 02 21:42:55.005851 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2161/4207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:54 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:55.462419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:55.463160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:55.477739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:55.478233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:55.483838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:55.494949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:55.495656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:55.525378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:55.696896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:55.710006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:55.733323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:55.734590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a656258-4399-4ba0-b03f-b059fc5ab493 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.277618 Nov 02 21:42:55.735159 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2047/4208] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:55 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:56.037594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:56.038748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:56.052709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:56.053353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:56.055650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:56.056638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:56.057835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:56.058443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:56.302898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:56.320369 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-80556c93-9cbd-477a-8733-81789d419af1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.291136 Nov 02 21:42:56.321619 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2162/4209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:56 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:56.764739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:56.765397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:56.777826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:56.786081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:56.789306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:56.793055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:56.793735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:56.799103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:57.106896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:57.115602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:57.129356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:57.130748 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-073c8edb-5639-419d-af8c-7d602f7c81f8 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.370565 Nov 02 21:42:57.145809 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2048/4210] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:56 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:57.351112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:57.352600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:57.360048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:57.365787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:57.367072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:57.368420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:57.371919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:57.372705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:57.736918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:57.754148 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-274879b5-9332-4e85-ac74-49bc51d656c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.406072 Nov 02 21:42:57.773207 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2163/4211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:57 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:42:58.164527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:58.165317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:58.194768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:58.195022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:58.195471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:58.197476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:58.203914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:58.204630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:58.410442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:58.422613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:58.424011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:58.425292 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-798b630d-70cd-4503-b93f-2cda7ab9387f tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.266261 Nov 02 21:42:58.438000 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2049/4212] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:58 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:42:58.788638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:58.791895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:58.810508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:58.814629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:58.815291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:58.816444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:58.817152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:58.820320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:59.458403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:42:59.459667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:42:59.463784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:42:59.485661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:59.486269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:59.486802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:59.494012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:42:59.495230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:42:59.495940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:42:59.820509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:59.835560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:59.837269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:59.838485 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b1746931-a0d8-45d7-8e49-25d19e51cee4 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.385374 Nov 02 21:42:59.842938 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2050/4213] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:42:59 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:42:59.863426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:42:59.872703 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3305654f-cbe5-46eb-b89a-950ebf0a5e50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 1.088495 Nov 02 21:42:59.877679 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2164/4214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:42:58 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:00.885873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:00.885873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:00.895972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:00.899629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:00.900306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:00.901683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:00.909630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:00.910723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:00.919621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:00.921581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:00.931485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:00.936381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:00.939237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:00.943639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:00.957344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:00.961810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:01.133607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:01.146995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:01.152468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:01.157023 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac75d2c1-c7cb-4f8e-9338-2543f840b5b3 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.292386 Nov 02 21:43:01.178073 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2051/4215] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:00 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:01.729299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:01.740136 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-105af009-04e0-4e5b-b4cb-66d8f303a0d4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.835143 Nov 02 21:43:01.742553 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2165/4216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:00 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:02.190270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:02.191056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:02.217140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:02.219162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:02.220361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:02.221147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:02.221620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:02.225179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:02.477931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:02.495632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:02.497488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:02.503248 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ccae4d38-e610-4787-ab89-e54668199eac tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.315495 Nov 02 21:43:02.504732 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2052/4217] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:02 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:02.769541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:02.770212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:02.786675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:02.787396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:02.789270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:02.793786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:02.794605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:02.795405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:03.213920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:03.225814 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0d8d15c-eea2-441f-b7b1-8bee030162a5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.460241 Nov 02 21:43:03.226405 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2166/4218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:02 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:03.540838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:03.542196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:03.562438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:03.563013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:03.565720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:03.566668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:03.567150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:03.567594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:03.769549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:03.787224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:03.789925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:03.791614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2d71acdf-e37d-455f-8a7d-21089fa6acab tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.255973 Nov 02 21:43:03.795663 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2053/4219] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:03 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:04.255213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:04.255792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:04.268279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:04.272803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:04.273698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:04.274627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:04.275268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:04.276173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:04.500364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:04.514189 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8da10754-9618-49ef-8d9e-183b1182f644 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.265047 Nov 02 21:43:04.530134 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2167/4220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:04 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:04.822267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:04.822895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:04.834128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:04.834637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:04.837933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:04.838949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:04.840416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:04.842482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:04.979900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:04.989572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:04.991040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:04.997536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-82cea9c4-9fce-490d-8293-3ded10403795 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.179368 Nov 02 21:43:04.998139 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2054/4221] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:04 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:05.545339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:05.547159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:05.562038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:05.562857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:05.564011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:05.566526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:05.567594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:05.569996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:05.901074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:05.911385 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f023ad56-4eb7-4ed1-a390-fd4ee41cd109 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.375371 Nov 02 21:43:05.919359 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2168/4222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:05 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:06.029696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:06.030323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:06.045699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:06.047214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:06.048770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:06.049868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:06.050558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:06.051185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:06.165162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:06.176378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:06.178221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:06.181502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-abb50a06-5f8b-40ba-8935-82c1eb03630d tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.156564 Nov 02 21:43:06.182304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2055/4223] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:06 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:06.941245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:06.941918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:06.952801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:06.953333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:06.959483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:06.961058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:06.961741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:06.965294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:07.185486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79b3e8ef-c3fe-4ad6-81e5-142477a8c5b8 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Action: 'create', calling method: .version_select at 0x7f9b69819700>, body: {"pool": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:08.088579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:08.099333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4cf9c782-ef3a-421d-a9eb-5e4e0d5c1421 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 1.162074 Nov 02 21:43:08.113708 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2056/4224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:06 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:08.126991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:08.126991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:08.130823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:08.131426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:08.132551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:08.133413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:08.134247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:08.134899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:08.160102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:08.236120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:08.258732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:08.261383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:08.262891 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df0ceb15-3d81-4df6-a533-d5e3491bd216 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.147290 Nov 02 21:43:08.263912 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2057/4225] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:08 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:09.127427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:09.134559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:09.159327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:09.161568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:09.161568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:09.161568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:09.162104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:09.162703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:09.954236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:09.972964 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6101feb6-a03b-4273-8d08-e99e700a1060 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.850432 Nov 02 21:43:09.974220 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2058/4226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:09 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:09.979649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:09.980480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:09.989902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:09.990807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:09.992826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:09.995589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:09.996308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:09.997173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:10.157256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:10.168492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:10.170325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:10.171857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1879dda3-59fe-46f7-9673-7b51b444a3b9 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.196477 Nov 02 21:43:10.173050 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2059/4227] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:09 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:10.567573 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79b3e8ef-c3fe-4ad6-81e5-142477a8c5b8 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.654137 Nov 02 21:43:10.568191 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2169/4228] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:43:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:10.583340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-096cece8-34f5-4a50-bea6-13179f28c7dd tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Action: 'create', calling method: .version_select at 0x7f9b68289940>, body: {"pool": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:11.008181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:11.008181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:11.022313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:11.025722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:11.025722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:11.029150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:11.029725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:11.030307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:11.419722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:11.429800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa535298-2796-43be-ac14-1c9ffff1b152 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.436328 Nov 02 21:43:11.431430 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2170/4229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:10 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:11.451550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:11.455314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:11.470116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:11.470609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:11.471052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:11.471758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:11.472212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:11.472641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:11.510434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:11.625606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:11.635300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:11.637823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:11.638602 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8faab9f-8597-44a7-8a02-d9d2a6a0cb44 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1407 microversion: 2.54 time: 0.205407 Nov 02 21:43:11.640038 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2171/4230] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:11 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:12.457968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:12.458685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:12.467540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:12.468212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:12.468910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:12.469967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:12.471976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:12.472524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:13.201109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:13.212878 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-073415b5-fbee-42b2-a072-a696c2e8fb50 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.758994 Nov 02 21:43:13.214607 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2172/4231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:12 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:13.222757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:13.226891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:13.239455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:13.240306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:13.240960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:13.242689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:13.243411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:13.244222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:13.355148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:13.367384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:13.369969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:13.370948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fbad6ab-b167-433c-a9df-548fe5e2e5b1 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1413 microversion: 2.54 time: 0.155042 Nov 02 21:43:13.389876 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2173/4232] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:13 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1413 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:13.949248 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-096cece8-34f5-4a50-bea6-13179f28c7dd tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.369639 Nov 02 21:43:13.949979 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2060/4233] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:43:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:13.962902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddaf37f3-b85f-47c4-9374-7db0afca58ad tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Action: 'create', calling method: .version_select at 0x7f9b6d2bfa60>, body: {"pool": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:14.241842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:14.242671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:14.258072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:14.258700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:14.259250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:14.260092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:14.260661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:14.261275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:14.576205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:14.586009 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-25a34d23-277d-48ac-be5c-505df4e8b6c9 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.348904 Nov 02 21:43:14.586009 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2061/4234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:14 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:14.613888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:14.614542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:14.626546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:14.627072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:14.627610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:14.628264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:14.628733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:14.629254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:14.764590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:14.777738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:14.779616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:14.781154 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-715c96e2-2a29-4316-b378-f8c987335b14 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1413 microversion: 2.54 time: 0.174932 Nov 02 21:43:14.798243 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2062/4235] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:14 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1413 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:15.517918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:15.519261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:15.528767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:15.529393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:15.530347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:15.531361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:15.532039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:15.532666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:15.658952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lazy-loading 'services' on Instance uuid f21137e8-af03-4d2e-84a8-6d5755d84bf0 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:43:15.941193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-76ca88c4-968f-461b-b162-7ea241870fa8 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments/1a9878de-046f-4617-9f23-d4bd930d8456" status: 202 len: 0 microversion: 2.1 time: 0.426846 Nov 02 21:43:15.942103 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2063/4236] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:43:15 2022] DELETE /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments/1a9878de-046f-4617-9f23-d4bd930d8456 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:43:15.970992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:15.974302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:15.999868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.002054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.003342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.005321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.007309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.008007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.279612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:16.298865 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7da9b0da-f1f8-4415-a3ea-aabae69c69f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.336944 Nov 02 21:43:16.299652 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2064/4237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:15 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:16.305418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:16.310436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:16.320577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.321114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.321567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.322289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.322746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.323172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.407138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:16.453536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:16.459138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:16.464019 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-438d7aca-9fd2-4514-8da2-c3c261262865 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1398 microversion: 2.54 time: 0.162846 Nov 02 21:43:16.465182 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2065/4238] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:16 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1398 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:16.471721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:16.476214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:16.491717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.492968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.501900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.505887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.506639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.507284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.595857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe5e06d4-caf6-4c20-bec8-10d16be1a6eb tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127990 Nov 02 21:43:16.609350 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2066/4239] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:16 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:16.627775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c180b3b0-4098-4f65-813a-c538aabde478 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '.version_select at 0x7f9b68b554c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:16.761866 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c180b3b0-4098-4f65-813a-c538aabde478 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-211091285" status: 204 len: 0 microversion: 2.54 time: 0.150382 Nov 02 21:43:16.762466 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2067/4240] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-211091285 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:43:16.780520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:16.793514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:16.817704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.821694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.821694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.823317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:16.825651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:16.826362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:16.923246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:43:17.498866 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88fd019c-76b3-43a5-97c7-c5f7047bfdc7 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 204 len: 0 microversion: 2.54 time: 0.717426 Nov 02 21:43:17.498866 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2068/4241] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:43:16 2022] DELETE /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:43:17.503743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:17.504496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:17.520991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:17.521489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:17.524187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:17.524187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:17.524187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:17.526404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:17.640129 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddaf37f3-b85f-47c4-9374-7db0afca58ad tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.681737 Nov 02 21:43:17.641658 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2174/4242] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:43:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:17.646719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:17.648960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:17.654944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:17.675517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:17.675517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:17.675517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:17.675517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:17.675517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:17.675517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:17.985534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:18.000485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:18.003253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:18.010254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-68a8032f-6081-4c20-add8-bb424542a0bd tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1404 microversion: 2.54 time: 0.367524 Nov 02 21:43:18.013281 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2175/4243] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:17 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1404 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:18.055563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:18.056530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:18.075528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:18.075700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:18.076881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:18.077586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:18.078530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:18.079273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:18.079976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:18.086790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4b2fb92b-9b7f-437a-951b-a688f48a48bc tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.588594 Nov 02 21:43:18.091472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2069/4244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:17 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:18.097769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b6e452a1-1f15-4760-847d-f49a78cc3308 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Action: 'create', calling method: .version_select at 0x7f9b682b4940>, body: {"pool": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:18.134636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-018c9589-8b66-4f8b-a8a7-8dcedc6cc0bf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107672 Nov 02 21:43:18.135378 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2176/4245] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:18 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:19.045098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:19.046666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:19.054645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:19.055239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:19.055894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:19.056794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:19.057342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:19.057837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:19.188850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:19.200759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:19.203423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:19.205358 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a2e5f159-71f6-47ae-be08-e40e8d6f3e4a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1404 microversion: 2.54 time: 0.164777 Nov 02 21:43:19.206094 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2177/4246] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:19 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:19.212992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:19.213848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:19.223021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:19.224104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:19.225142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:19.226186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:19.227407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:19.228695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:19.438629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:19.447439 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6efc630e-6fdf-41ca-bc38-089a58bc4e8b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.240139 Nov 02 21:43:19.448024 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2178/4247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:19 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:19.452616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:19.454897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:19.461075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:19.461576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:19.462189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:19.462892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:19.463346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:19.463961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:19.495791 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3864e7be-40b3-4f97-a5ea-5dd228ff378b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 Nov 02 21:43:19.496373 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2179/4248] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:19 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:20.239506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:20.240295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:20.262881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:20.264172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:20.265843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:20.275167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:20.276117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:20.277966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:20.333661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:20.334512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:20.335370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:20.336051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lazy-loading 'fault' on Instance uuid 74099701-a1ab-4abc-915c-eeb602dd7a10 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:43:20.495922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:20.516277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:20.516887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17bda08e43104a22a21db8ef07d48301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee027b6455cd4df883191f410c415f0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:20.519989 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f7fb78e2-bd30-46e2-b4d0-d75c4460664a tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 200 len: 1409 microversion: 2.54 time: 0.286016 Nov 02 21:43:20.524298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2180/4249] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:20 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 1409 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:20.533990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:20.535910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:20.550541 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b6e452a1-1f15-4760-847d-f49a78cc3308 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.458010 Nov 02 21:43:20.551748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2070/4250] 10.222.0.25 () {60 vars in 1170 bytes} [Wed Nov 2 21:43:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:20.558081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:20.565879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:20.567339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:20.567882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:20.573482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:20.577525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:20.579155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:20.581545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:20.600492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:20.601787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:20.602465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:20.603500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:20.604204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:20.604864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:20.660879 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9f79550-5a62-4233-b53c-44de1d3bf1b7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107843 Nov 02 21:43:20.662227 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2071/4251] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:20 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:20.667309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b672663-eb26-4a66-b828-d8d1aa09eb96 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Calling method '.version_select at 0x7f9b6851ba60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:21.116542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:21.128697 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8217c8e3-4379-49a1-9c8a-778ea711d87b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.602947 Nov 02 21:43:21.129546 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2181/4252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:20 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:21.550675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:21.551651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] [instance: 74099701-a1ab-4abc-915c-eeb602dd7a10] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:21.564903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:21.565434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:21.570133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:21.570133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:21.570133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:21.570133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:21.608721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] HTTP exception thrown: Instance 74099701-a1ab-4abc-915c-eeb602dd7a10 could not be found. Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Request method failure captured: Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 HTTP/1.1 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuRLmuUzVSo4NjvzVD74m3XYw9ZdUzqWd5_dZXY4FWoJzxskyROVce05k5TXWQO5Y_745VIz71jxhTQYp57lSpGVDRTqNi9I8AuDDfDjDA3OERjdkhuLPnGN9kWMCGdPvIcmoowAR4Ih3Kebob58-KqO1I8Wix9R0H7c0MQFNmXqpCA Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.54 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ee027b6455cd4df883191f410c415f0f Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerShowV254Test-2112564246 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ee027b6455cd4df883191f410c415f0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ee027b6455cd4df883191f410c415f0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ee027b6455cd4df883191f410c415f0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ee027b6455cd4df883191f410c415f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerShowV254Test-2112564246 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ee027b6455cd4df883191f410c415f0f Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerShowV254Test-2112564246 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerShowV254Test-2112564246-project Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 17bda08e43104a22a21db8ef07d48301 Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerShowV254Test-2112564246-project Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 74099701-a1ab-4abc-915c-eeb602dd7a10 could not be found. Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '74099701-a1ab-4abc-915c-eeb602dd7a10'} Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74099701-a1ab-4abc-915c-eeb602dd7a10 could not be found. Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74099701-a1ab-4abc-915c-eeb602dd7a10 could not be found. Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:21.613898 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:21.618948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:21.618948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:21.618948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:21.618948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:21.618948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:21.618948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74099701-a1ab-4abc-915c-eeb602dd7a10 could not be found. Nov 02 21:43:21.618948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:21.620966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] Returning 404 to user: Instance 74099701-a1ab-4abc-915c-eeb602dd7a10 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:21.623109 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eca4cf28-1c5b-439b-95a2-c9c331d58580 tempest-ServerShowV254Test-2112564246 tempest-ServerShowV254Test-2112564246-project] 10.222.0.25 "GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10" status: 404 len: 111 microversion: 2.54 time: 0.076470 Nov 02 21:43:21.626977 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2182/4253] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:21 2022] GET /compute/v2.1/servers/74099701-a1ab-4abc-915c-eeb602dd7a10 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:43:21.679749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:21.684083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:21.692361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:21.693224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:21.693826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:21.695293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:21.696120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:21.696747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:21.783596 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d7806ea-0788-49f8-9147-c43d8d5490ac tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113048 Nov 02 21:43:21.787010 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2183/4254] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:21 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:22.157738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:22.158373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:22.172754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:22.179754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:22.180223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:22.181007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:22.181476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:22.181915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:22.199932 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b672663-eb26-4a66-b828-d8d1aa09eb96 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips/6ffa7f74-4566-491d-acca-566d8a7fc930" status: 200 len: 141 microversion: 2.1 time: 1.534192 Nov 02 21:43:22.199932 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2072/4255] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 21:43:20 2022] GET /compute/v2.1/os-floating-ips/6ffa7f74-4566-491d-acca-566d8a7fc930 => generated 141 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:22.211254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b1d5a6e4-d330-4de4-8cc0-d3ecd7dbfc2e tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Calling method '.version_select at 0x7f9b6851b670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:22.740704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:22.757001 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98a403f8-737c-41a2-ab2b-eac5c5d0ad38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1522 microversion: 2.1 time: 0.605581 Nov 02 21:43:22.757932 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2184/4256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:22 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:22.797608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:22.800135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:22.812903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:22.814685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:22.815517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:22.816585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:22.817385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:22.817975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:22.857700 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e5fe122-07fe-4c95-93e5-135d841d149a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064373 Nov 02 21:43:22.858422 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2185/4257] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:22 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:23.787302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:23.789978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:23.810027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:23.810640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:23.811160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:23.812109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:23.812653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:23.813210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:24.138411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:24.148684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b1d5a6e4-d330-4de4-8cc0-d3ecd7dbfc2e tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/6ffa7f74-4566-491d-acca-566d8a7fc930" status: 202 len: 0 microversion: 2.1 time: 1.941626 Nov 02 21:43:24.149530 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2073/4258] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:43:22 2022] DELETE /compute/v2.1/os-floating-ips/6ffa7f74-4566-491d-acca-566d8a7fc930 => generated 0 bytes in 1943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:43:24.151190 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29f4792d-6498-4d10-8680-23e0c0de2a8a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1502 microversion: 2.1 time: 0.367899 Nov 02 21:43:24.153942 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2186/4259] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:23 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1502 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:24.155023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:24.158293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:24.172232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61d90bd0-fa1e-4bc4-a500-436dfea04fc9 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Calling method '.version_select at 0x7f9b68e87ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:24.186265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:24.186839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:24.187305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:24.191180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:24.191180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:24.191180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:24.257320 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-23add47c-cfa2-4cc2-8076-ae4ae6297f30 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106733 Nov 02 21:43:24.263062 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2074/4260] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:24 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:24.270100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:24.271120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:24.281201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:24.282250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:24.282773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:24.284032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:24.285054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:24.285663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:24.468142 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61d90bd0-fa1e-4bc4-a500-436dfea04fc9 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.311581 Nov 02 21:43:24.468828 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2187/4261] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 21:43:24 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:43:24.483904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58e73cc2-3deb-42fe-80a2-6d186828ec29 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Calling method '.version_select at 0x7f9b696e6670>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:24.629084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:24.639495 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f52827e-6870-49be-8b4e-6e4b9be0d7fd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1516 microversion: 2.1 time: 0.374783 Nov 02 21:43:24.640501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2075/4262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:24 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:24.666005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-767a246a-cfef-44c0-92ed-2fb13fb57510 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:24.669085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-767a246a-cfef-44c0-92ed-2fb13fb57510 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 34f57b05-7776-4ad4-b2ea-69864caf8096] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:24.678435 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-767a246a-cfef-44c0-92ed-2fb13fb57510 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Instance 34f57b05-7776-4ad4-b2ea-69864caf8096 could not be found. Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-767a246a-cfef-44c0-92ed-2fb13fb57510 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/34f57b05-7776-4ad4-b2ea-69864caf8096/action HTTP/1.1 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 14 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: {"rescue": {}} Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 34f57b05-7776-4ad4-b2ea-69864caf8096 could not be found. Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '34f57b05-7776-4ad4-b2ea-69864caf8096', 'body': {'rescue': {}}} Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f57b05-7776-4ad4-b2ea-69864caf8096 could not be found. Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f57b05-7776-4ad4-b2ea-69864caf8096 could not be found. Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:24.690908 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f57b05-7776-4ad4-b2ea-69864caf8096 could not be found. Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-767a246a-cfef-44c0-92ed-2fb13fb57510 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 404 to user: Instance 34f57b05-7776-4ad4-b2ea-69864caf8096 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-767a246a-cfef-44c0-92ed-2fb13fb57510 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/34f57b05-7776-4ad4-b2ea-69864caf8096/action" status: 404 len: 111 microversion: 2.1 time: 0.031995 Nov 02 21:43:24.696353 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2076/4263] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:43:24 2022] POST /compute/v2.1/servers/34f57b05-7776-4ad4-b2ea-69864caf8096/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:24.703687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:24.704234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:24.713817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:24.714536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:24.715150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:24.716067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:24.716737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:24.717350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:24.734681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:24.735759 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58e73cc2-3deb-42fe-80a2-6d186828ec29 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.259058 Nov 02 21:43:24.736790 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2188/4264] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Nov 2 21:43:24 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:43:24.761740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55cad9c2-2b8b-4cef-abb1-32e56a1d9c74 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Calling method '.version_select at 0x7f9b68f70160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:25.040057 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d331d164-e3d0-4988-a10a-03d1d4933d5b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action" status: 202 len: 0 microversion: 2.1 time: 0.340361 Nov 02 21:43:25.043866 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2077/4265] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:43:24 2022] POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:43:25.050840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:25.052501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:25.060633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.061265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.061812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.062632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.063198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.063722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.391079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:25.400003 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cb21de1e-d2bd-4342-baeb-5dde14c9fdcd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1521 microversion: 2.1 time: 0.353855 Nov 02 21:43:25.402091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2078/4266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:25 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:25.412395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:25.416311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:25.424142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.425382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.426834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.427654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.428329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.429645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.477690 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88d96b5b-260a-421c-b321-329842a428e7 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073008 Nov 02 21:43:25.484144 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2079/4267] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:43:25 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:43:25.556982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:25.557471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:25.564213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.564529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.564995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.568345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.568345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.568345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.603013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:43:25.909610 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cc43a899-23ae-4da9-9b23-b6ef4a8e5eda tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 204 len: 0 microversion: 2.1 time: 0.357006 Nov 02 21:43:25.915165 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2080/4268] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:43:25 2022] DELETE /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:43:25.925934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:25.926764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:25.936289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.937298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.938676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.940978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:25.940978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:25.941870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:25.977332 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55cad9c2-2b8b-4cef-abb1-32e56a1d9c74 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/51ef4534-77ce-43fa-af98-a4ed9053b7fa" status: 202 len: 0 microversion: 2.1 time: 1.228828 Nov 02 21:43:25.978801 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2189/4269] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:43:24 2022] DELETE /compute/v2.1/os-floating-ips/51ef4534-77ce-43fa-af98-a4ed9053b7fa => generated 0 bytes in 1231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:43:25.987129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98326c7f-13d7-42a8-a369-a1a2f2ce3a2b tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Calling method '.version_select at 0x7f9b696e6430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:26.348691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:26.355810 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a36ba77-d519-44df-9158-ce93e2ae8221 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1679 microversion: 2.1 time: 0.435962 Nov 02 21:43:26.356619 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2081/4270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:25 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1679 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:26.539806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-235679209", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": "none"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:26.626830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:43:26.628031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:43:26.629136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:43:26.630640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:43:26.631781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:43:26.641374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:26.641862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:26.642309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:26.643061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:26.643585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:26.644021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:26.663491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Getting quotas for project 57942cf8290b4b3091d38277c2eb3284. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:43:26.668894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Getting quotas for user cc1e411b078a46bdbd7e3e165bed7197 and project 57942cf8290b4b3091d38277c2eb3284. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:43:26.683838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:43:26.686504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:43:26.885784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f8b640e-3f61-421f-9bd1-cc990003b011 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.523215 Nov 02 21:43:26.887043 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2082/4271] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:43:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:43:26.894319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:26.896436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:26.927228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:26.928072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:26.928322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:26.929948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:26.931445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:26.931445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:27.144952 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98326c7f-13d7-42a8-a369-a1a2f2ce3a2b tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/5a915a68-2028-4b61-bd8c-9dcfe4b4de6f" status: 202 len: 0 microversion: 2.1 time: 1.162306 Nov 02 21:43:27.145721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2190/4272] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:43:25 2022] DELETE /compute/v2.1/os-floating-ips/5a915a68-2028-4b61-bd8c-9dcfe4b4de6f => generated 0 bytes in 1164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:43:27.155828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b61a76b-8223-4012-9d83-b64fe95572fe tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:27.156583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0b61a76b-8223-4012-9d83-b64fe95572fe tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:27.204541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:27.213602 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac4d6f77-d8e4-449f-9004-e727b065a2e0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1501 microversion: 2.1 time: 0.325353 Nov 02 21:43:27.214234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2083/4273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:26 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1501 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:27.218862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e85cef9e-c282-4aac-8f68-b627363c5308 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] Calling method '.version_select at 0x7f9b68467a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:27.293429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b61a76b-8223-4012-9d83-b64fe95572fe tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:27.306615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b61a76b-8223-4012-9d83-b64fe95572fe tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:27.319547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b61a76b-8223-4012-9d83-b64fe95572fe tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:27.319547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b61a76b-8223-4012-9d83-b64fe95572fe tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1277 microversion: 2.57 time: 0.159047 Nov 02 21:43:27.319547 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2191/4274] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:27 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:27.319547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:27.320450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:27.335204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:27.336152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:27.336999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:27.338822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:27.353912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:27.353912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:27.375933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lazy-loading 'flavor' on Instance uuid e3062332-f0fb-4550-8833-d635f1a66ecd {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:43:27.388298 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Cannot 'rescue' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state paused Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action HTTP/1.1 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 14 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: {"rescue": {}} Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: exception: Cannot 'rescue' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state paused Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e3062332-f0fb-4550-8833-d635f1a66ecd', 'body': {'rescue': {}}} Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3062332-f0fb-4550-8833-d635f1a66ecd in vm_state paused. Cannot rescue while the instance is in this state. Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state paused Nov 02 21:43:27.391314 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state paused Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 409 to user: Cannot 'rescue' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state paused {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a82728e2-35eb-40d3-aeb5-47103e025f86 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action" status: 409 len: 144 microversion: 2.1 time: 0.080874 Nov 02 21:43:27.405538 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2192/4275] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:43:27 2022] POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action => generated 144 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:43:27.408396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:27.409515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:27.418592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:27.419496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:27.421690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:27.422786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:27.423399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:27.424881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:27.865338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:27.877079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50d1fe74-7b90-4ea2-beae-739173bcdd50 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1679 microversion: 2.1 time: 0.477895 Nov 02 21:43:27.888965 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2193/4276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:27 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1679 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:27.897558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:27.897558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:27.919353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:27.919938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:27.920532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:27.921336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:27.921803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:27.922437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:27.957753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:28.316067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7de98fbb-8ce5-4343-b8fa-de6347ccec3f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action" status: 202 len: 0 microversion: 2.1 time: 0.434567 Nov 02 21:43:28.325235 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2194/4277] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:43:27 2022] POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:43:28.335843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:28.337683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:28.347283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:28.348060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:28.348723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:28.349649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:28.351206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:28.351845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e85cef9e-c282-4aac-8f68-b627363c5308 tempest-FloatingIPDetailsTestJSON-1130978465 tempest-FloatingIPDetailsTestJSON-1130978465-project] 10.222.0.25 "DELETE /compute/v2.1/os-floating-ips/ada34b34-0292-45c9-ba2c-e7d3d9c1ad5c" status: 202 len: 0 microversion: 2.1 time: 1.715784 Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2084/4278] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:43:27 2022] DELETE /compute/v2.1/os-floating-ips/ada34b34-0292-45c9-ba2c-e7d3d9c1ad5c => generated 0 bytes in 1717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:28.975238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:29.000087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:29.021380 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb48b9db-ac1f-4a27-90a7-67536d08a75f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1508 microversion: 2.1 time: 0.682257 Nov 02 21:43:29.021380 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2195/4279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:28 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1508 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:29.021896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:29.027047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:29.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:29.037202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:29.044164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:29.044164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:29.044164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:29.044164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:29.254308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:29.275073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:29.286326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:29.288279 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c76b8cc2-fa1d-45be-b105-4491f92f4e26 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1281 microversion: 2.57 time: 0.354770 Nov 02 21:43:29.293109 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2085/4280] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:28 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1281 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:29.294948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7e856d55-ff75-4d45-bd74-4d67fa34c62d req-b53b8e22-db3b-44a5-badb-c6fa89f15985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21137e8-af03-4d2e-84a8-6d5755d84bf0", "name": "network-vif-deleted", "tag": "c38e57ef-c213-4073-9dc4-74707fdab774"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:29.308241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7e856d55-ff75-4d45-bd74-4d67fa34c62d req-b53b8e22-db3b-44a5-badb-c6fa89f15985 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:29.309112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7e856d55-ff75-4d45-bd74-4d67fa34c62d req-b53b8e22-db3b-44a5-badb-c6fa89f15985 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:29.309875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7e856d55-ff75-4d45-bd74-4d67fa34c62d req-b53b8e22-db3b-44a5-badb-c6fa89f15985 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:29.327451 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7e856d55-ff75-4d45-bd74-4d67fa34c62d req-b53b8e22-db3b-44a5-badb-c6fa89f15985 service nova] Creating event network-vif-deleted:c38e57ef-c213-4073-9dc4-74707fdab774 for instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 on n-h2-860863-4 Nov 02 21:43:29.334094 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7e856d55-ff75-4d45-bd74-4d67fa34c62d req-b53b8e22-db3b-44a5-badb-c6fa89f15985 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042822 Nov 02 21:43:29.336261 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2086/4281] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:29.339376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:29.352161 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05f1390c-9edb-4214-b95c-2893e5923110 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1612 microversion: 2.1 time: 0.339095 Nov 02 21:43:29.369120 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2196/4282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:29 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1612 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:30.039928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:30.045113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:30.046439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:30.056661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:30.057538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:30.059217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:30.061072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:30.063271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:30.066039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:30.317333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:30.317961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:30.325560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:30.326555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:30.327224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:30.328169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:30.328839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:30.329979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:30.402344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:30.415939 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41ab7c7d-fd4c-4a39-999f-a92eb79e2aeb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1516 microversion: 2.1 time: 0.381344 Nov 02 21:43:30.417192 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2087/4283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:30 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1516 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:30.461928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:30.462579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:30.489720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:30.500480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:30.502226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:30.508884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:30.512184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:30.515733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:30.559332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:30.574675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:30.577806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:30.581094 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9227b468-618b-40a4-bdee-3969c1dea112 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1329 microversion: 2.57 time: 0.267582 Nov 02 21:43:30.583118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2197/4284] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:30 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1329 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:30.602391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:30.604213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:30.605126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:30.605999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lazy-loading 'fault' on Instance uuid f21137e8-af03-4d2e-84a8-6d5755d84bf0 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:43:30.810801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8520ce21dd03401685b8e65f8aefb205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0636c756c24859b25db0144e50de92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:30.841680 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6babdccc-a073-4b24-a920-5e34464cface tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 200 len: 1330 microversion: 2.1 time: 0.410145 Nov 02 21:43:30.843263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2088/4285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:30 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 1330 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:31.622532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:31.623835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:31.645201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:31.650410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:31.650410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:31.650410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:31.650410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:31.650410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:31.780029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:31.792122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:31.793616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:31.802040 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24348236-05b1-434a-91fa-be4622bbf68f tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1335 microversion: 2.57 time: 0.190972 Nov 02 21:43:31.802657 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2198/4286] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:31 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1335 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:31.870841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:31.871497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:31.882943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:31.887577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:31.888238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:31.890311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:31.890964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:31.893459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:31.941394 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 HTTP/1.1 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f21137e8-af03-4d2e-84a8-6d5755d84bf0'} Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:31.947043 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:31.951284 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:31.951284 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:31.951284 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:31.951284 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:31.951284 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:31.951284 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:31.951284 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:31.954646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:31.958855 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3306b93e-dfcc-448b-a91a-13691bbf4f19 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 404 len: 111 microversion: 2.1 time: 0.092127 Nov 02 21:43:31.960284 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2089/4287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:31 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:31.969454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7387d736-2d17-44e1-913a-ba950e3aae5b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '.version_select at 0x7f9b6882c0d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:32.105882 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7387d736-2d17-44e1-913a-ba950e3aae5b tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-561670444" status: 202 len: 0 microversion: 2.1 time: 0.140695 Nov 02 21:43:32.106982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2199/4288] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:43:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-561670444 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:43:32.836022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:32.836906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:32.862685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:32.862947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:32.863435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:32.864159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:32.874032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:32.874603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:33.143128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:33.157441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:33.161175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:33.165134 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b7f266b2-367a-47cc-b479-aab85ccc46ea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1335 microversion: 2.57 time: 0.330884 Nov 02 21:43:33.170498 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2090/4289] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:32 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1335 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:34.198761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:34.199406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:34.216072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:34.216578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:34.225285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:34.226315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:34.226958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:34.227556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:34.665148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:34.683760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:34.684739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:34.688479 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb5c79bd-01c1-4f3f-94d6-e8f5c6bec109 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1356 microversion: 2.57 time: 0.494776 Nov 02 21:43:34.691779 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2200/4290] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:34 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1356 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:43:34.718516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:34.722693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:34.731567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:34.732341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:34.732780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:34.733528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:34.733986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:34.734417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:34.838812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:43:34.838812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:43:34.839612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:43:34.840190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:43:34.840783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:43:35.048561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:35.048561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:35.058043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.058551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.059000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.062161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.072771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.077190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.150394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:35.160770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lazy-loading 'flavor' on Instance uuid e3062332-f0fb-4550-8833-d635f1a66ecd {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:43:35.175308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.177679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.178305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.179079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.179553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.179992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.279856 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-75af475a-8f44-4007-9b51-d7f78388dbba tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "POST /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e/action" status: 202 len: 1137 microversion: 2.57 time: 0.563924 Nov 02 21:43:35.293716 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2091/4291] 10.222.0.25 () {62 vars in 1320 bytes} [Wed Nov 2 21:43:34 2022] POST /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e/action => generated 1137 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 21:43:35.308181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:35.308801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:35.315945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.316707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.317341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.318261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.318937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.319526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.322943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:35.663102 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc6d2387-a637-4ec2-9339-575a2d5ca95b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action" status: 200 len: 32 microversion: 2.1 time: 0.625764 Nov 02 21:43:35.663102 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2201/4292] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:43:35 2022] POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action => generated 32 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:43:35.674469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:35.679605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:35.692744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:35.696541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.697443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.698091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.698982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:35.700503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:35.701278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:35.704308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:35.711044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:35.713482 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bd3cb0d-7200-408f-adbc-5b0c06273df5 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.408908 Nov 02 21:43:35.715685 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2092/4293] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:35 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:43:36.623167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:36.634813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29a77f45-95a1-4850-91a0-0796cad9dcce tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.964788 Nov 02 21:43:36.640987 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2202/4294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:35 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:36.747275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:36.747899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:36.842222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:36.849249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:36.855602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:36.863157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:36.866749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:36.870660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:36.873536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:36.874739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:37.161053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:37.173814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:37.175264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:37.180249 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd1aecc1-2a99-459d-9160-32b5337c67c0 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.439909 Nov 02 21:43:37.180836 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2093/4295] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:36 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:37.662632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:37.665324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:37.671818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:37.673775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:37.693194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:37.693194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:37.693194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:37.693194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:37.693194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:38.212419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:38.213667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:38.243531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:38.251336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:38.252069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:38.253993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:38.254629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:38.257948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:38.625452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:38.639448 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27098c12-6702-467b-83f2-3c85595a581f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.983060 Nov 02 21:43:38.661498 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2203/4296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:37 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:38.720071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:38.736226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:38.737728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:38.750875 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e26d31b-6623-4c00-a8ff-ef099f5ef89d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.531776 Nov 02 21:43:38.750875 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2094/4297] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:38 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:39.668834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:39.670333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:39.689427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:39.689932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:39.708027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:39.708027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:39.708027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:39.708027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:39.779338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:39.779951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:39.795838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:39.796335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:39.801692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:39.802765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:39.803667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:39.809545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:39.987521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:40.001262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:40.008130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:40.014384 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a6431f0-5cde-42f8-8fd1-e26c152ca179 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.237825 Nov 02 21:43:40.016820 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2095/4298] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:39 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:43:40.149035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:40.161579 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1711673-06a7-4130-98a2-889d6f19e565 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.492864 Nov 02 21:43:40.163548 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2204/4299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:39 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:41.057081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:41.057592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:41.079103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.079103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.079103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.079103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.079103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.079103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.192064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:41.192869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:41.222126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:41.226758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.230394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.230928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.233990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.234433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:41.236489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.237169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.242089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:41.245817 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55ae48e5-d477-45f4-b2f4-6a55c1af8eea tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.200018 Nov 02 21:43:41.256954 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2096/4300] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:41 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:41.680979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:41.699677 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88ef01c1-580b-4e70-b1e9-06d1839a6553 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.511478 Nov 02 21:43:41.731189 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2205/4301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:41 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:41.830540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:41.832856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:41.847767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.848263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.848702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.849456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.850665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.851094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.889934 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 HTTP/1.1 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f21137e8-af03-4d2e-84a8-6d5755d84bf0'} Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:41.891541 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:41.899157 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7c4a08b-2097-4257-b9ba-377f7bf954b4 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 404 len: 111 microversion: 2.1 time: 0.067725 Nov 02 21:43:41.907872 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2097/4302] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:43:41 2022] DELETE /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:41.909807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:41.910703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: f21137e8-af03-4d2e-84a8-6d5755d84bf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:41.930113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.932451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.932971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.936293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:41.936709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:41.937212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 HTTP/1.1 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f21137e8-af03-4d2e-84a8-6d5755d84bf0'} Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:41.984349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. Nov 02 21:43:41.988824 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:41.990831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance f21137e8-af03-4d2e-84a8-6d5755d84bf0 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:41.993687 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-169295d4-5e94-4c77-9661-59971a12eebf tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0" status: 404 len: 111 microversion: 2.1 time: 0.091873 Nov 02 21:43:41.995750 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2206/4303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:41 2022] GET /compute/v2.1/servers/f21137e8-af03-4d2e-84a8-6d5755d84bf0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:42.278684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:42.281817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:42.291450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:42.291935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:42.292380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:42.293113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:42.293560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:42.301474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:42.735143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:42.736496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:42.750608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:42.753628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:42.754262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:42.755165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:42.757483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:42.758135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:43.452438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:43.469339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:43.470878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:43.476285 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92e7910e-2005-48ff-8d2b-00f958a27925 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 1.201944 Nov 02 21:43:43.481290 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2098/4304] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:42 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:43.617934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:43.626303 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8fa82b63-0fe9-4d94-ab48-91a542a8cf90 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.895218 Nov 02 21:43:43.651657 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2207/4305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:42 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:44.508523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:44.509933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:44.525965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:44.527027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:44.527477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:44.528203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:44.528674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:44.529331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:44.673335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:44.673975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:44.691537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:44.701720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:44.702467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:44.703966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:44.713869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:44.714593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:44.760245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:44.804350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:44.838601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:44.843744 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a3a2363-2f83-4b5f-965c-97dd65c663fb tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.339432 Nov 02 21:43:44.849213 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2099/4306] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:44 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:45.002327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:45.018598 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e20f1da3-102f-4dc9-b920-6576cb74df20 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.353154 Nov 02 21:43:45.024323 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2208/4307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:44 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:45.350287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-467499389", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "65a94947-f991-4865-86d5-a3465290d583"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:45.432530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] validate_networks() for [('65a94947-f991-4865-86d5-a3465290d583', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:43:45.882668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:45.883894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:45.902054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:45.911889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:45.913984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:45.914933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:45.919881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:45.924241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:46.051533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:46.064623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:46.080162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:46.086953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:46.088259 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36720226-8263-4f55-8b63-258d287bf900 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.211603 Nov 02 21:43:46.110504 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2209/4308] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:45 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:43:46.118833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:46.120119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:46.133883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:46.136763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:46.141569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:46.142786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:46.143554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:46.144227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:46.419641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:43:46.420137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:43:46.420530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:43:46.420996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:43:46.425671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:43:46.445307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:46.446025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:46.446654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:46.447646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:46.448269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:46.448860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:46.471928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Getting quotas for project 5191bf0c1e3e446c9c2e6e47cea461e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:43:46.477956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Getting quotas for user c200d64c4ebb4f9dafe6e35daac13a39 and project 5191bf0c1e3e446c9c2e6e47cea461e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:43:46.493281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:43:46.495976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:43:46.531952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:46.539989 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19a4dd2f-83a3-479d-a9b4-b410f7b0b11a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.428186 Nov 02 21:43:46.540712 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2210/4309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:46 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:46.708734 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f3a8d7be-40e1-464a-b273-3066c7980147 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630900 Nov 02 21:43:46.710321 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2100/4310] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:43:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:43:46.722733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2f3f953-95ad-49bb-8996-6928f3f9baaa tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:46.723731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c2f3f953-95ad-49bb-8996-6928f3f9baaa tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:46.835646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2f3f953-95ad-49bb-8996-6928f3f9baaa tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:46.843185 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2f3f953-95ad-49bb-8996-6928f3f9baaa tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1217 microversion: 2.1 time: 0.124161 Nov 02 21:43:46.843897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2211/4311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:46 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:47.129687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:47.130713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:47.143372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:47.144126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:47.144732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:47.145859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:47.146663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:47.147813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:47.278758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:47.293261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:47.293261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:47.294405 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34cdf2ff-6af6-4ccf-aec5-3a8d054e07ab tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.171235 Nov 02 21:43:47.295553 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2101/4312] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:47 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:47.570293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:47.570810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:47.623849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:47.628270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:47.635657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:47.639932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:47.640373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:47.646229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:47.870091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36403186-8c00-4729-9aeb-af8c4a17810b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:47.875982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36403186-8c00-4729-9aeb-af8c4a17810b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:47.984850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:47.996755 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4388edcd-5b83-4b02-85c2-6b42d7547e2b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.434287 Nov 02 21:43:48.005747 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2212/4313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:47 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:48.049604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-36403186-8c00-4729-9aeb-af8c4a17810b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:48.061187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36403186-8c00-4729-9aeb-af8c4a17810b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1217 microversion: 2.1 time: 0.196182 Nov 02 21:43:48.065690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2102/4314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:47 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:48.325061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:48.325723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:48.336159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:48.337756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:48.338280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:48.338760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:48.339473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:48.339934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:48.340362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:48.492560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:48.507217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:48.508694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:48.509934 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-436aef11-7d80-44f0-b5c9-7004c18938b1 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.189186 Nov 02 21:43:48.510482 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2213/4315] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:48 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:49.027630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:49.027630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:49.071270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.071774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.072219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.092869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:49.093521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:49.097331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.099558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.102478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.135836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.136335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.142650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.145187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.145701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.146147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.514570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:49.538490 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-513731e8-4cdc-4b7d-a530-94236d019ba8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1221 microversion: 2.1 time: 0.441967 Nov 02 21:43:49.542774 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2214/4316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:49 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1221 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:49.560668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:49.566944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:49.583795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.584913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.585612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.586505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.587174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.587793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.627073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 HTTP/1.1 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd75b7954-00b0-4504-88c7-6e5c0e4b21b6'} Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:49.628865 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:49.634233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:49.636238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:49.637372 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23f438da-c2ee-4d1a-be50-ff75787a9506 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 404 len: 111 microversion: 2.1 time: 0.093460 Nov 02 21:43:49.638104 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2215/4317] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:43:49 2022] DELETE /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:49.644482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:49.652418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:49.678813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.679597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.680207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.681410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:49.688958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:49.689668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:49.965960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:49.995349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:49.999310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:49.999310 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7573521-b135-4f41-8dcc-f6f39ac37556 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.359085 Nov 02 21:43:50.005303 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2216/4318] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:49 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:50.022259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:50.022934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: d75b7954-00b0-4504-88c7-6e5c0e4b21b6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:50.052097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.052602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.067335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.068169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.069313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.069760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.093587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:50.098515 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b1058370-edc7-4e54-bb39-0ae350d2fad5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 1.079341 Nov 02 21:43:50.100235 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2103/4319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:49 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:50.160482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 HTTP/1.1 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd75b7954-00b0-4504-88c7-6e5c0e4b21b6'} Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:50.162998 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance d75b7954-00b0-4504-88c7-6e5c0e4b21b6 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11f00ba4-05d7-40a8-8415-a2a4cf85171a tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6" status: 404 len: 111 microversion: 2.1 time: 0.157649 Nov 02 21:43:50.166918 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2217/4320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:50 2022] GET /compute/v2.1/servers/d75b7954-00b0-4504-88c7-6e5c0e4b21b6 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:50.176693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:50.178344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:50.185735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.186602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.187264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.188233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.188912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.189607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.220777 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 HTTP/1.1 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9b0b51d7-2245-416b-910a-3824bd7a2234'} Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:50.223072 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.227599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.231257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:50.232355 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0adc08af-beac-451b-b77c-e1f383c296f9 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 404 len: 111 microversion: 2.1 time: 0.059696 Nov 02 21:43:50.233839 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2104/4321] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:43:50 2022] DELETE /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:50.242748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:50.243957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9b0b51d7-2245-416b-910a-3824bd7a2234] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:50.252320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.255595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.257041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.258100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.258838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.259485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.278673 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 HTTP/1.1 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9b0b51d7-2245-416b-910a-3824bd7a2234'} Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:50.280733 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.284589 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:50.284589 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:50.284589 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:50.284589 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:50.284589 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:50.284589 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. Nov 02 21:43:50.284589 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:50.288306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance 9b0b51d7-2245-416b-910a-3824bd7a2234 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:50.289488 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9790ebeb-efb8-4b92-9c57-1a208c8209de tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234" status: 404 len: 111 microversion: 2.1 time: 0.051404 Nov 02 21:43:50.290949 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2218/4322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:50 2022] GET /compute/v2.1/servers/9b0b51d7-2245-416b-910a-3824bd7a2234 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:50.577531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:50.578333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:50.598525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.606977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.607614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.635205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:50.635205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:50.635205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:50.867785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:50.894847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fa5398ca-5c04-4a7d-a6ba-1793d5d4ed2c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1269 microversion: 2.1 time: 0.322694 Nov 02 21:43:50.898845 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2105/4323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:50 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1269 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:51.029300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:51.030494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:51.061833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:51.064439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:51.066093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:51.074822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:51.078252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:51.079087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:51.135200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:51.145191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:51.207105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:51.210443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:51.212850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:51.216286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:51.230481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:51.234450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:51.633858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:51.654100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:51.655729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:51.657124 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a95f4d35-1890-4aa5-89e8-71fee0605508 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.633070 Nov 02 21:43:51.657699 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2219/4324] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:51 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:43:51.932415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:51.933908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:51.953180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:51.953871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:51.954486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:51.960837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:51.961572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:51.962176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:52.276499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:52.292377 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d0bf1ecf-4c21-4c32-bf37-b437a4353132 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1277 microversion: 2.1 time: 0.366167 Nov 02 21:43:52.296016 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2220/4325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:51 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1277 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:52.343588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:52.359818 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2b9c46b-9ea0-45ef-97da-842ff655eea5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 1.236859 Nov 02 21:43:52.360989 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2106/4326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:51 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:52.685008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:52.685728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:52.703996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:52.706549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:52.707184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:52.714723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:52.715485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:52.716084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:52.858786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:52.872599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:52.876783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:52.878045 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-338d0ef1-ad9f-4dd0-b565-ff34fb892747 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.197244 Nov 02 21:43:52.881377 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2221/4327] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:52 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:53.335346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:53.336093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:53.353351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.353351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.353351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.353351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.353351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.353351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.389870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:53.390427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:53.401312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.401811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.403215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.403215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.403413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.403903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.451480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:53.461852 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ab23c10-0669-441e-9e65-086f54ad38dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1275 microversion: 2.1 time: 0.131047 Nov 02 21:43:53.463198 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2107/4328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:53 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:53.689099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:53.700233 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-094c911d-25ec-4e3c-adba-9dc9355b7eee tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1502 microversion: 2.1 time: 0.314931 Nov 02 21:43:53.700892 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2222/4329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:53 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1502 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:53.728396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d18c724-6000-461a-a977-7650dc7a4bd3"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:53.731001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:53.793590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.809014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.810033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.811311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.812669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.813488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.907884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:53.908151 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Cannot 'attach_volume' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state rescued Nov 02 21:43:53.908965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/os-volume_attachments HTTP/1.1 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 74 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: {"volumeAttachment": {"volumeId": "2d18c724-6000-461a-a977-7650dc7a4bd3"}} Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'attach_volume' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state rescued Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': 'e3062332-f0fb-4550-8833-d635f1a66ecd', 'body': {'volumeAttachment': {'volumeId': '2d18c724-6000-461a-a977-7650dc7a4bd3'}}} Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3062332-f0fb-4550-8833-d635f1a66ecd in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 21:43:53.910922 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state rescued Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state rescued Nov 02 21:43:53.916152 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:43:53.925885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.925885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.926158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 409 to user: Cannot 'attach_volume' instance e3062332-f0fb-4550-8833-d635f1a66ecd while it is in vm_state rescued {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:53.926245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.926245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:53.926245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:53.926245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:53.926513 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c4a13032-45ab-4eb1-a181-3bfb7d147c0a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.201220 Nov 02 21:43:53.926513 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2108/4330] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:43:53 2022] POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/os-volume_attachments => generated 152 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:43:53.979748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:53.985899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:54.009589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:54.011874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:54.012562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:54.016318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:54.017059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:54.017696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:54.118990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:54.129243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:54.130717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:54.138764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cfeda24-59c1-44c2-b007-ada63f20a698 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.234965 Nov 02 21:43:54.144012 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2223/4331] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:53 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:43:54.412598 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c677589a-7f02-45dd-8258-0f17739f72f8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action" status: 202 len: 0 microversion: 2.1 time: 0.458100 Nov 02 21:43:54.414420 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2109/4332] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:43:53 2022] POST /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:43:54.433460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:54.435306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:54.469748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:54.474286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:54.475998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:54.477172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:54.480304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:54.481070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:54.494856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:54.495976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:54.522705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:54.527555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:54.529530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:54.530591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:54.536246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:54.538561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:55.250840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:55.270195 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1e976fb-da26-475e-8cb9-273603481b81 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.780852 Nov 02 21:43:55.282410 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2110/4333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:54 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:55.292799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:55.294034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:55.310528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:55.310886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:55.311328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:55.312053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:55.321293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:55.324188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:55.345309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:55.447497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:55.459756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e46234f4-6446-4bd3-b9df-c02b5dd9f328 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1510 microversion: 2.1 time: 1.039152 Nov 02 21:43:55.466964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2224/4334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:54 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1510 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:55.589495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:55.606192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:55.611136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:55.615110 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b6078de6-b5fc-48b3-a3b4-61b7203120e4 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.329788 Nov 02 21:43:55.618594 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2111/4335] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:55 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:56.216031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5c729690-a7ee-4dbe-acca-e28e051234a0 req-9cb8a228-3e50-4580-82fe-5f69be0d3444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da88578b-3773-4c6e-a924-2bc73e190ee3", "tag": "9f665f5b-4848-4725-8fb9-c04a00c125ef"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:56.239899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5c729690-a7ee-4dbe-acca-e28e051234a0 req-9cb8a228-3e50-4580-82fe-5f69be0d3444 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:56.241585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5c729690-a7ee-4dbe-acca-e28e051234a0 req-9cb8a228-3e50-4580-82fe-5f69be0d3444 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:56.243850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5c729690-a7ee-4dbe-acca-e28e051234a0 req-9cb8a228-3e50-4580-82fe-5f69be0d3444 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:56.280804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5c729690-a7ee-4dbe-acca-e28e051234a0 req-9cb8a228-3e50-4580-82fe-5f69be0d3444 service nova] Creating event network-changed:9f665f5b-4848-4725-8fb9-c04a00c125ef for instance da88578b-3773-4c6e-a924-2bc73e190ee3 on n-h1-860863-4 Nov 02 21:43:56.304732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:56.305542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:56.309864 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5c729690-a7ee-4dbe-acca-e28e051234a0 req-9cb8a228-3e50-4580-82fe-5f69be0d3444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086424 Nov 02 21:43:56.314289 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2225/4336] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:56.326944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:56.327584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:56.329432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:56.330299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:56.336389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:56.337299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:56.464230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:56.492537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:56.493536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:56.506244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:56.507364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:56.508071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:56.510468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:56.511220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:56.511907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:56.842981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:57.128781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:57.132576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:57.138074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fe36962-71e1-4e7c-9383-d36f223376f0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1510 microversion: 2.1 time: 0.650362 Nov 02 21:43:57.143593 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b746346-53a4-43a8-96f3-0c95824831d2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.843781 Nov 02 21:43:57.144971 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2226/4337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:56 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1510 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:57.161185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:57.161916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:57.166997 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2112/4338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:56 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:57.174867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:57.177302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:57.178327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:57.179062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:57.179538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:57.181300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:57.382366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:57.400736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:57.406670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:57.408449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3044148d-3a53-4efa-93a0-7bbc7387913e tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.260480 Nov 02 21:43:57.411489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2227/4339] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:57 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:57.562175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f0d4e10-0d45-4728-8978-3a86320088f6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b6878a9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-93871644", "description": "tempest-description-1965447825"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:58.009552 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f0d4e10-0d45-4728-8978-3a86320088f6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.560458 Nov 02 21:43:58.010700 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2113/4340] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:43:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:58.026000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-863c8849-48f3-4876-b438-8eeccc28965a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b68ef95e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-237482890", "description": "tempest-description-2050084237"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:58.172291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:43:58.180702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:58.181595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:58.211086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.212991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.217467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:58.218478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.224221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.228786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:58.671741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:58.690187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cdecffda-cea8-435d-8398-e8e507f96a6a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.518731 Nov 02 21:43:58.691436 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2114/4341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:58 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:43:58.701071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:58.702332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:58.713195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.714300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.714956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:58.716145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.716802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.717468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:58.917425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:58.927263 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ee3d36c-029d-40a9-9b5b-cff6d38fcc22 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1510 microversion: 2.1 time: 0.233742 Nov 02 21:43:58.930004 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2115/4342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:58 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:43:58.938394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:58.939215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:58.947923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.948402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.952477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:58.953638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.954166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.954926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:58.968156 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-863c8849-48f3-4876-b438-8eeccc28965a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.947756 Nov 02 21:43:58.981036 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2228/4343] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:43:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:43:58.981036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:58.981036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:58.987918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.988815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.993699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:58.994992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:58.996420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:58.997694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:59.050431 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 HTTP/1.1 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9478ec40-75b3-43e3-88b3-f8ff18b6c267'} Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:59.052121 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e24582bc-446f-45bd-ba94-d90c152f8572 tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 404 len: 111 microversion: 2.1 time: 0.086582 Nov 02 21:43:59.066948 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2229/4344] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:43:58 2022] DELETE /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:59.071733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:59.072547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] [instance: 9478ec40-75b3-43e3-88b3-f8ff18b6c267] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:59.080083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:59.080839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:59.081486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:59.082380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:59.083315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:59.084561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:59.100431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:59.102734 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] HTTP exception thrown: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Request method failure captured: Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 HTTP/1.1 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuLhpM2LdEkLVoJNpDP35aX-pfz-7ehkCFLlNFLim6KidjPvGSSjEr9fB8QwIOB_vvZo6Td9mqif_80jjNBZhzVUnGASkWOO3bnD-sw1v57P4iNWTCvhmcYAuzOME11OVigVqMC33G8jDNP4awudlKWmtCT4O87gdFg7S7n6qN3a3Qo Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4e0636c756c24859b25db0144e50de92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4e0636c756c24859b25db0144e50de92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4e0636c756c24859b25db0144e50de92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4e0636c756c24859b25db0144e50de92 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847223392 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8520ce21dd03401685b8e65f8aefb205 Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1847223392-project Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9478ec40-75b3-43e3-88b3-f8ff18b6c267'} Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:43:59.104280 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] Returning 404 to user: Instance 9478ec40-75b3-43e3-88b3-f8ff18b6c267 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e287247-90e1-4057-a8cd-f37c6ffc36db tempest-AttachVolumeNegativeTest-1847223392 tempest-AttachVolumeNegativeTest-1847223392-project] 10.222.0.25 "GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267" status: 404 len: 111 microversion: 2.1 time: 0.041628 Nov 02 21:43:59.108922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2230/4345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:59 2022] GET /compute/v2.1/servers/9478ec40-75b3-43e3-88b3-f8ff18b6c267 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:43:59.113814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:59.115532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:43:59.116846 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a21cb883-d7a0-44f0-ab37-1463cab63028 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.185359 Nov 02 21:43:59.118047 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2116/4346] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:43:58 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:43:59.152249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-697578894", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "7e72bb4a-f3db-457c-962f-233087b237aa"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:43:59.223010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] validate_networks() for [('7e72bb4a-f3db-457c-962f-233087b237aa', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:43:59.723075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:43:59.725023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:43:59.746564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:59.748755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:59.751055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:43:59.752323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:43:59.754125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:43:59.757842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:00.161490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:44:00.162524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:44:00.163327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:44:00.163885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:44:00.164338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:44:00.187307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:00.188132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:00.192685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:00.195182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:00.197718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:00.199589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:00.201227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:00.216518 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0b416233-96ca-46ff-9b92-ad21137c0c8b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.495834 Nov 02 21:44:00.217085 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2117/4347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:43:59 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:00.225626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:00.228998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:00.229964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Getting quotas for project a7bc05bd7cb041fabf4caa2635a2275f. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:44:00.237000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Getting quotas for user e2fd8798cdc74b2b885174cfea7621b6 and project a7bc05bd7cb041fabf4caa2635a2275f. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:44:00.242647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:00.244269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:00.246975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:00.247861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:00.248441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:00.251118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:00.294824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:44:00.299709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:44:00.479430 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-132fe9b1-93aa-485a-8827-1874178f5311 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330952 Nov 02 21:44:00.480093 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2231/4348] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:43:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:44:00.502752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:00.503378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:00.524320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:00.524834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:00.525319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:00.526036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:00.526492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:00.526920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:01.109881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:01.125699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:01.134942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:01.138192 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb496427-db5a-4edc-bad3-f3790bcd5b7d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.644593 Nov 02 21:44:01.141479 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2232/4349] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:00 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:01.159308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-903a91be-0a5d-4508-8025-403ada309533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:01.162604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-903a91be-0a5d-4508-8025-403ada309533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:01.334335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-903a91be-0a5d-4508-8025-403ada309533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:01.345046 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-903a91be-0a5d-4508-8025-403ada309533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1215 microversion: 2.1 time: 0.197777 Nov 02 21:44:01.345964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2233/4350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:01 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:01.357110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:01.358385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:01.380164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:01.386646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:01.387490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:01.388672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:01.389780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:01.390301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:01.391056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:01.398670 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-499c8762-a42a-446c-a503-b8eafa73c63c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1516 microversion: 2.1 time: 1.180243 Nov 02 21:44:01.430055 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2118/4351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:00 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1516 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:01.450030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:01.781994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:01.790573 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-730b3a2f-2c13-4fdd-b33a-3f21901d318f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.443356 Nov 02 21:44:01.791167 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2234/4352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:01 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:02.173771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:02.175228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:02.231966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:02.239692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:02.241117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:02.245935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:02.245935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:02.245935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:02.368217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:02.379527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:02.382828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:02.384502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7a791dc5-9382-4e91-a492-67a6123fbc73 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1365 microversion: 2.57 time: 0.217484 Nov 02 21:44:02.385738 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2119/4353] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:02 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:44:02.390185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:02.391136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:02.408979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:02.423978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:02.425629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:02.432464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:02.433505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:02.440326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:02.596727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:02.606518 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e4204be-7ede-437c-b719-bd754fb02b85 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1219 microversion: 2.1 time: 0.237329 Nov 02 21:44:02.611508 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2235/4354] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:02 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1219 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:02.816356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:02.817149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:02.831279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:02.835649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:02.836491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:02.837501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:02.838330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:02.839011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:03.138263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:03.148374 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c756f6a-2dce-4b7b-a494-1436d0ab0d5a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.336338 Nov 02 21:44:03.176413 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2120/4355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:02 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:03.413933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:03.415774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:03.442526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:03.443367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:03.445804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:03.451182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:03.451920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:03.452562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:03.636386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:03.638037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:03.648641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:03.660361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:03.669241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:03.669750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:03.670226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:03.670913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:03.671375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:03.671817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:03.697734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:03.697734 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74debc2c-ffa8-49ce-91f8-fd618292201d tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1371 microversion: 2.57 time: 0.275353 Nov 02 21:44:03.697734 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2236/4356] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:03 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:03.838585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:03.847440 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01532b19-eb8e-40ac-ba11-52f0e8c174e8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1211 microversion: 2.1 time: 0.218018 Nov 02 21:44:03.861319 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2121/4357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:03 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1211 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:04.171507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:04.172265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:04.182599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:04.187828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:04.189942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:04.189942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:04.189942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:04.190222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:04.466093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:04.489779 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-846aaf58-708f-4154-8463-ac1ad6721bff tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.320924 Nov 02 21:44:04.494803 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2237/4358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:04 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:04.717827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:04.718612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:04.755846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:04.761609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:04.764250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:04.765742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:04.768367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:04.769946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:04.774353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:04.880502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:04.881084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:04.905471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:04.906908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:04.907540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:04.909065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:04.913011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:04.914935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:04.972155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:04.999511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:05.005744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:05.011521 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7213c9c3-79f0-4a6f-99db-022530fef598 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1371 microversion: 2.57 time: 0.298102 Nov 02 21:44:05.021759 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2122/4359] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:04 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:05.079979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3afc5516-31ac-44b8-ad8f-807c9c5e0f7c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'create', calling method: .version_select at 0x7f9b6832e310>, body: {"keypair": {"name": "tempest-keypair-1670900422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6zbO16O8czUQAe1FpgLGplc7c3EQLk7f1ErInAZ5gWmloFMu9wQHIq40j0w8nIUzCdBdUqdstaX6BnjNCPepnTLnaTqeuI6ToOX5HIHvsGChTocm//1Qa0Q3oP1uYGwg=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:05.119912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3afc5516-31ac-44b8-ad8f-807c9c5e0f7c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for project df79cd574b99449bae4c4b82e1c698a0. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:44:05.142743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3afc5516-31ac-44b8-ad8f-807c9c5e0f7c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for user 887a362ce68547af87982d10a253bf97 and project df79cd574b99449bae4c4b82e1c698a0. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:44:05.151304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:05.168401 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-57610a8b-27e1-47fb-936a-ec752f1833e7 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1267 microversion: 2.1 time: 0.292074 Nov 02 21:44:05.173911 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2238/4360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:04 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:05.270161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3afc5516-31ac-44b8-ad8f-807c9c5e0f7c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194153 Nov 02 21:44:05.270874 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2123/4361] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:44:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:05.516743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:05.517327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:05.536048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:05.544544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:05.544544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:05.544544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:05.544544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:05.544544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:05.840160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f735d392-e5ae-40b6-afe8-2c26c1001deb req-eb989a26-5343-48d6-87c2-571ef8d49d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da88578b-3773-4c6e-a924-2bc73e190ee3", "name": "network-vif-plugged", "status": "completed", "tag": "9f665f5b-4848-4725-8fb9-c04a00c125ef"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:05.860474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f735d392-e5ae-40b6-afe8-2c26c1001deb req-eb989a26-5343-48d6-87c2-571ef8d49d56 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:05.869777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f735d392-e5ae-40b6-afe8-2c26c1001deb req-eb989a26-5343-48d6-87c2-571ef8d49d56 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:05.870451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f735d392-e5ae-40b6-afe8-2c26c1001deb req-eb989a26-5343-48d6-87c2-571ef8d49d56 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:05.895411 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f735d392-e5ae-40b6-afe8-2c26c1001deb req-eb989a26-5343-48d6-87c2-571ef8d49d56 service nova] Creating event network-vif-plugged:9f665f5b-4848-4725-8fb9-c04a00c125ef for instance da88578b-3773-4c6e-a924-2bc73e190ee3 on n-h1-860863-4 Nov 02 21:44:05.911345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:05.926544 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd522c8d-3ae8-4c94-8332-5664440eea88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.414542 Nov 02 21:44:05.929105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2239/4362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:05 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:05.942932 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f735d392-e5ae-40b6-afe8-2c26c1001deb req-eb989a26-5343-48d6-87c2-571ef8d49d56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107545 Nov 02 21:44:05.944236 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2124/4363] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:06.049180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:06.049812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:06.056610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.057174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.057623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:06.058334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.058802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.059223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:06.176537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:06.200381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:06.201700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:06.206732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:06.209627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:06.213255 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc694fae-7235-49b0-aeea-600a5585360c tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1356 microversion: 2.57 time: 0.169384 Nov 02 21:44:06.213605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.214426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.215052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:06.246051 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2240/4364] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:06 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1356 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:06.247917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.254773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:06.255288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:06.256041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.256960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:06.278942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.287106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.287106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:06.287106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.287106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.287106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:06.344612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:44:06.452353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:06.470453 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3768e1a9-ef13-4ab8-a743-6fc114118c7c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1273 microversion: 2.1 time: 0.274368 Nov 02 21:44:06.476912 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2125/4365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:06 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:06.805605 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddbad0d5-a799-4261-a9a5-4896857d8519 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 204 len: 0 microversion: 2.57 time: 0.556914 Nov 02 21:44:06.806281 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2241/4366] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:44:06 2022] DELETE /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:44:06.817279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:06.817730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:06.831809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.836963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.837692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:06.840113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:06.841641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:06.843423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:07.104596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:07.117523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:07.119375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:07.121023 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cb75b126-c49b-4141-9260-d36082950222 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1362 microversion: 2.57 time: 0.310162 Nov 02 21:44:07.134583 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2126/4367] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:06 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:07.150690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:07.151662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:07.160593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:07.161470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:07.162772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:07.163740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:07.164069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e18ced7-a52e-404d-870b-c4c2b36e2fb7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Action: 'create', calling method: .version_select at 0x7f9b685d2b80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2030389578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPU636E8gut8W4gGBRIaKsEDOiLNlKL+Kclonz3s7JYlBGjnzgaDOSh9NE8C+K2dgHocBrNSiPsvvJjV5FmI+SIG93z1yM3hNjlbbc2SR9aldvvVJsgKprzfG2dWe4fL9Q=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:07.164959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:07.165796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:07.188163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5e18ced7-a52e-404d-870b-c4c2b36e2fb7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Getting quotas for project d7badcd8061841fda3c5974d4ff5e2c0. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:44:07.195391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5e18ced7-a52e-404d-870b-c4c2b36e2fb7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Getting quotas for user b05a329a613041f780874384b4fcf5dc and project d7badcd8061841fda3c5974d4ff5e2c0. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:44:07.304883 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e18ced7-a52e-404d-870b-c4c2b36e2fb7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.365322 Nov 02 21:44:07.305798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2242/4368] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:44:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:07.465255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:07.476984 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a568785-3ff6-4b4e-8d25-64713cb63258 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1317 microversion: 2.1 time: 0.340202 Nov 02 21:44:07.485083 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2127/4369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:07 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:07.520014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:07.521072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:07.533401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:07.534147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:07.535598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:07.537447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:07.538258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:07.539085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:07.719259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:07.728115 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a789efa4-7304-4954-9765-558392423d67 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1315 microversion: 2.1 time: 0.219952 Nov 02 21:44:07.741496 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2243/4370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:07 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:08.155451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:08.156092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:08.170898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:08.172405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:08.173042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:08.174569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:08.177361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:08.178003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:08.288810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:08.306204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:08.307659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:08.308841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7dca2934-b6a0-421f-a3d3-2168d2178c8b tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1362 microversion: 2.57 time: 0.161107 Nov 02 21:44:08.309798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2128/4371] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:08 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:08.523647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:08.524279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:08.530807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:08.531303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:08.531808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:08.532518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:08.533026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:08.533456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:08.750751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:08.752357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:08.761233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:08.761732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:08.762176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:08.762887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:08.763343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:08.763775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.022288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:09.032083 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3de41f3c-c175-4c98-968b-d9faaa67bcd1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1506 microversion: 2.1 time: 0.514037 Nov 02 21:44:09.046203 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2244/4372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:08 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:09.059351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:09.060192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:09.070981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.071863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.072484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.076795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.076795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.076795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.223145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:09.235242 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d7eaacd-5e64-41ca-8234-7d8323edb8f0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1315 microversion: 2.1 time: 0.483984 Nov 02 21:44:09.236490 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2129/4373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:08 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:09.339876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:09.341148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:09.354085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.355193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.356018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.357649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.358416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.359157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.391105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:09.407937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.409304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.409993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.410462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lazy-loading 'fault' on Instance uuid bfecc518-fe1a-446a-b183-e1c1f742314e {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:44:09.442812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:09.454697 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b2d6eff-f257-4cc3-b072-a391e7b484e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1506 microversion: 2.1 time: 0.400473 Nov 02 21:44:09.465597 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2245/4374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:09 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:09.480622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:09.484523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:09.485966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:09.493596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.494381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.494983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.496141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.496751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.497251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:09.500433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.500554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc1e411b078a46bdbd7e3e165bed7197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57942cf8290b4b3091d38277c2eb3284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:09.501215 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0af109a9-fd19-4b6a-93f5-cd3fed21f151 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 200 len: 1367 microversion: 2.57 time: 0.166104 Nov 02 21:44:09.518066 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2130/4375] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:09 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:44:09.598847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:44:09.600838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:44:09.602200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:44:09.603138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:44:09.603749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:44:09.913416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:09.923129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:09.943357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.946281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.946281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.946281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:09.946281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:09.946600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:09.979000 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02d0d08e-9e28-48d6-ada4-cf97b701c3c1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "POST /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3/action" status: 202 len: 1108 microversion: 2.1 time: 0.503449 Nov 02 21:44:09.981052 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2246/4376] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:44:09 2022] POST /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3/action => generated 1108 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 21:44:10.003605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:10.004736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:10.039569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:10.040313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:10.041820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:10.042742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:10.043364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:10.043976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:10.122851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1edd708-591d-489c-96d0-f0cf551fdfe2 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Action: 'create', calling method: .version_select at 0x7f9b6832e3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1713955239", "metadata": {"Type": "work"}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:10.231952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:10.316632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:10.328554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b937bc4-bc97-44d4-9ef0-3227a8a354a6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.332782 Nov 02 21:44:10.329175 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2247/4377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:09 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:10.351529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-506869215", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cad765a1-cacf-48e3-8563-6fc38217862b"}], "security_groups": [{"name": "tempest-securitygroup--1803354744"}], "key_name": "tempest-keypair-1670900422", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:10.555161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] validate_networks() for [('cad765a1-cacf-48e3-8563-6fc38217862b', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:44:11.066558 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1edd708-591d-489c-96d0-f0cf551fdfe2 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.169867 Nov 02 21:44:11.079414 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2131/4378] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 21:44:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1171 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 21:44:11.079414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:11.079414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:11.082290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.082787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.083220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.084508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.084979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.085409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.641757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:11.653113 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ac3c46b-6246-4af5-970d-7baa4d880db6 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1315 microversion: 2.1 time: 0.584830 Nov 02 21:44:11.667103 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2132/4379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:11 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:11.676670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-37f3cda8-7e2b-41ed-aea9-2e2126b883b3 req-82f8b253-12d1-4b07-9b0c-0ce2744cc5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd3f93b-93a6-40e1-9750-17bc48e44a13", "tag": "b1e62496-b65e-44f0-81e7-f7375b04b0a5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:11.687377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-37f3cda8-7e2b-41ed-aea9-2e2126b883b3 req-82f8b253-12d1-4b07-9b0c-0ce2744cc5d0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.688115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-37f3cda8-7e2b-41ed-aea9-2e2126b883b3 req-82f8b253-12d1-4b07-9b0c-0ce2744cc5d0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.688915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-37f3cda8-7e2b-41ed-aea9-2e2126b883b3 req-82f8b253-12d1-4b07-9b0c-0ce2744cc5d0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.702388 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-37f3cda8-7e2b-41ed-aea9-2e2126b883b3 req-82f8b253-12d1-4b07-9b0c-0ce2744cc5d0 service nova] Creating event network-changed:b1e62496-b65e-44f0-81e7-f7375b04b0a5 for instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 on n-h2-860863-4 Nov 02 21:44:11.709000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-37f3cda8-7e2b-41ed-aea9-2e2126b883b3 req-82f8b253-12d1-4b07-9b0c-0ce2744cc5d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036103 Nov 02 21:44:11.709616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2133/4380] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:11.718209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:11.719110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] [instance: bfecc518-fe1a-446a-b183-e1c1f742314e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:11.727509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.728018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.728629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.729811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.732991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.732991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.747922 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] HTTP exception thrown: Instance bfecc518-fe1a-446a-b183-e1c1f742314e could not be found. Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Request method failure captured: Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e HTTP/1.1 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuR9kKfH33j9NXzc-zOMYDVUhd81GJ19E67JNvZyaXQq8cKlKDJVi-mFfA2cWDgsHEUu8QDSgN8EptWLYpT5Ycq0WCXLWb-w-wfLSLSoW_PdBXm7EmvhfOUJZ8WC2cgRH5otf9FfQHEBDUThozBeOJFi5mRIZYdLyRHKtVugPPBIt8U Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.57 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 57942cf8290b4b3091d38277c2eb3284 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerShowV257Test-824455464 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_57942cf8290b4b3091d38277c2eb3284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57942cf8290b4b3091d38277c2eb3284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/57942cf8290b4b3091d38277c2eb3284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/57942cf8290b4b3091d38277c2eb3284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerShowV257Test-824455464 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 57942cf8290b4b3091d38277c2eb3284 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerShowV257Test-824455464 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerShowV257Test-824455464-project Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: cc1e411b078a46bdbd7e3e165bed7197 Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerShowV257Test-824455464-project Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance bfecc518-fe1a-446a-b183-e1c1f742314e could not be found. Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bfecc518-fe1a-446a-b183-e1c1f742314e'} Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfecc518-fe1a-446a-b183-e1c1f742314e could not be found. Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfecc518-fe1a-446a-b183-e1c1f742314e could not be found. Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:11.749885 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:11.754732 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:11.754732 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:11.754732 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:11.754732 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:44:11.754732 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:44:11.754732 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfecc518-fe1a-446a-b183-e1c1f742314e could not be found. Nov 02 21:44:11.754732 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:11.757255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] Returning 404 to user: Instance bfecc518-fe1a-446a-b183-e1c1f742314e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:44:11.761691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cab3f65a-bae4-401c-a754-66bf9789f620 tempest-ServerShowV257Test-824455464 tempest-ServerShowV257Test-824455464-project] 10.222.0.25 "GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e" status: 404 len: 111 microversion: 2.57 time: 0.047353 Nov 02 21:44:11.761691 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2134/4381] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:11 2022] GET /compute/v2.1/servers/bfecc518-fe1a-446a-b183-e1c1f742314e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:44:11.772229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c6eba1e-07ea-4921-b4e2-bdec7471d291 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b68b55670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:11.783506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:44:11.784748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:44:11.785954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:44:11.787267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:44:11.790379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:44:11.801632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.802666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.803612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.805233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.806054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.806723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.822588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:11.846920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for project df79cd574b99449bae4c4b82e1c698a0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:44:11.858060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Getting quotas for user 887a362ce68547af87982d10a253bf97 and project df79cd574b99449bae4c4b82e1c698a0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:44:11.861603 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c6eba1e-07ea-4921-b4e2-bdec7471d291 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 200 len: 353 microversion: 2.1 time: 0.101637 Nov 02 21:44:11.863088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2135/4382] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:11 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:11.867878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:11.868499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:11.875504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:44:11.878239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:44:11.881013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.881646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.882338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:11.883529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:11.884047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:11.885042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:12.028425 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0f384109-e991-4343-a720-a941982bfcca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.682554 Nov 02 21:44:12.029714 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2248/4383] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:44:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:44:12.044396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f26397d-126c-4fa8-a108-a4c93e74b06f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:12.045641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f26397d-126c-4fa8-a108-a4c93e74b06f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:12.227408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f26397d-126c-4fa8-a108-a4c93e74b06f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:12.235962 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f26397d-126c-4fa8-a108-a4c93e74b06f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1245 microversion: 2.1 time: 0.197845 Nov 02 21:44:12.236547 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2249/4384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:12 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1245 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:12.292862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:12.307020 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d6d0773-4367-4c13-bdf1-20da95719c13 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.442826 Nov 02 21:44:12.307892 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2136/4385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:11 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:12.685971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:12.686631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:12.729477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:12.739179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:12.740583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:12.742317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:12.747782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:12.749752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:12.877793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc8c56a4-58a9-4c42-984f-498a660cd8b7 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b683e2ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:12.997517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:13.003775 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc8c56a4-58a9-4c42-984f-498a660cd8b7 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 200 len: 354 microversion: 2.1 time: 0.130557 Nov 02 21:44:13.004358 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2137/4386] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:12 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:13.005847 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a97dd453-2888-4a75-992e-622871414a18 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1315 microversion: 2.1 time: 0.325151 Nov 02 21:44:13.024970 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2250/4387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:12 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:13.025194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d5d1c29c-ac10-4a08-91e7-88c1f6e5b1cd tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b68309f70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:13.103405 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d5d1c29c-ac10-4a08-91e7-88c1f6e5b1cd tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 200 len: 354 microversion: 2.1 time: 0.087636 Nov 02 21:44:13.103997 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2138/4388] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:13 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:13.121494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c48f798e-8584-4f8f-8100-f6f400a35c0c tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b68dd8940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:13.269231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62d4f06a-dbad-4544-99ed-12f38cbc9d18 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:13.270085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62d4f06a-dbad-4544-99ed-12f38cbc9d18 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:13.377332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-62d4f06a-dbad-4544-99ed-12f38cbc9d18 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:13.382234 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c48f798e-8584-4f8f-8100-f6f400a35c0c tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 202 len: 0 microversion: 2.1 time: 0.265498 Nov 02 21:44:13.383354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2251/4389] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:44:13 2022] DELETE /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:13.388478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:13.389819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:13.393137 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62d4f06a-dbad-4544-99ed-12f38cbc9d18 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1245 microversion: 2.1 time: 0.135190 Nov 02 21:44:13.393725 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2139/4390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:13 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:13.398496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8025b6d3-a3d9-4eb2-923a-ab8faf9d045a tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b6875a940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:13.401586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:13.402516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:13.403263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:13.404391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:13.405038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:13.405624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:13.500075 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8025b6d3-a3d9-4eb2-923a-ab8faf9d045a tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 200 len: 353 microversion: 2.1 time: 0.105295 Nov 02 21:44:13.500791 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2140/4391] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:13 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:13.656312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:13.681483 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0225b58-39b0-4c7a-afcc-b54ce274b30c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.296724 Nov 02 21:44:13.682078 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2252/4392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:13 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:14.035625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:14.037421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:14.043777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:14.044564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:14.045253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:14.046132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:14.046753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:14.047341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:14.264898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:14.274791 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e2a0bb42-10cf-44b0-8539-d9df148bf60b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1315 microversion: 2.1 time: 0.242952 Nov 02 21:44:14.275541 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2141/4393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:14 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:14.429830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:14.431944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:14.472069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:14.472895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:14.473695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:14.474914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:14.475675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:14.476416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:14.516814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77e4c7db-90cc-4fd1-9e87-45127fa2c734 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b68766310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:14.617132 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77e4c7db-90cc-4fd1-9e87-45127fa2c734 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 200 len: 353 microversion: 2.1 time: 0.106764 Nov 02 21:44:14.618137 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2142/4394] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:14 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:14.629307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:14.650347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e662460-c108-4172-9d36-d878f93b5806 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1297 microversion: 2.1 time: 0.235402 Nov 02 21:44:14.655848 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2253/4395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:14 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1297 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:14.713407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:14.714298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:14.720795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:14.721553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:14.722192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:14.723063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:14.723683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:14.724338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:14.970735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:14.979389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab66715e-4b9d-497c-979c-2bdd6dca10ab tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.270411 Nov 02 21:44:14.983555 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2143/4396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:14 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:15.299943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:15.301072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:15.311116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:15.321769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:15.322626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:15.323616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:15.324263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:15.324878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:15.610572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:15.623564 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-233a6d42-5f9f-4cf8-8b82-007be3cda5ff tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1315 microversion: 2.1 time: 0.327952 Nov 02 21:44:15.626704 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2254/4397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:15 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:15.639868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92dc40ae-d531-4555-a666-cad160b67f53 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b688fd670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:15.687375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:15.688425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:15.721543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:15.722364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:15.723147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:15.729440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:15.730288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:15.731017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:15.819802 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92dc40ae-d531-4555-a666-cad160b67f53 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 200 len: 353 microversion: 2.1 time: 0.185395 Nov 02 21:44:15.820797 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2144/4398] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:15 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:15.944463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:15.966751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d46d7fc-f333-4d1f-90cc-1b4399c9b4bf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1303 microversion: 2.1 time: 0.290730 Nov 02 21:44:16.002391 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2255/4399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:15 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1303 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:16.015696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:16.016725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:16.028572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:16.029483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:16.030152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:16.031324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:16.032006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:16.032720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:16.076347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6c672ab1-0b60-4281-b95e-c01ecc986f2f req-a1963e26-4b9b-40e1-8d1a-e4134f0f5ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd3f93b-93a6-40e1-9750-17bc48e44a13", "name": "network-vif-plugged", "status": "completed", "tag": "b1e62496-b65e-44f0-81e7-f7375b04b0a5"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:16.104670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6c672ab1-0b60-4281-b95e-c01ecc986f2f req-a1963e26-4b9b-40e1-8d1a-e4134f0f5ba0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:16.111433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6c672ab1-0b60-4281-b95e-c01ecc986f2f req-a1963e26-4b9b-40e1-8d1a-e4134f0f5ba0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:16.113742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6c672ab1-0b60-4281-b95e-c01ecc986f2f req-a1963e26-4b9b-40e1-8d1a-e4134f0f5ba0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:16.145209 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6c672ab1-0b60-4281-b95e-c01ecc986f2f req-a1963e26-4b9b-40e1-8d1a-e4134f0f5ba0 service nova] Creating event network-vif-plugged:b1e62496-b65e-44f0-81e7-f7375b04b0a5 for instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 on n-h2-860863-4 Nov 02 21:44:16.152048 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6c672ab1-0b60-4281-b95e-c01ecc986f2f req-a1963e26-4b9b-40e1-8d1a-e4134f0f5ba0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081019 Nov 02 21:44:16.157147 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2256/4400] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:16.673686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:16.675563 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-94eec9fc-6f93-46e1-bf53-0779bfca34e5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.667686 Nov 02 21:44:16.678189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:16.678946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:16.679848 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2145/4401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:16 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:16.719475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:16.720160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:16.720629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:16.721412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:16.724105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:16.726174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:16.844610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98a17d25-e7c7-4715-a7e9-01e736e47761 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b68467af0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:17.047565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98a17d25-e7c7-4715-a7e9-01e736e47761 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 200 len: 353 microversion: 2.1 time: 0.208402 Nov 02 21:44:17.048983 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2146/4402] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:16 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:17.061724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:17.065230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:17.079976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:17.085175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:17.085915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:17.089391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:17.090101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:17.091222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:17.190596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:17.209730 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d059421f-d165-42ff-9734-3cecd001d616 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1315 microversion: 2.1 time: 0.541043 Nov 02 21:44:17.212515 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2257/4403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:16 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:17.351740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:17.363422 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-18855026-6a93-4e84-9077-adbca9195a71 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1303 microversion: 2.1 time: 0.312998 Nov 02 21:44:17.367971 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2147/4404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:17 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1303 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:17.703498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:17.704732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:17.719641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:17.726176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:17.726870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:17.727808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:17.728442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:17.729217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:17.983867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:17.995235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff07070f-95dc-4ba9-a119-b2df87231e1c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.297639 Nov 02 21:44:18.024149 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2258/4405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:17 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:18.065129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da0866ac-697b-4d3d-bbef-5d1a2303fab3 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Calling method '.version_select at 0x7f9b683093a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:18.118151 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-da0866ac-697b-4d3d-bbef-5d1a2303fab3 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] HTTP exception thrown: Volume bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc could not be found. Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da0866ac-697b-4d3d-bbef-5d1a2303fab3 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Request method failure captured: Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc HTTP/1.1 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSp05VrPCySF-GzAgQUhECoifz5ddXjYJnp9UPO5w1OGwhDolUwdSralc5jfRFzogpPGDo3jLqCtf7YF7nCMW9H0sMapVRa1wqE13hMw64UyhNyHQOJwVvwmrG4A8bq9okzV7QbPQ5JmeITEQRVIg-9B0dix-Ft-3Z59TF6UfPfSjY Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 61c83cecb95e46a0a1118b584a856662 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesGetTestJSON-680704913 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_61c83cecb95e46a0a1118b584a856662"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c83cecb95e46a0a1118b584a856662"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/61c83cecb95e46a0a1118b584a856662"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/61c83cecb95e46a0a1118b584a856662"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesGetTestJSON-680704913 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 61c83cecb95e46a0a1118b584a856662 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesGetTestJSON-680704913 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesGetTestJSON-680704913-project Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 84d2166cb0c6496e8c75fddee7029880 Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesGetTestJSON-680704913-project Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: exception: Volume bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc could not be found. Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc'} Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc could not be found. (HTTP 404) (Request-ID: req-b3448801-4e1e-4a3e-8448-9ac9d191e6c5) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:44:18.139769 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc could not be found. Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc could not be found. Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc could not be found. Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da0866ac-697b-4d3d-bbef-5d1a2303fab3 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] Returning 404 to user: Volume bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:44:18.152220 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da0866ac-697b-4d3d-bbef-5d1a2303fab3 tempest-VolumesGetTestJSON-680704913 tempest-VolumesGetTestJSON-680704913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc" status: 404 len: 109 microversion: 2.1 time: 0.080779 Nov 02 21:44:18.156739 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2148/4406] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:44:18 2022] GET /compute/v2.1/os-volumes/bbaade4c-bf8f-4eb2-94d4-1db65d4f56cc => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:44:18.242120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:18.242750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:18.269653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:18.270350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:18.270724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:18.272029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:18.272485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:18.279641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:18.392359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:18.394704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:18.409987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:18.410491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:18.410931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:18.411785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:18.414645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:18.415245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:18.776518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:18.790120 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a4670d7-de20-427d-9aae-82ed5026f184 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1501 microversion: 2.1 time: 0.555881 Nov 02 21:44:18.791623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2259/4407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:18 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1501 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:18.832162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-93871644"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:18.832994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:18.842326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:18.843078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:18.843721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:18.844803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:18.845464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:18.846526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:18.962334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:18.973627 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e64e5a20-6ff4-4ee3-8855-45a8785383b1 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.585721 Nov 02 21:44:18.975479 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2149/4408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:18 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:19.027408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:19.028337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:19.037322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:19.039925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:19.041604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:19.043237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:19.045622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:19.046287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:19.154645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.security_group_api [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Adding security group 357f2e0e-45dd-45ac-b01c-b8153676fd8c to port b1e62496-b65e-44f0-81e7-f7375b04b0a5 Nov 02 21:44:19.675103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:19.687300 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fe23c42-86bf-4403-849d-29364094dee0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.663975 Nov 02 21:44:19.690598 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2150/4409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:19 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:20.106279 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93fc1e80-768b-4e06-ae55-bf0ccc105fbc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13/action" status: 202 len: 0 microversion: 2.1 time: 1.290190 Nov 02 21:44:20.106987 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2260/4410] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:44:18 2022] POST /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13/action => generated 0 bytes in 1292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:20.113271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:20.113893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:20.130153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.132746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.133226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.133956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.134991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.134991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.136715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:20.137345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:20.163632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.165450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.167252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.170387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.170986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.171583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.251621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:44:20.582492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:20.592719 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11a1ee66-e461-4549-9352-e1ee501873aa tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.484403 Nov 02 21:44:20.609348 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2261/4411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:20 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:20.621068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-237482890"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:20.621611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:20.637374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.637866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.638305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.639012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.639728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.640148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.769234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5348047e-59f1-45ef-b67c-08d32960e3b0 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "DELETE /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 204 len: 0 microversion: 2.42 time: 1.076857 Nov 02 21:44:20.774073 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2151/4412] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:44:19 2022] DELETE /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:44:20.780095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5827fcd3-10a0-4b4d-a359-dd8fc17b5e5e req-938cb946-93a1-455c-8b01-190558853331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd3f93b-93a6-40e1-9750-17bc48e44a13", "tag": "b1e62496-b65e-44f0-81e7-f7375b04b0a5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:20.804040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5827fcd3-10a0-4b4d-a359-dd8fc17b5e5e req-938cb946-93a1-455c-8b01-190558853331 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.804597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5827fcd3-10a0-4b4d-a359-dd8fc17b5e5e req-938cb946-93a1-455c-8b01-190558853331 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.807050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5827fcd3-10a0-4b4d-a359-dd8fc17b5e5e req-938cb946-93a1-455c-8b01-190558853331 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.826508 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5827fcd3-10a0-4b4d-a359-dd8fc17b5e5e req-938cb946-93a1-455c-8b01-190558853331 service nova] Creating event network-changed:b1e62496-b65e-44f0-81e7-f7375b04b0a5 for instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 on n-h2-860863-4 Nov 02 21:44:20.840610 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5827fcd3-10a0-4b4d-a359-dd8fc17b5e5e req-938cb946-93a1-455c-8b01-190558853331 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064987 Nov 02 21:44:20.841659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2152/4413] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:20.847023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:20.860837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:20.869276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.882118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.882941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.883900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:20.884576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:20.885513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:20.888408 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.security_group_api [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Adding security group c0ae874b-6cdc-4deb-9a95-bb9de1e2c670 to port b1e62496-b65e-44f0-81e7-f7375b04b0a5 Nov 02 21:44:21.665247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:21.674423 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c193acb-4ac3-495c-a6c6-c47af69b3dac tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.831513 Nov 02 21:44:21.675009 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2153/4414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:20 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:21.702897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:21.705177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:21.720558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-242d049d-7e1f-4009-a62f-0e5c7cdb673d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13/action" status: 202 len: 0 microversion: 2.1 time: 1.109965 Nov 02 21:44:21.721289 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2262/4415] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:44:20 2022] POST /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13/action => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:21.728876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:21.729778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:21.732817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:21.732817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:21.733051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:21.733133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:21.733133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:21.738079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:21.750869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:21.753695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:21.754394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:21.755875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:21.762211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:21.767332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:21.826774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:22.232805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=20 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:22.455776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:22.471485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:22.472857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:22.497092 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-35edac7c-c565-4e83-aab6-b8e6495488b6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2963 microversion: 2.42 time: 0.793400 Nov 02 21:44:22.498010 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2154/4416] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:21 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2963 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:22.504694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:22.505209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:22.514107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:22.514518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:22.514518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:22.515109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:22.515924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:22.516463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:22.517008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:22.527185 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19d217e1-ccbe-4c77-81ea-8ea1a3567908 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.804490 Nov 02 21:44:22.531889 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2263/4417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:21 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:22.547746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f9817568-c794-4b94-be53-9ca09a4d485a req-173b152a-4495-494f-8bfb-d9272091662b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29976160-96b8-47c8-b3a9-cb8a1a3c3b02", "tag": "81d55a8b-2bfb-4ba3-a0ab-7d78b300d809"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:22.566971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9817568-c794-4b94-be53-9ca09a4d485a req-173b152a-4495-494f-8bfb-d9272091662b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:22.572244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9817568-c794-4b94-be53-9ca09a4d485a req-173b152a-4495-494f-8bfb-d9272091662b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:22.572822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9817568-c794-4b94-be53-9ca09a4d485a req-173b152a-4495-494f-8bfb-d9272091662b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:22.595538 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f9817568-c794-4b94-be53-9ca09a4d485a req-173b152a-4495-494f-8bfb-d9272091662b service nova] Creating event network-changed:81d55a8b-2bfb-4ba3-a0ab-7d78b300d809 for instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 on n-h2-860863-4 Nov 02 21:44:22.607300 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f9817568-c794-4b94-be53-9ca09a4d485a req-173b152a-4495-494f-8bfb-d9272091662b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073806 Nov 02 21:44:22.610713 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2264/4418] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:22.705247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:22.706181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:22.733192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:22.739465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:22.744369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:22.746544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:22.746544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:22.746903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:23.123539 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-07f7c622-f06a-4ebd-a574-3a887dcf79a0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.622550 Nov 02 21:44:23.124288 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2155/4419] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 21:44:22 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13/os-security-groups => generated 1156 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:23.129067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e5314459-09b9-4e8b-bed1-a80f0ddca2ba req-24339e36-4d67-4bcf-ba29-bac0e5097ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfd3f93b-93a6-40e1-9750-17bc48e44a13", "tag": "b1e62496-b65e-44f0-81e7-f7375b04b0a5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:23.140656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e5314459-09b9-4e8b-bed1-a80f0ddca2ba req-24339e36-4d67-4bcf-ba29-bac0e5097ea0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:23.141533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e5314459-09b9-4e8b-bed1-a80f0ddca2ba req-24339e36-4d67-4bcf-ba29-bac0e5097ea0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:23.142156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e5314459-09b9-4e8b-bed1-a80f0ddca2ba req-24339e36-4d67-4bcf-ba29-bac0e5097ea0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:23.154673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e5314459-09b9-4e8b-bed1-a80f0ddca2ba req-24339e36-4d67-4bcf-ba29-bac0e5097ea0 service nova] Creating event network-changed:b1e62496-b65e-44f0-81e7-f7375b04b0a5 for instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 on n-h2-860863-4 Nov 02 21:44:23.160229 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e5314459-09b9-4e8b-bed1-a80f0ddca2ba req-24339e36-4d67-4bcf-ba29-bac0e5097ea0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034575 Nov 02 21:44:23.161141 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2156/4420] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:23.167126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-559291ed-dc25-4c1e-bc15-f5c2607ebfb1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b691758b0>, body: {"security_group": {"name": " tempest-securitygroup -1616085976 ", "description": "tempest-description-1890565052"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:23.360318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:23.375909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8c234530-6d68-40f7-9586-c83b2eb371c2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.679941 Nov 02 21:44:23.378532 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2265/4421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:22 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:23.381778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:23.532129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:23.533191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:23.540542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:23.541411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:23.542468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:23.543414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:23.544106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:23.545775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:23.863065 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-559291ed-dc25-4c1e-bc15-f5c2607ebfb1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.699809 Nov 02 21:44:23.864297 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2157/4422] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:44:23 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:23.870317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:23.871320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:23.895117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:23.897566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:23.899750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:23.917250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:23.918402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:23.920310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:24.174750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:24.206562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:24.210531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:24.213297 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c9d5305-7975-4d13-9282-4965cd161248 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2963 microversion: 2.42 time: 0.685978 Nov 02 21:44:24.215223 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2266/4423] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:23 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2963 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:44:24.245971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c07512e0-e338-496d-8bea-8a82ea7f3f6c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b685f5dc0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:24.472289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:24.481328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c07512e0-e338-496d-8bea-8a82ea7f3f6c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05" status: 200 len: 224 microversion: 2.1 time: 0.263744 Nov 02 21:44:24.482463 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2267/4424] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:44:24 2022] GET /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 => generated 224 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:24.484151 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-feaa18ca-ce2f-47c1-b406-2a9652c48cca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.618129 Nov 02 21:44:24.485563 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2158/4425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:23 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:24.505060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:24.506211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:24.513589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:24.514177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:24.515063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5946fa09-4d74-471b-a3f9-15f3e5eb1697 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b69175940>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:24.515344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:24.516289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:24.516986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:24.517697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:24.780403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:24.845800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ebedd07-b6f5-4ac8-9424-c46ec17f0ee4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.362042 Nov 02 21:44:24.846401 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2268/4426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:24 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:24.982054 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5946fa09-4d74-471b-a3f9-15f3e5eb1697 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05" status: 202 len: 0 microversion: 2.1 time: 0.478670 Nov 02 21:44:24.983523 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2159/4427] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:44:24 2022] DELETE /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:24.992149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15279afb-a318-4c1e-b33b-3d1d881614d3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6d156310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:25.004745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1216041212-access_point-1956540662", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "9680a45d-3a0b-493c-9d04-325bf4344327"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2030389578", "security_groups": [{"name": "tempest-secgroup_access--154009418"}, {"name": "tempest-secgroup_general--1720476789"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-15279afb-a318-4c1e-b33b-3d1d881614d3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-15279afb-a318-4c1e-b33b-3d1d881614d3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-15279afb-a318-4c1e-b33b-3d1d881614d3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-46cd4911-7a05-4233-8a61-1da275061c94'] Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15279afb-a318-4c1e-b33b-3d1d881614d3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 HTTP/1.1 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-46cd4911-7a05-4233-8a61-1da275061c94'] Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'a5a340b1-c9f0-49d1-be52-f3e1f26a9b05'} Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:44:25.073702 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46cd4911-7a05-4233-8a61-1da275061c94'] Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46cd4911-7a05-4233-8a61-1da275061c94'] Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46cd4911-7a05-4233-8a61-1da275061c94'] Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46cd4911-7a05-4233-8a61-1da275061c94'] Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15279afb-a318-4c1e-b33b-3d1d881614d3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-46cd4911-7a05-4233-8a61-1da275061c94'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15279afb-a318-4c1e-b33b-3d1d881614d3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05" status: 404 len: 194 microversion: 2.1 time: 0.086743 Nov 02 21:44:25.078884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2269/4428] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:44:24 2022] GET /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:44:25.091254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc09333b-adc3-4b2a-b3c5-1c57fd7cc713 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b683e1280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1871918566", "description": "tempest-description-1256525919"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:25.574647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] validate_networks() for [('9680a45d-3a0b-493c-9d04-325bf4344327', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:44:26.391182 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc09333b-adc3-4b2a-b3c5-1c57fd7cc713 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.309157 Nov 02 21:44:26.394309 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2270/4429] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:44:25 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:26.401237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:26.404138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:26.421219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:26.422128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:26.423742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:26.426429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:26.427999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:26.428897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:27.050580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:27.073880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:27.078548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:27.086667 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee520448-389e-4acb-83ae-cbf46809d5a7 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2963 microversion: 2.42 time: 0.690861 Nov 02 21:44:27.087754 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2271/4430] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:26 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2963 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:27.123748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:27.126374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:27.143010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:27.145678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:27.148306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:27.149116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:27.150601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:27.154373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:27.182000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:27.488412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:44:27.489037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:44:27.490421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:44:27.491060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:44:27.491712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:44:27.504433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:27.506396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:27.507091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:27.508045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:27.509307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:27.509996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:27.522886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:27.537525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Getting quotas for project d7badcd8061841fda3c5974d4ff5e2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:44:27.543640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Getting quotas for user b05a329a613041f780874384b4fcf5dc and project d7badcd8061841fda3c5974d4ff5e2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:44:27.559012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:44:27.561307 n-d-860863-4 devstack@n-api.service[121039]: WARNING nova.utils [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1216041212-access_point-1956540662 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1216041212-ac Nov 02 21:44:27.562284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:44:27.628635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:27.678125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98b4335b-920c-476c-95f8-c965d5167790 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.585163 Nov 02 21:44:27.682338 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2272/4431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:27 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:27.696456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:27.697396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:27.704196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:27.705586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:27.710510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:27.710510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:27.710510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:27.710510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:27.735431 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2d200cfb-ec62-44bd-87f2-8ebd77368679 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.734201 Nov 02 21:44:27.745399 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2160/4432] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:44:24 2022] POST /compute/v2.1/servers => generated 457 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:44:27.753023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3117e098-0f3c-4ef6-b1a8-077d3907a08e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b68939d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1686383132", "description": "tempest-description-1989271378"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:27.970714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:27.993470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e357533-3572-4a67-b52e-4c5e081e3afd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.305179 Nov 02 21:44:27.995548 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2273/4433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:27 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:28.002527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5fc92110-18da-40e4-a5ac-6b365fabe066 req-59015292-3e56-4986-bc65-3519fe1d2ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-unplugged", "status": "completed", "tag": "9f51a648-5f20-411a-a7b2-b20f02126167"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:28.013110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5fc92110-18da-40e4-a5ac-6b365fabe066 req-59015292-3e56-4986-bc65-3519fe1d2ab1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:28.013940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5fc92110-18da-40e4-a5ac-6b365fabe066 req-59015292-3e56-4986-bc65-3519fe1d2ab1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:28.014866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5fc92110-18da-40e4-a5ac-6b365fabe066 req-59015292-3e56-4986-bc65-3519fe1d2ab1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:28.029595 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5fc92110-18da-40e4-a5ac-6b365fabe066 req-59015292-3e56-4986-bc65-3519fe1d2ab1 service nova] Creating event network-vif-unplugged:9f51a648-5f20-411a-a7b2-b20f02126167 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:28.063027 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5fc92110-18da-40e4-a5ac-6b365fabe066 req-59015292-3e56-4986-bc65-3519fe1d2ab1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059484 Nov 02 21:44:28.063027 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2274/4434] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:28.075563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a0f3ffc-327c-46eb-8ab3-1e79564b0731 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:28.076292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4a0f3ffc-327c-46eb-8ab3-1e79564b0731 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:28.196693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4a0f3ffc-327c-46eb-8ab3-1e79564b0731 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:28.205547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a0f3ffc-327c-46eb-8ab3-1e79564b0731 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1295 microversion: 2.1 time: 0.144975 Nov 02 21:44:28.206804 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2275/4435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:28 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:28.229768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:28.236640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:28.247808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:28.248547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:28.249110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:28.249958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:28.250494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:28.250999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:28.701704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:28.712449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:28.717102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:28.717102 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5d7bbd6-6f37-4c00-9e9f-6113f297bbc9 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2921 microversion: 2.42 time: 0.496424 Nov 02 21:44:28.717102 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2276/4436] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:28 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2921 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:28.721153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:28.722017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:28.724335 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3117e098-0f3c-4ef6-b1a8-077d3907a08e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.976085 Nov 02 21:44:28.725504 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2161/4437] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:44:27 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:28.730740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:28.732407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:28.733114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:28.734237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:28.735026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:28.736113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:28.738162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a76efbb-848d-4420-90c7-257e67f78af0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b682b4ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-280719373", "description": "tempest-description-2090158447"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:28.957267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:28.969523 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d432795c-6516-472b-a173-cc08ef021a5f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.252307 Nov 02 21:44:28.970126 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2277/4438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:28 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:29.023663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:29.024293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:29.033939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:29.034509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:29.039261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:29.047792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:29.048576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:29.051141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:29.422613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:29.434137 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d8f50e4f-dc70-4bf1-8c81-fd0d334c335d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.412004 Nov 02 21:44:29.441706 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2278/4439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:29 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:29.456123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0735b1dc-01cb-4646-a186-d995aacee9a5 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:29.457671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0735b1dc-01cb-4646-a186-d995aacee9a5 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:29.577586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0735b1dc-01cb-4646-a186-d995aacee9a5 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:29.586259 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0735b1dc-01cb-4646-a186-d995aacee9a5 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1295 microversion: 2.1 time: 0.141985 Nov 02 21:44:29.586907 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2279/4440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:29 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1295 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:29.621105 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a76efbb-848d-4420-90c7-257e67f78af0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.885117 Nov 02 21:44:29.622882 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2162/4441] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:44:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:29.640863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ca0ac08-dffe-4c6d-9321-aae93f61da5a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6914af70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:29.704655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e65cdaef-d0e5-46c5-9835-f3ec14d12c43 req-2aa90aa0-1e1d-4942-b346-ac9201c64648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-deleted", "tag": "9f51a648-5f20-411a-a7b2-b20f02126167"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:29.720104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e65cdaef-d0e5-46c5-9835-f3ec14d12c43 req-2aa90aa0-1e1d-4942-b346-ac9201c64648 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:29.721449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e65cdaef-d0e5-46c5-9835-f3ec14d12c43 req-2aa90aa0-1e1d-4942-b346-ac9201c64648 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:29.726470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e65cdaef-d0e5-46c5-9835-f3ec14d12c43 req-2aa90aa0-1e1d-4942-b346-ac9201c64648 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:29.742526 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e65cdaef-d0e5-46c5-9835-f3ec14d12c43 req-2aa90aa0-1e1d-4942-b346-ac9201c64648 service nova] Creating event network-vif-deleted:9f51a648-5f20-411a-a7b2-b20f02126167 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:29.756117 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e65cdaef-d0e5-46c5-9835-f3ec14d12c43 req-2aa90aa0-1e1d-4942-b346-ac9201c64648 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054336 Nov 02 21:44:29.758143 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2163/4442] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:29.770494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:29.771540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:29.781415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:29.782157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:29.782882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:29.783777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:29.784684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:29.785327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:30.260014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:30.275046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:30.278393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:30.280615 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d46c80a-d995-44ab-9e71-26d15439e8e1 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2874 microversion: 2.42 time: 0.520384 Nov 02 21:44:30.281863 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2164/4443] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:29 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2874 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:30.291303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:30.292121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:30.301035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:30.301718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:30.302359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:30.303511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:30.304126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:30.304718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:30.334073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ca0ac08-dffe-4c6d-9321-aae93f61da5a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.704902 Nov 02 21:44:30.335126 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2280/4444] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:44:29 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:30.339856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-unplugged", "status": "completed", "tag": "045e9332-9988-4cf9-bff0-a3d66cbd93c5"}, {"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-unplugged", "status": "completed", "tag": "9367ad21-601b-4cdf-9414-940e3aa0430b"}, {"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-unplugged", "status": "completed", "tag": "52468c6f-da2b-4db6-a97a-61a7be94b9cd"}, {"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-unplugged", "status": "completed", "tag": "cfb7a0d6-5668-4202-bf4b-e203c9b5c97d"}, {"server_uuid": "29976160-96b8-47c8-b3a9-cb8a1a3c3b02", "name": "network-vif-plugged", "status": "completed", "tag": "81d55a8b-2bfb-4ba3-a0ab-7d78b300d809"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:30.358458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:30.358952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:30.359396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:30.373473 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Creating event network-vif-unplugged:045e9332-9988-4cf9-bff0-a3d66cbd93c5 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:30.374223 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Creating event network-vif-unplugged:9367ad21-601b-4cdf-9414-940e3aa0430b for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:30.380211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Creating event network-vif-unplugged:52468c6f-da2b-4db6-a97a-61a7be94b9cd for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:30.380211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Creating event network-vif-unplugged:cfb7a0d6-5668-4202-bf4b-e203c9b5c97d for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:30.380211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] Creating event network-vif-plugged:81d55a8b-2bfb-4ba3-a0ab-7d78b300d809 for instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 on n-h2-860863-4 Nov 02 21:44:30.383612 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-771f5b06-b360-4ac0-8bc6-4f080dace0b3 req-1b8145a5-31a4-45cc-9d35-3929b04e5434 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 875 microversion: 2.1 time: 0.047310 Nov 02 21:44:30.384397 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2281/4445] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 875 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:30.391480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4043b1a-15c8-470e-8d8b-8adad9e931e0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6d217040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:31.203877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:31.235084 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c01ab3c2-a708-473f-8d53-cc585b9ca39f tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.951033 Nov 02 21:44:31.240301 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2165/4446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:30 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:31.258381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:31.265504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:31.284704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:31.285077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:31.285881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:31.286223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:31.287277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:31.287715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:31.642528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:31.651443 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-abf41751-73cb-4ba8-b9a4-9da1091cef41 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.407415 Nov 02 21:44:31.652050 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2166/4447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:31 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:31.666121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:31.667082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:31.669200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:31.674288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:31.674842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:31.675354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:31.676167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:31.676693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:31.677766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:31.744912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4043b1a-15c8-470e-8d8b-8adad9e931e0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d" status: 202 len: 0 microversion: 2.1 time: 1.358990 Nov 02 21:44:31.745525 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2282/4448] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:44:30 2022] DELETE /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d => generated 0 bytes in 1360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:31.751978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:31.752895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:31.768156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:31.768585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:31.769070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:31.769785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:31.773615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:31.776091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:31.811232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:31.821502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc28aa42-0541-4069-a239-3a9b927de0ce tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1291 microversion: 2.1 time: 0.165647 Nov 02 21:44:31.822416 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2167/4449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:31 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1291 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:31.830864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d46fb0bc-0ca2-4085-80cf-74d5284e3d86 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6832e1f0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:32.002563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-d46fb0bc-0ca2-4085-80cf-74d5284e3d86 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:44:32.003672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-d46fb0bc-0ca2-4085-80cf-74d5284e3d86 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d not found {{(pid=121039) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:44:32.005009 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d46fb0bc-0ca2-4085-80cf-74d5284e3d86 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:44:32.005009 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-1bed6a62-22ff-4643-8eb1-22167370cd86'] Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d46fb0bc-0ca2-4085-80cf-74d5284e3d86 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d HTTP/1.1 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: exception: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-1bed6a62-22ff-4643-8eb1-22167370cd86'] Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d'} Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:44:32.010543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bed6a62-22ff-4643-8eb1-22167370cd86'] Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bed6a62-22ff-4643-8eb1-22167370cd86'] Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bed6a62-22ff-4643-8eb1-22167370cd86'] Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1bed6a62-22ff-4643-8eb1-22167370cd86'] Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d46fb0bc-0ca2-4085-80cf-74d5284e3d86 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-1bed6a62-22ff-4643-8eb1-22167370cd86'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:44:32.014837 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d46fb0bc-0ca2-4085-80cf-74d5284e3d86 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d" status: 404 len: 194 microversion: 2.1 time: 0.187845 Nov 02 21:44:32.024605 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2168/4450] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:44:31 2022] GET /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d => generated 194 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:44:32.040268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-865f0135-061a-495d-80a7-d3dfeb3a23d1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b69175f70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:32.190514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:32.233461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:32.236675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:32.238036 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-960c3343-a37a-4ded-8273-411702b73345 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2713 microversion: 2.42 time: 0.491289 Nov 02 21:44:32.238617 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2283/4451] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:31 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2713 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:32.266775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:32.267400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:32.277185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:32.279803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:32.280506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:32.281628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:32.282106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:32.288166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:32.635816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:32.647123 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f105315b-3982-4a9d-a4c4-c9e952c76ca7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1371 microversion: 2.1 time: 0.385343 Nov 02 21:44:32.663418 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2284/4452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:32 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:32.669638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bdba9c32-c665-4460-a2cc-09be2ca07208 req-1c843b42-48f7-4449-8b76-70cea28d1aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-deleted", "tag": "cfb7a0d6-5668-4202-bf4b-e203c9b5c97d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:32.681372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bdba9c32-c665-4460-a2cc-09be2ca07208 req-1c843b42-48f7-4449-8b76-70cea28d1aba service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:32.681864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bdba9c32-c665-4460-a2cc-09be2ca07208 req-1c843b42-48f7-4449-8b76-70cea28d1aba service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:32.682309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bdba9c32-c665-4460-a2cc-09be2ca07208 req-1c843b42-48f7-4449-8b76-70cea28d1aba service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:32.695626 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bdba9c32-c665-4460-a2cc-09be2ca07208 req-1c843b42-48f7-4449-8b76-70cea28d1aba service nova] Creating event network-vif-deleted:cfb7a0d6-5668-4202-bf4b-e203c9b5c97d for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:32.707013 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-865f0135-061a-495d-80a7-d3dfeb3a23d1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee" status: 202 len: 0 microversion: 2.1 time: 0.681075 Nov 02 21:44:32.707607 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2169/4453] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:44:32 2022] DELETE /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:32.716998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:32.717641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:32.724482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bdba9c32-c665-4460-a2cc-09be2ca07208 req-1c843b42-48f7-4449-8b76-70cea28d1aba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059193 Nov 02 21:44:32.725140 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2285/4454] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:32.733701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfa86fea-a0a5-4e8c-8af9-bb1368c9ffcd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b68f27700>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:32.753575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:32.754967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:32.756471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:32.758183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:32.759780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:32.762125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:32.874942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-bfa86fea-a0a5-4e8c-8af9-bb1368c9ffcd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:44:32.875571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-bfa86fea-a0a5-4e8c-8af9-bb1368c9ffcd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:44:32.876107 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-bfa86fea-a0a5-4e8c-8af9-bb1368c9ffcd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:44:32.876107 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-f5850c1d-4de9-4298-a935-065094827e74'] Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfa86fea-a0a5-4e8c-8af9-bb1368c9ffcd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee HTTP/1.1 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-f5850c1d-4de9-4298-a935-065094827e74'] Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '423e8ada-9b44-47ed-b78b-65ad92ed6fee'} Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:44:32.878804 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5850c1d-4de9-4298-a935-065094827e74'] Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5850c1d-4de9-4298-a935-065094827e74'] Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5850c1d-4de9-4298-a935-065094827e74'] Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5850c1d-4de9-4298-a935-065094827e74'] Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfa86fea-a0a5-4e8c-8af9-bb1368c9ffcd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-f5850c1d-4de9-4298-a935-065094827e74'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfa86fea-a0a5-4e8c-8af9-bb1368c9ffcd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee" status: 404 len: 194 microversion: 2.1 time: 0.150810 Nov 02 21:44:32.886213 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2286/4455] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:44:32 2022] GET /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee => generated 194 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:44:32.897648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:32.900186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:32.926402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:32.926933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:32.930389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:32.934371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:32.935426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:32.937032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:33.147792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:33.159506 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a2338546-4f5f-473c-b755-2a8bee32d2bb tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1347 microversion: 2.1 time: 0.276920 Nov 02 21:44:33.160102 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2287/4456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:32 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1347 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:33.172916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84207297-695f-4cbe-bc29-044a5720fa2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b68dd95e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:33.426759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:33.435725 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10f798fc-f384-40e6-8b2e-02f9251c529f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.726392 Nov 02 21:44:33.439151 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2170/4457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:32 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:33.445840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:33.452417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:33.479411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:33.483811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:33.484510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:33.509271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:33.512971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:33.514284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:34.267459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:34.276620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:34.278403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:34.280119 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6db2f771-a654-4888-8a5d-32963fa11f9c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2420 microversion: 2.42 time: 0.839654 Nov 02 21:44:34.281408 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2171/4458] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:33 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2420 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:34.287296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:34.288227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:34.294684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:34.295726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:34.296414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:34.297468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:34.298368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:34.298988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:34.357294 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84207297-695f-4cbe-bc29-044a5720fa2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4" status: 202 len: 0 microversion: 2.1 time: 1.193286 Nov 02 21:44:34.357880 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2288/4459] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:44:33 2022] DELETE /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4 => generated 0 bytes in 1197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:34.371582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:34.372335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:34.414859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:34.417204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:34.422714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:34.422714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:34.422714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:34.426505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:34.635394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:34.645530 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bde60f57-4430-4de3-b8a4-b5bd8c1074e2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1353 microversion: 2.1 time: 0.285529 Nov 02 21:44:34.646791 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2289/4460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:34 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1353 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:34.660183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e284ec81-afb2-43dd-a2da-31932ed56f46 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b69993040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:34.738387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-e284ec81-afb2-43dd-a2da-31932ed56f46 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:44:34.740508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-e284ec81-afb2-43dd-a2da-31932ed56f46 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group 359a2f2f-fdb9-4795-8081-442984d473a4 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:44:34.744909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e284ec81-afb2-43dd-a2da-31932ed56f46 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:44:34.744909 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-7e993492-cc55-4969-82d3-177e80a1fe89'] Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e284ec81-afb2-43dd-a2da-31932ed56f46 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4 HTTP/1.1 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-7e993492-cc55-4969-82d3-177e80a1fe89'] Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '359a2f2f-fdb9-4795-8081-442984d473a4'} Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:44:34.748162 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e993492-cc55-4969-82d3-177e80a1fe89'] Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e993492-cc55-4969-82d3-177e80a1fe89'] Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e993492-cc55-4969-82d3-177e80a1fe89'] Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e993492-cc55-4969-82d3-177e80a1fe89'] Nov 02 21:44:34.752564 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:34.757626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e284ec81-afb2-43dd-a2da-31932ed56f46 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:44:34.757626 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-7e993492-cc55-4969-82d3-177e80a1fe89'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:44:34.761563 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e284ec81-afb2-43dd-a2da-31932ed56f46 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4" status: 404 len: 194 microversion: 2.1 time: 0.108916 Nov 02 21:44:34.763508 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2290/4461] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:44:34 2022] GET /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:44:34.777550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:34.798621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:34.807828 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9503b3fe-9748-4eb3-b012-1421d1baba2c tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1565 microversion: 2.1 time: 0.522047 Nov 02 21:44:34.809780 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2172/4462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:34 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1565 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:34.815926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:34.823167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da6978fa-9061-49d6-b7e9-6a7a404ed859 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b69175e50>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:34.836181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:34.836694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:34.837184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:34.837895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:34.838354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:34.838786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:35.857952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:35.884423 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-221f4ef1-beb5-402a-89bf-994de43ce510 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 1.113778 Nov 02 21:44:35.884423 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2291/4463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:34 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:35.900513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f92e774d-3519-405a-a5ec-a0bd911d8642 req-2b1fb5d6-a2c1-4130-b2b2-71f32f23c6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-deleted", "tag": "045e9332-9988-4cf9-bff0-a3d66cbd93c5"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:35.938043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f92e774d-3519-405a-a5ec-a0bd911d8642 req-2b1fb5d6-a2c1-4130-b2b2-71f32f23c6e3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:35.938566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f92e774d-3519-405a-a5ec-a0bd911d8642 req-2b1fb5d6-a2c1-4130-b2b2-71f32f23c6e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:35.938968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f92e774d-3519-405a-a5ec-a0bd911d8642 req-2b1fb5d6-a2c1-4130-b2b2-71f32f23c6e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:35.962305 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f92e774d-3519-405a-a5ec-a0bd911d8642 req-2b1fb5d6-a2c1-4130-b2b2-71f32f23c6e3 service nova] Creating event network-vif-deleted:045e9332-9988-4cf9-bff0-a3d66cbd93c5 for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:35.970839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f92e774d-3519-405a-a5ec-a0bd911d8642 req-2b1fb5d6-a2c1-4130-b2b2-71f32f23c6e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086182 Nov 02 21:44:35.972894 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2292/4464] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:35.980095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:35.981797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:35.989427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:35.991316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:35.992104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:35.993410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:35.994085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:35.998441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:36.025743 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da6978fa-9061-49d6-b7e9-6a7a404ed859 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.212528 Nov 02 21:44:36.027061 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2173/4465] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 21:44:34 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:36.042084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:36.044325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:36.082599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:36.082599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:36.082599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:36.082599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:36.082599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:36.082599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:36.230670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-baddc0a5-4a03-48fb-99ae-788396cdcf79 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255521 Nov 02 21:44:36.231267 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2293/4466] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:44:35 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:36.236946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:36.238011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:36.246623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:36.256142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:36.259979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:36.265489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:36.265489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:36.265489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:36.265489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:36.614356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:36.638294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:36.642738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:36.644807 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ce3d7f4-070e-4b27-9fbf-7279a0bcf626 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2215 microversion: 2.42 time: 0.616510 Nov 02 21:44:36.661160 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2174/4467] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:36 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2215 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:36.661160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b5307353-a175-4cfc-82db-895fd23338a4 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b68936160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1445507104", "description": "tempest-description-1996744107"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:36.683853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:36.692224 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d68782c4-420d-45a0-882a-8c8b03ac56df tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 0.459667 Nov 02 21:44:36.694834 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2294/4468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:36 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:36.909670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:36.911036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:36.936608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:36.937487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:36.939521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:36.939521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:36.939521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:36.945140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:37.277283 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b5307353-a175-4cfc-82db-895fd23338a4 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.622451 Nov 02 21:44:37.285977 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2175/4469] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:44:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:37.292229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97d6fbf1-7f36-42d3-af30-c0d7469aede3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b689bc160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1819172128", "description": "tempest-description-550482094"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:37.502821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:37.515914 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89c8b558-f867-4ac8-b807-e623da73822c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.613346 Nov 02 21:44:37.517705 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2295/4470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:36 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:37.523594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:37.553486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:37.680833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:37.681308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:37.687413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:37.687959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:37.688401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:37.689153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:37.689612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:37.690107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:37.962826 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97d6fbf1-7f36-42d3-af30-c0d7469aede3 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.674747 Nov 02 21:44:37.963424 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2176/4471] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:44:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:37.980319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:37.980953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:37.996274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:37.998601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:37.999091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:38.003187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:38.003187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:38.003187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:38.033002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:38.054945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:38.056706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:38.060338 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c5e5a61-3d98-468f-88bb-a8f40b8565ac tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 2168 microversion: 2.42 time: 0.384557 Nov 02 21:44:38.068355 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2296/4472] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:37 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 2168 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:38.074750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-53c1ad2c-932e-49bd-87ea-5ab5a36d5a6d req-9b7dcfa8-683a-4c86-9c87-87cba961b060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd8e12b-7667-4b6f-bfc2-c6903758e0a5", "tag": "000fb93d-e41f-426d-8ed3-37e7d0754574"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:38.103818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53c1ad2c-932e-49bd-87ea-5ab5a36d5a6d req-9b7dcfa8-683a-4c86-9c87-87cba961b060 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:38.104573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53c1ad2c-932e-49bd-87ea-5ab5a36d5a6d req-9b7dcfa8-683a-4c86-9c87-87cba961b060 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:38.105198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53c1ad2c-932e-49bd-87ea-5ab5a36d5a6d req-9b7dcfa8-683a-4c86-9c87-87cba961b060 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:38.128867 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-53c1ad2c-932e-49bd-87ea-5ab5a36d5a6d req-9b7dcfa8-683a-4c86-9c87-87cba961b060 service nova] Creating event network-changed:000fb93d-e41f-426d-8ed3-37e7d0754574 for instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 on n-h1-860863-4 Nov 02 21:44:38.135307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-53c1ad2c-932e-49bd-87ea-5ab5a36d5a6d req-9b7dcfa8-683a-4c86-9c87-87cba961b060 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065149 Nov 02 21:44:38.136308 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2297/4473] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:38.150522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8292462f-4262-4d00-a16c-bf659e828325 req-1b8b3226-3d06-4f4f-b524-71012c3b6675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-deleted", "tag": "52468c6f-da2b-4db6-a97a-61a7be94b9cd"}, {"server_uuid": "baee203f-5ed4-4bb9-af88-3c7752c4f505", "name": "network-vif-deleted", "tag": "9367ad21-601b-4cdf-9414-940e3aa0430b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:38.165645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8292462f-4262-4d00-a16c-bf659e828325 req-1b8b3226-3d06-4f4f-b524-71012c3b6675 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:38.166496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8292462f-4262-4d00-a16c-bf659e828325 req-1b8b3226-3d06-4f4f-b524-71012c3b6675 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:38.168229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8292462f-4262-4d00-a16c-bf659e828325 req-1b8b3226-3d06-4f4f-b524-71012c3b6675 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:38.182892 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8292462f-4262-4d00-a16c-bf659e828325 req-1b8b3226-3d06-4f4f-b524-71012c3b6675 service nova] Creating event network-vif-deleted:52468c6f-da2b-4db6-a97a-61a7be94b9cd for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:38.183905 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8292462f-4262-4d00-a16c-bf659e828325 req-1b8b3226-3d06-4f4f-b524-71012c3b6675 service nova] Creating event network-vif-deleted:9367ad21-601b-4cdf-9414-940e3aa0430b for instance baee203f-5ed4-4bb9-af88-3c7752c4f505 on n-h2-860863-4 Nov 02 21:44:38.190858 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8292462f-4262-4d00-a16c-bf659e828325 req-1b8b3226-3d06-4f4f-b524-71012c3b6675 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052979 Nov 02 21:44:38.191690 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2298/4474] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:38.199476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-195301954", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "7e72bb4a-f3db-457c-962f-233087b237aa"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:38.307400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] validate_networks() for [('7e72bb4a-f3db-457c-962f-233087b237aa', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:44:38.371847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:38.398578 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-21b3db5d-3047-4a83-89b7-c1a991df7246 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 0.433758 Nov 02 21:44:38.417582 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2177/4475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:37 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:38.541701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:38.541701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:38.557644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:38.559603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:38.564385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:38.568679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:38.569230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:38.569687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:39.182506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:39.196206 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ce368037-15e9-4a77-9598-df15caa0c363 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.660115 Nov 02 21:44:39.199594 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2178/4476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:38 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:39.206112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:39.209527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:39.226037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:39.227600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:39.228230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:39.229613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:39.230248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:39.230902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:39.234368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:44:39.234930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:44:39.235485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:44:39.236005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:44:39.236639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:44:39.259126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:39.262403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:39.263272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:39.266737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:39.267543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:39.269141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:39.300214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Getting quotas for project a7bc05bd7cb041fabf4caa2635a2275f. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:44:39.309431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Getting quotas for user e2fd8798cdc74b2b885174cfea7621b6 and project a7bc05bd7cb041fabf4caa2635a2275f. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:44:39.327077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:44:39.332709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:44:39.339561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:39.350607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:39.352904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:39.354201 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a58c7e56-9b1f-4da3-b860-11ed92758f0f tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.152466 Nov 02 21:44:39.355962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2179/4477] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:39 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:39.425573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:39.428434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:39.436049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:39.436551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:39.437109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:39.438082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:39.438554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:39.438991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:39.536822 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60610afb-c69f-4cac-ac88-a6a28a7b027e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342592 Nov 02 21:44:39.545020 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2299/4478] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:44:39.569693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e70fa311-adfb-470d-a39c-483c7920f47a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:39.571221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e70fa311-adfb-470d-a39c-483c7920f47a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:40.419233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e70fa311-adfb-470d-a39c-483c7920f47a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:40.435099 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e70fa311-adfb-470d-a39c-483c7920f47a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1215 microversion: 2.1 time: 0.883242 Nov 02 21:44:40.450970 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2300/4479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:39 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1215 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:40.465120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:40.469726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:40.471487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:40.471649 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f7c81607-48a0-4c69-9624-baa4bc4ccd87 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 1.051787 Nov 02 21:44:40.477068 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2180/4480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:39 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:40.491263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:40.500251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:40.501177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:40.501824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:40.502075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:40.503174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:40.504326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:40.505779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:40.517663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:40.526831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:40.528719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:40.529688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:40.531367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:40.532809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:40.707981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:40.728295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:40.730044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:40.731413 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd937203-0539-45ce-b3ea-d9cbd02c606c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.253180 Nov 02 21:44:40.732412 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2181/4481] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:40 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:40.752162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f72916ea-d218-40ba-bcfa-530afc58e54e req-0d27603d-b304-4565-bfbf-2cf83c815963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29976160-96b8-47c8-b3a9-cb8a1a3c3b02", "tag": "81d55a8b-2bfb-4ba3-a0ab-7d78b300d809"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:40.767026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f72916ea-d218-40ba-bcfa-530afc58e54e req-0d27603d-b304-4565-bfbf-2cf83c815963 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:40.778202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f72916ea-d218-40ba-bcfa-530afc58e54e req-0d27603d-b304-4565-bfbf-2cf83c815963 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:40.778822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f72916ea-d218-40ba-bcfa-530afc58e54e req-0d27603d-b304-4565-bfbf-2cf83c815963 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:40.821089 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f72916ea-d218-40ba-bcfa-530afc58e54e req-0d27603d-b304-4565-bfbf-2cf83c815963 service nova] Creating event network-changed:81d55a8b-2bfb-4ba3-a0ab-7d78b300d809 for instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 on n-h2-860863-4 Nov 02 21:44:40.854093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f72916ea-d218-40ba-bcfa-530afc58e54e req-0d27603d-b304-4565-bfbf-2cf83c815963 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119235 Nov 02 21:44:40.857736 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2182/4482] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:40.896902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:40.914684 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-68826e69-d0d5-43d7-b831-45fd457125e0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.458946 Nov 02 21:44:40.934071 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2301/4483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:40 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:41.463886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:41.470759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:41.484104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:41.484718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:41.485214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:41.486110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:41.486570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:41.486999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:41.498709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:41.499992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:41.521116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:41.523126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:41.523733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:41.525762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:41.527914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:41.528523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:41.544888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:41.717681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:41.729786 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-414ea3ca-2430-4071-a0d2-c2bd99f73a96 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1211 microversion: 2.1 time: 0.270128 Nov 02 21:44:41.730946 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2183/4484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:41 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1211 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:41.772295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:41.773238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:41.797582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:41.798612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:41.799885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:41.801209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:41.804827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:41.805216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:41.977127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:42.000251 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc952c7d-aa2c-40a4-bb4c-ce41543be976 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 0.492320 Nov 02 21:44:42.000908 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2302/4485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:41 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:42.011393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:42.022052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:42.045510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:42.045979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:42.046422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:42.054181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:42.056275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:42.056722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:42.057249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:42.081547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:42.086104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:42.087841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8162ddca-17f7-454a-be37-1227b818dd41 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.326099 Nov 02 21:44:42.090949 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2184/4486] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:41 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:42.276881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:42.286019 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edb5695d-41eb-470f-b65a-9d4795f24499 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1513 microversion: 2.1 time: 0.278584 Nov 02 21:44:42.286777 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2303/4487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:42 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:42.754100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:42.755571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:42.770296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:42.771609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:42.772089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:42.772848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:42.773346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:42.773787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:42.992968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:42.995706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:43.009656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-344d2084-d4ee-44f8-b525-db701036ad8a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1275 microversion: 2.1 time: 0.259414 Nov 02 21:44:43.010762 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2185/4488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:42 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:43.028380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:43.034230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:43.042247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:43.043826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:43.044469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:43.045611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:43.048397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:43.059865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:43.119532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:43.120500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:43.131427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:43.132308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:43.137826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:43.139167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:43.141575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:43.142360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:43.277812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:43.291065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:43.292779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:43.294897 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1ea869ed-13c8-472d-a007-1c51de63706d tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.180097 Nov 02 21:44:43.296286 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2186/4489] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:43 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:43.316309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:43.318417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:43.326217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:43.327267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:43.328244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:43.329263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:43.329896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:43.330532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:43.611675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:43.627827 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d0d56d3-02e4-4f1a-b2d7-8ebd8e9e6f8b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 0.598500 Nov 02 21:44:43.629220 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2304/4490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:43 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:43.726635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:43.741735 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb749b23-3ec1-4852-b4e2-c3195db1f29c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1519 microversion: 2.1 time: 0.426046 Nov 02 21:44:43.742941 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2187/4491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:43 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1519 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:44.044019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:44.045581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:44.054647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.055753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.056376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:44.057596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.058280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.058913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:44.177885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:44.189201 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36a776cf-3a1d-4d80-b2e5-9ac3f33a008c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1273 microversion: 2.1 time: 0.150103 Nov 02 21:44:44.193209 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2305/4492] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:44 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:44.326975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:44.333646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:44.347198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.350425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.351310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:44.353834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.356488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.357704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:44.516205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:44.544583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:44.552195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:44.568050 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cf55e80-4f19-48fe-9c8d-6ccdb03ad3e5 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.241054 Nov 02 21:44:44.569439 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2188/4493] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:44 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:44.657446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:44.658068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:44.673777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.674289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.674743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:44.675470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.688481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.689167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:44.767682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:44.768513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:44.778719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.783035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.783502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:44.789199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:44.789708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:44.790164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:45.292272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:45.302239 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1b48707-9d90-4767-b151-04247f8d11db tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 0.648444 Nov 02 21:44:45.312011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:45.319949 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2306/4494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:44 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:45.323317 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a703ba7-ac51-4fd6-838b-e08b36ced836 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1519 microversion: 2.1 time: 0.560018 Nov 02 21:44:45.337193 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2189/4495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:44 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1519 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:45.343621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:45.347787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:45.368743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:45.371997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:45.373683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:45.374569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:45.375734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:45.377753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:45.597286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:45.598050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:45.612398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:45.617391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:45.617391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:45.617391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:45.617680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:45.618749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:45.744161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:45.770153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:45.773958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:45.777368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:45.782091 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c40b2019-61e4-4b46-b7b6-631a22b651d8 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.185429 Nov 02 21:44:45.782091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2190/4496] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:45 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:45.804828 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b14fdaf-4abc-4562-ad08-22871d453a5e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1315 microversion: 2.1 time: 0.465354 Nov 02 21:44:45.806401 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2307/4497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:45 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:45.975555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-43661378-cd2d-44f7-96c2-786e31bb5db6 req-23a8d1f4-49d6-48cf-8ae7-24503c285109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd8e12b-7667-4b6f-bfc2-c6903758e0a5", "name": "network-vif-plugged", "status": "completed", "tag": "000fb93d-e41f-426d-8ed3-37e7d0754574"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:46.013707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-43661378-cd2d-44f7-96c2-786e31bb5db6 req-23a8d1f4-49d6-48cf-8ae7-24503c285109 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.014912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-43661378-cd2d-44f7-96c2-786e31bb5db6 req-23a8d1f4-49d6-48cf-8ae7-24503c285109 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.019419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-43661378-cd2d-44f7-96c2-786e31bb5db6 req-23a8d1f4-49d6-48cf-8ae7-24503c285109 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.048635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-43661378-cd2d-44f7-96c2-786e31bb5db6 req-23a8d1f4-49d6-48cf-8ae7-24503c285109 service nova] Creating event network-vif-plugged:000fb93d-e41f-426d-8ed3-37e7d0754574 for instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 on n-h1-860863-4 Nov 02 21:44:46.061924 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-43661378-cd2d-44f7-96c2-786e31bb5db6 req-23a8d1f4-49d6-48cf-8ae7-24503c285109 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093795 Nov 02 21:44:46.078563 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2191/4498] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:46.326895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:46.329059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:46.343920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.347848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.349620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.352473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.353236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.354523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.355230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:46.356065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:46.378331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.391204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.393746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.394540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.395035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.396048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.756463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:46.765744 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e641789-c85e-4958-a9b7-e09f9e5797b5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1519 microversion: 2.1 time: 0.415146 Nov 02 21:44:46.767246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2192/4499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:46 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:46.806090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:46.809472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:46.810666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:46.818023 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-126010d1-339c-4574-a031-63dae4584e32 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 0.496903 Nov 02 21:44:46.818611 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2308/4500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:46 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:46.819225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.819825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.820270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.821033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.821648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.822284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.837007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:46.837319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:46.846180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.852142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.852835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.854043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:46.855222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:46.855920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:46.960654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:46.973001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:46.993804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:46.995303 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-687bb9e9-3e50-4ceb-89e2-06754fd59d56 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.190423 Nov 02 21:44:46.995892 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2193/4501] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:46 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:44:47.005370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0a6c109e-83cc-473b-8a0c-9330933f2ad3 req-499ebd18-6810-4c27-be5f-e2f647b39da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1", "tag": "c5be92fa-eb78-4a73-a9fd-6b456d137df8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:47.027984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0a6c109e-83cc-473b-8a0c-9330933f2ad3 req-499ebd18-6810-4c27-be5f-e2f647b39da7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:47.028938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0a6c109e-83cc-473b-8a0c-9330933f2ad3 req-499ebd18-6810-4c27-be5f-e2f647b39da7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:47.029476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0a6c109e-83cc-473b-8a0c-9330933f2ad3 req-499ebd18-6810-4c27-be5f-e2f647b39da7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:47.053212 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0a6c109e-83cc-473b-8a0c-9330933f2ad3 req-499ebd18-6810-4c27-be5f-e2f647b39da7 service nova] Creating event network-changed:c5be92fa-eb78-4a73-a9fd-6b456d137df8 for instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 on n-h2-860863-4 Nov 02 21:44:47.065986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0a6c109e-83cc-473b-8a0c-9330933f2ad3 req-499ebd18-6810-4c27-be5f-e2f647b39da7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068634 Nov 02 21:44:47.066892 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2194/4502] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:47.244240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:47.255399 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aeb9d635-37bd-4b1f-a64c-1499f2da2fa0 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1315 microversion: 2.1 time: 0.422785 Nov 02 21:44:47.257706 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2309/4503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:46 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:47.794712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:47.795414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:47.807679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:47.808410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:47.811992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:47.813070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:47.813732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:47.815444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:47.847329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:47.847832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:47.862393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:47.865040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:47.868761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:47.869981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:47.870477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:47.870925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:48.221575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:48.234598 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8439672-8cc0-4b89-b24e-2ad3d023ae61 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1519 microversion: 2.1 time: 0.444113 Nov 02 21:44:48.235197 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2195/4504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:47 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:48.248717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:48.252871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:48.270296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:48.280647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:48.282421 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b68083e-edfe-4e22-b153-a3d4d078bd2e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1472 microversion: 2.1 time: 0.440202 Nov 02 21:44:48.283023 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2310/4505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:47 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:48.283817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:48.284451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:48.285641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:48.289261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:48.290590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:48.303676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:48.304772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:48.312739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:48.313444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:48.314048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:48.314992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:48.315735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:48.316321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:48.482051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:48.493816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:48.495537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:48.497016 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d84fe635-2f31-400f-9ab7-858fdff211dc tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.258167 Nov 02 21:44:48.497815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2196/4506] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:48 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:48.502823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2c579a28-1fbd-45db-b402-de6a06214532 req-50b652af-5e82-4148-8981-ad438e5f9b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da88578b-3773-4c6e-a924-2bc73e190ee3", "name": "network-vif-unplugged", "status": "completed", "tag": "9f665f5b-4848-4725-8fb9-c04a00c125ef"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:48.513227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2c579a28-1fbd-45db-b402-de6a06214532 req-50b652af-5e82-4148-8981-ad438e5f9b18 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:48.513803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2c579a28-1fbd-45db-b402-de6a06214532 req-50b652af-5e82-4148-8981-ad438e5f9b18 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:48.514434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2c579a28-1fbd-45db-b402-de6a06214532 req-50b652af-5e82-4148-8981-ad438e5f9b18 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:48.532116 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2c579a28-1fbd-45db-b402-de6a06214532 req-50b652af-5e82-4148-8981-ad438e5f9b18 service nova] Creating event network-vif-unplugged:9f665f5b-4848-4725-8fb9-c04a00c125ef for instance da88578b-3773-4c6e-a924-2bc73e190ee3 on n-h1-860863-4 Nov 02 21:44:48.538280 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2c579a28-1fbd-45db-b402-de6a06214532 req-50b652af-5e82-4148-8981-ad438e5f9b18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038803 Nov 02 21:44:48.539085 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2197/4507] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:48.551236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:48.560118 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3addc67-31d3-4c3f-ac26-06cd6372211d tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1315 microversion: 2.1 time: 0.276072 Nov 02 21:44:48.560846 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2311/4508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:48 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:49.260365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:49.261515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:49.271527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.272153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.272704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:49.273561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.274162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.274674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:49.305727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:49.307189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:49.317939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:49.327221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.328066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.328873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:49.332276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.332276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.332276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:49.787746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:49.813844 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff6af4e5-f9b7-456c-b40e-65bffd8a71fd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1519 microversion: 2.1 time: 0.558779 Nov 02 21:44:49.815839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:49.816703 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2198/4509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:49 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1519 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:49.832497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:49.838024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:49.845004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1a378942-68ac-4e57-b10e-ee113fc9efde tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1643 microversion: 2.1 time: 0.543203 Nov 02 21:44:49.850009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2312/4510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:49 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1643 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:49.863786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.865637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.866625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:49.867218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:49.868041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:49.868708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.870809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.875451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.879024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:49.882494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.885187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:49.885187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:49.891730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:49.892261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:50.096171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:50.123770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:50.128105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:50.132430 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b613637-029d-4c61-a21d-1083a041c195 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.310649 Nov 02 21:44:50.133859 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2199/4511] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:49 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:50.144405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:50.145866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:50.159959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:50.160519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:50.161910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:50.164389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:50.164614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:50.165052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:50.199015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:50.209580 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e29332cb-c3b9-4903-998f-b006119652ab tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1315 microversion: 2.1 time: 0.358125 Nov 02 21:44:50.210720 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2313/4512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:49 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:50.378323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:50.391325 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e7d26964-8593-44b2-92bc-4344f93a6e84 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1643 microversion: 2.1 time: 0.255097 Nov 02 21:44:50.410752 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2200/4513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:50 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1643 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:50.415845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:50.416464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:50.423062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:50.423558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:50.424005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:50.424712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:50.433375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:50.433951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:50.434431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:50.554366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b33775c8-7c91-4fec-bc59-00a6ef273697 req-5fdae3e3-9416-45e9-976a-3f816a104c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da88578b-3773-4c6e-a924-2bc73e190ee3", "name": "network-vif-plugged", "status": "completed", "tag": "9f665f5b-4848-4725-8fb9-c04a00c125ef"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:50.566982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b33775c8-7c91-4fec-bc59-00a6ef273697 req-5fdae3e3-9416-45e9-976a-3f816a104c0d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:50.567756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b33775c8-7c91-4fec-bc59-00a6ef273697 req-5fdae3e3-9416-45e9-976a-3f816a104c0d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:50.568471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b33775c8-7c91-4fec-bc59-00a6ef273697 req-5fdae3e3-9416-45e9-976a-3f816a104c0d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:50.581097 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b33775c8-7c91-4fec-bc59-00a6ef273697 req-5fdae3e3-9416-45e9-976a-3f816a104c0d service nova] Creating event network-vif-plugged:9f665f5b-4848-4725-8fb9-c04a00c125ef for instance da88578b-3773-4c6e-a924-2bc73e190ee3 on n-h1-860863-4 Nov 02 21:44:50.598198 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b33775c8-7c91-4fec-bc59-00a6ef273697 req-5fdae3e3-9416-45e9-976a-3f816a104c0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047972 Nov 02 21:44:50.600697 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2201/4514] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:50.843427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:50.844145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:50.858406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:50.859649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:50.861556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:50.862524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:50.866223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:50.866963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:51.432120 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9022568d-e0fc-4dcc-86e7-6e8d6c8cd201 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1794 microversion: 2.1 time: 1.019784 Nov 02 21:44:51.437230 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2314/4515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:50 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1794 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:51.441312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:51.442751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:51.450196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:51.451071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:51.451753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:51.452696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:51.453472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:51.454227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:51.670769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:51.686468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:51.692836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:51.694465 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ff10301-c688-44fb-9ca4-592e0303bcfe tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.259451 Nov 02 21:44:51.698742 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2315/4516] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:51 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:51.707075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:51.708231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:51.727193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:51.727193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:51.727193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:51.727193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:51.727734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:51.728022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:51.766405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:51.775998 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6034711e-ad33-4f07-b146-329752e11d93 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1519 microversion: 2.1 time: 0.938124 Nov 02 21:44:51.776588 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2202/4517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:50 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1519 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:51.963551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:51.976255 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4449e03-a180-42a7-84ab-d69fd65245ad tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1315 microversion: 2.1 time: 0.275610 Nov 02 21:44:51.976553 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2316/4518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:51 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:52.727948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:52.728694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:52.741916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:52.743086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:52.744800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:52.747195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:52.747879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:52.748987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:52.811430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:52.812784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:52.834596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:52.835104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:52.838979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:52.841730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:52.845199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:52.849916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:52.979512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:52.999585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:53.008338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:53.011960 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0082039e-b8e1-474f-8e94-b508742a38bb tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.285865 Nov 02 21:44:53.017406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2203/4519] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:52 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:53.029483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:53.038929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:53.060061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:53.061836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:53.062541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:53.064791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:53.065593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:53.066784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:53.186339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:53.199002 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8f6e4a6-5df6-4f3f-a7ed-a67f92931b4c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1504 microversion: 2.1 time: 0.391578 Nov 02 21:44:53.201040 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2317/4520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:52 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:53.256037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:53.262506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:53.290652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:53.290803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:53.291159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:53.296379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:53.297079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:53.297743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:53.337123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:53.345765 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e804658c-dfe0-40e0-8fce-f2219e6743b1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1315 microversion: 2.1 time: 0.326727 Nov 02 21:44:53.346556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2204/4521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:53 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:53.512082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-885ebfd8-47e6-48db-8b51-c4bcd21fff88 req-2f7db4b9-bea0-403c-80b2-6b046684f8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1", "name": "network-vif-plugged", "status": "completed", "tag": "c5be92fa-eb78-4a73-a9fd-6b456d137df8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:53.528395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-885ebfd8-47e6-48db-8b51-c4bcd21fff88 req-2f7db4b9-bea0-403c-80b2-6b046684f8e2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:53.529443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-885ebfd8-47e6-48db-8b51-c4bcd21fff88 req-2f7db4b9-bea0-403c-80b2-6b046684f8e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:53.530174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-885ebfd8-47e6-48db-8b51-c4bcd21fff88 req-2f7db4b9-bea0-403c-80b2-6b046684f8e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:53.538069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:53.542026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:53.547234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:44:53.556247 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96541786-eee8-4dc2-a888-3aaea4dce0f9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 200 len: 1504 microversion: 2.1 time: 0.335080 Nov 02 21:44:53.557247 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2318/4522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:53 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:53.567485 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-885ebfd8-47e6-48db-8b51-c4bcd21fff88 req-2f7db4b9-bea0-403c-80b2-6b046684f8e2 service nova] Creating event network-vif-plugged:c5be92fa-eb78-4a73-a9fd-6b456d137df8 for instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 on n-h2-860863-4 Nov 02 21:44:53.577686 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-885ebfd8-47e6-48db-8b51-c4bcd21fff88 req-2f7db4b9-bea0-403c-80b2-6b046684f8e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072420 Nov 02 21:44:53.578303 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2205/4523] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:53.582458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:53.583523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:53.591957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:53.592753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:53.594082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:53.595036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:53.595713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:53.596347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:53.656646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:44:54.005376 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7c055a4-4c2b-435a-94da-2774056050fc tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 204 len: 0 microversion: 2.1 time: 0.425004 Nov 02 21:44:54.005376 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2319/4524] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:44:53 2022] DELETE /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:44:54.047239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:54.047976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:54.064817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:54.065613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:54.071575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:54.071575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:54.072207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:54.072682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:54.188407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1755710390", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "65a94947-f991-4865-86d5-a3465290d583"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:54.233435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:54.257067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:54.259598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:54.261082 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d99808c4-b236-471b-bea2-f4500e9416b3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.220350 Nov 02 21:44:54.265926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] validate_networks() for [('65a94947-f991-4865-86d5-a3465290d583', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:44:54.288329 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2206/4525] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:54 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:54.375358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:54.376654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:54.409759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:54.422845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:54.424591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:54.432503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:54.440018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:54.440724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:54.798031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:54.810764 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88373eeb-0744-4e66-8b05-88af142af021 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1315 microversion: 2.1 time: 0.436328 Nov 02 21:44:54.812042 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2207/4526] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:54 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:54.931276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5279dede-7de6-489c-a8d3-e3d78b000483 req-a491b08c-b4e2-4e12-ac3c-86e9df906d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd8e12b-7667-4b6f-bfc2-c6903758e0a5", "tag": "000fb93d-e41f-426d-8ed3-37e7d0754574"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:54.956108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5279dede-7de6-489c-a8d3-e3d78b000483 req-a491b08c-b4e2-4e12-ac3c-86e9df906d88 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:54.958404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5279dede-7de6-489c-a8d3-e3d78b000483 req-a491b08c-b4e2-4e12-ac3c-86e9df906d88 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:54.958992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5279dede-7de6-489c-a8d3-e3d78b000483 req-a491b08c-b4e2-4e12-ac3c-86e9df906d88 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:54.990566 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5279dede-7de6-489c-a8d3-e3d78b000483 req-a491b08c-b4e2-4e12-ac3c-86e9df906d88 service nova] Creating event network-changed:000fb93d-e41f-426d-8ed3-37e7d0754574 for instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 on n-h1-860863-4 Nov 02 21:44:54.999720 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5279dede-7de6-489c-a8d3-e3d78b000483 req-a491b08c-b4e2-4e12-ac3c-86e9df906d88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073007 Nov 02 21:44:55.006515 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2208/4527] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:44:55.151972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:44:55.152489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:44:55.153260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:44:55.154122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:44:55.155006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:44:55.186292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:55.191093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:55.191561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:55.196889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:55.196889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:55.199734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:55.285119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Getting quotas for project 5191bf0c1e3e446c9c2e6e47cea461e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:44:55.307333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Getting quotas for user c200d64c4ebb4f9dafe6e35daac13a39 and project 5191bf0c1e3e446c9c2e6e47cea461e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:44:55.317942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:55.318777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:55.327641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:55.329080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:44:55.332561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:44:55.341301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:55.342725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:55.343770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:55.344898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:55.345979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:55.535708 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecff505c-8511-4c02-80a5-55a26de53692 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346869 Nov 02 21:44:55.539794 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2320/4528] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:44:55.568041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e2b7e4c-4e7e-4913-a00d-954bbc04ef46 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:55.568041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e2b7e4c-4e7e-4913-a00d-954bbc04ef46 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:55.639351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:55.652750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:55.655244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:55.656833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-863e0e5f-eac8-4123-9163-c21f3da3cc8c tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.343788 Nov 02 21:44:55.670480 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2209/4529] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:55 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:44:55.844315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:55.844992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:55.854802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:55.855898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e2b7e4c-4e7e-4913-a00d-954bbc04ef46 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:55.860690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:55.861354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:55.865306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:55.871166 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e2b7e4c-4e7e-4913-a00d-954bbc04ef46 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1218 microversion: 2.1 time: 0.306120 Nov 02 21:44:55.872359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:55.873015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:55.873247 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2321/4530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:55 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1218 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:56.529975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:56.542468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f5064f3-ab80-4d79-93a2-cc81e9619f11 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1502 microversion: 2.1 time: 0.705285 Nov 02 21:44:56.563017 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2210/4531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:55 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1502 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:44:56.579306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1445507104"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:56.580482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:56.599136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:56.599995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:56.600785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:56.603411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:56.604166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:56.606983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:56.686967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:56.687960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:56.702124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:56.706712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:56.706712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:56.706712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:56.706712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:56.706712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:56.899849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:56.928222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:56.941267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:56.945639 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-244565fc-7d0d-457d-a136-6abebbcbe0e3 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.261964 Nov 02 21:44:56.948401 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2211/4532] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:56 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:56.974528 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.security_group_api [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Adding security group f9cb2027-6d60-470d-a99a-6f4d067c0696 to port c5be92fa-eb78-4a73-a9fd-6b456d137df8 Nov 02 21:44:56.980326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cadb3527-2096-4154-85fb-564646dfb9d3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:56.986109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cadb3527-2096-4154-85fb-564646dfb9d3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:57.115562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cadb3527-2096-4154-85fb-564646dfb9d3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:57.123819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cadb3527-2096-4154-85fb-564646dfb9d3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1218 microversion: 2.1 time: 0.174262 Nov 02 21:44:57.126636 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2212/4533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:56 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:57.930078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5e744401-dc2f-4be3-bee7-3a28a6e3cb92 req-20634985-f5e0-4421-9b2a-a4f3819d5038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da88578b-3773-4c6e-a924-2bc73e190ee3", "name": "network-vif-deleted", "tag": "9f665f5b-4848-4725-8fb9-c04a00c125ef"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:57.991576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5e744401-dc2f-4be3-bee7-3a28a6e3cb92 req-20634985-f5e0-4421-9b2a-a4f3819d5038 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:57.992128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5e744401-dc2f-4be3-bee7-3a28a6e3cb92 req-20634985-f5e0-4421-9b2a-a4f3819d5038 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:57.992645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5e744401-dc2f-4be3-bee7-3a28a6e3cb92 req-20634985-f5e0-4421-9b2a-a4f3819d5038 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:58.010990 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5e744401-dc2f-4be3-bee7-3a28a6e3cb92 req-20634985-f5e0-4421-9b2a-a4f3819d5038 service nova] Creating event network-vif-deleted:9f665f5b-4848-4725-8fb9-c04a00c125ef for instance da88578b-3773-4c6e-a924-2bc73e190ee3 on n-h1-860863-4 Nov 02 21:44:58.017619 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5e744401-dc2f-4be3-bee7-3a28a6e3cb92 req-20634985-f5e0-4421-9b2a-a4f3819d5038 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093592 Nov 02 21:44:58.018725 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2213/4534] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:44:58.035588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:58.036395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:58.044402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:58.045242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:58.046928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:58.047672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:58.048142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:58.048575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:58.081626 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9890e921-99fc-42e9-9b01-8af442faa72c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1/action" status: 202 len: 0 microversion: 2.1 time: 1.507677 Nov 02 21:44:58.087469 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2322/4535] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:44:56 2022] POST /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1/action => generated 0 bytes in 1514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:58.111351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc924ac5-d51e-48a2-b32b-e3814cd11519 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b68e9b040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:58.387094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:58.408280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:58.416504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:58.431333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4bc3d4e5-9a07-46a0-bad6-64267da8d823 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.397942 Nov 02 21:44:58.453113 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2214/4536] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:58 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:44:58.464865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:58.465837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:58.479796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:58.480335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:58.480780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:58.487425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:58.487425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:58.487425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:58.670986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:58.681270 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1af188a-a60c-4e2e-af1c-4fe776936a90 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1270 microversion: 2.1 time: 0.226629 Nov 02 21:44:58.681868 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2215/4537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:58 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:58.789569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-bc924ac5-d51e-48a2-b32b-e3814cd11519 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use.", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:44:58.790618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-bc924ac5-d51e-48a2-b32b-e3814cd11519 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use. Nov 02 21:44:58.790618 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-9f4e48d6-6fc8-478c-a852-135937dddfda'] Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc924ac5-d51e-48a2-b32b-e3814cd11519 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696 HTTP/1.1 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: exception: Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use. Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-9f4e48d6-6fc8-478c-a852-135937dddfda'] Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f9cb2027-6d60-470d-a99a-6f4d067c0696'} Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:44:58.792855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use. Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f4e48d6-6fc8-478c-a852-135937dddfda'] Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use. Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f4e48d6-6fc8-478c-a852-135937dddfda'] Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use. Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f4e48d6-6fc8-478c-a852-135937dddfda'] Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use. Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f4e48d6-6fc8-478c-a852-135937dddfda'] Nov 02 21:44:58.797076 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:44:58.809344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc924ac5-d51e-48a2-b32b-e3814cd11519 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 400 to user: Security Group f9cb2027-6d60-470d-a99a-6f4d067c0696 in use. Nov 02 21:44:58.809344 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-9f4e48d6-6fc8-478c-a852-135937dddfda'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:44:58.809344 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc924ac5-d51e-48a2-b32b-e3814cd11519 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696" status: 400 len: 185 microversion: 2.1 time: 0.707930 Nov 02 21:44:58.809344 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2323/4538] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:44:58 2022] DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696 => generated 185 bytes in 709 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:44:58.813315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:44:58.815840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:58.824196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:58.835736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:58.835736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:58.835736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:58.835736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:58.836057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:59.183341 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-29bef042-a2d0-4a3a-964b-0e9a3b132b36 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1/action" status: 202 len: 0 microversion: 2.1 time: 0.376411 Nov 02 21:44:59.185236 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2216/4539] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:44:58 2022] POST /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:44:59.195326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:59.196699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:59.210704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:59.212240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:59.214724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:59.221084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:59.222079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:59.222763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:59.461114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:59.462390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:59.477237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:59.477992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:59.479418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:59.481762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:59.482900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:59.488694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:59.682745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:59.695558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:59.696846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:59.700878 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9543ab2-e22e-49ff-9cc6-59e1b2f03f48 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1604 microversion: 2.42 time: 0.243084 Nov 02 21:44:59.702178 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2217/4540] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:44:59 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:44:59.709791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:44:59.710578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:44:59.721472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:59.722269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:59.722856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:59.723841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:44:59.724496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:44:59.725308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:44:59.870079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:59.882549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7beb5ec7-9c48-4db2-8617-44b717c078f5 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1288 microversion: 2.1 time: 0.178563 Nov 02 21:44:59.883291 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2218/4541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:59 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1288 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:44:59.899315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:44:59.917122 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c96a836e-c4b2-4294-8469-caac47ab60de tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1573 microversion: 2.1 time: 0.725707 Nov 02 21:44:59.918235 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2324/4542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:44:59 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1573 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:00.034954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-cb74392a-c895-4ecc-87c5-632ce0993685 req-e9316ff2-1afb-4f2d-a0ae-9de71ea26472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1", "tag": "c5be92fa-eb78-4a73-a9fd-6b456d137df8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:00.054046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cb74392a-c895-4ecc-87c5-632ce0993685 req-e9316ff2-1afb-4f2d-a0ae-9de71ea26472 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.055608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cb74392a-c895-4ecc-87c5-632ce0993685 req-e9316ff2-1afb-4f2d-a0ae-9de71ea26472 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.056101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cb74392a-c895-4ecc-87c5-632ce0993685 req-e9316ff2-1afb-4f2d-a0ae-9de71ea26472 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:00.084560 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-cb74392a-c895-4ecc-87c5-632ce0993685 req-e9316ff2-1afb-4f2d-a0ae-9de71ea26472 service nova] Creating event network-changed:c5be92fa-eb78-4a73-a9fd-6b456d137df8 for instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 on n-h2-860863-4 Nov 02 21:45:00.093747 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-cb74392a-c895-4ecc-87c5-632ce0993685 req-e9316ff2-1afb-4f2d-a0ae-9de71ea26472 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062382 Nov 02 21:45:00.097123 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2219/4543] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:00.730983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:00.732487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:00.744396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.746858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.747650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:00.750288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.751014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.753811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:00.838586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:00.851730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.852791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.853441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:00.854280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lazy-loading 'fault' on Instance uuid baee203f-5ed4-4bb9-af88-3c7752c4f505 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:45:00.920606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:00.925272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:00.933611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.934356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.935317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:00.936191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.936871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.937509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:00.945424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:00.963415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:00.963415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '315ca0c90d5d48b98ec3d3b8d13a0fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e324e71765694763955a4468458bd7f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:00.964188 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3897fc66-a385-425f-abbb-e8a029f75d54 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 200 len: 1609 microversion: 2.42 time: 0.237745 Nov 02 21:45:00.965377 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2325/4544] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:45:00 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 1609 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:45:00.978779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:00.981915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:00.990790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.991733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.992585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:00.993581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:00.995174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:00.995830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:01.412323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:01.430480 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-391df554-4c44-46bd-ad03-9cd97411357e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1318 microversion: 2.1 time: 0.514540 Nov 02 21:45:01.432778 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2220/4545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:00 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:01.557057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:01.574175 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-662db42b-7318-46b8-bff1-49070fde418a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1573 microversion: 2.1 time: 0.607459 Nov 02 21:45:01.577186 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2326/4546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:00 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1573 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:01.990666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:01.991465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:02.008763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:02.010891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:02.011897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:02.012595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:02.013600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:02.014131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:02.015064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:02.030762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] HTTP exception thrown: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Request method failure captured: Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 HTTP/1.1 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuMCy9Si1ZrFybVkIcCsf6jg6UUrAEAhkbyADLq_A27SD7miUcD-isyOOFLw7PSmnBh8OyDTFS79f7xmBp4TLfejSgHzOG-KkW7uIC_7N773afmxj_PxTkLt9mLfjZ7fxy1u5DYWmg66DyvX2b9xYV0QPJxbQ6FhrCguvntkqmjdzCY Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e324e71765694763955a4468458bd7f2 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e324e71765694763955a4468458bd7f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e324e71765694763955a4468458bd7f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e324e71765694763955a4468458bd7f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e324e71765694763955a4468458bd7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e324e71765694763955a4468458bd7f2 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TaggedBootDevicesTest_v242-2027473711-project Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 315ca0c90d5d48b98ec3d3b8d13a0fe9 Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027473711-project Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'baee203f-5ed4-4bb9-af88-3c7752c4f505'} Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:02.039140 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Returning 404 to user: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ec1edc5-cc30-4b31-b87b-4710c1d19e62 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 404 len: 111 microversion: 2.42 time: 0.047960 Nov 02 21:45:02.043656 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2221/4547] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:45:01 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:45:02.046742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-277bc03b-bf0f-4844-8971-467bead1277a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '.version_select at 0x7f9b681851f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:02.177318 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-277bc03b-bf0f-4844-8971-467bead1277a tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194597330" status: 204 len: 0 microversion: 2.42 time: 0.136395 Nov 02 21:45:02.185739 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2327/4548] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:45:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194597330 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:45:02.465398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:02.466447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:02.474332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:02.474893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:02.475507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:02.476376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:02.476847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:02.477303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:02.597814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:02.598884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:02.637178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:02.637832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:02.638291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:02.639048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:02.639507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:02.640201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:02.939835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:02.949386 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86520204-94c8-44e0-beec-c67a38a3e05e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1318 microversion: 2.1 time: 0.488834 Nov 02 21:45:02.950041 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2222/4549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:02 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:03.051343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:03.074519 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae70d76a-0ac3-4e0f-b24c-bb6b7d58ca12 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1571 microversion: 2.1 time: 0.481236 Nov 02 21:45:03.075879 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2328/4550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:02 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1571 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:03.101894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1819172128"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:03.102495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:03.116018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:03.117049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:03.123024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:03.123024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:03.123024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:03.123024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:03.388187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.network.security_group_api [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Adding security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 to port c5be92fa-eb78-4a73-a9fd-6b456d137df8 Nov 02 21:45:03.862561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-02a6b6ef-d507-4cac-831e-8970bc7cf16d req-715001ae-72be-4c5c-9903-7ee001ef283a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ea44e1-eb31-4dde-8e15-de4306c89cc5", "tag": "21daa7f7-8b82-4acb-be39-b1131920894b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:03.882832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-02a6b6ef-d507-4cac-831e-8970bc7cf16d req-715001ae-72be-4c5c-9903-7ee001ef283a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:03.883307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-02a6b6ef-d507-4cac-831e-8970bc7cf16d req-715001ae-72be-4c5c-9903-7ee001ef283a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:03.884786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-02a6b6ef-d507-4cac-831e-8970bc7cf16d req-715001ae-72be-4c5c-9903-7ee001ef283a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:03.957025 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-02a6b6ef-d507-4cac-831e-8970bc7cf16d req-715001ae-72be-4c5c-9903-7ee001ef283a service nova] Creating event network-changed:21daa7f7-8b82-4acb-be39-b1131920894b for instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 on n-h2-860863-4 Nov 02 21:45:03.967309 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-02a6b6ef-d507-4cac-831e-8970bc7cf16d req-715001ae-72be-4c5c-9903-7ee001ef283a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112666 Nov 02 21:45:03.969263 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2329/4551] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:45:03.986656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:03.987374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:04.007203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:04.007669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:04.008175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:04.008991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:04.009674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:04.010295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:04.138773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b283712-3b0d-4a4c-a14e-18636673c0b8 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1/action" status: 202 len: 0 microversion: 2.1 time: 1.039385 Nov 02 21:45:04.138773 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2223/4552] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:45:03 2022] POST /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:45:04.146920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1302b5b8-6d93-477a-9928-619904a2919e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6d215670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:04.438814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:04.453409 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-323968dc-3f28-4493-94c5-20dc473a943d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1318 microversion: 2.1 time: 0.482636 Nov 02 21:45:04.454300 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2330/4553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:03 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:04.845245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-1302b5b8-6d93-477a-9928-619904a2919e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use.", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:45:04.846190 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-1302b5b8-6d93-477a-9928-619904a2919e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use. Nov 02 21:45:04.846190 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-218a8b5a-cf9a-4e19-9343-a7f6cc8ae185'] Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1302b5b8-6d93-477a-9928-619904a2919e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 HTTP/1.1 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: exception: Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use. Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-218a8b5a-cf9a-4e19-9343-a7f6cc8ae185'] Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '55646ed7-1c8a-42b3-8ea0-dd937a70b0a4'} Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:45:04.851251 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use. Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-218a8b5a-cf9a-4e19-9343-a7f6cc8ae185'] Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use. Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-218a8b5a-cf9a-4e19-9343-a7f6cc8ae185'] Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use. Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-218a8b5a-cf9a-4e19-9343-a7f6cc8ae185'] Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use. Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-218a8b5a-cf9a-4e19-9343-a7f6cc8ae185'] Nov 02 21:45:04.855356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:04.858000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1302b5b8-6d93-477a-9928-619904a2919e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 400 to user: Security Group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 in use. Nov 02 21:45:04.858000 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-218a8b5a-cf9a-4e19-9343-a7f6cc8ae185'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:04.859239 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1302b5b8-6d93-477a-9928-619904a2919e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4" status: 400 len: 185 microversion: 2.1 time: 0.717466 Nov 02 21:45:04.860484 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2224/4554] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:04 2022] DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 => generated 185 bytes in 719 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:45:04.878329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:04.878329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:04.879235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:04.879814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:04.880257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:04.880975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:04.881675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:04.882262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:04.936596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:45:05.246642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:05.295769 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72ca5c14-0581-4fe0-b7b7-6592aa398734 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 204 len: 0 microversion: 2.1 time: 0.427339 Nov 02 21:45:05.296668 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2331/4555] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:45:04 2022] DELETE /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:45:05.313895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:05.316767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:05.324923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:05.326495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:05.326495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:05.327426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:05.328108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:05.328704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:05.486081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:05.486830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:05.494719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:05.495217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:05.495656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:05.496360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:05.496814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:05.497812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:05.552050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:05.562561 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dd6e106c-d80a-49ba-9338-bf5e567ba811 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1646 microversion: 2.1 time: 0.261417 Nov 02 21:45:05.583016 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2225/4556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:05 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1646 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:05.857285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:05.868307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:05.871104 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9314869b-628d-4b52-9bcb-8247af1c90c3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1318 microversion: 2.1 time: 0.392188 Nov 02 21:45:05.882324 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2332/4557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:05 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:06.009488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b9b1287a-6890-406b-af90-c68b98cf24be req-107c2bff-f766-412e-9468-d442ee23f972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1", "tag": "c5be92fa-eb78-4a73-a9fd-6b456d137df8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:06.026280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9b1287a-6890-406b-af90-c68b98cf24be req-107c2bff-f766-412e-9468-d442ee23f972 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:06.026969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9b1287a-6890-406b-af90-c68b98cf24be req-107c2bff-f766-412e-9468-d442ee23f972 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:06.029838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9b1287a-6890-406b-af90-c68b98cf24be req-107c2bff-f766-412e-9468-d442ee23f972 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:06.053914 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b9b1287a-6890-406b-af90-c68b98cf24be req-107c2bff-f766-412e-9468-d442ee23f972 service nova] Creating event network-changed:c5be92fa-eb78-4a73-a9fd-6b456d137df8 for instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 on n-h2-860863-4 Nov 02 21:45:06.062568 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b9b1287a-6890-406b-af90-c68b98cf24be req-107c2bff-f766-412e-9468-d442ee23f972 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057965 Nov 02 21:45:06.063442 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2226/4558] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:06.587699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:06.589049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:06.597209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:06.597964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:06.599265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:06.600281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:06.601002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:06.601643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:06.896523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:06.897256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:06.910457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:06.911082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:06.911530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:06.912398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:06.912847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:06.917390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:06.923986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:07.058257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:07.071282 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed133e7c-41eb-48ef-9d0c-79ee715399dd tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1646 microversion: 2.1 time: 0.487686 Nov 02 21:45:07.071871 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2333/4559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:06 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1646 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:07.130178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:07.245647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:07.255097 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3597cc9f-99de-4fe3-8966-02838e0729b0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1318 microversion: 2.1 time: 0.362027 Nov 02 21:45:07.258893 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2227/4560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:06 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:07.865417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:07.865417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:07.877036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:07.877569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:07.878011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:07.880386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:07.880864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:07.881876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:07.928998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] HTTP exception thrown: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Request method failure captured: Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 HTTP/1.1 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuMCy9Si1ZrFybVkIcCsf6jg6UUrAEAhkbyADLq_A27SD7miUcD-isyOOFLw7PSmnBh8OyDTFS79f7xmBp4TLfejSgHzOG-KkW7uIC_7N773afmxj_PxTkLt9mLfjZ7fxy1u5DYWmg66DyvX2b9xYV0QPJxbQ6FhrCguvntkqmjdzCY Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: e324e71765694763955a4468458bd7f2 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e324e71765694763955a4468458bd7f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e324e71765694763955a4468458bd7f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e324e71765694763955a4468458bd7f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e324e71765694763955a4468458bd7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: e324e71765694763955a4468458bd7f2 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TaggedBootDevicesTest_v242-2027473711-project Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 315ca0c90d5d48b98ec3d3b8d13a0fe9 Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027473711-project Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'baee203f-5ed4-4bb9-af88-3c7752c4f505'} Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:45:07.930782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Returning 404 to user: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:07.936285 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa770037-a330-4b8a-a42a-8dd9454c0404 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "DELETE /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 404 len: 111 microversion: 2.42 time: 0.077506 Nov 02 21:45:07.941307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:07.942091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] [instance: baee203f-5ed4-4bb9-af88-3c7752c4f505] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:07.947288 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2334/4561] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:45:07 2022] DELETE /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:45:07.953579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:07.956308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:07.956793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:07.958537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:07.959012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:07.961300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:07.985719 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] HTTP exception thrown: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Request method failure captured: Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 HTTP/1.1 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuMCy9Si1ZrFybVkIcCsf6jg6UUrAEAhkbyADLq_A27SD7miUcD-isyOOFLw7PSmnBh8OyDTFS79f7xmBp4TLfejSgHzOG-KkW7uIC_7N773afmxj_PxTkLt9mLfjZ7fxy1u5DYWmg66DyvX2b9xYV0QPJxbQ6FhrCguvntkqmjdzCY Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: e324e71765694763955a4468458bd7f2 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e324e71765694763955a4468458bd7f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e324e71765694763955a4468458bd7f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e324e71765694763955a4468458bd7f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e324e71765694763955a4468458bd7f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: e324e71765694763955a4468458bd7f2 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027473711 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TaggedBootDevicesTest_v242-2027473711-project Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 315ca0c90d5d48b98ec3d3b8d13a0fe9 Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027473711-project Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'baee203f-5ed4-4bb9-af88-3c7752c4f505'} Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.987997 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. Nov 02 21:45:07.993935 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:07.995479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] Returning 404 to user: Instance baee203f-5ed4-4bb9-af88-3c7752c4f505 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:07.997043 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aaa31b2c-3461-4c8e-a8da-915e3d8fa5d6 tempest-TaggedBootDevicesTest_v242-2027473711 tempest-TaggedBootDevicesTest_v242-2027473711-project] 10.222.0.25 "GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505" status: 404 len: 111 microversion: 2.42 time: 0.060101 Nov 02 21:45:07.998166 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2228/4562] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:45:07 2022] GET /compute/v2.1/servers/baee203f-5ed4-4bb9-af88-3c7752c4f505 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:45:08.095942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:08.097204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:08.131123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:08.131947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:08.133745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:08.137082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:08.137690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:08.141715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:08.285194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:08.305080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:08.311385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:08.312031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:08.312676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:08.316563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:08.317779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:08.320808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:08.680470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:08.689893 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28581c4d-ae46-439e-a0e8-8d602c71d388 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1646 microversion: 2.1 time: 0.598892 Nov 02 21:45:08.707321 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2335/4563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:08 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1646 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:08.743466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4985ea3b-3823-465c-ae09-20e9cc8816fb req-130c3bfa-7f69-485b-85cc-eeb9d48c3a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1", "name": "network-vif-deleted", "tag": "c5be92fa-eb78-4a73-a9fd-6b456d137df8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:08.758455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4985ea3b-3823-465c-ae09-20e9cc8816fb req-130c3bfa-7f69-485b-85cc-eeb9d48c3a79 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:08.759150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4985ea3b-3823-465c-ae09-20e9cc8816fb req-130c3bfa-7f69-485b-85cc-eeb9d48c3a79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:08.760299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4985ea3b-3823-465c-ae09-20e9cc8816fb req-130c3bfa-7f69-485b-85cc-eeb9d48c3a79 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:08.776792 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4985ea3b-3823-465c-ae09-20e9cc8816fb req-130c3bfa-7f69-485b-85cc-eeb9d48c3a79 service nova] Creating event network-vif-deleted:c5be92fa-eb78-4a73-a9fd-6b456d137df8 for instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 on n-h2-860863-4 Nov 02 21:45:08.783315 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4985ea3b-3823-465c-ae09-20e9cc8816fb req-130c3bfa-7f69-485b-85cc-eeb9d48c3a79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051551 Nov 02 21:45:08.784539 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2336/4564] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:08.887892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:08.938112 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61590adb-f2dc-40f1-a530-b7568c5130f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1318 microversion: 2.1 time: 0.651009 Nov 02 21:45:08.961232 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2229/4565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:08 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:09.385642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-64eb4b0d-c349-44cc-847a-d8a1db51b9f8 req-08e5eaed-885e-4824-9b95-b5239f087b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ea44e1-eb31-4dde-8e15-de4306c89cc5", "name": "network-vif-plugged", "status": "completed", "tag": "21daa7f7-8b82-4acb-be39-b1131920894b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:09.398340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-64eb4b0d-c349-44cc-847a-d8a1db51b9f8 req-08e5eaed-885e-4824-9b95-b5239f087b58 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:09.399015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-64eb4b0d-c349-44cc-847a-d8a1db51b9f8 req-08e5eaed-885e-4824-9b95-b5239f087b58 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:09.399613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-64eb4b0d-c349-44cc-847a-d8a1db51b9f8 req-08e5eaed-885e-4824-9b95-b5239f087b58 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:09.422135 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-64eb4b0d-c349-44cc-847a-d8a1db51b9f8 req-08e5eaed-885e-4824-9b95-b5239f087b58 service nova] Creating event network-vif-plugged:21daa7f7-8b82-4acb-be39-b1131920894b for instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 on n-h2-860863-4 Nov 02 21:45:09.428012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-64eb4b0d-c349-44cc-847a-d8a1db51b9f8 req-08e5eaed-885e-4824-9b95-b5239f087b58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052179 Nov 02 21:45:09.428609 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2337/4566] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:45:09.720553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:09.721455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:09.754219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:09.757627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:09.761261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:09.762170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:09.762697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:09.763228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:09.846425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:09.847239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:09.850062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:09.853181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lazy-loading 'fault' on Instance uuid 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:45:09.907931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:09.918349 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-35ba5148-0a62-46e1-964d-57b83ff07147 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 200 len: 1471 microversion: 2.1 time: 0.202442 Nov 02 21:45:09.919485 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2230/4567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:09 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:09.966040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:09.966745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:09.977171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:09.977171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:09.977359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:09.977917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:09.986842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:09.990767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:10.054166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:10.281687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:10.293695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6824f9ee-2738-4ecf-9644-04f7bf04dc1b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1318 microversion: 2.1 time: 0.331725 Nov 02 21:45:10.294561 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2338/4568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:09 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:10.942256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:10.943528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:10.954639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:10.955242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:10.957313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:10.959309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:10.965734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:10.966606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:10.991395 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 HTTP/1.1 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1'} Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:10.993890 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:10.999855 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:10.999855 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:10.999855 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:10.999855 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:10.999855 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:10.999855 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:10.999855 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:11.001265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:11.002352 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-544cb9cc-363a-4539-ab23-5023766998a5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 404 len: 111 microversion: 2.1 time: 0.064028 Nov 02 21:45:11.003233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2231/4569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:10 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:11.012695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b436386e-88dc-4132-b569-99bd39608fa2 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6841ce50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:11.312665 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b436386e-88dc-4132-b569-99bd39608fa2 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696" status: 202 len: 0 microversion: 2.1 time: 0.303614 Nov 02 21:45:11.313243 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2339/4570] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:11 2022] DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:45:11.321455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:11.322019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d7ed6662-d900-4a7a-8db3-bc4159a5ccbe tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6841c430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:11.322347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:11.333775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:11.334367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:11.337492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:11.339635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:11.340683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:11.342311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:11.627819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:11.637311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1c4f13d6-7222-41ad-bd60-c264d1f2e6f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1506 microversion: 2.1 time: 0.321002 Nov 02 21:45:11.652107 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2232/4571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:11 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:11.663877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:11.665371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:11.670642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:11.671137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:11.671583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:11.672281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:11.672744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:11.673208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:11.782843 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7ed6662-d900-4a7a-8db3-bc4159a5ccbe tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4" status: 202 len: 0 microversion: 2.1 time: 0.466126 Nov 02 21:45:11.783438 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2340/4572] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:11 2022] DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:45:11.794961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0316f808-3657-4034-aa34-41fafdca14bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'create', calling method: .version_select at 0x7f9b6848a790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1528057814", "description": "tempest-description-1912794686"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:11.872092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:11.881153 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e21dd2b-2231-4b75-a706-ede752d0abd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1506 microversion: 2.1 time: 0.222360 Nov 02 21:45:11.881727 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2233/4573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:11 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:11.909435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:11.916081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:11.925162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:11.929385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:11.929385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:11.929385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:11.929385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:11.929385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.121451 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a1b51ff-80e3-4ee1-b63a-9a48cef60f6d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "PUT /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1078 microversion: 2.1 time: 0.218390 Nov 02 21:45:12.125065 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2234/4574] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:45:11 2022] PUT /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1078 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:12.141981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:12.142590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:12.152981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.168257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.168257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.168257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.168257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.168257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.390482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0316f808-3657-4034-aa34-41fafdca14bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.597388 Nov 02 21:45:12.390482 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2341/4575] 10.222.0.25 () {60 vars in 1180 bytes} [Wed Nov 2 21:45:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:45:12.404660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd655b70-5839-44f8-bbe1-c71f555fcc6b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Action: 'update', calling method: .version_select at 0x7f9b6d1bf5e0>, body: {"security_group": {"name": "tempest-sg-hth-131148421", "description": "tempest-description-hth-228836388"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:12.438935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:12.452740 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19cab6e7-a4cf-4d75-9e6c-3216f3d88b69 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1504 microversion: 2.1 time: 0.314536 Nov 02 21:45:12.468369 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2235/4576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:12 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:12.480182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:12.480805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:12.492860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.493622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.494623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.501361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.501361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.501361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.781252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:12.792266 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b5360fe7-bc11-40d9-b63c-3aecddc3463c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1504 microversion: 2.1 time: 0.318233 Nov 02 21:45:12.793867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2236/4577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:12 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:12.800633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "604d7bf9-ad4a-488e-bec5-03350c3b38e2"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:12.804444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:12.812077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.812821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.813648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.814726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.818147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.818955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.840244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd655b70-5839-44f8-bbe1-c71f555fcc6b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "PUT /compute/v2.1/os-security-groups/2dfad455-726e-445e-ace1-7d7dda1de074" status: 200 len: 216 microversion: 2.1 time: 0.440440 Nov 02 21:45:12.841021 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2342/4578] 10.222.0.25 () {60 vars in 1290 bytes} [Wed Nov 2 21:45:12 2022] PUT /compute/v2.1/os-security-groups/2dfad455-726e-445e-ace1-7d7dda1de074 => generated 216 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:12.846000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:12.852121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:12.872395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.872909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.873381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:12.874893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:12.876065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:12.880317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:13.010174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:45:13.010596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:45:13.011081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:45:13.011471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:45:13.011882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:45:13.252755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:13.263575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:13.264654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:13.266816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:13.267932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:13.268560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:13.269221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:13.308507 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2660a802-2886-44db-9a0a-438b19d4cf4d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "POST /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5/action" status: 202 len: 1110 microversion: 2.1 time: 0.466177 Nov 02 21:45:13.310609 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2343/4579] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:45:12 2022] POST /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5/action => generated 1110 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 21:45:13.318960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-747ae886-6983-4753-8f80-4bbd9116897c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b68e87d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:13.405216 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-747ae886-6983-4753-8f80-4bbd9116897c tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/os-security-groups/2dfad455-726e-445e-ace1-7d7dda1de074" status: 200 len: 216 microversion: 2.1 time: 0.092598 Nov 02 21:45:13.408185 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2344/4580] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 21:45:13 2022] GET /compute/v2.1/os-security-groups/2dfad455-726e-445e-ace1-7d7dda1de074 => generated 216 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:13.416124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:13.419025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:13.432057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:13.433610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:13.434486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:13.435411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:13.436028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:13.436697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:13.741508 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-caac6956-58db-4197-8d39-c09bfec7a3f2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946060 Nov 02 21:45:13.742817 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2237/4581] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:45:12 2022] POST /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:13.783153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-212bf21c-a256-403e-9a88-6211d3eb7dee tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b69175f70>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:14.409505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:14.416569 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d81f37b1-77f9-4792-9063-b7e5aff3ceef tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 1.006722 Nov 02 21:45:14.417671 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2345/4582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:13 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:14.712835 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-212bf21c-a256-403e-9a88-6211d3eb7dee tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/2dfad455-726e-445e-ace1-7d7dda1de074" status: 202 len: 0 microversion: 2.1 time: 0.968421 Nov 02 21:45:14.717722 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2238/4583] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:13 2022] DELETE /compute/v2.1/os-security-groups/2dfad455-726e-445e-ace1-7d7dda1de074 => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:45:14.722221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:14.722955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:14.732358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:14.734602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:14.739356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:14.739356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:14.754233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:14.755083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:14.794421 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 HTTP/1.1 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1'} Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:45:14.796153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.800796 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.804565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:14.805482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ec573d0-192f-476a-8777-4780f930e122 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 404 len: 111 microversion: 2.1 time: 0.087680 Nov 02 21:45:14.806053 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2346/4584] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:45:14 2022] DELETE /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:14.814637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:14.815587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:14.824034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:14.824529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:14.824997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:14.825704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:14.826166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:14.826599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:14.841083 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 HTTP/1.1 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1'} Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:14.842766 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Instance 1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eeefac46-c42d-4716-a260-7fd2ba2178b9 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1" status: 404 len: 111 microversion: 2.1 time: 0.033920 Nov 02 21:45:14.847160 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2239/4585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:14 2022] GET /compute/v2.1/servers/1acbca3e-d94c-4fb2-905c-9a0fef4bf0c1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:14.854446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f3fcee1-73e6-4665-8099-1a79509e9d79 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6d217ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:14.917064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-7f3fcee1-73e6-4665-8099-1a79509e9d79 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:45:14.917474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-7f3fcee1-73e6-4665-8099-1a79509e9d79 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:45:14.918122 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7f3fcee1-73e6-4665-8099-1a79509e9d79 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist Nov 02 21:45:14.918122 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-ebd97b71-5e90-49ea-8c13-a0e375b2afa6'] Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f3fcee1-73e6-4665-8099-1a79509e9d79 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 HTTP/1.1 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-ebd97b71-5e90-49ea-8c13-a0e375b2afa6'] Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '55646ed7-1c8a-42b3-8ea0-dd937a70b0a4'} Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:45:14.920136 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebd97b71-5e90-49ea-8c13-a0e375b2afa6'] Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebd97b71-5e90-49ea-8c13-a0e375b2afa6'] Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebd97b71-5e90-49ea-8c13-a0e375b2afa6'] Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebd97b71-5e90-49ea-8c13-a0e375b2afa6'] Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f3fcee1-73e6-4665-8099-1a79509e9d79 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group 55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 does not exist Nov 02 21:45:14.925401 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-ebd97b71-5e90-49ea-8c13-a0e375b2afa6'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:14.930210 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f3fcee1-73e6-4665-8099-1a79509e9d79 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4" status: 404 len: 194 microversion: 2.1 time: 0.077508 Nov 02 21:45:14.932313 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2347/4586] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:14 2022] DELETE /compute/v2.1/os-security-groups/55646ed7-1c8a-42b3-8ea0-dd937a70b0a4 => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:14.940531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42d8a8a8-045c-494d-819d-1a2e945d446e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6d13a550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:14.994185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-42d8a8a8-045c-494d-819d-1a2e945d446e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:45:14.994995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-42d8a8a8-045c-494d-819d-1a2e945d446e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group f9cb2027-6d60-470d-a99a-6f4d067c0696 not found {{(pid=121039) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:45:14.995682 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-42d8a8a8-045c-494d-819d-1a2e945d446e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist Nov 02 21:45:14.995682 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-865a3281-b8e5-4dae-8aeb-5e53ebef4db5'] Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42d8a8a8-045c-494d-819d-1a2e945d446e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696 HTTP/1.1 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: exception: Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-865a3281-b8e5-4dae-8aeb-5e53ebef4db5'] Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f9cb2027-6d60-470d-a99a-6f4d067c0696'} Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:45:14.997793 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-865a3281-b8e5-4dae-8aeb-5e53ebef4db5'] Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-865a3281-b8e5-4dae-8aeb-5e53ebef4db5'] Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-865a3281-b8e5-4dae-8aeb-5e53ebef4db5'] Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-865a3281-b8e5-4dae-8aeb-5e53ebef4db5'] Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42d8a8a8-045c-494d-819d-1a2e945d446e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group f9cb2027-6d60-470d-a99a-6f4d067c0696 does not exist Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-865a3281-b8e5-4dae-8aeb-5e53ebef4db5'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42d8a8a8-045c-494d-819d-1a2e945d446e tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696" status: 404 len: 194 microversion: 2.1 time: 0.066004 Nov 02 21:45:15.003052 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2240/4587] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:14 2022] DELETE /compute/v2.1/os-security-groups/f9cb2027-6d60-470d-a99a-6f4d067c0696 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:45:15.014728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f5ee8ac-1642-4c41-87e2-df5004fabd2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6843e790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:15.031114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-3f5ee8ac-1642-4c41-87e2-df5004fabd2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:45:15.031703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-3f5ee8ac-1642-4c41-87e2-df5004fabd2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group 359a2f2f-fdb9-4795-8081-442984d473a4 not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:45:15.032210 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3f5ee8ac-1642-4c41-87e2-df5004fabd2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:45:15.032210 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-d149c1c1-c110-4621-8fe2-e58e3731c54a'] Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f5ee8ac-1642-4c41-87e2-df5004fabd2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4 HTTP/1.1 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-d149c1c1-c110-4621-8fe2-e58e3731c54a'] Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '359a2f2f-fdb9-4795-8081-442984d473a4'} Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:45:15.034027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d149c1c1-c110-4621-8fe2-e58e3731c54a'] Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d149c1c1-c110-4621-8fe2-e58e3731c54a'] Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d149c1c1-c110-4621-8fe2-e58e3731c54a'] Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d149c1c1-c110-4621-8fe2-e58e3731c54a'] Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f5ee8ac-1642-4c41-87e2-df5004fabd2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group 359a2f2f-fdb9-4795-8081-442984d473a4 does not exist Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-d149c1c1-c110-4621-8fe2-e58e3731c54a'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f5ee8ac-1642-4c41-87e2-df5004fabd2a tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4" status: 404 len: 194 microversion: 2.1 time: 0.031359 Nov 02 21:45:15.038541 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2348/4588] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:15 2022] DELETE /compute/v2.1/os-security-groups/359a2f2f-fdb9-4795-8081-442984d473a4 => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:15.045539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8d4d746e-33fa-47c5-a542-fdbbe11f75bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6d2fc430>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:15.069981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-8d4d746e-33fa-47c5-a542-fdbbe11f75bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:45:15.071020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-8d4d746e-33fa-47c5-a542-fdbbe11f75bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee not found {{(pid=121039) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:45:15.071737 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8d4d746e-33fa-47c5-a542-fdbbe11f75bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:45:15.071737 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-04dee56d-a08f-4183-bcf1-7fcd591dea5c'] Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8d4d746e-33fa-47c5-a542-fdbbe11f75bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee HTTP/1.1 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: exception: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-04dee56d-a08f-4183-bcf1-7fcd591dea5c'] Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '423e8ada-9b44-47ed-b78b-65ad92ed6fee'} Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:45:15.077681 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04dee56d-a08f-4183-bcf1-7fcd591dea5c'] Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04dee56d-a08f-4183-bcf1-7fcd591dea5c'] Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04dee56d-a08f-4183-bcf1-7fcd591dea5c'] Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04dee56d-a08f-4183-bcf1-7fcd591dea5c'] Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8d4d746e-33fa-47c5-a542-fdbbe11f75bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group 423e8ada-9b44-47ed-b78b-65ad92ed6fee does not exist Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-04dee56d-a08f-4183-bcf1-7fcd591dea5c'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8d4d746e-33fa-47c5-a542-fdbbe11f75bc tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee" status: 404 len: 194 microversion: 2.1 time: 0.035394 Nov 02 21:45:15.083023 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2241/4589] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:15 2022] DELETE /compute/v2.1/os-security-groups/423e8ada-9b44-47ed-b78b-65ad92ed6fee => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:15.087752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f638ada3-cb5d-465a-8910-1a3ff003888b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6843e040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:15.115360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG neutronclient.v2_0.client [None req-f638ada3-cb5d-465a-8910-1a3ff003888b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist", "detail": ""}} {{(pid=121040) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:45:15.116353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.security_group_api [None req-f638ada3-cb5d-465a-8910-1a3ff003888b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d not found {{(pid=121040) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:45:15.117105 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f638ada3-cb5d-465a-8910-1a3ff003888b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:45:15.117105 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-42129dfe-306e-4c2a-938a-71cf64fa5a38'] Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f638ada3-cb5d-465a-8910-1a3ff003888b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d HTTP/1.1 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: exception: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-42129dfe-306e-4c2a-938a-71cf64fa5a38'] Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d'} Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:45:15.119350 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42129dfe-306e-4c2a-938a-71cf64fa5a38'] Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42129dfe-306e-4c2a-938a-71cf64fa5a38'] Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42129dfe-306e-4c2a-938a-71cf64fa5a38'] Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42129dfe-306e-4c2a-938a-71cf64fa5a38'] Nov 02 21:45:15.123976 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.127871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f638ada3-cb5d-465a-8910-1a3ff003888b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group 4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d does not exist Nov 02 21:45:15.127871 n-d-860863-4 devstack@n-api.service[121040]: Neutron server returns request_ids: ['req-42129dfe-306e-4c2a-938a-71cf64fa5a38'] {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:15.131002 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f638ada3-cb5d-465a-8910-1a3ff003888b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d" status: 404 len: 194 microversion: 2.1 time: 0.048369 Nov 02 21:45:15.131775 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2349/4590] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:15 2022] DELETE /compute/v2.1/os-security-groups/4aaa1b91-e0cb-46ef-8c0e-23b8e2e5bd3d => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:15.141380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-917fd7c5-3f58-4692-9ace-9d1be3521b8b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b689c3280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:15.181104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG neutronclient.v2_0.client [None req-917fd7c5-3f58-4692-9ace-9d1be3521b8b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist", "detail": ""}} {{(pid=121039) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 21:45:15.181920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-917fd7c5-3f58-4692-9ace-9d1be3521b8b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Neutron security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 not found {{(pid=121039) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 21:45:15.182611 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-917fd7c5-3f58-4692-9ace-9d1be3521b8b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:45:15.182611 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-384d4fad-6b47-48d3-a2df-de56a7fa09ef'] Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-917fd7c5-3f58-4692-9ace-9d1be3521b8b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 HTTP/1.1 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: exception: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-384d4fad-6b47-48d3-a2df-de56a7fa09ef'] Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'a5a340b1-c9f0-49d1-be52-f3e1f26a9b05'} Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 21:45:15.184998 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384d4fad-6b47-48d3-a2df-de56a7fa09ef'] Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384d4fad-6b47-48d3-a2df-de56a7fa09ef'] Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384d4fad-6b47-48d3-a2df-de56a7fa09ef'] Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384d4fad-6b47-48d3-a2df-de56a7fa09ef'] Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-917fd7c5-3f58-4692-9ace-9d1be3521b8b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Security group a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 does not exist Nov 02 21:45:15.190644 n-d-860863-4 devstack@n-api.service[121039]: Neutron server returns request_ids: ['req-384d4fad-6b47-48d3-a2df-de56a7fa09ef'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:15.195067 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-917fd7c5-3f58-4692-9ace-9d1be3521b8b tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05" status: 404 len: 194 microversion: 2.1 time: 0.058389 Nov 02 21:45:15.195837 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2242/4591] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:15 2022] DELETE /compute/v2.1/os-security-groups/a5a340b1-c9f0-49d1-be52-f3e1f26a9b05 => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:15.204510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:15.205180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:15.229321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:15.229321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:15.229321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:15.229321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:15.229321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:15.229321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:15.255648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:45:15.446935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:15.447934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:15.459225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:15.460834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:15.461972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:15.463599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:15.464432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:15.465147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:15.667912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e002fc72-11ca-4f8a-a1fb-e06005e674ba tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 204 len: 0 microversion: 2.1 time: 0.467688 Nov 02 21:45:15.669334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2350/4592] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:45:15 2022] DELETE /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:45:15.679008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:15.680641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:15.690426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:15.692954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:15.694377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:15.696213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:15.698188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:15.699514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:15.716962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:15.730638 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a21909c7-9fcb-4371-9dd7-57af002878dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.290455 Nov 02 21:45:15.736962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2243/4593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:15 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:15.923010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:15.934261 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1030fe8f-e99b-4e26-877a-303053646533 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1642 microversion: 2.1 time: 0.260336 Nov 02 21:45:15.934847 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2351/4594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:15 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1642 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:16.756457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:16.757298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:16.772542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:16.773921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:16.774383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:16.775127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:16.776228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:16.776671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:16.961461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:16.966459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:16.979599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:16.980498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:16.981142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:16.983294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:16.984055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:16.984780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:17.053732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:17.064201 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd6c46d2-7f00-4018-8c91-9a3a431369b6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.312899 Nov 02 21:45:17.068332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2244/4595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:16 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:17.472824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:17.487839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-301aa78d-7ccf-49e9-b4c2-c10976ede2aa tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1642 microversion: 2.1 time: 0.534152 Nov 02 21:45:17.489493 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2352/4596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:16 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1642 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:18.002025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0c52cdee-187c-442e-b8c7-048fd9cdc573 req-4a0abac2-55a4-4108-a658-6ba57502ec95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfd3f93b-93a6-40e1-9750-17bc48e44a13", "name": "network-vif-deleted", "tag": "b1e62496-b65e-44f0-81e7-f7375b04b0a5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:18.015668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0c52cdee-187c-442e-b8c7-048fd9cdc573 req-4a0abac2-55a4-4108-a658-6ba57502ec95 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:18.017217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0c52cdee-187c-442e-b8c7-048fd9cdc573 req-4a0abac2-55a4-4108-a658-6ba57502ec95 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:18.017217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0c52cdee-187c-442e-b8c7-048fd9cdc573 req-4a0abac2-55a4-4108-a658-6ba57502ec95 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:18.028653 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0c52cdee-187c-442e-b8c7-048fd9cdc573 req-4a0abac2-55a4-4108-a658-6ba57502ec95 service nova] Creating event network-vif-deleted:b1e62496-b65e-44f0-81e7-f7375b04b0a5 for instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 on n-h2-860863-4 Nov 02 21:45:18.034641 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0c52cdee-187c-442e-b8c7-048fd9cdc573 req-4a0abac2-55a4-4108-a658-6ba57502ec95 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036560 Nov 02 21:45:18.036450 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2245/4597] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:18.091645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:18.092576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:18.105891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:18.109193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:18.111491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:18.112373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:18.114221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:18.115313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:18.472310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:18.497392 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-989f3f04-73c5-4539-837c-c6bf8627a401 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.409580 Nov 02 21:45:18.500159 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2353/4598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:18 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:18.515205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:18.516091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:18.527781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:18.531024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:18.531858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:18.533989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:18.539697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:18.544520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:18.633877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:18.633877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:18.633877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:18.635271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lazy-loading 'fault' on Instance uuid cfd3f93b-93a6-40e1-9750-17bc48e44a13 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:45:18.717677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2fd8798cdc74b2b885174cfea7621b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7bc05bd7cb041fabf4caa2635a2275f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:18.740368 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fbb6ca66-1b5c-4095-86a9-aeeb01e0ba50 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 200 len: 1305 microversion: 2.1 time: 0.230041 Nov 02 21:45:18.741309 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2246/4599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:18 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:19.534549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:19.536554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:19.544855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:19.545370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:19.545988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:19.546873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:19.547475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:19.548051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:19.741007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:19.750328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9aba683f-d9ee-4797-b4f5-0e5efa4face4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.219753 Nov 02 21:45:19.751310 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2354/4600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:19 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:19.769650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:19.769650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] [instance: cfd3f93b-93a6-40e1-9750-17bc48e44a13] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:19.781452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:19.782120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:19.782740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:19.783603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:19.784750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:19.786616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:19.812823 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] HTTP exception thrown: Instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 could not be found. Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Request method failure captured: Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 HTTP/1.1 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSdrZQllLFUA8IE2d5VNPTMPkUF4b2_fmAzU0lLendCASflermDfgVAbNl2OoaHXflrc7zIx9JxdaerVpS8N4bIokCtJ30Ml4_xKbQDnExMT-bhdQ0V5AjzNKAn70SD3B21moy18UNsEqzoaVFKjuSAaYvhEGOsHngrCEEIt6qIyVM Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7bc05bd7cb041fabf4caa2635a2275f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a7bc05bd7cb041fabf4caa2635a2275f Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1990336673 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: e2fd8798cdc74b2b885174cfea7621b6 Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-SecurityGroupsTestJSON-1990336673-project Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 could not be found. Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'cfd3f93b-93a6-40e1-9750-17bc48e44a13'} Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 could not be found. Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 could not be found. Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:45:19.826849 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:19.831599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:45:19.831599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:45:19.831599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:45:19.831599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:45:19.831599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:45:19.831599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 could not be found. Nov 02 21:45:19.831599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:45:19.833418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Returning 404 to user: Instance cfd3f93b-93a6-40e1-9750-17bc48e44a13 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:45:19.834473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-90861e8a-4dd6-40ea-b25a-c58c7487cfc5 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13" status: 404 len: 111 microversion: 2.1 time: 0.072114 Nov 02 21:45:19.835355 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2247/4601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:19 2022] GET /compute/v2.1/servers/cfd3f93b-93a6-40e1-9750-17bc48e44a13 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:45:19.843396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56edf0b1-6a29-465e-84fe-e2026d202b54 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b685f58b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:20.225698 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56edf0b1-6a29-465e-84fe-e2026d202b54 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/c0ae874b-6cdc-4deb-9a95-bb9de1e2c670" status: 202 len: 0 microversion: 2.1 time: 0.386030 Nov 02 21:45:20.227232 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2355/4602] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:19 2022] DELETE /compute/v2.1/os-security-groups/c0ae874b-6cdc-4deb-9a95-bb9de1e2c670 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:45:20.234694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db59f78c-b503-4adf-80b1-4f964e12a8f1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] Calling method '.version_select at 0x7f9b6d1e5af0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:20.568799 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db59f78c-b503-4adf-80b1-4f964e12a8f1 tempest-SecurityGroupsTestJSON-1990336673 tempest-SecurityGroupsTestJSON-1990336673-project] 10.222.0.25 "DELETE /compute/v2.1/os-security-groups/357f2e0e-45dd-45ac-b01c-b8153676fd8c" status: 202 len: 0 microversion: 2.1 time: 0.337012 Nov 02 21:45:20.571558 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2248/4603] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 21:45:20 2022] DELETE /compute/v2.1/os-security-groups/357f2e0e-45dd-45ac-b01c-b8153676fd8c => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:45:20.777520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:20.778742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:20.794679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:20.797787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:20.800053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:20.804596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:20.807287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:20.808032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:21.149462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:21.161605 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7385918b-5050-4ba5-bfd0-d9878744ef85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.389640 Nov 02 21:45:21.165696 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2356/4604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:20 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:22.194185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:22.194185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:22.203314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:22.213001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:22.214229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:22.216650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:22.220221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:22.222454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:22.297092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:22.458184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:22.465767 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dee62402-5d4e-45e0-9711-3d5daadf4f32 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.279562 Nov 02 21:45:22.487419 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2249/4605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:22 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:23.492583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:23.493951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:23.506216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:23.507146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:23.507813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:23.508704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:23.511522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:23.513479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:24.367212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:24.375711 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-076a96c0-cf53-4dac-b2bc-163f431fcf0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.888441 Nov 02 21:45:24.376287 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2357/4606] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:23 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:25.412211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:25.413729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:25.460443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:25.461657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:25.466074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:25.467505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:25.469015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:25.478714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:25.970211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:25.992320 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-021ab003-ad68-4469-a127-fa57a99dbcd9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.590214 Nov 02 21:45:25.995651 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2250/4607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:25 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:27.021172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:27.022604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:27.042794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:27.045033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:27.048573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:27.048573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:27.048573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:27.048573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:27.582970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:27.592892 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b618a55-27d2-4d4b-8c20-7b7aa2644b98 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.575415 Nov 02 21:45:27.594117 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2358/4608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:27 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:28.618515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:28.619209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:28.654855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:28.660443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:28.660443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:28.670578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:28.672382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:28.674701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:28.800308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:28.803930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:28.837791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:28.840136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:28.841568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:28.843435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:28.844890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:28.845803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:28.993172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lazy-loading 'flavor' on Instance uuid 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:45:29.211331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:29.231134 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2a3dc9c-117b-46cf-a1d4-b7e86e05251f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.617983 Nov 02 21:45:29.235048 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2251/4609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:28 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:29.285056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:29.569112 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-825e90b8-2594-40ee-8ea7-862e78655d69 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/action" status: 200 len: 32 microversion: 2.1 time: 0.776252 Nov 02 21:45:29.570049 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2359/4610] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:45:28 2022] POST /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/action => generated 32 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:45:29.579825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:29.580457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:29.592610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:29.593139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:29.593584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:29.594289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:29.594737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:29.595439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:29.827201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:29.840901 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aac21599-a977-46e3-b6db-d7f8e6a0ee0d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.263549 Nov 02 21:45:29.841328 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2252/4611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:29 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:30.275417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:30.286007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:30.307119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:30.307119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:30.307119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:30.307119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:30.307119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:30.307119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:30.653360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:30.665236 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e260bbf5-4031-4643-ac31-dd579a410861 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.402956 Nov 02 21:45:30.673441 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2360/4612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:30 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:30.867168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:30.867168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:30.879874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:30.880373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:30.890605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:30.891515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:30.892007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:30.892465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:31.562121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:31.583134 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab9e8588-fd8c-4733-b0c5-9aa461261b70 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.721165 Nov 02 21:45:31.586162 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2253/4613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:30 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:31.688507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:31.689188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:31.705646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:31.709198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:31.710639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:31.714868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:31.717786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:31.719283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:32.193210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:32.195581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:32.196351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:32.196901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:32.199747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:32.200548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:32.202075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:32.225358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:32.242155 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-afe19b58-c8ea-4d38-850f-6bc83d0b4780 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.559374 Nov 02 21:45:32.242771 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2361/4614] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:31 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:32.301711 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f82e16ef-af33-4571-be70-dce2c0616dd8 tempest-AZV2TestJSON-388503085 tempest-AZV2TestJSON-388503085-project] 10.222.0.25 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.429678 Nov 02 21:45:32.302337 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2254/4615] 10.222.0.25 () {58 vars in 1164 bytes} [Wed Nov 2 21:45:31 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:45:32.612550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:32.614037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:32.617254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:32.627218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:32.627984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:32.629070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:32.632018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:32.632993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:32.633462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:32.913365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:32.924890 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cb93e67-bce1-46db-baa9-11ae73c215a2 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.317249 Nov 02 21:45:32.927160 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2362/4616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:32 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:33.267245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:33.267848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:33.271612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=62 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:33.285745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:33.299086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:33.299086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:33.299086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:33.299086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:33.299086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:33.955922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:33.957880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:33.968123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:33.978677 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c3fbfdb-e356-4306-a378-970428682590 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.715466 Nov 02 21:45:33.979675 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2255/4617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:33 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:34.009780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:34.010535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:34.011319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:34.016136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:34.024052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:34.026291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:34.921325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:34.934485 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-585f9ca9-7464-4bbb-a96a-df026a9bfb92 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.986475 Nov 02 21:45:34.935371 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2363/4618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:33 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:35.013049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:35.014095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:35.023827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:35.024635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:35.025258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:35.026858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:35.027406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:35.027914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:35.451134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:35.461254 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df0a258d-6f46-4920-8a66-0539d288785d tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.453019 Nov 02 21:45:35.462400 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2256/4619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:35 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:35.959215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:35.963865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:35.973463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:35.974602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:35.976250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:35.979473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:35.980284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:35.980994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:36.219382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:36.284944 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08811918-8873-4fd7-b8a2-26a1b57abf63 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.329991 Nov 02 21:45:36.298876 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2364/4620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:35 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:36.488014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:36.489426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:36.497571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:36.498380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:36.499087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:36.500027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:36.507086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:36.507936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:36.827891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:36.836742 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-46ab2af6-c62a-47f7-898d-42e8269c36d9 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.355124 Nov 02 21:45:36.837675 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2257/4621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:36 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:37.320235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:37.320870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:37.341382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:37.342325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:37.343844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:37.344912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:37.348857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:37.349652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:37.867492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:37.868695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:37.878927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:37.880146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:37.880611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:37.881375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:37.881844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:37.882284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:38.237024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:38.272111 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1264a24a-c0a5-4ede-a2e4-271169274372 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.957180 Nov 02 21:45:38.273421 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2365/4622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:37 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:38.575042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:38.583717 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a69a1103-93aa-4b56-9e5d-aea8f57a647b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.726017 Nov 02 21:45:38.593748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2258/4623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:37 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:39.299934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:39.302186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:39.323200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:39.330075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:39.334386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:39.334386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:39.335359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:39.336080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:39.621165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:39.621165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:39.649603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:39.655773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:39.655773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:39.655773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:39.660920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:39.661877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:40.255124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:40.269632 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2273470-89c8-4823-a971-d3f86b53dd57 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1515 microversion: 2.1 time: 0.655056 Nov 02 21:45:40.275461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:40.280403 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2259/4624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:39 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1515 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:40.291420 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f477bbc-a4ee-4f7f-b759-867ba1b27a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.994240 Nov 02 21:45:40.299342 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2366/4625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:39 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:41.321741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:41.323434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:41.323560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:41.324287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:41.340268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:41.340762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:41.348314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:41.349036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:41.350098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:41.350625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:41.351562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:41.353861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:41.354556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:41.358625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:41.359484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:41.362205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:41.881911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:41.902483 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3eaf761-8d05-4af3-a5cb-29b6b9b9e900 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.590504 Nov 02 21:45:41.903013 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2367/4626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:41 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:41.939114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:41.947163 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47773c30-6561-4fef-b08d-b95bd45cd579 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1521 microversion: 2.1 time: 0.643546 Nov 02 21:45:41.952872 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2260/4627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:41 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1521 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:42.927625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:42.928257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:42.945930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:42.945930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:42.945930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:42.946376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:42.946511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:42.946946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:42.980172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:42.980793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:42.982787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:42.995101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:42.995611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:42.996111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:42.996825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:42.997357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:42.997839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:43.267719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:43.276896 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8cdd7ff-395b-4ffb-96c7-11b7a62d98bd tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.354772 Nov 02 21:45:43.283727 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2368/4628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:42 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:43.541594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:43.550653 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2b7445a-4ba3-4fde-b5f3-b0f629ac70dd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1521 microversion: 2.1 time: 0.574322 Nov 02 21:45:43.555709 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2261/4629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:42 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:44.308594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:44.316852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:44.320678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:44.321782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:44.322852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:44.324083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:44.324557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:44.325012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:44.402324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8ba9c49f-8d1e-4702-bedd-151fc7341463 req-d06b9104-3e72-4918-9211-75be4c46b7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ea44e1-eb31-4dde-8e15-de4306c89cc5", "name": "network-vif-unplugged", "status": "completed", "tag": "21daa7f7-8b82-4acb-be39-b1131920894b"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:44.442733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8ba9c49f-8d1e-4702-bedd-151fc7341463 req-d06b9104-3e72-4918-9211-75be4c46b7ea service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:44.442977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8ba9c49f-8d1e-4702-bedd-151fc7341463 req-d06b9104-3e72-4918-9211-75be4c46b7ea service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:44.443331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8ba9c49f-8d1e-4702-bedd-151fc7341463 req-d06b9104-3e72-4918-9211-75be4c46b7ea service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:44.479004 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8ba9c49f-8d1e-4702-bedd-151fc7341463 req-d06b9104-3e72-4918-9211-75be4c46b7ea service nova] Creating event network-vif-unplugged:21daa7f7-8b82-4acb-be39-b1131920894b for instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 on n-h2-860863-4 Nov 02 21:45:44.490300 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8ba9c49f-8d1e-4702-bedd-151fc7341463 req-d06b9104-3e72-4918-9211-75be4c46b7ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096696 Nov 02 21:45:44.491655 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2262/4630] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:44.531436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:44.542368 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ecfbd1d-d9a0-43cc-9887-550241791978 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.237512 Nov 02 21:45:44.561811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2369/4631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:44 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:44.580618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:44.581365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:44.611395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:44.611970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:44.612489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:44.614767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:44.617186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:44.620214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:44.926265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:44.934533 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a8f7d7ce-3dd1-4fa5-b0a1-c61b00376f8e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1521 microversion: 2.1 time: 0.359207 Nov 02 21:45:44.935501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2263/4632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:44 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:45.573622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:45.574318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:45.608825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:45.610523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:45.621366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:45.625533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:45.627713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:45.628336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:45.967392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:45.968181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:45.990600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:45.991802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:45.993011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:46.000758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:46.000758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:46.000758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:46.060735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:46.084211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-879a7b19-78e9-4c21-aef6-880c7f5970cf tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.513411 Nov 02 21:45:46.085588 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2370/4633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:45 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:46.232633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:46.244302 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-041aa6f7-c488-487c-b523-6adcf432d27e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1521 microversion: 2.1 time: 0.287509 Nov 02 21:45:46.245616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2264/4634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:45 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:47.116238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:47.117481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:47.131830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:47.142619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:47.142619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:47.142619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:47.142619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:47.142619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:47.272891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:47.273573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:47.290908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:47.306085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:47.310347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:47.311855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:47.313333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:47.314660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:47.537699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:47.544173 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ca64abe-ab22-4065-b6f2-e1e4023d2d3b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.440153 Nov 02 21:45:47.560226 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2371/4635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:47 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:47.638555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:47.650213 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a5c6b568-e494-4e4e-8a9a-5c3d08d1ccd4 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1521 microversion: 2.1 time: 0.384928 Nov 02 21:45:47.655024 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2265/4636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:47 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:48.573033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:48.573673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:48.590083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:48.590578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:48.591303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:48.592011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:48.593113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:48.593563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:48.676369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:48.677021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:48.698143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:48.698143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:48.698143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:48.698143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:48.698143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:48.698641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:49.092331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:49.108506 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b1eb36d5-c58e-4bda-9c41-f713ac615089 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1521 microversion: 2.1 time: 0.436621 Nov 02 21:45:49.109265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:49.124968 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2266/4637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:48 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:49.141027 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9080a2a4-4c66-4aa1-b5bd-015ee3015a60 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.570539 Nov 02 21:45:49.146091 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2372/4638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:48 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:49.182074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6f429d1c-cc27-4d61-88e1-b3000daa0a17 req-174b4d11-c2e3-499c-988c-120847e432b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ea44e1-eb31-4dde-8e15-de4306c89cc5", "name": "network-vif-plugged", "status": "completed", "tag": "21daa7f7-8b82-4acb-be39-b1131920894b"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:49.215594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6f429d1c-cc27-4d61-88e1-b3000daa0a17 req-174b4d11-c2e3-499c-988c-120847e432b3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:49.216386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6f429d1c-cc27-4d61-88e1-b3000daa0a17 req-174b4d11-c2e3-499c-988c-120847e432b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:49.217993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6f429d1c-cc27-4d61-88e1-b3000daa0a17 req-174b4d11-c2e3-499c-988c-120847e432b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:49.254940 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6f429d1c-cc27-4d61-88e1-b3000daa0a17 req-174b4d11-c2e3-499c-988c-120847e432b3 service nova] Creating event network-vif-plugged:21daa7f7-8b82-4acb-be39-b1131920894b for instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 on n-h2-860863-4 Nov 02 21:45:49.260329 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6f429d1c-cc27-4d61-88e1-b3000daa0a17 req-174b4d11-c2e3-499c-988c-120847e432b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083442 Nov 02 21:45:49.265765 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2267/4639] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:45:49.406704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1938327192", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "ecb4109d-be01-4f35-b745-ad97e41f4a36"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2030389578", "security_groups": []}, "os:scheduler_hints": {"different_host": ["7cd8e12b-7667-4b6f-bfc2-c6903758e0a5"]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:49.505703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] validate_networks() for [('ecb4109d-be01-4f35-b745-ad97e41f4a36', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:45:50.136354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:50.137588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:50.154739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:50.155525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:50.156122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:50.157031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:50.157699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:50.158986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:50.271107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:50.916220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:45:50.917468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:45:50.923028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:45:50.923754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:45:50.924414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:45:50.950160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:50.951307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:50.952232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:50.954113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:50.993383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:50.996983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:51.014993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:51.041598 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a15f037-0f81-461b-aa2c-339f9874c4b1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1521 microversion: 2.1 time: 0.903550 Nov 02 21:45:51.048815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2268/4640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:50 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1521 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:51.090892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:51.098759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:51.122831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:51.127640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:51.133409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:51.135420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Getting quotas for project d7badcd8061841fda3c5974d4ff5e2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:45:51.136891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:51.137972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:51.140187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:51.157055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Getting quotas for user b05a329a613041f780874384b4fcf5dc and project d7badcd8061841fda3c5974d4ff5e2c0. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:45:51.216751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:45:51.216751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:45:51.424656 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bae7657-9241-411f-a7bd-2ee913a0af9e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.022374 Nov 02 21:45:51.426275 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2373/4641] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:45:49 2022] POST /compute/v2.1/servers => generated 361 bytes in 2025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:45:51.724381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:51.757191 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f92702f3-bf02-40b0-8981-c4611b5df932 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.703095 Nov 02 21:45:51.762119 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2269/4642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:51 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:51.783614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1088469385", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "c9b8aa64-161c-442b-9105-220ff13512a1"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:51.791408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62c66a82-cc26-4d1f-af46-30395b71b5f3 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:51.792031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62c66a82-cc26-4d1f-af46-30395b71b5f3 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:51.892062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] validate_networks() for [('c9b8aa64-161c-442b-9105-220ff13512a1', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:45:52.010654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-62c66a82-cc26-4d1f-af46-30395b71b5f3 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:52.025650 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62c66a82-cc26-4d1f-af46-30395b71b5f3 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1242 microversion: 2.1 time: 0.260684 Nov 02 21:45:52.028295 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2270/4643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:51 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:52.073456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:52.074892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:52.086829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:52.087591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:52.091697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:52.092741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:52.093513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:52.094123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:52.569102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:52.580716 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e710c54-6723-4ad9-be22-365caa5560af tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1506 microversion: 2.1 time: 0.514573 Nov 02 21:45:52.595826 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2271/4644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:52 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:52.607724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:52.610054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:52.620787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:52.624961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:52.625455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:52.626979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:52.627655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:52.628105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:53.368245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:45:53.368741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:45:53.370818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:45:53.371643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:45:53.372262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:45:53.391241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:53.393505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:53.399058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:53.400733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:53.401260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:53.401706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:53.471304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Getting quotas for project 74f2e3b11ecd425e942701fab82dba02. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:45:53.484591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Getting quotas for user f34842288b784bf796fa2c37e8364712 and project 74f2e3b11ecd425e942701fab82dba02. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:45:53.498906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:53.516485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:45:53.521908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:45:53.523877 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-17ae85c4-627d-478d-b17d-bcc0357179e6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 200 len: 1506 microversion: 2.1 time: 0.915468 Nov 02 21:45:53.529667 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2272/4645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:52 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 1506 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:45:53.547737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:53.549670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:53.566850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:53.572159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:53.572159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:53.572159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:53.573546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:53.575306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:53.716225 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2ec47ee-e61c-43c8-8006-d6607fec3c4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.281888 Nov 02 21:45:53.726177 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2374/4646] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:45:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:45:53.763534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:53.764334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:53.792964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:53.803770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:53.804232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:53.805018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:53.805482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:53.805913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:54.182330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:54.193946 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bd0acc3-0d55-465f-acda-5556941742d9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1238 microversion: 2.1 time: 0.444901 Nov 02 21:45:54.194678 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2375/4647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:53 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1238 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:54.231650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:54.235059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:54.267479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:54.268067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:54.268526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:54.269868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:54.270544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:54.270974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:54.355782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:54.374290 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ced92042-1aa1-44f0-9942-ea67cce8bb65 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 0.842648 Nov 02 21:45:54.375162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:45:54.379171 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2273/4648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:53 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:54.391651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-976173701", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "c9b8aa64-161c-442b-9105-220ff13512a1"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:54.457910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:45:54.514802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] validate_networks() for [('c9b8aa64-161c-442b-9105-220ff13512a1', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:45:54.902778 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39d5bd39-0119-4dd5-8587-9ab3efa7e591 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 204 len: 0 microversion: 2.1 time: 0.689409 Nov 02 21:45:54.903455 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2376/4649] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:45:54 2022] DELETE /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:45:55.159712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1570104037", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "65a94947-f991-4865-86d5-a3465290d583"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:55.300036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] validate_networks() for [('65a94947-f991-4865-86d5-a3465290d583', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:45:56.234780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:45:56.240298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:45:56.241390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:45:56.242109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:45:56.244557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:45:56.260990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:56.262079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:56.262940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:56.263857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:56.266698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:56.278743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:56.319687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Getting quotas for project 74f2e3b11ecd425e942701fab82dba02. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:45:56.329685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Getting quotas for user f34842288b784bf796fa2c37e8364712 and project 74f2e3b11ecd425e942701fab82dba02. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:45:56.355524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:45:56.358445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:45:56.609565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-28265d27-75a3-4740-998f-12c1727cf6ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.228805 Nov 02 21:45:56.610229 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2274/4650] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:45:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:45:56.630104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:56.632205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:56.654298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:56.660267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:56.660267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:56.661874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:56.664656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:56.666089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:57.068236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:57.079555 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-280b0bda-ddd2-4772-ad35-e653b69370e0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1312 microversion: 2.1 time: 0.467092 Nov 02 21:45:57.085509 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2275/4651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:56 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1312 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:57.102410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:57.103493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:57.133260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:57.136015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:57.140423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:57.141786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:57.144425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:57.145087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:58.521605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:58.537876 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-071009a0-7fcc-4242-863b-1ad766b943e4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 1.444180 Nov 02 21:45:58.541321 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2276/4652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:57 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:58.566955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1788041288", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "451", "networks": [{"uuid": "c9b8aa64-161c-442b-9105-220ff13512a1"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:45:58.700339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] validate_networks() for [('c9b8aa64-161c-442b-9105-220ff13512a1', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:45:58.812774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:45:58.813543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:45:58.814717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:45:58.816019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:45:58.816725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:45:58.857493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:58.857997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:58.858444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:58.859180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:58.859636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:58.860069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:58.931109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Getting quotas for project 5191bf0c1e3e446c9c2e6e47cea461e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:45:58.962510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Getting quotas for user c200d64c4ebb4f9dafe6e35daac13a39 and project 5191bf0c1e3e446c9c2e6e47cea461e1. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:45:59.011480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:45:59.015056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:45:59.195134 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b62abde2-1dfe-4458-93fb-a8403ec5c32e tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.040501 Nov 02 21:45:59.198293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2377/4653] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:45:59.215164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:59.218599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:45:59.245463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:59.245463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:59.245463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:59.245463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:45:59.245463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:45:59.245463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:45:59.823927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:45:59.833763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-de1eee42-7488-4341-babd-e2e44f065620 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.634320 Nov 02 21:45:59.839755 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2378/4654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:59 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:45:59.854244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b7feba6-62ec-4995-a33f-282ccffe1792 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:45:59.861610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b7feba6-62ec-4995-a33f-282ccffe1792 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:00.024684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b7feba6-62ec-4995-a33f-282ccffe1792 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:00.049053 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b7feba6-62ec-4995-a33f-282ccffe1792 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1218 microversion: 2.1 time: 0.206538 Nov 02 21:46:00.062657 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2379/4655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:45:59 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:00.096298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:00.098561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:00.127612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:00.132403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:00.134304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:00.134304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:00.139062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:00.140251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:01.837327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:01.852387 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eef49b5e-6716-4f94-8a41-bad3bf21d6c4 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 1.788215 Nov 02 21:46:01.858161 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2380/4656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:00 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:01.870968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:01.872811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:01.890939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:01.891763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:01.892719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:01.893832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:01.895269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:01.896448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.278536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:02.306603 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3cde82b5-d342-4543-b7aa-fc8fe3a77467 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.444864 Nov 02 21:46:02.309338 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2381/4657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:01 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:02.323532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:02.324659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:02.352701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:02.354763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:02.355277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.356028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:02.356587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:02.359472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.509541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:46:02.510609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:46:02.511393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:46:02.512413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:46:02.513057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:46:02.543046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:02.543046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:02.543046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.543046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:02.543046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:02.543046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.552473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:02.569821 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e36d7bda-5650-417c-9c96-a01b87668e94 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1270 microversion: 2.1 time: 0.255915 Nov 02 21:46:02.571368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2382/4658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:02 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1270 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:02.595269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-79eb41f2-e933-465d-a7e5-f96caeaf711f req-eae3c4e6-3140-412d-93ad-55cdcdfd3573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ea44e1-eb31-4dde-8e15-de4306c89cc5", "name": "network-vif-deleted", "tag": "21daa7f7-8b82-4acb-be39-b1131920894b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:02.607985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Getting quotas for project 74f2e3b11ecd425e942701fab82dba02. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:46:02.629047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-79eb41f2-e933-465d-a7e5-f96caeaf711f req-eae3c4e6-3140-412d-93ad-55cdcdfd3573 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:02.629868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-79eb41f2-e933-465d-a7e5-f96caeaf711f req-eae3c4e6-3140-412d-93ad-55cdcdfd3573 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:02.630765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-79eb41f2-e933-465d-a7e5-f96caeaf711f req-eae3c4e6-3140-412d-93ad-55cdcdfd3573 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.637459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Getting quotas for user f34842288b784bf796fa2c37e8364712 and project 74f2e3b11ecd425e942701fab82dba02. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:46:02.656525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:46:02.661864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:46:02.666524 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-79eb41f2-e933-465d-a7e5-f96caeaf711f req-eae3c4e6-3140-412d-93ad-55cdcdfd3573 service nova] Creating event network-vif-deleted:21daa7f7-8b82-4acb-be39-b1131920894b for instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 on n-h2-860863-4 Nov 02 21:46:02.679038 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-79eb41f2-e933-465d-a7e5-f96caeaf711f req-eae3c4e6-3140-412d-93ad-55cdcdfd3573 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106082 Nov 02 21:46:02.682919 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2383/4659] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:02.886306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:02.887930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:02.932906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:02.933823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:02.935435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.936380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:02.953270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:02.956189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:02.967255 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c994608-07ce-4cd4-a3b5-422efef86b5a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.422729 Nov 02 21:46:02.969617 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2277/4660] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:46:02.983896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d336d27-4648-418f-8017-3a6f82286264 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:02.985328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3d336d27-4648-418f-8017-3a6f82286264 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:03.258519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3d336d27-4648-418f-8017-3a6f82286264 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:03.267115 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d336d27-4648-418f-8017-3a6f82286264 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1221 microversion: 2.1 time: 0.288747 Nov 02 21:46:03.294992 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2278/4661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:02 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1221 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:03.343185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:03.344452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:03.370017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:03.370835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:03.372375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:03.373159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:03.373626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:03.376041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:03.729427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:03.751334 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-240395d3-d372-4a1a-9699-0ee9d855c716 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.415186 Nov 02 21:46:03.751993 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2279/4662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:03 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:03.768597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:03.769589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:03.776066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:03.796381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:03.796881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:03.797350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:03.798096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:03.798519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:03.798946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:04.213176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:04.223322 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffb218e3-0f33-4bba-a621-8ac564daed38 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1734 microversion: 2.1 time: 1.341483 Nov 02 21:46:04.231487 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2384/4663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:02 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1734 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:04.298371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7638fd48-06b1-40b9-aa20-def4ac229ed0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:04.298998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7638fd48-06b1-40b9-aa20-def4ac229ed0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:04.332557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:04.380294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:04.390879 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89deec0f-5b4e-4cdf-8443-481e3fc3b382 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1288 microversion: 2.1 time: 0.637515 Nov 02 21:46:04.404267 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2280/4664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:03 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1288 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:04.729695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7638fd48-06b1-40b9-aa20-def4ac229ed0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:04.738532 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7638fd48-06b1-40b9-aa20-def4ac229ed0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1221 microversion: 2.1 time: 0.444090 Nov 02 21:46:04.741667 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2385/4665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:04 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1221 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:04.780313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:04.780999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:04.789843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:04.792912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:04.792912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:04.792912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:04.792912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:04.792912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:05.037502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:05.056107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-35bc9745-3ec6-4091-b8d3-83d09a750d3d tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.280987 Nov 02 21:46:05.057068 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2281/4666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:04 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:05.256585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:05.257261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:05.282329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:05.282706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:05.283151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:05.283869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:05.284331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:05.284816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:05.428531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:05.429402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:05.449905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:05.456254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:05.460775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:05.460775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:05.460775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:05.460775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:05.913452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:05.922407 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f33bafa3-091d-4ac7-b550-8f32595589f1 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1276 microversion: 2.1 time: 0.498532 Nov 02 21:46:05.923000 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2282/4667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:05 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1276 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:05.958333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:05.961659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:05.992565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:06.015457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:06.020821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:06.029811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:06.030316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:06.030814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:06.390083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:06.403214 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42330c34-a06f-417b-b509-a36d49e7dd10 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1273 microversion: 2.1 time: 0.465365 Nov 02 21:46:06.407660 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2283/4668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:05 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1273 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:06.430929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:06.436517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:06.449027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:06.449445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:06.449895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:06.450622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:06.451081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:06.451514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:07.550592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:07.566477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b854ed1-ffd1-4a95-88ac-afb470a217f7 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1714 microversion: 2.1 time: 2.313832 Nov 02 21:46:07.572595 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2386/4669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:05 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1714 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:07.588720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:07.604259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:07.642595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:07.643145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:07.645306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:07.653083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:07.654066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:07.656420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.230939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:08.239311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a5eb6d9-f608-43c9-8faf-8ea8be0702cc tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 1.830420 Nov 02 21:46:08.239909 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2284/4670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:06 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:08.254070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:08.254920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:08.268533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.269303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.269994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.270730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.271188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.281713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.312016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:08.332519 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ed2a437-b82e-4664-93ac-ed7c2dab3267 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1276 microversion: 2.1 time: 0.756054 Nov 02 21:46:08.335830 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2387/4671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:07 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1276 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:08.349820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:08.351167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:08.367302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.367803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.368458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.369406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.370185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.370786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.558794 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Cannot 'detach_volume' instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 while it is in vm_state rescued Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments/604d7bf9-ad4a-488e-bec5-03350c3b38e2 HTTP/1.1 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: exception: Cannot 'detach_volume' instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 while it is in vm_state rescued Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': '29976160-96b8-47c8-b3a9-cb8a1a3c3b02', 'id': '604d7bf9-ad4a-488e-bec5-03350c3b38e2'} Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 while it is in vm_state rescued Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:08.571054 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 while it is in vm_state rescued Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 409 to user: Cannot 'detach_volume' instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 while it is in vm_state rescued {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6f5b9fc-9a0a-4838-b427-188153ba7788 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments/604d7bf9-ad4a-488e-bec5-03350c3b38e2" status: 409 len: 152 microversion: 2.1 time: 0.239820 Nov 02 21:46:08.583158 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2388/4672] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:46:08 2022] DELETE /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments/604d7bf9-ad4a-488e-bec5-03350c3b38e2 => generated 152 bytes in 242 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:46:08.587242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-91b34e31-56d1-41bc-9427-d34cafc240da req-24af1ba4-9d11-4be2-ad25-7b7c798f8aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe3564db-cde7-43d0-87c8-fa12540f758e", "tag": "7b5a73b7-bb17-40d5-a90d-a32621a10c10"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:08.588044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:08.597177 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-378e121b-6b50-4a44-8655-568605d3fe50 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1279 microversion: 2.1 time: 0.355841 Nov 02 21:46:08.601695 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2285/4673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:08 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1279 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:08.613333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:08.614139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:08.622621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-91b34e31-56d1-41bc-9427-d34cafc240da req-24af1ba4-9d11-4be2-ad25-7b7c798f8aae service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.623464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-91b34e31-56d1-41bc-9427-d34cafc240da req-24af1ba4-9d11-4be2-ad25-7b7c798f8aae service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.625625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-91b34e31-56d1-41bc-9427-d34cafc240da req-24af1ba4-9d11-4be2-ad25-7b7c798f8aae service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.626640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.629669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.630397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.631324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.636280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.637034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.678250 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-91b34e31-56d1-41bc-9427-d34cafc240da req-24af1ba4-9d11-4be2-ad25-7b7c798f8aae service nova] Creating event network-changed:7b5a73b7-bb17-40d5-a90d-a32621a10c10 for instance fe3564db-cde7-43d0-87c8-fa12540f758e on n-h2-860863-4 Nov 02 21:46:08.690780 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-91b34e31-56d1-41bc-9427-d34cafc240da req-24af1ba4-9d11-4be2-ad25-7b7c798f8aae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111995 Nov 02 21:46:08.691987 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2389/4674] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:08.697516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1247395594", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "fac8e638-2840-4452-b928-3b46fff09560"}, {"uuid": "c9c59801-aaca-4c9f-8728-1a6fe593033d"}, {"uuid": "fac8e638-2840-4452-b928-3b46fff09560"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:08.759851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] validate_networks() for [('fac8e638-2840-4452-b928-3b46fff09560', None, None, None, None, None), ('c9c59801-aaca-4c9f-8728-1a6fe593033d', None, None, None, None, None), ('fac8e638-2840-4452-b928-3b46fff09560', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:46:08.903646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:08.921069 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1ea15fee-5bb1-4de4-a9bd-64a813e3600e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/action" status: 202 len: 0 microversion: 2.1 time: 0.312206 Nov 02 21:46:08.925223 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2286/4675] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:46:08 2022] POST /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:46:08.930572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:08.931277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:08.957439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.957703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.958157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:08.958876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:08.959338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:08.959770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:09.001123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:09.583988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:09.611547 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fefcb3f4-41c0-43f1-9f40-3807db2d59c3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1722 microversion: 2.1 time: 0.683661 Nov 02 21:46:09.621360 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2287/4676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:08 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1722 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:09.671792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:09.675185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:09.702819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:09.706269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:09.708138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:09.710490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:09.720014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:09.720854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:10.142230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:10.185577 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-60e24b08-fca3-4a72-8994-82e74e46edcf tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.563602 Nov 02 21:46:10.187519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2288/4677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:09 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:10.243836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:10.245735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:10.273886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:10.275094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:10.276972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:10.279237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:10.281091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:10.286055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:11.236505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:11.249500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c4e75f54-0da0-44b0-afbc-be60fc23f238 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 1.044008 Nov 02 21:46:11.267266 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2289/4678] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:10 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:11.275556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:11.278942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:11.287307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:11.288834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:11.289544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:11.290568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:11.291620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:11.292334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:11.498422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:11.510529 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-67ac1783-094c-465a-8105-e4ce8f193618 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1279 microversion: 2.1 time: 0.242017 Nov 02 21:46:11.511453 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2290/4679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:11 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:11.516287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:11.520820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:11.540720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:11.541341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:11.541700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:11.542438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:11.551818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:11.552807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:12.542553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:12.820746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:12.839590 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9be62d7-aff5-466a-8b6e-d775dddd8919 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1722 microversion: 2.1 time: 1.327049 Nov 02 21:46:12.840194 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2291/4680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:11 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1722 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:12.856043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:12.859276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:12.876379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:12.882029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:12.882970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:12.883707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:12.885422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:12.886979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:13.172406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:13.207441 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d6d40b4-648a-47fa-b372-025086daf876 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.363723 Nov 02 21:46:13.224586 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2292/4681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:12 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:13.241616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dfdc1771-8015-4128-9cb3-5836971d4d08 req-6ca1b9fa-7a01-4cb4-a6c5-14ed612579b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d038722-0e6f-4c00-9b7c-003408be38bc", "tag": "ec2d4c00-8e9c-4bf5-b1b5-a47d5106e80c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:13.265141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dfdc1771-8015-4128-9cb3-5836971d4d08 req-6ca1b9fa-7a01-4cb4-a6c5-14ed612579b8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:13.267844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dfdc1771-8015-4128-9cb3-5836971d4d08 req-6ca1b9fa-7a01-4cb4-a6c5-14ed612579b8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:13.268510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dfdc1771-8015-4128-9cb3-5836971d4d08 req-6ca1b9fa-7a01-4cb4-a6c5-14ed612579b8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:13.281973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=16 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:13.293589 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dfdc1771-8015-4128-9cb3-5836971d4d08 req-6ca1b9fa-7a01-4cb4-a6c5-14ed612579b8 service nova] Creating event network-changed:ec2d4c00-8e9c-4bf5-b1b5-a47d5106e80c for instance 1d038722-0e6f-4c00-9b7c-003408be38bc on n-h1-860863-4 Nov 02 21:46:13.312349 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dfdc1771-8015-4128-9cb3-5836971d4d08 req-6ca1b9fa-7a01-4cb4-a6c5-14ed612579b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081427 Nov 02 21:46:13.313822 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2293/4682] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:13.319858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:13.326157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:13.334461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:13.338905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:13.338905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:13.338905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:13.338905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:13.338905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.152769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:46:14.153992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:46:14.154933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:46:14.155658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:46:14.156321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:46:14.158447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:14.171763 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-204cd800-c030-4736-8cfc-557d80317991 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.852194 Nov 02 21:46:14.172605 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2294/4683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:13 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:14.181958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.183278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.184951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.186365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.186523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f0d46ac8-4ff1-4bac-9bdc-ef79611457e7 req-ed3bbde8-746e-4735-b8d5-7dfe98d0f2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff2642a-0376-4c88-8925-412a9b6248b4", "tag": "e8c5dc3b-4ff7-4d6c-9021-9c976db4c706"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:14.189783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.190466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.199087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f0d46ac8-4ff1-4bac-9bdc-ef79611457e7 req-ed3bbde8-746e-4735-b8d5-7dfe98d0f2ce service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.199921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f0d46ac8-4ff1-4bac-9bdc-ef79611457e7 req-ed3bbde8-746e-4735-b8d5-7dfe98d0f2ce service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.200622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f0d46ac8-4ff1-4bac-9bdc-ef79611457e7 req-ed3bbde8-746e-4735-b8d5-7dfe98d0f2ce service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.219059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f0d46ac8-4ff1-4bac-9bdc-ef79611457e7 req-ed3bbde8-746e-4735-b8d5-7dfe98d0f2ce service nova] Creating event network-changed:e8c5dc3b-4ff7-4d6c-9021-9c976db4c706 for instance aff2642a-0376-4c88-8925-412a9b6248b4 on n-h1-860863-4 Nov 02 21:46:14.224892 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f0d46ac8-4ff1-4bac-9bdc-ef79611457e7 req-ed3bbde8-746e-4735-b8d5-7dfe98d0f2ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049259 Nov 02 21:46:14.225383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Getting quotas for project f6de6b9842554c11a1e54fd084cfd316. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:46:14.225848 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2295/4684] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:14.231538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:14.232481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:14.233142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Getting quotas for user 8e67ab12debe4aba94cb5d0023931e2b and project f6de6b9842554c11a1e54fd084cfd316. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:46:14.239823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.240295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.240743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.241470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.242362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.246708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.256735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:46:14.259559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:46:14.412748 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-045f9049-9060-4edb-8815-e7bed4eebeb6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.719425 Nov 02 21:46:14.423860 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2390/4685] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:46:14.436321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:14.437269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:14.467419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.468079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.468628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.469600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.470169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.470708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.832845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:14.866842 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8681eeac-ae48-4646-8563-5dbb907ad67f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1321 microversion: 2.1 time: 0.639744 Nov 02 21:46:14.871090 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2296/4686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:14 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1321 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:14.881745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:14.882577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:14.896258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.905643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.906442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:14.910363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:14.913934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:14.915287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:15.303954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:15.320652 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9f1b3b6-0d50-4255-b515-306dfb31b607 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.441662 Nov 02 21:46:15.346196 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2297/4687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:14 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:15.346196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad466c46-697d-439e-9bbb-c05a8c982b1f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:15.346196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ad466c46-697d-439e-9bbb-c05a8c982b1f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:15.455719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:15.475996 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8997b1b7-8fdb-4e8f-9c15-b09cd00306a8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1728 microversion: 2.1 time: 1.043307 Nov 02 21:46:15.479756 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2391/4688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:14 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1728 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:15.496652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:15.497784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:15.515396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:15.519370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:15.522927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:15.523913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:15.524984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ad466c46-697d-439e-9bbb-c05a8c982b1f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:15.527095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:15.529172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:15.533039 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad466c46-697d-439e-9bbb-c05a8c982b1f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1213 microversion: 2.1 time: 0.194936 Nov 02 21:46:15.542365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2298/4689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:15 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:15.546990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:15.547600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:15.566072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:15.566706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:15.573950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:15.573950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:15.573950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:15.576009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:15.951587 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e383fb40-05af-4cb0-8c11-538d0b210395 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.407456 Nov 02 21:46:15.952466 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2299/4690] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:46:15 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-interface => generated 284 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:15.965932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:15.966688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:15.984782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:15.989933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:15.991737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:15.992755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:15.993544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:16.001931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:16.287267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:16.303557 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f11edae4-253c-41b3-b783-fed4ddd8a462 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.820938 Nov 02 21:46:16.307366 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2392/4691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:15 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:16.326825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1a2c2f76-a03e-4e96-9aca-f1334af6f725 req-e313728a-4825-48b9-98ee-75fc5c3acbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e161fbde-5a77-417a-9283-f372011e1b21", "tag": "c362d04f-f9b1-4d6c-a06f-9badf08ba6d7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:16.345354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1a2c2f76-a03e-4e96-9aca-f1334af6f725 req-e313728a-4825-48b9-98ee-75fc5c3acbfd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:16.345838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1a2c2f76-a03e-4e96-9aca-f1334af6f725 req-e313728a-4825-48b9-98ee-75fc5c3acbfd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:16.352903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1a2c2f76-a03e-4e96-9aca-f1334af6f725 req-e313728a-4825-48b9-98ee-75fc5c3acbfd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:16.388574 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1a2c2f76-a03e-4e96-9aca-f1334af6f725 req-e313728a-4825-48b9-98ee-75fc5c3acbfd service nova] Creating event network-changed:c362d04f-f9b1-4d6c-a06f-9badf08ba6d7 for instance e161fbde-5a77-417a-9283-f372011e1b21 on n-h1-860863-4 Nov 02 21:46:16.398957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1a2c2f76-a03e-4e96-9aca-f1334af6f725 req-e313728a-4825-48b9-98ee-75fc5c3acbfd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075239 Nov 02 21:46:16.400351 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2393/4692] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:16.406964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:16.408353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:16.418337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:16.419210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:16.419818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:16.421157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:16.421779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:16.422372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:16.745011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:16.754309 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee84d559-62f3-431b-8959-d1642a0ba82e tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.352118 Nov 02 21:46:16.757863 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2394/4693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:16 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:16.762925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:16.763721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:16.780041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:16.780542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:16.781212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:16.782089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:16.782750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:16.783042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:16.804980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:16.828169 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-612e6abd-ab26-4842-a1a9-ebd74b7dacab tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1321 microversion: 2.1 time: 0.863781 Nov 02 21:46:16.830648 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2300/4694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:15 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1321 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:16.939586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:16.948720 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b9d60fb5-52aa-477d-ad28-0891f6328c3b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1217 microversion: 2.1 time: 0.189600 Nov 02 21:46:16.953811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2395/4695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:16 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:17.041255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2e969d63-c000-4e46-922d-de88fdd64cf2 req-601709d3-5be7-4157-b4ae-89c09b07b238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3564db-cde7-43d0-87c8-fa12540f758e", "name": "network-vif-plugged", "status": "completed", "tag": "7b5a73b7-bb17-40d5-a90d-a32621a10c10"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:17.056372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2e969d63-c000-4e46-922d-de88fdd64cf2 req-601709d3-5be7-4157-b4ae-89c09b07b238 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:17.056869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2e969d63-c000-4e46-922d-de88fdd64cf2 req-601709d3-5be7-4157-b4ae-89c09b07b238 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:17.057548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2e969d63-c000-4e46-922d-de88fdd64cf2 req-601709d3-5be7-4157-b4ae-89c09b07b238 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:17.076188 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2e969d63-c000-4e46-922d-de88fdd64cf2 req-601709d3-5be7-4157-b4ae-89c09b07b238 service nova] Creating event network-vif-plugged:7b5a73b7-bb17-40d5-a90d-a32621a10c10 for instance fe3564db-cde7-43d0-87c8-fa12540f758e on n-h2-860863-4 Nov 02 21:46:17.083926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2e969d63-c000-4e46-922d-de88fdd64cf2 req-601709d3-5be7-4157-b4ae-89c09b07b238 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045345 Nov 02 21:46:17.085335 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2301/4696] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:17.334820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:17.334943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:17.342356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:17.343213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:17.343881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:17.344810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:17.345491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:17.346124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:17.783557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:17.785019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:17.791799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:17.792415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:17.793085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:17.793895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:17.794615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:17.795104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:18.106580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:18.133027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1eec4c7-9df1-4916-9f1a-47d3393d87b2 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1300 microversion: 2.1 time: 0.354889 Nov 02 21:46:18.133027 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2302/4697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:17 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1300 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:18.138337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:18.139227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:18.160612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:18.165828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:18.167105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:18.169139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:18.169829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:18.172420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:18.210053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:18.225677 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b81f6f0-eed3-486a-8641-deaf9289558b tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.895331 Nov 02 21:46:18.241844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2396/4698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:17 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:18.250489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:18.251278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:18.259561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:18.260316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:18.260921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:18.261834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:18.263286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:18.263910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:18.292139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:18.533784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:18.631003 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50090cb9-e2ef-4cac-92a3-c2334c2da36e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1265 microversion: 2.1 time: 0.387500 Nov 02 21:46:18.640543 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2397/4699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:18 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1265 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:18.668588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2c562da6-35c1-43f9-a5fa-f8900263144a req-619ef94c-3701-49ee-bf76-e86c9db7eeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f2e11-2c45-4125-a365-62130bcafcfe", "tag": "13aeb2a3-b0c6-44db-a3a6-f06169d5904a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:18.732191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2c562da6-35c1-43f9-a5fa-f8900263144a req-619ef94c-3701-49ee-bf76-e86c9db7eeef service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:18.733130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2c562da6-35c1-43f9-a5fa-f8900263144a req-619ef94c-3701-49ee-bf76-e86c9db7eeef service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:18.733980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2c562da6-35c1-43f9-a5fa-f8900263144a req-619ef94c-3701-49ee-bf76-e86c9db7eeef service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:18.752166 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2c562da6-35c1-43f9-a5fa-f8900263144a req-619ef94c-3701-49ee-bf76-e86c9db7eeef service nova] Creating event network-changed:13aeb2a3-b0c6-44db-a3a6-f06169d5904a for instance 690f2e11-2c45-4125-a365-62130bcafcfe on n-h2-860863-4 Nov 02 21:46:18.762910 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2c562da6-35c1-43f9-a5fa-f8900263144a req-619ef94c-3701-49ee-bf76-e86c9db7eeef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117614 Nov 02 21:46:18.764404 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2398/4700] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:18.785938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:18.794506 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c53261c-83b5-45ad-9884-54e0b70b2bcb tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1321 microversion: 2.1 time: 0.661476 Nov 02 21:46:18.795354 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2303/4701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:18 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:19.172921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:19.172921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:19.181093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:19.181817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:19.183635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:19.185922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:19.188744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:19.189515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:19.257695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:19.258745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:19.281928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:19.283803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:19.285009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:19.308545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:19.309835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:19.310440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:19.928471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:19.947132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e0ee9ea-f00f-4b20-b741-83f5041a19d8 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1473 microversion: 2.1 time: 0.785076 Nov 02 21:46:19.948835 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2399/4702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:19 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1473 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:19.956034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:19.958246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:19.971522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:19.973119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:19.979836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:19.979836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:19.979836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:19.979836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:20.092907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:20.103025 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11a29adc-bf12-4fd2-973a-059f69f75f9a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1271 microversion: 2.1 time: 0.152537 Nov 02 21:46:20.112239 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2400/4703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:19 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:20.122804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:20.123437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:20.142336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:20.142858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:20.144400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:20.145641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:20.146115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:20.146551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:20.209217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:20.220050 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ef661334-98e7-4c42-8f1e-e923fe61c234 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.968680 Nov 02 21:46:20.221373 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2304/4704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:19 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:20.227424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:20.228052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:20.248823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:20.250752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:20.250752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:20.251969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:20.252609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:20.253471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:20.480814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:20.490294 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0edeb937-5451-4b53-8b02-73e71f16706c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1321 microversion: 2.1 time: 0.376277 Nov 02 21:46:20.493675 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2401/4705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:20 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:20.511799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:20.536213 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-294fea54-1ceb-4e5b-b1b8-de1653915e94 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1473 microversion: 2.1 time: 0.312686 Nov 02 21:46:20.538815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2305/4706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:20 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1473 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:20.563498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:20.564302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:20.583744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:20.584579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:20.586401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:20.588686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:20.590197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:20.591989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:20.962668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1031467b-7c0b-4549-b193-16014daae9ca req-1bd2becf-0452-4f98-9b21-e6f4acfca4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29976160-96b8-47c8-b3a9-cb8a1a3c3b02", "tag": "81d55a8b-2bfb-4ba3-a0ab-7d78b300d809"}, {"name": "network-changed", "server_uuid": "29976160-96b8-47c8-b3a9-cb8a1a3c3b02", "tag": "81d55a8b-2bfb-4ba3-a0ab-7d78b300d809"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:20.984723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1031467b-7c0b-4549-b193-16014daae9ca req-1bd2becf-0452-4f98-9b21-e6f4acfca4c1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:20.985795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1031467b-7c0b-4549-b193-16014daae9ca req-1bd2becf-0452-4f98-9b21-e6f4acfca4c1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:20.989106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1031467b-7c0b-4549-b193-16014daae9ca req-1bd2becf-0452-4f98-9b21-e6f4acfca4c1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:21.014827 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1031467b-7c0b-4549-b193-16014daae9ca req-1bd2becf-0452-4f98-9b21-e6f4acfca4c1 service nova] Creating event network-changed:81d55a8b-2bfb-4ba3-a0ab-7d78b300d809 for instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 on n-h2-860863-4 Nov 02 21:46:21.016255 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1031467b-7c0b-4549-b193-16014daae9ca req-1bd2becf-0452-4f98-9b21-e6f4acfca4c1 service nova] Creating event network-changed:81d55a8b-2bfb-4ba3-a0ab-7d78b300d809 for instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 on n-h2-860863-4 Nov 02 21:46:21.035729 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1031467b-7c0b-4549-b193-16014daae9ca req-1bd2becf-0452-4f98-9b21-e6f4acfca4c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076472 Nov 02 21:46:21.037504 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2306/4707] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:21.127728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:21.129417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:21.149756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f08b9d1f-35fd-4608-a8f1-c0381141f4de tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1624 microversion: 2.1 time: 0.583367 Nov 02 21:46:21.161228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:21.161228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:21.161486 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2402/4708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:20 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1624 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:21.169271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:21.170289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:21.170851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:21.171310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:21.193205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:21.193942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:21.201854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:21.202347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:21.202788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:21.203497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:21.203947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:21.204375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:22.536529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:22.541425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:22.552204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-717e0927-e548-4f6c-98a8-84c7d7a563db tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1313 microversion: 2.1 time: 1.428936 Nov 02 21:46:22.588418 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2307/4709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:21 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1313 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:22.635417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:22.637189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:22.661555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:22.664272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:22.665239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:22.666624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:22.671440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:22.673580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:22.798561 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df38af21-fa47-4994-894a-f6a56a384b77 tempest-TestSecurityGroupsBasicOps-1471102498 tempest-TestSecurityGroupsBasicOps-1471102498-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1913 microversion: 2.1 time: 1.629934 Nov 02 21:46:22.802818 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2403/4710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:21 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1913 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:22.820617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-43e76bd1-374c-4e54-9005-59d2a31d710a req-6cd18c23-d7d7-449d-a46d-795bfe9f42bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d038722-0e6f-4c00-9b7c-003408be38bc", "name": "network-vif-plugged", "status": "completed", "tag": "ec2d4c00-8e9c-4bf5-b1b5-a47d5106e80c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:22.835035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-43e76bd1-374c-4e54-9005-59d2a31d710a req-6cd18c23-d7d7-449d-a46d-795bfe9f42bd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:22.835736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-43e76bd1-374c-4e54-9005-59d2a31d710a req-6cd18c23-d7d7-449d-a46d-795bfe9f42bd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:22.836330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-43e76bd1-374c-4e54-9005-59d2a31d710a req-6cd18c23-d7d7-449d-a46d-795bfe9f42bd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:22.850815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-43e76bd1-374c-4e54-9005-59d2a31d710a req-6cd18c23-d7d7-449d-a46d-795bfe9f42bd service nova] Creating event network-vif-plugged:ec2d4c00-8e9c-4bf5-b1b5-a47d5106e80c for instance 1d038722-0e6f-4c00-9b7c-003408be38bc on n-h1-860863-4 Nov 02 21:46:22.859928 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-43e76bd1-374c-4e54-9005-59d2a31d710a req-6cd18c23-d7d7-449d-a46d-795bfe9f42bd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055588 Nov 02 21:46:22.865214 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2404/4711] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:22.879471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:22.880486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:22.891753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:22.895633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:22.896304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:22.899008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:22.899663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:22.900459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:23.336859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:23.374992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fbab9f33-07d7-42f2-8c81-5371d0e3ae4a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.783851 Nov 02 21:46:23.379009 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2308/4712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:22 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:23.399678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:23.400745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:23.420265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:23.422361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:23.423176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:23.436726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:23.437969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:23.441116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:23.482180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:23.496888 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8cac2f2-98d6-41fc-bb22-3554b82b8e41 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1321 microversion: 2.1 time: 0.629605 Nov 02 21:46:23.498468 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2405/4713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:22 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:23.529390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:46:23.617974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:23.619527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:23.634202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:23.635005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:23.636898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:23.637845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:23.638863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:23.639556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:23.923714 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ea7b89f7-4387-4dfe-90a6-2126a19d286b tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 204 len: 0 microversion: 2.1 time: 0.542066 Nov 02 21:46:23.926631 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2309/4714] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:46:23 2022] DELETE /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:46:23.938312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:23.939297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:23.954650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:23.955459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:23.957837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:23.960141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:23.967339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:23.967339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:24.210716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:24.248497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=28 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:24.507821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:24.531545 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4588b753-e52b-4c03-a303-313a414bc6b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1334 microversion: 2.1 time: 0.914649 Nov 02 21:46:24.531545 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2406/4715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:23 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1334 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:24.533768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:24.536378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:24.537027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:24.553251 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d1963966-8c6f-4e52-89df-f82f54a18051 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1479 microversion: 2.1 time: 0.621067 Nov 02 21:46:24.555139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:24.556646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:24.558626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:24.559505 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2310/4716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:23 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1479 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:24.562407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:24.563125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:24.563762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:24.569809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:24.570692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:24.600415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:24.600922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:24.601418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:24.602130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:24.602594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:24.603024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:24.970363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:24.971045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:24.992115 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3dbea3d0-d5b5-4a78-b5f2-429d5763fa11 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.461721 Nov 02 21:46:24.993211 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2407/4717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:24 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:25.009226 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-230becc7-47f5-40c4-b633-838644616e9e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1321 microversion: 2.1 time: 0.448200 Nov 02 21:46:25.022263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2311/4718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:24 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:25.025331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fbb56a88-0797-4ad8-8016-80ec23d6bcfa req-bf949f9e-0cb3-4690-b551-afd009ac2ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f2e11-2c45-4125-a365-62130bcafcfe", "name": "network-vif-plugged", "status": "completed", "tag": "13aeb2a3-b0c6-44db-a3a6-f06169d5904a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:25.037056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fbb56a88-0797-4ad8-8016-80ec23d6bcfa req-bf949f9e-0cb3-4690-b551-afd009ac2ee1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:25.038050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fbb56a88-0797-4ad8-8016-80ec23d6bcfa req-bf949f9e-0cb3-4690-b551-afd009ac2ee1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:25.038497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fbb56a88-0797-4ad8-8016-80ec23d6bcfa req-bf949f9e-0cb3-4690-b551-afd009ac2ee1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:25.051884 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fbb56a88-0797-4ad8-8016-80ec23d6bcfa req-bf949f9e-0cb3-4690-b551-afd009ac2ee1 service nova] Creating event network-vif-plugged:13aeb2a3-b0c6-44db-a3a6-f06169d5904a for instance 690f2e11-2c45-4125-a365-62130bcafcfe on n-h2-860863-4 Nov 02 21:46:25.057974 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fbb56a88-0797-4ad8-8016-80ec23d6bcfa req-bf949f9e-0cb3-4690-b551-afd009ac2ee1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041589 Nov 02 21:46:25.058892 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2408/4719] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:25.559236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:25.561271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:25.566046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:25.580700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:25.581843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:25.591906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:25.592781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:25.595765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:25.596872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:25.597737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:25.598405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:25.601724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:25.605145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:25.605145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:25.605145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:25.605145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:25.605145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:25.845867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:25.861182 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c5d86794-7283-443c-bb12-e2064560a6a7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1479 microversion: 2.1 time: 0.276761 Nov 02 21:46:25.862997 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2409/4720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:25 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1479 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:25.960088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:25.971008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3794479a-a3f8-4e14-8d44-db41d76e1be3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1334 microversion: 2.1 time: 0.417479 Nov 02 21:46:26.008202 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2312/4721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:25 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1334 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:26.022287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:26.023572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:26.033321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:26.033321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:26.033321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:26.033321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:26.033718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:26.034696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:26.045804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:26.046428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:26.053738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:26.054397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:26.054844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:26.055761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:26.056379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:26.056993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:26.328174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:26.335255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:26.338378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe89e0dc-e16d-4ed0-ba2f-adc28890dfae tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1321 microversion: 2.1 time: 0.298602 Nov 02 21:46:26.343956 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c373a0f0-87fc-4fcb-8db6-8fd004b99bb6 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.326666 Nov 02 21:46:26.360975 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2410/4723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:26 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:26.361432 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2313/4723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:26 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:26.887058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:26.887058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:26.896182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:26.897340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:26.898142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:26.899316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:26.900000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:26.900756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:26.995793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:26.996442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:27.010304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:27.011586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:27.011972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:27.016507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:27.021078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:27.021790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:27.077462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:27.102405 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a05dd69b-018a-42ea-81cb-857353a542d7 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1479 microversion: 2.1 time: 0.219275 Nov 02 21:46:27.106313 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2411/4724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:26 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1479 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:27.121047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ab19d98f-b7eb-4ed0-ab82-e96ecbc1dcb5 req-934ffd7d-1973-4eff-89c1-23b8a0690ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e161fbde-5a77-417a-9283-f372011e1b21", "name": "network-vif-plugged", "status": "completed", "tag": "c362d04f-f9b1-4d6c-a06f-9badf08ba6d7"}, {"server_uuid": "aff2642a-0376-4c88-8925-412a9b6248b4", "name": "network-vif-plugged", "status": "completed", "tag": "e8c5dc3b-4ff7-4d6c-9021-9c976db4c706"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:27.149773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab19d98f-b7eb-4ed0-ab82-e96ecbc1dcb5 req-934ffd7d-1973-4eff-89c1-23b8a0690ccb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:27.150254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab19d98f-b7eb-4ed0-ab82-e96ecbc1dcb5 req-934ffd7d-1973-4eff-89c1-23b8a0690ccb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:27.150687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab19d98f-b7eb-4ed0-ab82-e96ecbc1dcb5 req-934ffd7d-1973-4eff-89c1-23b8a0690ccb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:27.179042 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ab19d98f-b7eb-4ed0-ab82-e96ecbc1dcb5 req-934ffd7d-1973-4eff-89c1-23b8a0690ccb service nova] Creating event network-vif-plugged:c362d04f-f9b1-4d6c-a06f-9badf08ba6d7 for instance e161fbde-5a77-417a-9283-f372011e1b21 on n-h1-860863-4 Nov 02 21:46:27.179817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ab19d98f-b7eb-4ed0-ab82-e96ecbc1dcb5 req-934ffd7d-1973-4eff-89c1-23b8a0690ccb service nova] Creating event network-vif-plugged:e8c5dc3b-4ff7-4d6c-9021-9c976db4c706 for instance aff2642a-0376-4c88-8925-412a9b6248b4 on n-h1-860863-4 Nov 02 21:46:27.188853 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ab19d98f-b7eb-4ed0-ab82-e96ecbc1dcb5 req-934ffd7d-1973-4eff-89c1-23b8a0690ccb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082046 Nov 02 21:46:27.189497 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2412/4725] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:27.363555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:27.364440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:27.375541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:27.376141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:27.377680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:27.379039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:27.379878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:27.394634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:27.537048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:27.546072 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-616bb5ce-7ffa-40b0-be6e-3743ab5aa897 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.554004 Nov 02 21:46:27.553556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2314/4726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:26 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:27.575692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:27.587062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:27.610408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:27.611548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:27.621583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:27.622660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:27.623073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:27.624050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.200248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:28.218639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9770d2c8-977f-4349-b321-da1f7df5112f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1511 microversion: 2.1 time: 0.859850 Nov 02 21:46:28.219510 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2413/4727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:27 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1511 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:28.256796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e19a4668-0273-4ce9-84b3-de740c479e14 req-3083d194-1971-46e2-8902-82e6e0fd376d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3564db-cde7-43d0-87c8-fa12540f758e", "name": "network-vif-deleted", "tag": "7b5a73b7-bb17-40d5-a90d-a32621a10c10"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:28.268999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e19a4668-0273-4ce9-84b3-de740c479e14 req-3083d194-1971-46e2-8902-82e6e0fd376d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.269883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e19a4668-0273-4ce9-84b3-de740c479e14 req-3083d194-1971-46e2-8902-82e6e0fd376d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.270509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e19a4668-0273-4ce9-84b3-de740c479e14 req-3083d194-1971-46e2-8902-82e6e0fd376d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.286432 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e19a4668-0273-4ce9-84b3-de740c479e14 req-3083d194-1971-46e2-8902-82e6e0fd376d service nova] Creating event network-vif-deleted:7b5a73b7-bb17-40d5-a90d-a32621a10c10 for instance fe3564db-cde7-43d0-87c8-fa12540f758e on n-h2-860863-4 Nov 02 21:46:28.293299 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e19a4668-0273-4ce9-84b3-de740c479e14 req-3083d194-1971-46e2-8902-82e6e0fd376d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040437 Nov 02 21:46:28.294786 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2414/4728] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:28.302061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:28.303145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:28.310369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.311337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.312126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.313266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.314036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.314718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.355062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.356172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.361416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.361416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lazy-loading 'fault' on Instance uuid fe3564db-cde7-43d0-87c8-fa12540f758e {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:46:28.371426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:28.389693 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9dfb39d4-60f0-4ca4-a243-7bfc89ebcd88 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.832727 Nov 02 21:46:28.393223 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2315/4729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:27 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:28.411160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:28.415684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:28.426287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.426812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.427505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.428247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.428703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.429167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.490502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:28.506681 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71b8209c-1203-4060-8b7b-153f6d5191b9 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 200 len: 1332 microversion: 2.1 time: 0.210388 Nov 02 21:46:28.515744 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2415/4730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:28 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 1332 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:28.580120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:28.580834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:28.593788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.594419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.594934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.595787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:28.596253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:28.596713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:28.830357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:28.844388 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e750797e-52bf-40b7-9f69-d965add5c1e6 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1321 microversion: 2.1 time: 0.445668 Nov 02 21:46:28.847402 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2316/4731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:28 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:29.019013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:29.034957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd630c57-cba3-45a9-b21d-148affaed2d5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.455191 Nov 02 21:46:29.034957 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2416/4732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:28 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:29.423643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:29.424314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:29.434128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:29.434627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:29.435065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:29.435776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:29.436244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:29.442545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:29.541518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:29.543142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: fe3564db-cde7-43d0-87c8-fa12540f758e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:29.551743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:29.552955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:29.553538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:29.554727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:29.555688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:29.556391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:29.575115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:29.576838 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] HTTP exception thrown: Instance fe3564db-cde7-43d0-87c8-fa12540f758e could not be found. Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Request method failure captured: Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e HTTP/1.1 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSk8ts0OUuxTzKXr6aiyfp-dsfUoek34-q1V3-ew5FAm0B5a23vLtg0Yi3axUGqUuk52BlaXIQVJDxIO-r6Qs5Ho2SCJicJcK4N_2fCIk9UbabdMBOO6gAG4CZnEWRmBdnsnOF5u3W0h5-FIVXy0-Fq3JzFslmJw2PCsu7C2gJ4Ic4 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: d7badcd8061841fda3c5974d4ff5e2c0 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1216041212 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1216041212 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: d7badcd8061841fda3c5974d4ff5e2c0 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1216041212 Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestSecurityGroupsBasicOps-1216041212-project Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b05a329a613041f780874384b4fcf5dc Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1216041212-project Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance fe3564db-cde7-43d0-87c8-fa12540f758e could not be found. Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'fe3564db-cde7-43d0-87c8-fa12540f758e'} Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3564db-cde7-43d0-87c8-fa12540f758e could not be found. Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3564db-cde7-43d0-87c8-fa12540f758e could not be found. Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:29.578687 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3564db-cde7-43d0-87c8-fa12540f758e could not be found. Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Returning 404 to user: Instance fe3564db-cde7-43d0-87c8-fa12540f758e could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:29.584847 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9a203a5-035d-478c-8656-e3f9317fc0e4 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e" status: 404 len: 111 microversion: 2.1 time: 0.046577 Nov 02 21:46:29.589129 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2417/4733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:29 2022] GET /compute/v2.1/servers/fe3564db-cde7-43d0-87c8-fa12540f758e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:46:29.870242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:29.871035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:29.877760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:29.878779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:29.879807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:29.880964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:29.881624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:29.882995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:29.911645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:29.922441 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-842d13fe-dcd7-4ad0-9ce0-e01a2426e38f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1318 microversion: 2.1 time: 0.506027 Nov 02 21:46:29.927392 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2317/4734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:29 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:30.057787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:30.058536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:30.070127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:30.072727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:30.073375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:30.076002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:30.076861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:30.078289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:30.119664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:30.138517 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c63b1bf5-5474-4a5f-918a-a7bb959eeabd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1321 microversion: 2.1 time: 0.269445 Nov 02 21:46:30.140662 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2418/4735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:29 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:30.309626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:30.319390 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dbcc346b-71da-4ddd-862d-1d3503c9d169 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.266611 Nov 02 21:46:30.333909 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2318/4736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:30 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:30.369087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-53f3c051-41d1-499f-b2ad-4a4d8548beea req-c068a01d-ffa8-4d47-9d5c-c10da646e8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "tag": "1dabad0a-8b5e-45ea-bfd4-7f442e2684ef"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:30.390054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53f3c051-41d1-499f-b2ad-4a4d8548beea req-c068a01d-ffa8-4d47-9d5c-c10da646e8e0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:30.393461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53f3c051-41d1-499f-b2ad-4a4d8548beea req-c068a01d-ffa8-4d47-9d5c-c10da646e8e0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:30.394592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-53f3c051-41d1-499f-b2ad-4a4d8548beea req-c068a01d-ffa8-4d47-9d5c-c10da646e8e0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:30.406900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-53f3c051-41d1-499f-b2ad-4a4d8548beea req-c068a01d-ffa8-4d47-9d5c-c10da646e8e0 service nova] Creating event network-changed:1dabad0a-8b5e-45ea-bfd4-7f442e2684ef for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:46:30.418450 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-53f3c051-41d1-499f-b2ad-4a4d8548beea req-c068a01d-ffa8-4d47-9d5c-c10da646e8e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053984 Nov 02 21:46:30.419562 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2419/4737] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:30.950824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:30.951574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:30.960624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:30.968280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:30.968280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:30.968280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:30.968280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:30.968280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.172068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:31.176122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:31.196683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.197208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.197651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.198364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.198916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.199300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.205651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:31.216323 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-20ce8759-6327-4497-8755-6c32fd070735 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1507 microversion: 2.1 time: 0.270246 Nov 02 21:46:31.238608 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2319/4738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:30 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:31.254458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:31.255169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:31.263674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.264170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.264611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.265429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.266442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.266871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.498866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:31.505436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:31.521942 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b92b48d8-f257-4c0e-9913-1afdf7a74c25 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1507 microversion: 2.1 time: 0.269444 Nov 02 21:46:31.535670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b5eac0d-ab60-4657-952e-b7ca684b0f2a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1512 microversion: 2.1 time: 0.365058 Nov 02 21:46:31.535670 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2420/4739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:31 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:31.535670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:31.535670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:31.545126 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2320/4740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:31 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:31.562602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.563160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.563750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.564468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.564992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.566239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.583824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:31.597853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:31.606178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.606724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.607174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.608126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.608751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.609844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.800392 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae8b76dd-6177-4e67-9b03-c51c8c2704b2 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "PUT /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1079 microversion: 2.1 time: 0.253224 Nov 02 21:46:31.814503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2321/4741] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:46:31 2022] PUT /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1079 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:31.814503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:31.814503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:31.831007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.831623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.833491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.835548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.836202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.837971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.844235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:31.891699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:31.901576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4caa7f54-f492-4cd2-9380-614494357c3d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.372149 Nov 02 21:46:31.909588 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2421/4742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:31 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:31.917153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:31.927075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:31.946831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.947640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.948677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:31.949833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:31.950463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:31.951070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.177406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:32.193529 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ff53566-d742-4341-97ac-82bfe6c090c8 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1505 microversion: 2.1 time: 0.282195 Nov 02 21:46:32.213376 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2422/4743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:31 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:32.239784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:32.240665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:32.250326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.251447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.252402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.254815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.255886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.256856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.477905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:32.489648 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d347c116-4565-4fbc-8996-1ccb2923c750 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1510 microversion: 2.1 time: 0.687314 Nov 02 21:46:32.489835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:32.495006 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2322/4744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:31 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1510 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:32.504141 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce57c62f-02d0-4655-ab27-090b6b828958 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1505 microversion: 2.1 time: 0.271826 Nov 02 21:46:32.529687 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2423/4745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:32 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:32.530492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:32.539264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:32.539486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:32.539889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:32.544779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:32.552541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.553061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.553503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.554225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.554679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.555105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.559249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.560099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.560709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.563979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.564732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.569086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.656954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:32.721142 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-089cc533-8f63-4b9b-85c8-50c172f0b9f0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "PUT /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1081 microversion: 2.1 time: 0.190316 Nov 02 21:46:32.733887 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2424/4746] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:46:32 2022] PUT /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1081 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:32.746375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:32.747253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:32.751070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:32.755789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.755789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.756652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.757606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.758282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.758947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:32.763904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:32.764400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:32.764840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.277242 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-078f0996-b6d3-43b2-b085-c22df97e3c42 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.762117 Nov 02 21:46:33.293575 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2323/4747] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Nov 2 21:46:32 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:33.306035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:33.306876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:33.312444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:33.314459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.315678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.316298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.317414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.318503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.319091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.338589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:33.349051 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-040a001b-d3ef-4d9b-9730-8ffa571c7f3a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1507 microversion: 2.1 time: 0.609595 Nov 02 21:46:33.350013 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2425/4748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:32 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1507 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:33.355850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:33.363523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:33.368236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1088469385', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:33.374258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.374749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.375194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.375932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.376469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.376884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.501202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:33.509139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:33.522635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-714e6875-6969-473c-acaa-b804d80489fd tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.224710 Nov 02 21:46:33.525101 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2324/4749] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:33 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:33.539578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:33.540860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:33.561258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.562780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.563234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.563963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.564452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.564831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.626654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:33.642251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:33.644997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.649840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.650533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.797573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:33.808687 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c0e0b1bb-23af-4714-b82d-96e80b9fb3f3 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1507 microversion: 2.1 time: 0.280927 Nov 02 21:46:33.809311 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2325/4750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:33 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:33.828479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-36550898-6a12-41ee-b690-db1d020f4872 req-f4fdd367-186f-4d41-aac1-b1af3103ae7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "tag": "e627cb20-9ba5-4f69-9b5b-1bd43ff12db9"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:33.842544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-36550898-6a12-41ee-b690-db1d020f4872 req-f4fdd367-186f-4d41-aac1-b1af3103ae7e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.843927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-36550898-6a12-41ee-b690-db1d020f4872 req-f4fdd367-186f-4d41-aac1-b1af3103ae7e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.844824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-36550898-6a12-41ee-b690-db1d020f4872 req-f4fdd367-186f-4d41-aac1-b1af3103ae7e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.853386 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b5d6862-6404-402e-a0b8-152ac12ba3ea tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1088469385" status: 200 len: 1515 microversion: 2.1 time: 0.501919 Nov 02 21:46:33.854519 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2426/4751] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:46:33 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1088469385 => generated 1515 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:33.859231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:33.859941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:33.866907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.867598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.868203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.869244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.869869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.870465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.879354 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-36550898-6a12-41ee-b690-db1d020f4872 req-f4fdd367-186f-4d41-aac1-b1af3103ae7e service nova] Creating event network-changed:e627cb20-9ba5-4f69-9b5b-1bd43ff12db9 for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:46:33.885739 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-36550898-6a12-41ee-b690-db1d020f4872 req-f4fdd367-186f-4d41-aac1-b1af3103ae7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070732 Nov 02 21:46:33.887214 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2326/4752] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:33.892762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:33.901022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:33.901785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:33.910112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.911205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.912718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.913682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:33.914303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:33.914927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:33.920451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:46:34.071514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:34.174056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:34.183029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.183378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.184406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.319776 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa48b8f7-5a22-4b3a-aacf-f5b9e9c8ffe7 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 204 len: 0 microversion: 2.1 time: 0.463800 Nov 02 21:46:34.320989 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2427/4753] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:46:33 2022] DELETE /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:46:34.338722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:34.341710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:34.365491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.367604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.368174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.369797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.372183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.373280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.410979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:46:34.454943 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f76f531-52d7-4a33-b772-1b95ef2068f3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.566509 Nov 02 21:46:34.456477 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2327/4754] 10.222.0.25 () {58 vars in 1173 bytes} [Wed Nov 2 21:46:33 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:34.486374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:34.492315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:34.492766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.servers [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Removing options 'limit' from query {{(pid=121039) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 21:46:34.493558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:34.498018 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.api [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Instance is already in deleting state, ignoring this request Nov 02 21:46:34.499071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.499243 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63b47f7e-8cb2-428a-b650-906628022c7f tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 204 len: 0 microversion: 2.1 time: 0.165774 Nov 02 21:46:34.499899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.503299 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2428/4755] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:46:34 2022] DELETE /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:46:34.503809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.504974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.510175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.510175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.510871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:34.510871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:34.519380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.519962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.520414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.521765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.522232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.522862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.550814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:34.558053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.558709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.559247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.755867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:34.758511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2c1707e-c7e6-40f2-b301-58076f3e4498 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.275769 Nov 02 21:46:34.762286 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2328/4756] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 21:46:34 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:34.764110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:34.765056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:34.771773 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce2d34d7-924c-454e-8941-27c11edde359 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1513 microversion: 2.1 time: 0.266899 Nov 02 21:46:34.773742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.774421 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2429/4757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:34 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:34.774885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.775481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.776587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.777259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.777874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.791830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:34.798200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:34.800031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:34.809624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.810301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.811307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.812342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:34.813066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:34.813716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:34.923582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:34.966850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:34.979278 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd7ff892-8cf6-4e32-8609-85c4c5c0d95e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.218737 Nov 02 21:46:34.985275 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2329/4758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:34 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:34.996018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:34.998581 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3edea186-bab4-4957-bbe6-8b1622bfe9a3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.211007 Nov 02 21:46:34.999372 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2430/4759] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 21:46:34 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:35.014940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:35.020827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:35.021309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.servers [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Removing options 'limit' from query {{(pid=121039) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 21:46:35.021987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:35.028328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.028810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.029286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.030286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.030739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.031167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.061944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:35.099773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bccd9e7-097a-4575-8c25-e39e357615bc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.085735 Nov 02 21:46:35.108248 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2330/4760] 10.222.0.25 () {58 vars in 1150 bytes} [Wed Nov 2 21:46:35 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:35.114982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:35.120437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:35.121587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:35.127530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.127999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.128446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.129217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.129673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.130103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.161177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:35.195731 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab0a1e52-04fc-4b72-b49c-67b3284e4c30 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.084468 Nov 02 21:46:35.210461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:35.215944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:35.216425 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2431/4761] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:46:35 2022] GET /compute/v2.1/servers => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:35.216758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:35.232254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.232747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.233229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.233958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.234411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.234835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.330898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:35.418553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2d9a009b-0671-4374-b141-e66b99f64e1e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.212332 Nov 02 21:46:35.426697 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2331/4762] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:46:35 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:35.438182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:35.445118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:35.446907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.servers [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Removing options 'limit' from query {{(pid=121040) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 21:46:35.446907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:35.453459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.454959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.455625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.456666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.457442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.458104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.493611 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-127995b8-1c08-4d0a-992d-6128aaff3574 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.061959 Nov 02 21:46:35.504449 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2432/4763] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 21:46:35 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:35.509479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:35.517277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:35.518026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1088469385', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:46:35.529961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.531199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.534830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.536059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.536762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.537581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.657926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:46:35.747363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-812e44c6-8d9a-48f7-9e25-2b9211431d8c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1088469385" status: 200 len: 346 microversion: 2.1 time: 0.242482 Nov 02 21:46:35.748408 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2332/4764] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 21:46:35 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1088469385 => generated 346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:35.762094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2653818a-3285-4a74-b2ad-12b603db7316 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:35.769449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2653818a-3285-4a74-b2ad-12b603db7316 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.769940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2653818a-3285-4a74-b2ad-12b603db7316 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.770580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2653818a-3285-4a74-b2ad-12b603db7316 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.799306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2653818a-3285-4a74-b2ad-12b603db7316 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:46:35.807103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:35.807903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:35.814207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.814701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.815174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.815886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:35.816390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:35.816818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:35.981198 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2653818a-3285-4a74-b2ad-12b603db7316 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "POST /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4/action" status: 202 len: 0 microversion: 2.1 time: 0.222439 Nov 02 21:46:35.982293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2433/4765] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:46:35 2022] POST /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:46:35.992758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:35.994254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:36.004879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:36.005931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:36.006542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:36.012980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:36.012980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:36.012980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:36.294868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:36.308428 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bdd24543-f8c6-4f14-ac05-9a9cfd84ed19 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1513 microversion: 2.1 time: 0.505230 Nov 02 21:46:36.310308 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2333/4766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:35 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:36.316533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:36.317659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:36.342986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:36.344845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:36.347266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:36.348244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:36.348785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:36.349257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:36.563700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:36.585095 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee61f34d-14f8-4d85-91e7-a782473afeee tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.598507 Nov 02 21:46:36.586294 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2434/4767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:35 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:37.005824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:37.012680 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-483d3f21-fe41-4310-b694-ec7700df6130 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.700738 Nov 02 21:46:37.013919 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2334/4768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:36 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:37.337276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:37.337908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:37.356015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:37.356015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:37.356015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:37.356015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:37.356015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:37.356015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:37.413715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ea30d4f2-4ce6-480c-a5d9-b8609bc3e1e0 req-9fc9e3f4-5938-4918-a84a-5f48e063ec4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e161fbde-5a77-417a-9283-f372011e1b21", "name": "network-vif-deleted", "tag": "c362d04f-f9b1-4d6c-a06f-9badf08ba6d7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:37.432411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea30d4f2-4ce6-480c-a5d9-b8609bc3e1e0 req-9fc9e3f4-5938-4918-a84a-5f48e063ec4e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:37.442250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea30d4f2-4ce6-480c-a5d9-b8609bc3e1e0 req-9fc9e3f4-5938-4918-a84a-5f48e063ec4e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:37.442250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea30d4f2-4ce6-480c-a5d9-b8609bc3e1e0 req-9fc9e3f4-5938-4918-a84a-5f48e063ec4e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:37.468280 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ea30d4f2-4ce6-480c-a5d9-b8609bc3e1e0 req-9fc9e3f4-5938-4918-a84a-5f48e063ec4e service nova] Creating event network-vif-deleted:c362d04f-f9b1-4d6c-a06f-9badf08ba6d7 for instance e161fbde-5a77-417a-9283-f372011e1b21 on n-h1-860863-4 Nov 02 21:46:37.479290 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ea30d4f2-4ce6-480c-a5d9-b8609bc3e1e0 req-9fc9e3f4-5938-4918-a84a-5f48e063ec4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070824 Nov 02 21:46:37.479922 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2335/4769] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:46:37.611109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:37.612891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:37.627070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:37.627965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:37.629207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:37.630120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:37.630742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:37.633112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:37.916388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:37.936530 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95235d70-8a8f-4913-83b1-3bc18b193a0a tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1471 microversion: 2.1 time: 0.603503 Nov 02 21:46:37.937171 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2435/4770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:37 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:38.024771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2a3f2d65-ea01-4da4-a3b0-8216af2caa7d req-aa1e226e-f655-4777-b48d-ef16fa7be1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "tag": "0b050332-3102-4354-b0f5-c8e02e9298f8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:38.045760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2a3f2d65-ea01-4da4-a3b0-8216af2caa7d req-aa1e226e-f655-4777-b48d-ef16fa7be1ac service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:38.046876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2a3f2d65-ea01-4da4-a3b0-8216af2caa7d req-aa1e226e-f655-4777-b48d-ef16fa7be1ac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:38.047502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2a3f2d65-ea01-4da4-a3b0-8216af2caa7d req-aa1e226e-f655-4777-b48d-ef16fa7be1ac service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:38.063957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2a3f2d65-ea01-4da4-a3b0-8216af2caa7d req-aa1e226e-f655-4777-b48d-ef16fa7be1ac service nova] Creating event network-changed:0b050332-3102-4354-b0f5-c8e02e9298f8 for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:46:38.081725 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2a3f2d65-ea01-4da4-a3b0-8216af2caa7d req-aa1e226e-f655-4777-b48d-ef16fa7be1ac service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059836 Nov 02 21:46:38.082991 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2436/4771] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:38.096841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:38.096841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:38.110185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:38.110708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:38.111122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:38.114066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:38.114583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:38.116411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:38.194106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:38.208439 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a904a06c-e143-4cae-a162-0aed6e6226ff tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.600417 Nov 02 21:46:38.226552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2336/4772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:37 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:38.486851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:38.503858 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfb44eed-003c-4a93-8809-973c62aa89e9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.419407 Nov 02 21:46:38.520513 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2437/4773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:38 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:38.966102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:38.966751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:38.978099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:38.983489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:38.983489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:38.983489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:38.984985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:38.985817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:39.064010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:39.065932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:39.066946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:39.067339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lazy-loading 'fault' on Instance uuid e161fbde-5a77-417a-9283-f372011e1b21 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:46:39.075749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:39.176970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c200d64c4ebb4f9dafe6e35daac13a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5191bf0c1e3e446c9c2e6e47cea461e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:39.187765 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-495d4d55-f233-4f83-ad86-3b4f5fedea85 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 200 len: 1308 microversion: 2.1 time: 0.228695 Nov 02 21:46:39.203066 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2337/4774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:38 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:39.238224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:39.239665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:39.247000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:39.247764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:39.248298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:39.249935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:39.250633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:39.251136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:39.532457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:39.532457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:39.554736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:39.554736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:39.554736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:39.558449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:39.563593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:39.564295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:39.873647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:39.887252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32deac5c-0520-49b1-9a5f-76400e533acc tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.653541 Nov 02 21:46:39.888232 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2438/4775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:39 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:40.079317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:40.091703 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5b31a365-d2de-4141-a699-cf2d9e5d4a24 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.567636 Nov 02 21:46:40.092226 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2338/4776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:39 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:40.215399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:40.216055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: e161fbde-5a77-417a-9283-f372011e1b21] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:40.225323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.231286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.231286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.231286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.231286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.231286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.249235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] HTTP exception thrown: Instance e161fbde-5a77-417a-9283-f372011e1b21 could not be found. Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Request method failure captured: Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 HTTP/1.1 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSQUngzaGzRXYX-ut5HAZe1ZVVkej4j2woe5U3IYo8A3200V9cbEccNvlqxqLsUQ_TO0ekGssP5my6qOybIMnDTy8XpbOxCrgVi069He0WE4h0Pdb1bzlBaoKgLEB_d8NdpAIPyKAebQjj400pb2sXNCAFzD9xu7k7sqQf5YqM3gzU Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c200d64c4ebb4f9dafe6e35daac13a39 Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e161fbde-5a77-417a-9283-f372011e1b21 could not be found. Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e161fbde-5a77-417a-9283-f372011e1b21'} Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e161fbde-5a77-417a-9283-f372011e1b21 could not be found. Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e161fbde-5a77-417a-9283-f372011e1b21 could not be found. Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.251888 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e161fbde-5a77-417a-9283-f372011e1b21 could not be found. Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Returning 404 to user: Instance e161fbde-5a77-417a-9283-f372011e1b21 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44a238c1-cffb-45d7-ba52-9828a4f29143 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21" status: 404 len: 111 microversion: 2.1 time: 0.043267 Nov 02 21:46:40.264602 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2439/4777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:40 2022] GET /compute/v2.1/servers/e161fbde-5a77-417a-9283-f372011e1b21 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:46:40.267727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:40.268729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:40.276445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.277419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.278087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.279620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.280439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.281726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.302165 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] HTTP exception thrown: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Request method failure captured: Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 HTTP/1.1 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSQUngzaGzRXYX-ut5HAZe1ZVVkej4j2woe5U3IYo8A3200V9cbEccNvlqxqLsUQ_TO0ekGssP5my6qOybIMnDTy8XpbOxCrgVi069He0WE4h0Pdb1bzlBaoKgLEB_d8NdpAIPyKAebQjj400pb2sXNCAFzD9xu7k7sqQf5YqM3gzU Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: c200d64c4ebb4f9dafe6e35daac13a39 Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '78ea44e1-eb31-4dde-8e15-de4306c89cc5'} Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:46:40.304572 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.309676 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.311294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Returning 404 to user: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:40.312076 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7516391f-a98d-4913-a3cd-4d2419228ae0 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 404 len: 111 microversion: 2.1 time: 0.047529 Nov 02 21:46:40.313184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2339/4778] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:46:40 2022] DELETE /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:46:40.322618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:40.323851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: 78ea44e1-eb31-4dde-8e15-de4306c89cc5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:40.330440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.331803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.332554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.333550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.334199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.334841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.351620 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] HTTP exception thrown: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Request method failure captured: Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 HTTP/1.1 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSQUngzaGzRXYX-ut5HAZe1ZVVkej4j2woe5U3IYo8A3200V9cbEccNvlqxqLsUQ_TO0ekGssP5my6qOybIMnDTy8XpbOxCrgVi069He0WE4h0Pdb1bzlBaoKgLEB_d8NdpAIPyKAebQjj400pb2sXNCAFzD9xu7k7sqQf5YqM3gzU Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c200d64c4ebb4f9dafe6e35daac13a39 Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '78ea44e1-eb31-4dde-8e15-de4306c89cc5'} Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.355923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.363120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Returning 404 to user: Instance 78ea44e1-eb31-4dde-8e15-de4306c89cc5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:40.368076 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-77b07586-feb5-4409-8808-e8725a3a9ccd tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5" status: 404 len: 111 microversion: 2.1 time: 0.050012 Nov 02 21:46:40.370799 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2440/4779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:40 2022] GET /compute/v2.1/servers/78ea44e1-eb31-4dde-8e15-de4306c89cc5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:46:40.379017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:40.380026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:40.409343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.411399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.411399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.412013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.412575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.413104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.431580 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] HTTP exception thrown: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Request method failure captured: Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 HTTP/1.1 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuSQUngzaGzRXYX-ut5HAZe1ZVVkej4j2woe5U3IYo8A3200V9cbEccNvlqxqLsUQ_TO0ekGssP5my6qOybIMnDTy8XpbOxCrgVi069He0WE4h0Pdb1bzlBaoKgLEB_d8NdpAIPyKAebQjj400pb2sXNCAFzD9xu7k7sqQf5YqM3gzU Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: c200d64c4ebb4f9dafe6e35daac13a39 Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'da88578b-3773-4c6e-a924-2bc73e190ee3'} Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:46:40.434492 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Returning 404 to user: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:40.440391 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-84b37c83-2f22-4821-b225-919227f17338 tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 404 len: 111 microversion: 2.1 time: 0.060205 Nov 02 21:46:40.445157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:40.446108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] [instance: da88578b-3773-4c6e-a924-2bc73e190ee3] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:40.450937 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2340/4780] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:46:40 2022] DELETE /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:46:40.453607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.454175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.454692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.455469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.456598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.457144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.472503 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] HTTP exception thrown: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Request method failure captured: Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 HTTP/1.1 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSQUngzaGzRXYX-ut5HAZe1ZVVkej4j2woe5U3IYo8A3200V9cbEccNvlqxqLsUQ_TO0ekGssP5my6qOybIMnDTy8XpbOxCrgVi069He0WE4h0Pdb1bzlBaoKgLEB_d8NdpAIPyKAebQjj400pb2sXNCAFzD9xu7k7sqQf5YqM3gzU Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5191bf0c1e3e446c9c2e6e47cea461e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 5191bf0c1e3e446c9c2e6e47cea461e1 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1914691462 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: c200d64c4ebb4f9dafe6e35daac13a39 Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerDiskConfigTestJSON-1914691462-project Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'da88578b-3773-4c6e-a924-2bc73e190ee3'} Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:40.474192 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] Returning 404 to user: Instance da88578b-3773-4c6e-a924-2bc73e190ee3 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:40.479196 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e5077cf-d0ea-4ece-8159-70ae6178364c tempest-ServerDiskConfigTestJSON-1914691462 tempest-ServerDiskConfigTestJSON-1914691462-project] 10.222.0.25 "GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3" status: 404 len: 111 microversion: 2.1 time: 0.036074 Nov 02 21:46:40.480820 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2441/4781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:40 2022] GET /compute/v2.1/servers/da88578b-3773-4c6e-a924-2bc73e190ee3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:46:40.912311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:40.912639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:40.924480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.925076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.925520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:40.926227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:40.926678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:40.927108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:41.124558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:41.125960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:41.136556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:41.138389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:41.138389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:41.139212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:41.139900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:41.145468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:41.367424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:41.384029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac6912ae-df08-4aee-ae6a-4ec57a7b0143 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.476143 Nov 02 21:46:41.385719 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2341/4782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:40 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:41.598069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:41.613861 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfb62ce5-8dbf-4046-9757-92650ab36b8f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.495883 Nov 02 21:46:41.615602 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2442/4783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:41 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:42.411150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:42.419320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:42.435461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:42.436752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:42.437888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:42.439856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:42.441676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:42.452736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:42.637165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:42.638422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:42.659456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:42.664214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:42.664214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:42.664214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:42.664214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:42.664214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:42.921427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:42.939637 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61339c27-0569-4b61-8ddb-76f586f57b8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.530108 Nov 02 21:46:42.939637 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2342/4784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:42 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:42.973560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:42.979818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:42.984816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:42.985362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:42.985808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:42.990846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:42.991500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:42.991956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:43.067537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:46:43.134158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:43.152650 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-370a6d74-eef7-406b-826c-49d9d060f890 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.518758 Nov 02 21:46:43.168486 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2443/4785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:42 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:43.192740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f18f5c31-c518-4c0b-8160-900c134575ef req-02de8010-6d47-4e87-a7f1-cad2ecca80a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd8e12b-7667-4b6f-bfc2-c6903758e0a5", "tag": "000fb93d-e41f-426d-8ed3-37e7d0754574"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:43.242084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f18f5c31-c518-4c0b-8160-900c134575ef req-02de8010-6d47-4e87-a7f1-cad2ecca80a6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:43.250795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f18f5c31-c518-4c0b-8160-900c134575ef req-02de8010-6d47-4e87-a7f1-cad2ecca80a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:43.251443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f18f5c31-c518-4c0b-8160-900c134575ef req-02de8010-6d47-4e87-a7f1-cad2ecca80a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:43.290966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f18f5c31-c518-4c0b-8160-900c134575ef req-02de8010-6d47-4e87-a7f1-cad2ecca80a6 service nova] Creating event network-changed:000fb93d-e41f-426d-8ed3-37e7d0754574 for instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 on n-h1-860863-4 Nov 02 21:46:43.301845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f18f5c31-c518-4c0b-8160-900c134575ef req-02de8010-6d47-4e87-a7f1-cad2ecca80a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118147 Nov 02 21:46:43.302522 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2444/4786] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:43.434290 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec9fbb65-40fe-4f3f-b369-dd6dfc09a103 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 204 len: 0 microversion: 2.1 time: 0.464939 Nov 02 21:46:43.439283 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2343/4787] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:46:42 2022] DELETE /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:46:43.447480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:43.448557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:43.460401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:43.461140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:43.461756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:43.462909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:43.463539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:43.464135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:43.614374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:43.928426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:43.941056 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-062a226d-6d93-4856-a4a5-f922de50ec82 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1768 microversion: 2.1 time: 0.495144 Nov 02 21:46:43.942119 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2445/4788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:43 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1768 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:43.979372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:43.983045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:44.023871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:44.024396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:44.025003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:44.026233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:44.027193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:44.027789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:44.183631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:44.184373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:44.195157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:44.197616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:44.198408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:44.200348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:44.202243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:44.204014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:44.440868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:44.454118 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e73390f0-dfdb-4a41-9601-fc480ab07f4f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.492766 Nov 02 21:46:44.474206 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2344/4789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:43 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:44.642627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:44.660728 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0434de2-bd2f-4c5f-a324-36aa5a5d250a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.481432 Nov 02 21:46:44.673354 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2446/4790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:44 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:44.969640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:44.970651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:44.980595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:44.987731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:44.987731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:44.987731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:44.991347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:44.992147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:44.994102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:45.489738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:45.489738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:45.489738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:45.504546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:45.505558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:45.508511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:45.510242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:45.517844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:45.519847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:45.591426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:46.265727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:46.281471 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3283dcd0-fa76-4b72-b51e-efdf5ffc4fa1 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1768 microversion: 2.1 time: 1.316350 Nov 02 21:46:46.298002 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2345/4791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:44 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1768 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:46.304485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:46.306156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:46.312883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:46.313689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:46.314315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:46.315289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:46.316032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:46.316637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:46.365186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:46.372770 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60fcf5b1-3e9c-4042-aa8c-194382f55f8b tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.890795 Nov 02 21:46:46.377053 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2447/4792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:45 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:46.387431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:46.397915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:46.404975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:46.405926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:46.407277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:46.408240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:46.409227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:46.410347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:46.512596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lazy-loading 'services' on Instance uuid 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:46:46.815561 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-64cd68bb-8703-444b-afd5-c1ce54448227 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments/604d7bf9-ad4a-488e-bec5-03350c3b38e2" status: 202 len: 0 microversion: 2.1 time: 0.514921 Nov 02 21:46:46.816704 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2346/4793] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:46:46 2022] DELETE /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments/604d7bf9-ad4a-488e-bec5-03350c3b38e2 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:46:46.825616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e1854056-2212-4f3a-a426-efd561feb2e1 req-86080982-41f6-47bc-9278-6401714a1dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd8e12b-7667-4b6f-bfc2-c6903758e0a5", "name": "network-vif-deleted", "tag": "000fb93d-e41f-426d-8ed3-37e7d0754574"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:46.841174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:46.850678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1854056-2212-4f3a-a426-efd561feb2e1 req-86080982-41f6-47bc-9278-6401714a1dc2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:46.851892 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c89cbabe-09e3-4fab-88a9-d677276ad2ca tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.473414 Nov 02 21:46:46.852297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1854056-2212-4f3a-a426-efd561feb2e1 req-86080982-41f6-47bc-9278-6401714a1dc2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:46.852756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1854056-2212-4f3a-a426-efd561feb2e1 req-86080982-41f6-47bc-9278-6401714a1dc2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:46.853885 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2448/4794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:46 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:46.876726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:46.876726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:46.886984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:46.887612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:46.888132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:46.888994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:46.889688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:46.890757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:46.897874 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e1854056-2212-4f3a-a426-efd561feb2e1 req-86080982-41f6-47bc-9278-6401714a1dc2 service nova] Creating event network-vif-deleted:000fb93d-e41f-426d-8ed3-37e7d0754574 for instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 on n-h1-860863-4 Nov 02 21:46:46.911980 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e1854056-2212-4f3a-a426-efd561feb2e1 req-86080982-41f6-47bc-9278-6401714a1dc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094063 Nov 02 21:46:46.917355 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2347/4795] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:46.950975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:47.013036 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-43af2e6a-db13-4341-b951-6eb9e96faf72 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157686 Nov 02 21:46:47.013642 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2449/4796] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:46 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:47.314847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:47.316587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:47.327784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:47.329330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:47.331875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:47.332796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:47.333444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:47.334672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:47.375082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:47.375695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:47.376119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:47.376742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lazy-loading 'fault' on Instance uuid 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:46:47.401669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:47.402704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:47.412129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:47.413172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:47.418782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:47.418782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:47.418782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:47.418782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:47.430376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b05a329a613041f780874384b4fcf5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7badcd8061841fda3c5974d4ff5e2c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:47.439586 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-75185cfa-895a-4098-a919-d24ee663e71a tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 200 len: 1535 microversion: 2.1 time: 0.129483 Nov 02 21:46:47.441191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2348/4797] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:47 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 1535 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:47.800964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:47.836709 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a9e793c-c4ef-4da9-afac-9abed3e94a57 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.439407 Nov 02 21:46:47.837912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2450/4798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:47 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:47.879487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:47.880843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:47.889264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:47.890040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:47.890699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:47.892244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:47.893708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:47.912166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:48.027407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:48.029740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:48.046009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:48.052797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:48.052797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:48.065733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:48.068214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:48.068683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:48.149669 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84998258-b88a-4c9c-84ad-483390759a28 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125730 Nov 02 21:46:48.150291 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2451/4799] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:48 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:46:48.339197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:48.370144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e5fb00df-d1ad-4fb6-af92-e6895cfa9d0d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.482411 Nov 02 21:46:48.370144 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2349/4800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:47 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:46:48.468224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:48.469191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] [instance: 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:48.478873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:48.480593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:48.484573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:48.486211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:48.488667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:48.489335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:48.519125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] HTTP exception thrown: Instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 could not be found. Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Request method failure captured: Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 HTTP/1.1 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuSk8ts0OUuxTzKXr6aiyfp-dsfUoek34-q1V3-ew5FAm0B5a23vLtg0Yi3axUGqUuk52BlaXIQVJDxIO-r6Qs5Ho2SCJicJcK4N_2fCIk9UbabdMBOO6gAG4CZnEWRmBdnsnOF5u3W0h5-FIVXy0-Fq3JzFslmJw2PCsu7C2gJ4Ic4 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: d7badcd8061841fda3c5974d4ff5e2c0 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1216041212 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d7badcd8061841fda3c5974d4ff5e2c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1216041212 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: d7badcd8061841fda3c5974d4ff5e2c0 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1216041212 Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestSecurityGroupsBasicOps-1216041212-project Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b05a329a613041f780874384b4fcf5dc Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1216041212-project Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 could not be found. Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7cd8e12b-7667-4b6f-bfc2-c6903758e0a5'} Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 could not be found. Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 could not be found. Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:48.523003 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 could not be found. Nov 02 21:46:48.528953 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:46:48.532300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Returning 404 to user: Instance 7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:48.532461 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b8a8045-4bde-4ce9-9a2e-3071d079cf71 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5" status: 404 len: 111 microversion: 2.1 time: 0.067850 Nov 02 21:46:48.541542 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2452/4801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:48 2022] GET /compute/v2.1/servers/7cd8e12b-7667-4b6f-bfc2-c6903758e0a5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:46:48.864179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:48.864892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:48.871626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:48.872168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:48.872555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:48.873280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:48.873957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:48.874586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:49.164422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:49.166719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:49.185633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:49.186358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:49.187013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:49.188068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:49.188882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:49.189683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:49.265827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:49.269668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d602a755-5449-467f-9397-8e4cd8baa1d5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111075 Nov 02 21:46:49.276674 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2453/4802] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:49 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:49.279068 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3c6e34d9-c3a9-41b6-8094-7c3b009d8b4e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.419544 Nov 02 21:46:49.309966 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2350/4803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:48 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:49.385802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:49.385802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:49.389962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:49.390460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:49.390906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:49.391887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:49.392346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:49.393512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:50.298722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:50.304036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:50.320389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:50.321202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:50.322103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:50.325843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:50.329106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:50.329763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:50.394468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-df6fd255-506f-48e7-993b-e9bd0e85edfb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100061 Nov 02 21:46:50.395917 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2351/4804] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:50 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:46:50.401812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:50.402790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:50.410747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:50.411628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:50.412362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:50.413401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:50.414109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:50.414768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:50.510399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:50.519302 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4dc2e0da-869f-4a2e-939b-bb17dcd404b9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 1.144279 Nov 02 21:46:50.519902 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2454/4805] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:49 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:50.769370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:50.782518 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf9bb0c6-36f6-4c64-a5b0-566a02021aa5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.384974 Nov 02 21:46:50.787467 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2352/4806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:50 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:51.409500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:51.411748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:51.429894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:51.430416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:51.431645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:51.431809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:51.432393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:51.432842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:51.546438 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1994029b-0a43-4760-ae71-c14b1447fb13 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140240 Nov 02 21:46:51.547044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:51.547797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:51.549609 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2455/4807] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:51 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:51.560334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:51.561149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:51.561754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:51.562945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:51.565791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:51.566417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:51.624400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:51.808248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:51.809372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:51.818414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:51.821515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:51.827553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:51.828886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:51.831145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:51.831603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:52.623017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:52.651488 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3dbf5c8b-af07-4d35-8564-a4f7475653c4 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 1.105849 Nov 02 21:46:52.653525 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2353/4808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:51 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:52.677263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:52.683548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:52.708872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:52.711588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:52.713731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:52.715205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:52.716435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:52.718247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:52.833906 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f08f10c8-6eeb-4282-89a5-122cd62ea3d8 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168702 Nov 02 21:46:52.834870 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2354/4809] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:52 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:53.056381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:53.093801 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92c81516-82c3-455a-adee-e3a0e279ad37 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 1.288604 Nov 02 21:46:53.095136 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2456/4810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:51 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:53.681731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:53.681731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:53.708057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:53.708580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:53.715130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:53.716008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:53.716501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:53.716964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:53.847282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:53.849803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:53.868164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:53.868814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:53.869310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:53.870099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:53.870563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:53.870997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:53.962043 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d3788d6-8da5-4bd1-b685-39ad0679da98 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118920 Nov 02 21:46:53.963224 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2457/4811] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:53 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:54.118867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:54.119905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:54.149548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:54.150056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:54.150507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:54.162863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:54.162863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:54.162863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:54.605253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:54.620289 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2be9b5b-bfc9-4f75-87c1-67d4aa2c1cc6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.948298 Nov 02 21:46:54.622980 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2355/4812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:53 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:54.644021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6e0c09b3-d5c2-4941-b758-8923ab934a3f req-587c8527-8e41-46e9-913e-f297c4f437b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "name": "network-vif-plugged", "status": "completed", "tag": "1dabad0a-8b5e-45ea-bfd4-7f442e2684ef"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:54.685254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6e0c09b3-d5c2-4941-b758-8923ab934a3f req-587c8527-8e41-46e9-913e-f297c4f437b9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:54.690354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6e0c09b3-d5c2-4941-b758-8923ab934a3f req-587c8527-8e41-46e9-913e-f297c4f437b9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:54.691106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6e0c09b3-d5c2-4941-b758-8923ab934a3f req-587c8527-8e41-46e9-913e-f297c4f437b9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:54.718400 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6e0c09b3-d5c2-4941-b758-8923ab934a3f req-587c8527-8e41-46e9-913e-f297c4f437b9 service nova] Creating event network-vif-plugged:1dabad0a-8b5e-45ea-bfd4-7f442e2684ef for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:46:54.738336 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6e0c09b3-d5c2-4941-b758-8923ab934a3f req-587c8527-8e41-46e9-913e-f297c4f437b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100688 Nov 02 21:46:54.739641 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2356/4813] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:46:54.976518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:54.980083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:55.008069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:55.010557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:55.035539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:55.043741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:55.046847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:55.053511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:55.206710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f81634d-c28a-44a6-8bb8-baa3e9c83b83 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235360 Nov 02 21:46:55.217634 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2357/4814] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:54 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:46:55.417996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:55.432639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f23e339-a0c6-47fb-8a86-730a8890c6af tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 1.313240 Nov 02 21:46:55.445431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2458/4815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:54 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:55.650574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:55.651206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:55.669541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:55.670154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:55.670622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:55.683637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:55.683637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:55.683637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:56.225531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:56.227777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:56.248770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:56.249314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:56.249772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:56.269304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:56.269618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:56.277871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:56.413362 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-30f24400-1217-4fa0-9613-b129fb1c1fb5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193481 Nov 02 21:46:56.413957 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2459/4816] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:56 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:46:56.465960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:56.466641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:56.477624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:56.478127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:56.478570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:56.480572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:56.493221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:56.493841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:56.671819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:56.685977 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88768e14-66ef-4ec5-83a1-abd6bd724c68 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 1.036027 Nov 02 21:46:56.705461 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2358/4817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:55 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:56.921469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-3a0564bb-9a36-42c8-af1f-ca132f108817 req-06832399-7a11-443a-85c8-16abb76fbdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "name": "network-vif-plugged", "status": "completed", "tag": "e627cb20-9ba5-4f69-9b5b-1bd43ff12db9"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:56.938844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3a0564bb-9a36-42c8-af1f-ca132f108817 req-06832399-7a11-443a-85c8-16abb76fbdd1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:56.939353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3a0564bb-9a36-42c8-af1f-ca132f108817 req-06832399-7a11-443a-85c8-16abb76fbdd1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:56.939864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3a0564bb-9a36-42c8-af1f-ca132f108817 req-06832399-7a11-443a-85c8-16abb76fbdd1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:56.994515 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-3a0564bb-9a36-42c8-af1f-ca132f108817 req-06832399-7a11-443a-85c8-16abb76fbdd1 service nova] Creating event network-vif-plugged:e627cb20-9ba5-4f69-9b5b-1bd43ff12db9 for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:46:57.019252 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-3a0564bb-9a36-42c8-af1f-ca132f108817 req-06832399-7a11-443a-85c8-16abb76fbdd1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107825 Nov 02 21:46:57.020200 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2359/4818] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:57.250773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:57.278914 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f6997c3-dd59-491d-a370-b34fe0ad8ec4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.812848 Nov 02 21:46:57.290605 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2460/4819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:56 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:57.432590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:57.457560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:57.469874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.473173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.483170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:57.484062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.488981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.489738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:57.566096 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e275367-2fc0-40a5-963c-539142154999 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.143326 Nov 02 21:46:57.567021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2360/4820] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:46:57 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:46:57.734811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:57.735967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:57.739855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:57.745028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:57.755830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.756344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.756787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:57.757558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.760557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.762830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:57.773596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.777983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.777983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:57.777983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.777983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.777983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:57.874303 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Cannot 'reboot' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action HTTP/1.1 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 28 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: {"reboot": {"type": "HARD"}} Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'reboot' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bd55ba83-9cae-44f7-8a0f-8cb4ed408dad', 'body': {'reboot': {'type': 'HARD'}}} Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:46:57.920158 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:57.925880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:57.933857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 409 to user: Cannot 'reboot' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:57.934985 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-866d54a1-7f71-4f5f-8d59-1b802f900243 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action" status: 409 len: 145 microversion: 2.1 time: 0.199959 Nov 02 21:46:57.936130 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2361/4821] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:46:57 2022] POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action => generated 145 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:46:57.946304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:57.951062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:57.979645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.981110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.981742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:57.982677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:57.983304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:57.983899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:58.037529 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Cannot 'rebuild' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action HTTP/1.1 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 65 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'rebuild' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bd55ba83-9cae-44f7-8a0f-8cb4ed408dad', 'body': {'rebuild': {'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c'}}} Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:46:58.043402 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued Nov 02 21:46:58.049224 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:46:58.057331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 409 to user: Cannot 'rebuild' instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad while it is in vm_state rescued {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:46:58.060056 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-217756dc-351b-413f-a238-4674628313f6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action" status: 409 len: 146 microversion: 2.1 time: 0.118232 Nov 02 21:46:58.065268 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2362/4822] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:46:57 2022] POST /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad/action => generated 146 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:46:58.074691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:58.081604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:58.089048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:58.090461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:58.091192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:58.092155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:58.092841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:58.093526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:58.126910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:46:58.432374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:46:58.522598 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a572bf32-3caa-4965-b1ba-38ff23d812cb tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 204 len: 0 microversion: 2.1 time: 0.451682 Nov 02 21:46:58.523714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2363/4823] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:46:58 2022] DELETE /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:46:58.529579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:58.530580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:58.554925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:58.555870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:58.556604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:58.557567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:58.559848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:58.560556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:59.112426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:59.124429 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e827a9bd-a947-4489-8c31-618ad6dd26db tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 0.598692 Nov 02 21:46:59.126516 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2364/4824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:58 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:59.140191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:46:59.140843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:46:59.153019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:59.153131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:59.153557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:59.154638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:59.155308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:59.156079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:59.386085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:59.405782 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65cf2d1a-dc5e-473c-9d5f-e0af67bd7569 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 1.681819 Nov 02 21:46:59.408993 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2461/4825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:57 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:46:59.509273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6285f434-007e-4566-a22a-604ffef05ee2 req-c4488be6-238b-4136-b8a0-69c106d30cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "name": "network-vif-plugged", "status": "completed", "tag": "0b050332-3102-4354-b0f5-c8e02e9298f8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:46:59.540329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6285f434-007e-4566-a22a-604ffef05ee2 req-c4488be6-238b-4136-b8a0-69c106d30cce service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:46:59.546058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6285f434-007e-4566-a22a-604ffef05ee2 req-c4488be6-238b-4136-b8a0-69c106d30cce service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:46:59.546862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6285f434-007e-4566-a22a-604ffef05ee2 req-c4488be6-238b-4136-b8a0-69c106d30cce service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:46:59.593526 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6285f434-007e-4566-a22a-604ffef05ee2 req-c4488be6-238b-4136-b8a0-69c106d30cce service nova] Creating event network-vif-plugged:0b050332-3102-4354-b0f5-c8e02e9298f8 for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:46:59.608522 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6285f434-007e-4566-a22a-604ffef05ee2 req-c4488be6-238b-4136-b8a0-69c106d30cce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106007 Nov 02 21:46:59.609735 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2462/4826] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:46:59.963116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:46:59.983102 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-595707dd-90e9-4b19-ad78-d1ec73afcd9b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1688 microversion: 2.1 time: 0.855154 Nov 02 21:46:59.983864 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2365/4827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:46:59 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1688 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:00.161027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:00.161960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:00.185484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:00.186546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:00.187320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:00.188748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:00.196240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:00.196885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:00.437426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:00.437426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:00.444905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:00.445769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:00.446443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:00.447378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:00.448061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:00.448744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:01.173885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:01.186931 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55961ceb-5a16-480c-9e16-86972cbbfb1d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1522 microversion: 2.1 time: 1.036060 Nov 02 21:47:01.200952 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2463/4828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:00 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1522 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:01.212449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:01.213231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:01.220221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:01.220716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:01.233184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:01.233995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:01.234554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:01.235008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:01.578211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:01.591372 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a6463bcd-227d-463e-b5e9-48cf6b374a99 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 1.159440 Nov 02 21:47:01.606476 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2366/4829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:00 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:01.722912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:01.736725 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-279f3b2a-9b76-43a4-9a03-9beeec82cd37 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1688 microversion: 2.1 time: 0.544619 Nov 02 21:47:01.747774 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2464/4830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:01 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1688 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:02.212853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:02.213763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:02.222849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:02.226167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:02.226959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6893d703-ea09-422f-8a64-7e4f116709d0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] Calling method '.version_select at 0x7f9b68297430>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:02.233595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:02.234435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:02.234990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:02.235519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:02.364363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6893d703-ea09-422f-8a64-7e4f116709d0 tempest-TestSecurityGroupsBasicOps-1216041212 tempest-TestSecurityGroupsBasicOps-1216041212-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2030389578" status: 202 len: 0 microversion: 2.1 time: 0.156635 Nov 02 21:47:02.369646 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2367/4831] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 21:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2030389578 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:47:02.620039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:02.621385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:02.632310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:02.637580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:02.640378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:02.640378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:02.640378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:02.640378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:02.959372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:02.972335 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4f729273-16e4-461e-8711-406f5c45ac2f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1499 microversion: 2.1 time: 0.763625 Nov 02 21:47:02.992287 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2465/4832] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:02 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1499 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:02.999813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:03.000782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:03.007935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:03.008711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:03.009362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:03.010251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:03.010877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:03.011479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:03.311220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:03.323274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-78fbae2d-e552-40a3-a472-d0fbc07e5907 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1355 microversion: 2.1 time: 0.707416 Nov 02 21:47:03.329499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2368/4833] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:02 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1355 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:03.334161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:03.356248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:03.359945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:03.379445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:03.380382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:03.383091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:03.386709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:03.386709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:03.387408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:03.434301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:03.544787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81bb2833-bd33-49c4-a672-d02400a6b390 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.214290 Nov 02 21:47:03.546119 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2369/4834] 10.222.0.25 () {58 vars in 1154 bytes} [Wed Nov 2 21:47:03 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:03.558316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d577a750-7343-4e53-9a95-012b5f25d50c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:03.570329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d577a750-7343-4e53-9a95-012b5f25d50c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:03.570329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d577a750-7343-4e53-9a95-012b5f25d50c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:03.570329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d577a750-7343-4e53-9a95-012b5f25d50c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:03.599155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d577a750-7343-4e53-9a95-012b5f25d50c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Going to try to start instance {{(pid=121039) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 21:47:03.626790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:03.819954 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d577a750-7343-4e53-9a95-012b5f25d50c tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "POST /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4/action" status: 202 len: 0 microversion: 2.1 time: 0.265519 Nov 02 21:47:03.831206 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2370/4835] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:47:03 2022] POST /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:47:03.864100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:03.864902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:03.888690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:03.892953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:03.892953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:03.894076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:03.899405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:03.899972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:04.429681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:04.439160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8cd2cbbf-265c-45f9-93c8-3000a554c827 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1688 microversion: 2.1 time: 1.443762 Nov 02 21:47:04.446891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2466/4836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:02 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1688 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:04.482218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:04.483350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:04.490154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:04.492256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:04.494278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:04.494873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:04.495710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:04.496371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:04.497156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:04.546567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:04.868375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:04.888957 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ea4d8a4a-0202-4960-8a91-f9120014d05a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1508 microversion: 2.1 time: 1.055465 Nov 02 21:47:04.890143 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2371/4837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:03 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1508 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:05.041965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:05.059925 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a3882a8-2a4c-491f-a40e-038a5dc34ffe tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1805 microversion: 2.1 time: 0.591087 Nov 02 21:47:05.062379 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2467/4838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:04 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1805 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:05.088010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:05.097736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:05.104362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.104862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.107490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.107490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.107490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.107490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.139891 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b69b1c03-d7c2-4c9e-a374-603370171987 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c/ips" status: 200 len: 218 microversion: 2.1 time: 0.056073 Nov 02 21:47:05.149178 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2372/4839] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:47:05 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c/ips => generated 218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:05.164260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:05.164839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:05.203963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.208093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.209973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.210984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.213383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.213964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.286683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:05.475463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:05.476085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:05.485080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.485574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.490158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.491260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.496969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.497693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.718630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:05.738808 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7a216cf4-26d5-4605-80a7-d0cbd879da8d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1620 microversion: 2.1 time: 0.268134 Nov 02 21:47:05.743234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2373/4840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:05 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1620 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:05.858269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ef499a88-b6ac-4e4e-969e-0d54a24d15d8 req-ca1548dd-622d-4bed-b3fa-81cc962c21ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29976160-96b8-47c8-b3a9-cb8a1a3c3b02", "name": "network-vif-deleted", "tag": "81d55a8b-2bfb-4ba3-a0ab-7d78b300d809"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:05.865097 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d17a18f7-1e16-4bf0-8db2-dd86e4e0a965 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 204 len: 0 microversion: 2.1 time: 0.715204 Nov 02 21:47:05.866929 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2468/4841] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:05 2022] DELETE /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:05.877510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:05.881135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:05.884631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ef499a88-b6ac-4e4e-969e-0d54a24d15d8 req-ca1548dd-622d-4bed-b3fa-81cc962c21ef service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.888580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ef499a88-b6ac-4e4e-969e-0d54a24d15d8 req-ca1548dd-622d-4bed-b3fa-81cc962c21ef service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.889268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ef499a88-b6ac-4e4e-969e-0d54a24d15d8 req-ca1548dd-622d-4bed-b3fa-81cc962c21ef service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.908090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.908090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.908090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.908090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.908090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.908090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.960250 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ef499a88-b6ac-4e4e-969e-0d54a24d15d8 req-ca1548dd-622d-4bed-b3fa-81cc962c21ef service nova] Creating event network-vif-deleted:81d55a8b-2bfb-4ba3-a0ab-7d78b300d809 for instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 on n-h2-860863-4 Nov 02 21:47:05.973298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ef499a88-b6ac-4e4e-969e-0d54a24d15d8 req-ca1548dd-622d-4bed-b3fa-81cc962c21ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118624 Nov 02 21:47:05.974172 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2374/4842] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:47:05.985554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:05.985554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:05.993153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.994253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.994871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:05.995761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:05.996216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:05.996642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:06.632488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:06.647495 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7458a60-08e0-4792-af39-b1cf11231ed1 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1811 microversion: 2.1 time: 0.775112 Nov 02 21:47:06.655165 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2469/4843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:05 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1811 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:06.677927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:06.690564 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-11ec1a16-8e72-4e56-b13b-54c2fc1f9a62 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1508 microversion: 2.1 time: 0.714761 Nov 02 21:47:06.692516 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2375/4844] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:05 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1508 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:06.765144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:06.765914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:06.779253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:06.784816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:06.785431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:06.786279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:06.786932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:06.788674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:07.015492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:07.026400 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b74568a0-716d-48a6-ab56-c9248493cb24 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 200 len: 1620 microversion: 2.1 time: 0.265963 Nov 02 21:47:07.032799 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2470/4845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:06 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 1620 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:07.674764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:07.679089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:07.693944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:07.694643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:07.695188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:07.696003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:07.696708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:07.697398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:07.718506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:07.719136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:07.737078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:07.737901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:07.738554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:07.739464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:07.740104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:07.740716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.270786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:08.275464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:08.284409 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47741dbc-38b9-4dd9-9c5f-dbf1024bb5f5 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1811 microversion: 2.1 time: 0.613765 Nov 02 21:47:08.286273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3be6e3f3-03f4-45ae-92bd-d8523d1c29ba tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1512 microversion: 2.1 time: 0.571342 Nov 02 21:47:08.307090 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2376/4846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:07 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1811 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:08.307320 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2471/4847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:07 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1512 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:08.316229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:08.320990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:08.321793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: 29976160-96b8-47c8-b3a9-cb8a1a3c3b02] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:08.337981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.338488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.339217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.339921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.340342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.340776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.342034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:08.346642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.servers [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Removing options 'limit' from query {{(pid=121040) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 21:47:08.347998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:08.349379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.351393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.352014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.355638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.356344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.356975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.358774 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-018ee33f-8c6a-4ef7-abf5-735f21e3ea45 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.043121 Nov 02 21:47:08.363073 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 could not be found. Nov 02 21:47:08.364731 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2472/4848] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 21:47:08 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 HTTP/1.1 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 could not be found. Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '29976160-96b8-47c8-b3a9-cb8a1a3c3b02'} Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 could not be found. Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 could not be found. Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:08.373154 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 could not be found. Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 404 to user: Instance 29976160-96b8-47c8-b3a9-cb8a1a3c3b02 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-856cbe78-c9d5-4fc1-a969-f6a6bbf0020d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02" status: 404 len: 111 microversion: 2.1 time: 0.072217 Nov 02 21:47:08.378664 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2377/4849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:08 2022] GET /compute/v2.1/servers/29976160-96b8-47c8-b3a9-cb8a1a3c3b02 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:47:08.383534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ee4582d-3287-45e8-8d5a-fe2a9f3492f3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '.version_select at 0x7f9b683180d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:08.385880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:08.386703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:08.396032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.399203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.399203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.399203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.399203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.399203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.502850 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ee4582d-3287-45e8-8d5a-fe2a9f3492f3 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670900422" status: 202 len: 0 microversion: 2.1 time: 0.118875 Nov 02 21:47:08.505499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2378/4850] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:47:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670900422 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:47:08.871856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:08.885476 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4e9a2ef4-dee3-4f49-b93f-c0666ee7a497 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1512 microversion: 2.1 time: 0.504455 Nov 02 21:47:08.896168 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2473/4851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:08 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:08.918731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:08.919392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:08.929175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.929668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.930109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:08.937358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:08.937857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:08.938302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:09.023129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e189390f-85bb-42ff-8b09-e144a276803c req-5125b840-491f-4df4-9742-4b9305068d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "name": "network-vif-deleted", "tag": "1dabad0a-8b5e-45ea-bfd4-7f442e2684ef"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:09.039678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e189390f-85bb-42ff-8b09-e144a276803c req-5125b840-491f-4df4-9742-4b9305068d12 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:09.039678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e189390f-85bb-42ff-8b09-e144a276803c req-5125b840-491f-4df4-9742-4b9305068d12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:09.039678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e189390f-85bb-42ff-8b09-e144a276803c req-5125b840-491f-4df4-9742-4b9305068d12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:09.070392 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e189390f-85bb-42ff-8b09-e144a276803c req-5125b840-491f-4df4-9742-4b9305068d12 service nova] Creating event network-vif-deleted:1dabad0a-8b5e-45ea-bfd4-7f442e2684ef for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:47:09.085221 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e189390f-85bb-42ff-8b09-e144a276803c req-5125b840-491f-4df4-9742-4b9305068d12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064148 Nov 02 21:47:09.085221 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2474/4852] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:47:09.314046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:09.316304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:09.322946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:09.323789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:09.330931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:09.332360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:09.333094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:09.333749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:09.919099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:09.930086 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5940b790-c683-492f-9f1b-00dde4148845 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1675 microversion: 2.1 time: 0.620367 Nov 02 21:47:09.935422 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2475/4853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:09 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1675 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:09.941744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:09.950196 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72d58c8a-a6fe-4569-9667-72f92c1cbb44 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1510 microversion: 2.1 time: 1.035389 Nov 02 21:47:09.966596 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2379/4854] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:08 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1510 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:09.973457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:09.974358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:09.981296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:09.982030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:09.982670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:09.983562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:09.984191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:09.989289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:10.603155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:10.615975 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6de15df1-9b77-4026-b837-28e7c015d249 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1511 microversion: 2.1 time: 0.647021 Nov 02 21:47:10.617238 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2476/4855] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:09 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1511 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:10.648768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:10.674232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:10.678098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:10.964571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:10.965247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:10.982529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:10.982529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:10.982754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:10.983439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:10.984135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:10.984757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:10.989446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:10.990039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:10.990381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:10.991157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:10.991820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:10.992262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:11.214310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:11.350926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ba0e921-e1b8-4f84-96d2-5e7a200d8111 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.707012 Nov 02 21:47:11.353796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2380/4856] 10.222.0.25 () {58 vars in 1154 bytes} [Wed Nov 2 21:47:10 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:11.364136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8f919c58-9957-45a0-821e-5c957851d18e req-fac9875a-47d9-4424-b4a9-449a33ce7863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "name": "network-vif-unplugged", "status": "completed", "tag": "e627cb20-9ba5-4f69-9b5b-1bd43ff12db9"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:11.389068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8f919c58-9957-45a0-821e-5c957851d18e req-fac9875a-47d9-4424-b4a9-449a33ce7863 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:11.394145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8f919c58-9957-45a0-821e-5c957851d18e req-fac9875a-47d9-4424-b4a9-449a33ce7863 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:11.395020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8f919c58-9957-45a0-821e-5c957851d18e req-fac9875a-47d9-4424-b4a9-449a33ce7863 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:11.419306 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8f919c58-9957-45a0-821e-5c957851d18e req-fac9875a-47d9-4424-b4a9-449a33ce7863 service nova] Creating event network-vif-unplugged:e627cb20-9ba5-4f69-9b5b-1bd43ff12db9 for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:47:11.429458 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8f919c58-9957-45a0-821e-5c957851d18e req-fac9875a-47d9-4424-b4a9-449a33ce7863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073887 Nov 02 21:47:11.432246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2381/4857] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:11.444436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:11.445195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:11.458307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:11.458713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:11.459153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:11.463329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:11.463819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:11.464266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:11.566756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:11.577384 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cf0c006-0ffd-4a15-a3ed-e1b211045eb3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1654 microversion: 2.1 time: 0.617073 Nov 02 21:47:11.593962 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2477/4858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:10 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1654 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:11.601664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-17650c71-6e94-4203-b218-481044043261 req-49a82f89-e784-4c57-903b-305fcea5d896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "name": "network-vif-deleted", "tag": "0b050332-3102-4354-b0f5-c8e02e9298f8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:11.619968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-17650c71-6e94-4203-b218-481044043261 req-49a82f89-e784-4c57-903b-305fcea5d896 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:11.621737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-17650c71-6e94-4203-b218-481044043261 req-49a82f89-e784-4c57-903b-305fcea5d896 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:11.622392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-17650c71-6e94-4203-b218-481044043261 req-49a82f89-e784-4c57-903b-305fcea5d896 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:11.653775 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-17650c71-6e94-4203-b218-481044043261 req-49a82f89-e784-4c57-903b-305fcea5d896 service nova] Creating event network-vif-deleted:0b050332-3102-4354-b0f5-c8e02e9298f8 for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:47:11.662181 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-17650c71-6e94-4203-b218-481044043261 req-49a82f89-e784-4c57-903b-305fcea5d896 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066040 Nov 02 21:47:11.662982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2478/4859] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:11.864123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:11.877353 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f6a0812-596a-4ccc-938f-e88502c340d0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1512 microversion: 2.1 time: 0.439563 Nov 02 21:47:11.889398 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2382/4860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:11 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:11.927835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:11.929095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:11.937094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:11.940788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:11.940788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:11.941311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:11.941951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:11.942555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:12.292733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:12.311478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe1ece17-af9a-4ef1-afd2-c34ca4126dbd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1510 microversion: 2.1 time: 0.414562 Nov 02 21:47:12.312450 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2479/4861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:11 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:12.334575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:12.335877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:12.343064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:12.343789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:12.344405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:12.345306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:12.346494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:12.347094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:12.602988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:12.604027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:12.616498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:12.624449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:12.627638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:12.633231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:12.634298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:12.634949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:12.719471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:12.749510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c4a1fb8e-29c6-4e72-a516-363c53e53fb9 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1511 microversion: 2.1 time: 0.418633 Nov 02 21:47:12.765239 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2383/4862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:12 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:12.779411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:12.790620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:12.797510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:12.845133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:12.845809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:12.846337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:12.851033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:12.851674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:12.854758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:12.975114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:12.986546 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edee9c38-6372-4f83-992a-93ba73d5c259 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1455 microversion: 2.1 time: 0.388254 Nov 02 21:47:12.997578 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2480/4863] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:12 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1455 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:13.045166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:13.138589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:13.159304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:13.160269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:13.160889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:13.686397 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8661b73e-b163-4643-b6c3-31ce7ebfbc79 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.915936 Nov 02 21:47:13.687067 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2384/4864] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:47:12 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:13.737118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:13.746873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:13.747660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:13.806497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-80b5bff6-5fe5-45c4-989c-297c3d6b9c1b req-bd3cb0eb-7608-4903-a062-7daab2f952e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e818a2-c9ff-45be-bdbe-12c2821e543c", "name": "network-vif-deleted", "tag": "e627cb20-9ba5-4f69-9b5b-1bd43ff12db9"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:13.825566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-80b5bff6-5fe5-45c4-989c-297c3d6b9c1b req-bd3cb0eb-7608-4903-a062-7daab2f952e6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:13.830203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-80b5bff6-5fe5-45c4-989c-297c3d6b9c1b req-bd3cb0eb-7608-4903-a062-7daab2f952e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:13.845436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-80b5bff6-5fe5-45c4-989c-297c3d6b9c1b req-bd3cb0eb-7608-4903-a062-7daab2f952e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:13.939990 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-80b5bff6-5fe5-45c4-989c-297c3d6b9c1b req-bd3cb0eb-7608-4903-a062-7daab2f952e6 service nova] Creating event network-vif-deleted:e627cb20-9ba5-4f69-9b5b-1bd43ff12db9 for instance 67e818a2-c9ff-45be-bdbe-12c2821e543c on n-h2-860863-4 Nov 02 21:47:13.949224 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-80b5bff6-5fe5-45c4-989c-297c3d6b9c1b req-bd3cb0eb-7608-4903-a062-7daab2f952e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146947 Nov 02 21:47:13.953789 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2385/4865] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:14.009850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.010341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.010788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.011537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.011984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.012420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.026190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:14.027160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:14.035429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.036265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.037046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.038152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.039027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.039631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.127720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.130737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.131474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.133850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lazy-loading 'fault' on Instance uuid 67e818a2-c9ff-45be-bdbe-12c2821e543c {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:47:14.272128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:14.297710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:14.309791 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72882cd9-2540-4f0e-8c99-96d51cc16e9e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 200 len: 1303 microversion: 2.1 time: 0.289103 Nov 02 21:47:14.329123 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2386/4866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:14 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 1303 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:14.441094 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23d45d4e-c90b-45d1-96be-d4d466d10e9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.705331 Nov 02 21:47:14.458749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:14.462099 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2481/4867] 10.222.0.25 () {58 vars in 1150 bytes} [Wed Nov 2 21:47:13 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:14.466878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:14.471213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:14.489823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.490460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.491150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.495464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.504482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.511290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.727710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:14.825201 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d150663-50df-43fb-b1b3-160840c6ac9a tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.369839 Nov 02 21:47:14.826540 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2387/4868] 10.222.0.25 () {58 vars in 1212 bytes} [Wed Nov 2 21:47:14 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:14.842710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:14.851003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:14.854706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:14.870612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.871402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.872479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:14.874555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:14.875445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:14.876290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:15.037628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:15.202478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02bff08d-56f8-498e-a794-ae1d23059c08 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.366881 Nov 02 21:47:15.214049 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2482/4869] 10.222.0.25 () {58 vars in 1196 bytes} [Wed Nov 2 21:47:14 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:15.226645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:15.234632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:15.235337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'name': '1088469385', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:15.260277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:15.261449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:15.261926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:15.262744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:15.263206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:15.263638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:15.344952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:15.347349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:15.365264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:15.366487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:15.368201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:15.369873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:15.371758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:15.373645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:15.422837 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] HTTP exception thrown: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Request method failure captured: Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c HTTP/1.1 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuUUTUtMhyBIqFdlPXYLyUzzoruz3buM7aXzBHpYpHVEZyAMUzum7EFss2vIlZGzWKdCdPkNejxUtJJjJYs0FQKIWIVSeOJzpJr9Gejsj__6C5zSSpxhoTR5bUh326uYhaJl-UWgfT3omcd46A8clbowoPlU4I__STYAMfcJwpsJ8ck Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestMultiNic-872713671 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestMultiNic-872713671-project Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8e67ab12debe4aba94cb5d0023931e2b Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestMultiNic-872713671-project Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '67e818a2-c9ff-45be-bdbe-12c2821e543c'} Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:15.437488 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:15.443470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Returning 404 to user: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:15.444157 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89cd30ae-6d8a-4a2b-bd50-1567d3cc6b70 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 404 len: 111 microversion: 2.1 time: 0.105306 Nov 02 21:47:15.447895 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2483/4870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:15 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:47:16.128796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:16.209343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:16.252820 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f3b2bc20-6f29-484d-bece-99497a7a532e tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?name=1088469385" status: 200 len: 346 microversion: 2.1 time: 1.025437 Nov 02 21:47:16.252820 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2388/4871] 10.222.0.25 () {58 vars in 1156 bytes} [Wed Nov 2 21:47:15 2022] GET /compute/v2.1/servers?name=1088469385 => generated 346 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:16.263476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:16.272332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:16.277301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:16.294574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:16.301362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:16.302231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:16.303215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:16.303854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:16.304801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:16.466526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:16.483189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:16.543128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0ba60d4-b72d-4922-99b9-9153d306caa7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.283657 Nov 02 21:47:16.544373 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2484/4872] 10.222.0.25 () {58 vars in 1154 bytes} [Wed Nov 2 21:47:16 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:16.557289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:16.570882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:16.572189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-108846938', 'deleted': False, 'project_id': '74f2e3b11ecd425e942701fab82dba02'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:16.589028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:16.592661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:16.593471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:16.594456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:16.596370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:16.599716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:16.798519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:16.933106 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c9e497e-7592-431e-9640-4387043921dd tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-108846938" status: 200 len: 346 microversion: 2.1 time: 0.379537 Nov 02 21:47:16.942435 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2389/4873] 10.222.0.25 () {58 vars in 1228 bytes} [Wed Nov 2 21:47:16 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-108846938 => generated 346 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:16.950319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:16.950986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:16.968101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:16.969075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:16.969862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:16.971162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:16.971859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:16.972295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:17.008194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:17.430050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bed9244a-fc78-4c95-b525-586bb36669b7 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "DELETE /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 204 len: 0 microversion: 2.1 time: 0.485658 Nov 02 21:47:17.431248 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2485/4874] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:16 2022] DELETE /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:17.441058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:17.442911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:17.462451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:17.462953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:17.463403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:17.473831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:17.474358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:17.479637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:18.120095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:18.129060 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6eaa5c0e-c419-4e67-b97a-f0e0a9944315 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1517 microversion: 2.1 time: 0.693223 Nov 02 21:47:18.134084 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2390/4875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:17 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1517 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:18.401918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1722414124", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "0d24f025-2d0e-45a1-8799-4036fd78c2a4"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:18.498039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] validate_networks() for [('0d24f025-2d0e-45a1-8799-4036fd78c2a4', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:47:18.728373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1821164722", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:18.834204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:47:20.672335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:47:20.672888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:47:20.673066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:47:20.673791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:47:20.674451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:47:20.711391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:20.715990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:20.716970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:20.723827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:20.727601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:20.727940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:20.830663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Getting quotas for project 4b75daabf84e4861ac29d01e41d90b79. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:47:20.854620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Getting quotas for user a1e677c1cd1e46e6b8a98b5f6f9cd140 and project 4b75daabf84e4861ac29d01e41d90b79. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:47:20.902113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:47:20.904811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:47:21.086471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:47:21.087190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:47:21.087567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:47:21.088143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:47:21.088685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:47:21.113345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:21.118084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:21.118690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:21.119621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:21.120535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:21.121156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:21.131011 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-940c4eae-2e2c-4e1b-a29f-709ea0781c15 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.402709 Nov 02 21:47:21.133057 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2391/4876] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:47:21.147161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:21.147917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:21.179953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:21.183027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:21.187768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:21.188863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:21.189768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:21.190398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:21.218446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Getting quotas for project 6164e68cad634d739964f17a76cdafda. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:47:21.238615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Getting quotas for user 00a7ed00fe564141ba3c5a7030ec4613 and project 6164e68cad634d739964f17a76cdafda. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:47:21.279334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Going to run 2 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:47:21.282343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: abfe24a6-81f0-46d7-8956-8a724a647a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:47:21.376339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:21.395464 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a25d0f8e-0fe5-46c2-a60f-afb1d1c99d93 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1475 microversion: 2.1 time: 0.255452 Nov 02 21:47:21.406629 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2392/4877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:21 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:21.424898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff174b44-5b50-4169-8dc7-7b43e6cbfb7f tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:21.429653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff174b44-5b50-4169-8dc7-7b43e6cbfb7f tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:21.463622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=abfe24a6-81f0-46d7-8956-8a724a647a77,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:47:21.696496 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-849a9a9e-8ded-48d8-a72e-5b93e82b9dd1 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.611097 Nov 02 21:47:21.708368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2486/4878] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:47:21.722082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:21.741176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:21.742569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Searching by: {'deleted': False, 'project_id': '6164e68cad634d739964f17a76cdafda'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:21.755031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff174b44-5b50-4169-8dc7-7b43e6cbfb7f tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:21.792283 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff174b44-5b50-4169-8dc7-7b43e6cbfb7f tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1215 microversion: 2.1 time: 0.374931 Nov 02 21:47:21.793200 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2393/4879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:21 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:21.811249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:21.811951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:21.818938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:21.820111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:21.821000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:21.822266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:21.889812 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90116c0b-ab5d-4f43-8213-dc153a746a7d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.179491 Nov 02 21:47:21.890991 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2487/4880] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:47:21 2022] GET /compute/v2.1/servers => generated 677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:21.904070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e654489-1b6c-46b1-8b22-a74c4653137e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:21.907226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e654489-1b6c-46b1-8b22-a74c4653137e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:22.062711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e654489-1b6c-46b1-8b22-a74c4653137e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:22.074229 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e654489-1b6c-46b1-8b22-a74c4653137e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1220 microversion: 2.1 time: 0.174284 Nov 02 21:47:22.077173 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2394/4881] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:21 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:22.125206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7d966c0f-2c45-4c88-97a7-5ed4c7fe845f req-2c47a5c9-b19a-4440-8144-40ce69a2e762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f2e11-2c45-4125-a365-62130bcafcfe", "name": "network-vif-deleted", "tag": "13aeb2a3-b0c6-44db-a3a6-f06169d5904a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:22.142574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7d966c0f-2c45-4c88-97a7-5ed4c7fe845f req-2c47a5c9-b19a-4440-8144-40ce69a2e762 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:22.146725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7d966c0f-2c45-4c88-97a7-5ed4c7fe845f req-2c47a5c9-b19a-4440-8144-40ce69a2e762 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:22.148655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7d966c0f-2c45-4c88-97a7-5ed4c7fe845f req-2c47a5c9-b19a-4440-8144-40ce69a2e762 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:22.212174 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7d966c0f-2c45-4c88-97a7-5ed4c7fe845f req-2c47a5c9-b19a-4440-8144-40ce69a2e762 service nova] Creating event network-vif-deleted:13aeb2a3-b0c6-44db-a3a6-f06169d5904a for instance 690f2e11-2c45-4125-a365-62130bcafcfe on n-h2-860863-4 Nov 02 21:47:22.235599 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7d966c0f-2c45-4c88-97a7-5ed4c7fe845f req-2c47a5c9-b19a-4440-8144-40ce69a2e762 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121079 Nov 02 21:47:22.246859 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2488/4882] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:22.431733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:22.432548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:22.451066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:22.451964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:22.452690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:22.453689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:22.454403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:22.455617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:22.823193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba6df2ef-3158-45c8-b8b7-8122a0b30211 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:22.824095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba6df2ef-3158-45c8-b8b7-8122a0b30211 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:22.919853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:22.949392 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31100aad-6f9f-4d29-8f32-dea94fff9b20 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 200 len: 1306 microversion: 2.1 time: 0.522114 Nov 02 21:47:22.956519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2395/4883] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:22 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 1306 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:23.026042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba6df2ef-3158-45c8-b8b7-8122a0b30211 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:23.046092 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba6df2ef-3158-45c8-b8b7-8122a0b30211 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1215 microversion: 2.1 time: 0.228624 Nov 02 21:47:23.053114 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2489/4884] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:22 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1215 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:23.100584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e8ff5335-bf5f-47d2-8ae9-79d97158429d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:23.101971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e8ff5335-bf5f-47d2-8ae9-79d97158429d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:23.188906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e8ff5335-bf5f-47d2-8ae9-79d97158429d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:23.200149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e8ff5335-bf5f-47d2-8ae9-79d97158429d tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1220 microversion: 2.1 time: 0.102717 Nov 02 21:47:23.200829 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2396/4885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:23 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:23.987808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:23.987808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 690f2e11-2c45-4125-a365-62130bcafcfe] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:24.003419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.003997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.004548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.008128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.009558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.011527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.055435 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] HTTP exception thrown: Instance 690f2e11-2c45-4125-a365-62130bcafcfe could not be found. Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Request method failure captured: Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe HTTP/1.1 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuUOofYHooBwxx0sz1GU1PlmwVOopOjFpbMEpVlAjxzFPT78alnXOiX_oZUjXDSKYbR1GlSzKcB917899_DnMgjVF9b_faLUvvWJQPQfN3QVRZtzNlz14AQqj4g9Lsm817NWPhV25DQUTpQ7CpN5Lg8dr_SCJtxJBaBEDPchSuhVlKY Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 74f2e3b11ecd425e942701fab82dba02 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 74f2e3b11ecd425e942701fab82dba02 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ListServerFiltersTestJSON-1698275639-project Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: f34842288b784bf796fa2c37e8364712 Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ListServerFiltersTestJSON-1698275639-project Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 690f2e11-2c45-4125-a365-62130bcafcfe could not be found. Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '690f2e11-2c45-4125-a365-62130bcafcfe'} Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 690f2e11-2c45-4125-a365-62130bcafcfe could not be found. Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 690f2e11-2c45-4125-a365-62130bcafcfe could not be found. Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:24.057574 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:24.063218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:24.063218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:24.063218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:24.063218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:24.063218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:24.063218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 690f2e11-2c45-4125-a365-62130bcafcfe could not be found. Nov 02 21:47:24.063218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:24.073065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Returning 404 to user: Instance 690f2e11-2c45-4125-a365-62130bcafcfe could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:24.082095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:24.082609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:24.088460 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32900863-4bf4-43ee-82d3-4877613b4d66 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe" status: 404 len: 111 microversion: 2.1 time: 0.090632 Nov 02 21:47:24.091663 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2490/4886] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:23 2022] GET /compute/v2.1/servers/690f2e11-2c45-4125-a365-62130bcafcfe => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:47:24.110889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:24.111640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.111761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:24.111877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.111877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.111877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.111877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.111877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.113827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.114514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.114880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.115858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.116397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.116943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.155919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:24.312655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:24.330748 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e672fc20-4685-4af6-8b2c-f349e9acb090 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1267 microversion: 2.1 time: 0.260041 Nov 02 21:47:24.347805 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2397/4887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:24 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:24.353154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2434ed9a-d6c3-4836-abf5-67b9988a370e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:24.354129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2434ed9a-d6c3-4836-abf5-67b9988a370e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:24.420549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2434ed9a-d6c3-4836-abf5-67b9988a370e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:24.454536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2434ed9a-d6c3-4836-abf5-67b9988a370e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1220 microversion: 2.1 time: 0.079751 Nov 02 21:47:24.455546 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2398/4888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:24 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:24.555878 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-125fcb26-a907-4279-a989-77f182f28517 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 204 len: 0 microversion: 2.1 time: 0.451533 Nov 02 21:47:24.555878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2491/4889] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:24 2022] DELETE /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:24.557581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:24.558312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:24.561809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:24.571783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:24.572672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.572814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:24.573128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.573333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.574058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.576899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.577362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.591143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.593240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.594916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.596438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:24.597764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:24.599549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:24.634950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:24.995853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:25.014109 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a5bf94b-2300-4567-a321-f7de885789b0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1516 microversion: 2.1 time: 0.450469 Nov 02 21:47:25.014109 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2492/4890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:24 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1516 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:25.070740 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8b5fb202-4841-41ad-b055-b716128bf637 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 204 len: 0 microversion: 2.1 time: 0.516691 Nov 02 21:47:25.071348 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2399/4891] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:24 2022] DELETE /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:25.082221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:25.083116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:25.094934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:25.110080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:25.111501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:25.112580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:25.125606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:25.126246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:25.365574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:25.383372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:25.401306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:25.402605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:25.403423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:25.406630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:25.407610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:25.411540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:25.593584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:25.609115 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-97be8090-55db-4d20-96c3-fe61e1ee0aa6 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1508 microversion: 2.1 time: 0.531528 Nov 02 21:47:25.610875 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2493/4892] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:25 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:25.628600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:25.630960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:25.632540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:25.642936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:25.643296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ec427f6-0604-49d7-8ad6-151fc551ddd2 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1273 microversion: 2.1 time: 0.289903 Nov 02 21:47:25.643890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:25.645521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:25.645659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2400/4893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:25 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:25.647453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:25.648141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:25.648787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:25.797516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:25.807301 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f45328f7-911f-476c-bd6b-93f78ebe7f6e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1224 microversion: 2.1 time: 0.193635 Nov 02 21:47:25.807963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2494/4894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:25 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1224 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:26.037696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:26.038321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:26.046536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:26.047042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:26.047490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:26.048202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:26.048902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:26.061803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:26.521427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:26.539754 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8d9e649-a58b-470c-b38d-d292404c0a35 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1516 microversion: 2.1 time: 0.506454 Nov 02 21:47:26.540366 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2401/4895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:26 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1516 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:26.637597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:26.638999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:26.647319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:26.653519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:26.653985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:26.661512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:26.662237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:26.663023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:26.667661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:26.668286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:26.687304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:26.687813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:26.688261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:26.689040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:26.690781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:26.691259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:27.800877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:27.812267 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e67a8787-6482-4103-8e84-d1474ccc7d17 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 1.148358 Nov 02 21:47:27.816520 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2402/4896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:26 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:27.838920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:27.839564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:27.856871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:27.857628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:27.858259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:27.859443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:27.860073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:27.860667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:27.942241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:27.952284 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a75240b0-3ea4-4fdb-a894-2cea27649301 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1508 microversion: 2.1 time: 1.318622 Nov 02 21:47:27.953465 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2495/4897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:26 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1508 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:27.979899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:27.980528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:28.014321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:28.015543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:28.019353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:28.020472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:28.021201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:28.028075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:28.057055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:28.069766 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-387f5c72-b661-4f10-b7bf-ea967f417275 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1216 microversion: 2.1 time: 0.251869 Nov 02 21:47:28.070758 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2403/4898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:27 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1216 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:28.446254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:28.455478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f425a6a-8e17-4118-a498-7a5f0c47b0c5 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1516 microversion: 2.1 time: 0.499899 Nov 02 21:47:28.465454 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2496/4899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:27 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1516 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:28.835815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:28.836469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:28.853319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:28.853697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:28.854350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:28.855242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:28.855871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:28.856478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.208890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:29.209546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:29.217112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:29.219118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:29.219857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.221073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:29.221737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:29.223312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.432490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:29.433285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:29.442548 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c6e2e51f-1049-479e-91f8-bbab447d1539 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1466 microversion: 2.1 time: 0.469837 Nov 02 21:47:29.444058 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ba4fd88-1022-44ef-a5a0-4910c29bd376 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.610633 Nov 02 21:47:29.445233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2404/4901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:28 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:29.447588 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2497/4900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:28 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1466 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:29.450338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:29.451222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:29.455339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8603e58f-d88c-4d25-a746-ab4623981386 req-07a5888b-09e0-49ea-9dc5-ff4905f44d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd55ba83-9cae-44f7-8a0f-8cb4ed408dad", "name": "network-vif-deleted", "tag": "7fd216f5-6a20-45d0-b169-f23f091c542c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:29.471935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:29.473814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:29.475032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.476251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:29.476877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:29.477811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.484125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8603e58f-d88c-4d25-a746-ab4623981386 req-07a5888b-09e0-49ea-9dc5-ff4905f44d34 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:29.486147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8603e58f-d88c-4d25-a746-ab4623981386 req-07a5888b-09e0-49ea-9dc5-ff4905f44d34 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:29.487221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8603e58f-d88c-4d25-a746-ab4623981386 req-07a5888b-09e0-49ea-9dc5-ff4905f44d34 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.524908 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8603e58f-d88c-4d25-a746-ab4623981386 req-07a5888b-09e0-49ea-9dc5-ff4905f44d34 service nova] Creating event network-vif-deleted:7fd216f5-6a20-45d0-b169-f23f091c542c for instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad on n-h1-860863-4 Nov 02 21:47:29.547751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8603e58f-d88c-4d25-a746-ab4623981386 req-07a5888b-09e0-49ea-9dc5-ff4905f44d34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098829 Nov 02 21:47:29.556480 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2498/4902] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:29.562733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:29.565575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:29.578820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:29.579815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:29.580447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.581802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:29.589638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:29.589638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:29.820509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:29.834745 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e98629a6-c4d5-4e9e-8862-4247f78d9b3b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1272 microversion: 2.1 time: 0.385240 Nov 02 21:47:29.837736 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2405/4903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:29 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:30.000237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:30.012903 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50ebb840-79c4-4361-9980-ba9106839e3d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1516 microversion: 2.1 time: 0.454935 Nov 02 21:47:30.014547 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2499/4904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:29 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1516 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:30.479082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:30.481167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:30.481620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:30.483162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:30.495953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:30.497922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:30.501150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:30.502254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:30.502989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:30.503994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:30.504766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:30.505502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:30.506302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:30.507377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:30.508016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:30.511306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:30.514847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:30.628230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:30.629297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:30.630075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:30.630809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lazy-loading 'fault' on Instance uuid bd55ba83-9cae-44f7-8a0f-8cb4ed408dad {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:47:30.771659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=14 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:30.891584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:30.910547 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0956a68c-74a0-4126-955a-672852df9118 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 200 len: 1312 microversion: 2.1 time: 0.441364 Nov 02 21:47:30.911842 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2406/4905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:30 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 1312 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:30.988790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:30.997187 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96bc018a-d175-4249-a68d-623e0051b609 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.528785 Nov 02 21:47:31.018134 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2500/4906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:30 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:31.034149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:31.035224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:31.042059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.042906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.043567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:31.044516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.045251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.045902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:31.069817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-aab5e4d5-9007-46a1-a03c-03354714c818 req-d1605e58-e5b3-42e7-b788-aa0a79b3b08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74613c2-6e0b-467c-83bc-7afcb88e7b3b", "tag": "bbc0973d-d6d9-44b8-891b-9c42bfa2672e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:31.093810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aab5e4d5-9007-46a1-a03c-03354714c818 req-d1605e58-e5b3-42e7-b788-aa0a79b3b08c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.099401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aab5e4d5-9007-46a1-a03c-03354714c818 req-d1605e58-e5b3-42e7-b788-aa0a79b3b08c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.100065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aab5e4d5-9007-46a1-a03c-03354714c818 req-d1605e58-e5b3-42e7-b788-aa0a79b3b08c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:31.139174 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-aab5e4d5-9007-46a1-a03c-03354714c818 req-d1605e58-e5b3-42e7-b788-aa0a79b3b08c service nova] Creating event network-changed:bbc0973d-d6d9-44b8-891b-9c42bfa2672e for instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b on n-h2-860863-4 Nov 02 21:47:31.148727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-aab5e4d5-9007-46a1-a03c-03354714c818 req-d1605e58-e5b3-42e7-b788-aa0a79b3b08c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234931 Nov 02 21:47:31.151648 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2407/4907] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:31.170180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:31.170180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:31.183152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.183525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.187921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:31.188725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.189963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.190481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:31.252711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:31.491249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:31.503176 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-960b6847-df37-428b-ac08-106ecdecf29f tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1474 microversion: 2.1 time: 0.346745 Nov 02 21:47:31.537320 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2408/4908] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:31 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:31.622315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:31.646693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d2ab366-f929-4615-87eb-8f3ff0222dbb tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.627045 Nov 02 21:47:31.647843 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2501/4909] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:31 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:31.772487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1406987999", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "2e7fe7bc-a60e-49c1-8db4-708189842d92"}, {"uuid": "9047d58a-3578-4704-87c9-9db8c3cc4707"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:31.863168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] validate_networks() for [('2e7fe7bc-a60e-49c1-8db4-708189842d92', None, None, None, None, None), ('9047d58a-3578-4704-87c9-9db8c3cc4707', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:47:31.939745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:31.940961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: bd55ba83-9cae-44f7-8a0f-8cb4ed408dad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:31.946800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:31.948948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.949646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.950285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:31.951168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.951789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.952389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:31.968485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:31.971132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad could not be found. Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad HTTP/1.1 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad could not be found. Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'bd55ba83-9cae-44f7-8a0f-8cb4ed408dad'} Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad could not be found. Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad could not be found. Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:31.972671 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad could not be found. Nov 02 21:47:31.977923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:31.979390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 404 to user: Instance bd55ba83-9cae-44f7-8a0f-8cb4ed408dad could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:31.980415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e1aeb65-edd4-458f-af78-fe39ef5e97c0 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad" status: 404 len: 111 microversion: 2.1 time: 0.046188 Nov 02 21:47:31.984993 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2502/4910] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:31 2022] GET /compute/v2.1/servers/bd55ba83-9cae-44f7-8a0f-8cb4ed408dad => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:47:31.990324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:31.991065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:31.997840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:31.998671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:31.999277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:32.000156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:32.000783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:32.002185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:32.033955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:32.397833 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96945604-dcdb-4cb5-a955-47fb2e7c921d tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 204 len: 0 microversion: 2.1 time: 0.411123 Nov 02 21:47:32.399474 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2503/4911] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:31 2022] DELETE /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:32.405872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:32.406613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:32.420787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:32.433049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:32.433628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:32.434549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:32.435178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:32.435793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:32.817681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:32.834271 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8be747f-4e5e-4b98-a02a-39fb2d057ab8 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.433171 Nov 02 21:47:32.850295 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2504/4912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:32 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:32.857266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:32.858374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:32.868610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:32.869363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:32.870434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:32.871323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:32.872094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:32.872699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.043969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:33.211529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:47:33.212022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:47:33.212414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:47:33.212825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:47:33.213379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:47:33.225045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.225547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.226022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.226750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.227264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.227693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.255473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Getting quotas for project f6de6b9842554c11a1e54fd084cfd316. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:47:33.258432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:33.269384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Getting quotas for user 8e67ab12debe4aba94cb5d0023931e2b and project f6de6b9842554c11a1e54fd084cfd316. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:47:33.275759 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da6db78d-73e4-435d-b517-a6e699095639 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.424163 Nov 02 21:47:33.278512 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2505/4913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:32 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:33.284536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:47:33.285125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:33.285952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:33.287115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:47:33.295681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.297087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.299265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.300404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.300909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.301579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.340357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.341251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.342090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.342728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lazy-loading 'fault' on Instance uuid 1d038722-0e6f-4c00-9b7c-003408be38bc {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:47:33.451723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:33.459138 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92b1346b-291f-4e96-9460-818f06ff73f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690930 Nov 02 21:47:33.469278 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c15e5972-8c42-4dfa-b3da-a7b2bde63189 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1310 microversion: 2.1 time: 0.188977 Nov 02 21:47:33.470797 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2506/4914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:33 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1310 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:33.477451 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2409/4915] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:47:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:47:33.486878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:33.487896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:33.498671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.499474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.500165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.501155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.503497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.504236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.515039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b49ebb6f-a03c-454a-b378-d2b19408bf07 req-571b26cb-1de2-4eb1-a151-0e349ecd5fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d038722-0e6f-4c00-9b7c-003408be38bc", "name": "network-vif-deleted", "tag": "ec2d4c00-8e9c-4bf5-b1b5-a47d5106e80c"}, {"name": "network-changed", "server_uuid": "abfe24a6-81f0-46d7-8956-8a724a647a77", "tag": "baac467a-6e2b-433c-b8ea-1d96ac1af3ca"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:33.529075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b49ebb6f-a03c-454a-b378-d2b19408bf07 req-571b26cb-1de2-4eb1-a151-0e349ecd5fd6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.529873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b49ebb6f-a03c-454a-b378-d2b19408bf07 req-571b26cb-1de2-4eb1-a151-0e349ecd5fd6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.530484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b49ebb6f-a03c-454a-b378-d2b19408bf07 req-571b26cb-1de2-4eb1-a151-0e349ecd5fd6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.545662 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b49ebb6f-a03c-454a-b378-d2b19408bf07 req-571b26cb-1de2-4eb1-a151-0e349ecd5fd6 service nova] Creating event network-vif-deleted:ec2d4c00-8e9c-4bf5-b1b5-a47d5106e80c for instance 1d038722-0e6f-4c00-9b7c-003408be38bc on n-h1-860863-4 Nov 02 21:47:33.546396 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b49ebb6f-a03c-454a-b378-d2b19408bf07 req-571b26cb-1de2-4eb1-a151-0e349ecd5fd6 service nova] Creating event network-changed:baac467a-6e2b-433c-b8ea-1d96ac1af3ca for instance abfe24a6-81f0-46d7-8956-8a724a647a77 on n-h2-860863-4 Nov 02 21:47:33.561709 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b49ebb6f-a03c-454a-b378-d2b19408bf07 req-571b26cb-1de2-4eb1-a151-0e349ecd5fd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.082881 Nov 02 21:47:33.562602 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2410/4916] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:33.568035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-49f8f69e-33c2-4861-8e37-dcc885ba72a3 req-be97661e-57d5-47c7-b37a-413056446068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e718d3d-faf9-4032-b2f9-71f3a39b6048", "tag": "bef74976-58e0-4493-9857-75cf1aa4c9a8"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:33.581163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-49f8f69e-33c2-4861-8e37-dcc885ba72a3 req-be97661e-57d5-47c7-b37a-413056446068 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.581980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-49f8f69e-33c2-4861-8e37-dcc885ba72a3 req-be97661e-57d5-47c7-b37a-413056446068 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.582604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-49f8f69e-33c2-4861-8e37-dcc885ba72a3 req-be97661e-57d5-47c7-b37a-413056446068 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.594869 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-49f8f69e-33c2-4861-8e37-dcc885ba72a3 req-be97661e-57d5-47c7-b37a-413056446068 service nova] Creating event network-changed:bef74976-58e0-4493-9857-75cf1aa4c9a8 for instance 1e718d3d-faf9-4032-b2f9-71f3a39b6048 on n-h1-860863-4 Nov 02 21:47:33.613929 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-49f8f69e-33c2-4861-8e37-dcc885ba72a3 req-be97661e-57d5-47c7-b37a-413056446068 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047214 Nov 02 21:47:33.613929 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2411/4917] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:33.627911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-624367b4-8823-4076-b858-7bb5f2a7caaf tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:33.630811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-624367b4-8823-4076-b858-7bb5f2a7caaf tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:33.727100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-624367b4-8823-4076-b858-7bb5f2a7caaf tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:33.736628 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-624367b4-8823-4076-b858-7bb5f2a7caaf tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1213 microversion: 2.1 time: 0.120406 Nov 02 21:47:33.737796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2412/4918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:33 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:33.758821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:33.767657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3136b65d-0dc4-4007-8f1e-b9935bd56825 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.292619 Nov 02 21:47:33.768451 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2507/4919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:33 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:33.863765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:33.863765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:33.874890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.875865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.875865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:33.878750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:33.879285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:33.879776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.054346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:34.063492 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-64b6fc36-6e54-4f92-a507-977a7f531f7b tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.206124 Nov 02 21:47:34.064134 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2413/4920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:33 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:34.306218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:34.307038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:34.318385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.319074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.319530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.320250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.320710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.321186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.499696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:34.500321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:34.510902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.511869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.512010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.512720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.514287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.515188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.541779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:34.554950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c861df57-7176-462b-b8ca-784a674e662a tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.252972 Nov 02 21:47:34.557832 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2508/4921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:34 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:34.581245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.581644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.582215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.582792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lazy-loading 'fault' on Instance uuid 1d038722-0e6f-4c00-9b7c-003408be38bc {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:47:34.667136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:34.685614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae233c3e-be10-4143-8f98-0428bc1ef3cf tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1310 microversion: 2.1 time: 0.191742 Nov 02 21:47:34.686714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2414/4922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:34 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1310 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:34.762927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:34.763934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:34.771905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.772658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.773335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.774976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.775611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.776203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.791759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:34.793635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:34.806844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.807572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.808243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.809972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:34.810810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:34.811507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:34.942336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:34.951727 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f928dcd4-b20f-4672-8ac7-4e518d6b14df tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1217 microversion: 2.1 time: 0.195577 Nov 02 21:47:34.952783 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2509/4923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:34 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:35.088617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:35.089343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:35.100385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:35.101608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:35.103004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:35.106596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:35.107279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:35.108064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:35.159265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:35.168549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b137c1f8-8c62-478b-9ef7-97662601a8c2 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.381495 Nov 02 21:47:35.176856 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2415/4924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:34 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:35.349590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:35.359446 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2548eb89-6721-4f7c-983f-e00266e785e1 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.276152 Nov 02 21:47:35.360297 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2510/4925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:35 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:35.582953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:35.585408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:35.608919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:35.609921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:35.610564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:35.612191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:35.612875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:35.613585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:35.725743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:35.727570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:35.749629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:35.752681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:35.753402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:35.754991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:35.756479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:35.757235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:35.859443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:35.860230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:35.862714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:35.863578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lazy-loading 'fault' on Instance uuid 1d038722-0e6f-4c00-9b7c-003408be38bc {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:47:36.109173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:36.119586 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f84c1b99-83a8-42e2-bc70-2d89e1afafce tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 200 len: 1310 microversion: 2.1 time: 0.408502 Nov 02 21:47:36.134063 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2511/4926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:35 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 1310 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:36.147564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:36.150340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:36.156858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:36.156858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:36.157606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:36.158397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:36.159368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:36.159973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:36.342986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:36.371349 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4c106df-865b-4f97-ae08-8dcd5b1b90a9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1217 microversion: 2.1 time: 0.233878 Nov 02 21:47:36.384704 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2512/4927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:36 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:36.399400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:36.400381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:36.408783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:36.409722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:36.410644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:36.411657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:36.412347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:36.413158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:36.563413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:36.574182 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4908b5f4-f4ef-4677-8e43-2da08d409a8e tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1522 microversion: 2.1 time: 0.996330 Nov 02 21:47:36.587539 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2416/4928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:35 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1522 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:36.597965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:36.598826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:36.605492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:36.606250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:36.606902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:36.607791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:36.608428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:36.609109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:36.894789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:36.916524 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0223f50-9bf7-4de3-b892-9caba3876746 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.522631 Nov 02 21:47:36.933891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2513/4929] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:36 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:37.048915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:37.085813 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88e33684-4a29-4bfa-8525-af55f8227a31 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.496364 Nov 02 21:47:37.087257 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2417/4930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:36 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:37.173802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:37.174888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: 1d038722-0e6f-4c00-9b7c-003408be38bc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:37.206003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.206803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.208612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.216146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.225036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.227158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.281147 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] HTTP exception thrown: Instance 1d038722-0e6f-4c00-9b7c-003408be38bc could not be found. Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Request method failure captured: Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc HTTP/1.1 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuUOofYHooBwxx0sz1GU1PlmwVOopOjFpbMEpVlAjxzFPT78alnXOiX_oZUjXDSKYbR1GlSzKcB917899_DnMgjVF9b_faLUvvWJQPQfN3QVRZtzNlz14AQqj4g9Lsm817NWPhV25DQUTpQ7CpN5Lg8dr_SCJtxJBaBEDPchSuhVlKY Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 74f2e3b11ecd425e942701fab82dba02 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 74f2e3b11ecd425e942701fab82dba02 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ListServerFiltersTestJSON-1698275639-project Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: f34842288b784bf796fa2c37e8364712 Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ListServerFiltersTestJSON-1698275639-project Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 1d038722-0e6f-4c00-9b7c-003408be38bc could not be found. Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1d038722-0e6f-4c00-9b7c-003408be38bc'} Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d038722-0e6f-4c00-9b7c-003408be38bc could not be found. Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d038722-0e6f-4c00-9b7c-003408be38bc could not be found. Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:37.284395 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:37.289459 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:37.289459 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:37.289459 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:37.289459 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:37.289459 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:37.289459 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d038722-0e6f-4c00-9b7c-003408be38bc could not be found. Nov 02 21:47:37.289459 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:37.292303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Returning 404 to user: Instance 1d038722-0e6f-4c00-9b7c-003408be38bc could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:37.293836 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98ad7a7a-dcab-4cc7-8f4f-c6eef66050c4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc" status: 404 len: 111 microversion: 2.1 time: 0.130850 Nov 02 21:47:37.295756 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2514/4931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:37 2022] GET /compute/v2.1/servers/1d038722-0e6f-4c00-9b7c-003408be38bc => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:47:37.304013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:37.305052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:37.314571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.315321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.316557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.317539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.318194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.318824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.359859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:37.399428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:37.400304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:37.414107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.414917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.415721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.419732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.420343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.421624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.587551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:37.602422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa7dd0d2-7325-48dd-ab27-2e32a0c3630f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1265 microversion: 2.1 time: 0.207279 Nov 02 21:47:37.603596 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2515/4932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:37 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:37.628796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:37.630348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:37.646987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.647590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.648328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.649147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.649665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.650110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.792441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:37.801675 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-780f1751-5ab8-4729-9591-e8c56bcbabf5 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1480 microversion: 2.1 time: 0.196847 Nov 02 21:47:37.802390 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2516/4933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:37 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1480 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:37.821311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36703716-1445-4711-b354-52efb59ad646 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 204 len: 0 microversion: 2.1 time: 0.519879 Nov 02 21:47:37.821311 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2418/4934] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:37 2022] DELETE /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:37.837431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:37.838166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:37.856298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.857858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.858554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.859669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.860495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.861846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.945853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:37.946605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:37.953686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.955599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.956272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:37.957799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:37.958469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:37.960800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.152261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:38.163775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:38.176606 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f0c1a93-6af9-4fd7-b4b5-4ce190048be2 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1518 microversion: 2.1 time: 0.350765 Nov 02 21:47:38.188957 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2517/4935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:37 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1518 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:38.188957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f8751a44-7016-4f02-9d94-0e7c0bab6fc3 req-0b26396a-be4d-4fcf-b28a-d1bb24b9f34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3062332-f0fb-4550-8833-d635f1a66ecd", "name": "network-vif-deleted", "tag": "df8a5f26-1f77-4141-9b19-fd0a12030b75"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:38.202354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f8751a44-7016-4f02-9d94-0e7c0bab6fc3 req-0b26396a-be4d-4fcf-b28a-d1bb24b9f34f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:38.202933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f8751a44-7016-4f02-9d94-0e7c0bab6fc3 req-0b26396a-be4d-4fcf-b28a-d1bb24b9f34f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:38.203610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f8751a44-7016-4f02-9d94-0e7c0bab6fc3 req-0b26396a-be4d-4fcf-b28a-d1bb24b9f34f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.225499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:38.237846 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7a595ae6-2ebf-4b87-baec-f406069c499f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.296608 Nov 02 21:47:38.249000 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f8751a44-7016-4f02-9d94-0e7c0bab6fc3 req-0b26396a-be4d-4fcf-b28a-d1bb24b9f34f service nova] Creating event network-vif-deleted:df8a5f26-1f77-4141-9b19-fd0a12030b75 for instance e3062332-f0fb-4550-8833-d635f1a66ecd on n-h1-860863-4 Nov 02 21:47:38.251002 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2419/4936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:37 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:38.255505 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f8751a44-7016-4f02-9d94-0e7c0bab6fc3 req-0b26396a-be4d-4fcf-b28a-d1bb24b9f34f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075375 Nov 02 21:47:38.256421 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2518/4937] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:38.259167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:38.259865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:38.266694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:38.268389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:38.269058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.270625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:38.271109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:38.271585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.458464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:38.470911 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-540ca526-f8f6-4d23-8152-f612221abca9 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.217496 Nov 02 21:47:38.471875 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2420/4938] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:38 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:38.631119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:38.632513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:38.639859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:38.640654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:38.641326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.643313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:38.643952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:38.644555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.713114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:38.722885 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f23732f-9801-4f18-9556-96bc95cbbf37 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1265 microversion: 2.1 time: 0.097385 Nov 02 21:47:38.723482 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2519/4939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:38 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:38.830241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:38.831016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:38.839883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:38.840527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:38.841262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.842053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:38.842591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:38.843101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:38.912689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:38.920954 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2e12166-42a8-4e30-8f45-e524c5dea9ca tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1480 microversion: 2.1 time: 0.095284 Nov 02 21:47:38.921527 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2421/4940] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:38 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1480 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:39.205112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:39.206143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:39.213722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.214222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.214661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:39.215589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.216045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.216475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:39.262162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:39.262895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:39.274487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.276024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.277279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:39.280339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.281129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.281774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:39.621620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:39.632527 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-43e36475-213f-4ff6-b6e9-e07e929b133d tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1518 microversion: 2.1 time: 0.432154 Nov 02 21:47:39.634214 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2520/4941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:39 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1518 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:39.643208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:39.644200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:39.667198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.669487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.670192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:39.671946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.672619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.674065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:39.827944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:39.842952 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e5cd141-618d-46ee-817b-a172ee38c917 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.584682 Nov 02 21:47:39.866219 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2422/4942] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:39 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:39.877904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:39.879075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:39.888375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.889466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.890194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:39.901110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:39.901110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:39.903706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.032363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:40.044414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38d89245-254d-4215-8135-1782ede050da tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1283 microversion: 2.1 time: 0.174688 Nov 02 21:47:40.045408 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2423/4943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:39 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:40.050860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:40.051532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:40.064720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.065594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.066240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.067130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.068112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.068753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.119352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.120048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.121047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.121873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lazy-loading 'fault' on Instance uuid e3062332-f0fb-4550-8833-d635f1a66ecd {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:47:40.260461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887a362ce68547af87982d10a253bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df79cd574b99449bae4c4b82e1c698a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:40.276416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f65388e-3303-4156-8284-54e5e198c20b tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 200 len: 1312 microversion: 2.1 time: 0.229811 Nov 02 21:47:40.282220 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2424/4944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:40 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:40.285903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:40.294485 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fcf7a09-c28f-4b4b-aac7-6d0092d9523c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.659055 Nov 02 21:47:40.297941 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2521/4945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:39 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:40.365983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-98404711-b5ca-4ecf-a553-a6e44e6e9930 req-b78c9977-5461-4f5d-ab60-a4b4cf11b06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff2642a-0376-4c88-8925-412a9b6248b4", "name": "network-vif-deleted", "tag": "e8c5dc3b-4ff7-4d6c-9021-9c976db4c706"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:40.378200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-98404711-b5ca-4ecf-a553-a6e44e6e9930 req-b78c9977-5461-4f5d-ab60-a4b4cf11b06d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.379011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-98404711-b5ca-4ecf-a553-a6e44e6e9930 req-b78c9977-5461-4f5d-ab60-a4b4cf11b06d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.379711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-98404711-b5ca-4ecf-a553-a6e44e6e9930 req-b78c9977-5461-4f5d-ab60-a4b4cf11b06d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.399762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-98404711-b5ca-4ecf-a553-a6e44e6e9930 req-b78c9977-5461-4f5d-ab60-a4b4cf11b06d service nova] Creating event network-vif-deleted:e8c5dc3b-4ff7-4d6c-9021-9c976db4c706 for instance aff2642a-0376-4c88-8925-412a9b6248b4 on n-h1-860863-4 Nov 02 21:47:40.405321 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-98404711-b5ca-4ecf-a553-a6e44e6e9930 req-b78c9977-5461-4f5d-ab60-a4b4cf11b06d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044021 Nov 02 21:47:40.406536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2425/4946] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:40.663513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:40.664728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:40.678383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.681827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.681827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.681827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.689419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.693078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.873415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:40.877516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:40.883953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:40.899830 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-49fef1fd-6539-41ff-8bee-4f524d3728e4 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1476 microversion: 2.1 time: 0.237186 Nov 02 21:47:40.916774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.916774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.917809 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2522/4947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:40 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:40.917936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.917936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:40.917936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:40.917936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:40.943742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:41.069683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:41.071094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:41.077593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.078487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.079294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.081363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.082359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.084099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.629129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:41.638742 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-013ab5eb-238d-4f4f-9dbe-1bc5c2affed2 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1271 microversion: 2.1 time: 0.574177 Nov 02 21:47:41.645642 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2523/4948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:41 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1271 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:41.670778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-59a2ff9d-0e03-43aa-a677-290aa0a58a87 req-20f0e9eb-c856-46d6-864c-f0e4e3f055a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74613c2-6e0b-467c-83bc-7afcb88e7b3b", "name": "network-vif-plugged", "status": "completed", "tag": "bbc0973d-d6d9-44b8-891b-9c42bfa2672e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:41.683912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-59a2ff9d-0e03-43aa-a677-290aa0a58a87 req-20f0e9eb-c856-46d6-864c-f0e4e3f055a9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.684770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-59a2ff9d-0e03-43aa-a677-290aa0a58a87 req-20f0e9eb-c856-46d6-864c-f0e4e3f055a9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.685325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-59a2ff9d-0e03-43aa-a677-290aa0a58a87 req-20f0e9eb-c856-46d6-864c-f0e4e3f055a9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.705965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-59a2ff9d-0e03-43aa-a677-290aa0a58a87 req-20f0e9eb-c856-46d6-864c-f0e4e3f055a9 service nova] Creating event network-vif-plugged:bbc0973d-d6d9-44b8-891b-9c42bfa2672e for instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b on n-h2-860863-4 Nov 02 21:47:41.714974 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-59a2ff9d-0e03-43aa-a677-290aa0a58a87 req-20f0e9eb-c856-46d6-864c-f0e4e3f055a9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067385 Nov 02 21:47:41.715995 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2524/4949] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:41.726821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:41.728323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] [instance: e3062332-f0fb-4550-8833-d635f1a66ecd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:41.738904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.740228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.741744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.742647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.743209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.743740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.766736 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] HTTP exception thrown: Instance e3062332-f0fb-4550-8833-d635f1a66ecd could not be found. Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Request method failure captured: Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd HTTP/1.1 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuREqEfpexa4O9JXuPH240v-8-4dEZZp0eqQYL_bc_SDqI_6jetRQs8RKTUcv6mfRG3pjgRy26N44WvBoL3rmpDtK7u6Bey5X8EIeFErXYa6qc_An_z32Z13ikoGRbxbgnFyFVlsxon54ZhLc_cD9JwJDow7Vhn8oUCC-0rqLXHzI00 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df79cd574b99449bae4c4b82e1c698a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: df79cd574b99449bae4c4b82e1c698a0 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1463482554 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 887a362ce68547af87982d10a253bf97 Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1463482554-project Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e3062332-f0fb-4550-8833-d635f1a66ecd could not be found. Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e3062332-f0fb-4550-8833-d635f1a66ecd'} Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3062332-f0fb-4550-8833-d635f1a66ecd could not be found. Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3062332-f0fb-4550-8833-d635f1a66ecd could not be found. Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:41.769730 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3062332-f0fb-4550-8833-d635f1a66ecd could not be found. Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:47:41.774984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] Returning 404 to user: Instance e3062332-f0fb-4550-8833-d635f1a66ecd could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:41.776503 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d095521a-8966-4957-98aa-a0272acc3739 tempest-ServerRescueNegativeTestJSON-1463482554 tempest-ServerRescueNegativeTestJSON-1463482554-project] 10.222.0.25 "GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd" status: 404 len: 111 microversion: 2.1 time: 0.057170 Nov 02 21:47:41.781231 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2525/4950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:41 2022] GET /compute/v2.1/servers/e3062332-f0fb-4550-8833-d635f1a66ecd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:47:41.784598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:41.786098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:41.794806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.795464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.795998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.796866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.797450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.798033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.798559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:41.811326 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e366643-e354-4157-b3cc-73a1fb869945 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.943035 Nov 02 21:47:41.815339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2426/4951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:40 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:41.925179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:41.926540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:41.938456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.942974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.945746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:41.946855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:41.948418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:41.950111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:42.020903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:42.021421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:42.021912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:42.024324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lazy-loading 'fault' on Instance uuid aff2642a-0376-4c88-8925-412a9b6248b4 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:47:42.199961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f34842288b784bf796fa2c37e8364712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f2e3b11ecd425e942701fab82dba02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:42.210634 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d38e079c-f4f2-49d1-a85e-cdd774230aa0 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 200 len: 1311 microversion: 2.1 time: 0.290661 Nov 02 21:47:42.211232 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2427/4952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:41 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 1311 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:42.340450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:42.346405 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-602c22cd-20fc-4f79-9013-e43ca7c50c5a tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1315 microversion: 2.1 time: 0.566900 Nov 02 21:47:42.369287 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2526/4953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:41 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:42.670114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:42.670738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:42.684520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:42.685051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:42.685504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:42.686213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:42.686668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:42.687098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:42.840127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:42.841536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:42.848605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:42.849358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:42.850071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:42.851023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:42.851515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:42.852123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:43.117862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:43.149515 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-069ac613-52a5-4520-b45d-711b25c94941 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1313 microversion: 2.1 time: 0.482947 Nov 02 21:47:43.155138 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2428/4954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:42 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:43.238481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:43.239470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] [instance: aff2642a-0376-4c88-8925-412a9b6248b4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:43.249838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:43.254639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:43.255329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:43.255788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:43.256518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:43.259880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:43.260368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:43.295443 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] HTTP exception thrown: Instance aff2642a-0376-4c88-8925-412a9b6248b4 could not be found. Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Request method failure captured: Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 HTTP/1.1 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuUOofYHooBwxx0sz1GU1PlmwVOopOjFpbMEpVlAjxzFPT78alnXOiX_oZUjXDSKYbR1GlSzKcB917899_DnMgjVF9b_faLUvvWJQPQfN3QVRZtzNlz14AQqj4g9Lsm817NWPhV25DQUTpQ7CpN5Lg8dr_SCJtxJBaBEDPchSuhVlKY Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 74f2e3b11ecd425e942701fab82dba02 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/74f2e3b11ecd425e942701fab82dba02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 74f2e3b11ecd425e942701fab82dba02 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1698275639 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ListServerFiltersTestJSON-1698275639-project Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f34842288b784bf796fa2c37e8364712 Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ListServerFiltersTestJSON-1698275639-project Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance aff2642a-0376-4c88-8925-412a9b6248b4 could not be found. Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'aff2642a-0376-4c88-8925-412a9b6248b4'} Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff2642a-0376-4c88-8925-412a9b6248b4 could not be found. Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff2642a-0376-4c88-8925-412a9b6248b4 could not be found. Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:43.298416 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff2642a-0376-4c88-8925-412a9b6248b4 could not be found. Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] Returning 404 to user: Instance aff2642a-0376-4c88-8925-412a9b6248b4 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dd49f76f-4db3-4d63-9afb-e1960b3a72b3 tempest-ListServerFiltersTestJSON-1698275639 tempest-ListServerFiltersTestJSON-1698275639-project] 10.222.0.25 "GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4" status: 404 len: 111 microversion: 2.1 time: 0.066041 Nov 02 21:47:43.310535 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2429/4955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:43 2022] GET /compute/v2.1/servers/aff2642a-0376-4c88-8925-412a9b6248b4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:47:43.370047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:43.370788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:43.383236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:43.384094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:43.385530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:43.386532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:43.387236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:43.387896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:43.461100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:43.475669 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e926db01-2752-4591-a093-fe4cb71f8a18 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.640427 Nov 02 21:47:43.489226 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2527/4956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:42 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:43.729391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f2d8ed28-0250-4c40-832d-c5865b43f08e req-5fd7c9b2-81ca-4e73-84b8-e4d0baaa6454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfe24a6-81f0-46d7-8956-8a724a647a77", "name": "network-vif-plugged", "status": "completed", "tag": "baac467a-6e2b-433c-b8ea-1d96ac1af3ca"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:43.736458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=24 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:43.740379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f2d8ed28-0250-4c40-832d-c5865b43f08e req-5fd7c9b2-81ca-4e73-84b8-e4d0baaa6454 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:43.741119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f2d8ed28-0250-4c40-832d-c5865b43f08e req-5fd7c9b2-81ca-4e73-84b8-e4d0baaa6454 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:43.741757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f2d8ed28-0250-4c40-832d-c5865b43f08e req-5fd7c9b2-81ca-4e73-84b8-e4d0baaa6454 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:43.754864 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f2d8ed28-0250-4c40-832d-c5865b43f08e req-5fd7c9b2-81ca-4e73-84b8-e4d0baaa6454 service nova] Creating event network-vif-plugged:baac467a-6e2b-433c-b8ea-1d96ac1af3ca for instance abfe24a6-81f0-46d7-8956-8a724a647a77 on n-h2-860863-4 Nov 02 21:47:43.761155 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f2d8ed28-0250-4c40-832d-c5865b43f08e req-5fd7c9b2-81ca-4e73-84b8-e4d0baaa6454 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Nov 02 21:47:43.764374 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2528/4957] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:43.906341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:43.922195 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a575756-e95f-4f27-b32b-c829924441fe tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1464 microversion: 2.1 time: 0.555975 Nov 02 21:47:43.924499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2430/4958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:43 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1464 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:43.987814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:43.989108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:43.997746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:43.998517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:43.999130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:44.000002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:44.001727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:44.002533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:44.034822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:44.175991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:44.177211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:44.184522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:44.186358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:44.187115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:44.187731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:44.188601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:44.189280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:44.189963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:44.397590 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b6e2529d-7075-4b3e-8b2f-d68f8a73a6c5 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 204 len: 0 microversion: 2.1 time: 0.413657 Nov 02 21:47:44.402707 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2529/4959] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:43 2022] DELETE /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:44.410243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:44.411088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:44.418421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:44.418970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:44.419582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:44.420368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:44.420903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:44.421431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:45.145674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:45.165572 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9afb649-e731-4f00-833b-2b8cd4b7171a tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1313 microversion: 2.1 time: 0.990925 Nov 02 21:47:45.166799 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2431/4960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:44 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1313 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:45.180481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:45.183480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:45.210929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:45.211711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:45.212321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:45.213307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:45.213942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:45.214561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:45.295942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:45.338547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf2abcfe-8394-40b5-9dc1-e4aed4173a1c tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1470 microversion: 2.1 time: 0.934065 Nov 02 21:47:45.349598 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2530/4961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:44 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1470 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:45.579354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:45.606140 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e440ff2-44bc-412b-bd09-46b3a7adaab5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 0.436617 Nov 02 21:47:45.607950 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2432/4962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:45 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:45.960431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-11ca57d6-6f22-480d-aaad-0a919b1bbf2b req-ecd9da9b-11e9-4cb2-979e-89bf41a6b71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e718d3d-faf9-4032-b2f9-71f3a39b6048", "name": "network-vif-plugged", "status": "completed", "tag": "bef74976-58e0-4493-9857-75cf1aa4c9a8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:45.978944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-11ca57d6-6f22-480d-aaad-0a919b1bbf2b req-ecd9da9b-11e9-4cb2-979e-89bf41a6b71f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:45.979748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-11ca57d6-6f22-480d-aaad-0a919b1bbf2b req-ecd9da9b-11e9-4cb2-979e-89bf41a6b71f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:45.982151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-11ca57d6-6f22-480d-aaad-0a919b1bbf2b req-ecd9da9b-11e9-4cb2-979e-89bf41a6b71f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:46.007143 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-11ca57d6-6f22-480d-aaad-0a919b1bbf2b req-ecd9da9b-11e9-4cb2-979e-89bf41a6b71f service nova] Creating event network-vif-plugged:bef74976-58e0-4493-9857-75cf1aa4c9a8 for instance 1e718d3d-faf9-4032-b2f9-71f3a39b6048 on n-h1-860863-4 Nov 02 21:47:46.018212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-11ca57d6-6f22-480d-aaad-0a919b1bbf2b req-ecd9da9b-11e9-4cb2-979e-89bf41a6b71f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184876 Nov 02 21:47:46.019358 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2531/4963] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:46.194084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:46.195343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:46.212675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:46.213466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:46.214121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:46.215027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:46.215662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:46.216264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:46.378914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:46.381829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:46.393283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:46.396552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:46.397359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:46.400533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:46.400533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:46.400533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:46.856789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:46.869331 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9fdfb267-33f1-408c-bae4-599a6ccea621 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.679115 Nov 02 21:47:46.870764 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2433/4964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:46 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:46.878920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:46.879928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:46.887245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:46.887917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:46.888500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:46.889343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:46.890042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:46.890725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:47.105234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:47.129881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f38edcbc-a377-47cd-b101-41f6cae4f9d4 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1470 microversion: 2.1 time: 0.743399 Nov 02 21:47:47.131262 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2532/4965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:46 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1470 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:47.855719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-02da2dd4-ee14-4b77-a06a-396119514cd7 req-c7c0658b-12cd-4f7e-ba54-090e307d55cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74613c2-6e0b-467c-83bc-7afcb88e7b3b", "name": "network-vif-deleted", "tag": "bbc0973d-d6d9-44b8-891b-9c42bfa2672e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:47.879151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-02da2dd4-ee14-4b77-a06a-396119514cd7 req-c7c0658b-12cd-4f7e-ba54-090e307d55cc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:47.879698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-02da2dd4-ee14-4b77-a06a-396119514cd7 req-c7c0658b-12cd-4f7e-ba54-090e307d55cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:47.880146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-02da2dd4-ee14-4b77-a06a-396119514cd7 req-c7c0658b-12cd-4f7e-ba54-090e307d55cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:47.904273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-02da2dd4-ee14-4b77-a06a-396119514cd7 req-c7c0658b-12cd-4f7e-ba54-090e307d55cc service nova] Creating event network-vif-deleted:bbc0973d-d6d9-44b8-891b-9c42bfa2672e for instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b on n-h2-860863-4 Nov 02 21:47:47.914792 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-02da2dd4-ee14-4b77-a06a-396119514cd7 req-c7c0658b-12cd-4f7e-ba54-090e307d55cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062696 Nov 02 21:47:47.915938 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2533/4966] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:47.921326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:47.922250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:47.923704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:47.930176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:47.930905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:47.931528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:47.932415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:47.933078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:47.933730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:47.964311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-66f8b831-f354-48c1-aa43-db042b305eb5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1320 microversion: 2.1 time: 1.086031 Nov 02 21:47:47.968234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2434/4967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:46 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1320 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:48.143571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:48.144835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:48.161751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:48.165653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:48.167952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:48.170064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:48.176894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:48.178970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:48.447117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e677c1cd1e46e6b8a98b5f6f9cd140', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b75daabf84e4861ac29d01e41d90b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:48.454441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:48.463973 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8bb786a-537c-436d-8b72-d7ac441d6ea3 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.546602 Nov 02 21:47:48.468586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2534/4968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:47 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:48.469377 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0e4bf9a-6bbd-47c8-be71-cb064e5ff708 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 200 len: 1300 microversion: 2.1 time: 0.327811 Nov 02 21:47:48.479740 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2435/4969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:48 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 1300 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:48.991590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:48.992220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:49.009485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.009982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.012999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.012999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.012999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.012999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.707614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ce4aba5a-65f2-4bdc-9d89-1fffc62a6627 req-bdce3dc2-3d57-44c5-95eb-f2a92db9000b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f64c21-3cf0-4469-9f2e-e01092e20951", "tag": "5c164a39-4d1e-4464-867d-573c68b0bc34"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:49.730162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ce4aba5a-65f2-4bdc-9d89-1fffc62a6627 req-bdce3dc2-3d57-44c5-95eb-f2a92db9000b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.735918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ce4aba5a-65f2-4bdc-9d89-1fffc62a6627 req-bdce3dc2-3d57-44c5-95eb-f2a92db9000b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.735918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ce4aba5a-65f2-4bdc-9d89-1fffc62a6627 req-bdce3dc2-3d57-44c5-95eb-f2a92db9000b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.761403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:49.769381 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ce4aba5a-65f2-4bdc-9d89-1fffc62a6627 req-bdce3dc2-3d57-44c5-95eb-f2a92db9000b service nova] Creating event network-changed:5c164a39-4d1e-4464-867d-573c68b0bc34 for instance f4f64c21-3cf0-4469-9f2e-e01092e20951 on n-h1-860863-4 Nov 02 21:47:49.778128 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ce4aba5a-65f2-4bdc-9d89-1fffc62a6627 req-bdce3dc2-3d57-44c5-95eb-f2a92db9000b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491374 Nov 02 21:47:49.783522 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e937898-f9f6-476e-8de5-5cc6966e420c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 200 len: 1508 microversion: 2.1 time: 0.795877 Nov 02 21:47:49.784649 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2535/4970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:48 2022] GET /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 1508 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:49.790134 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2436/4971] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:49.792749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:49.799540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:49.810211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:49.814947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] [instance: e74613c2-6e0b-467c-83bc-7afcb88e7b3b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:49.816803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.817364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.817821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.819039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.819525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.820286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.832066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.833735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.834731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.835432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.836140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.836742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.859689 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] HTTP exception thrown: Instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b could not be found. Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Request method failure captured: Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b HTTP/1.1 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuVhdJiOC3dT_1J86vCqnWcqRsu0Ufqys1dVk5GXg6vQ28xp1UCG75g_f_bdXPp51Oz0edFN73YyBS8YD5ZoboAzlLn_4Tb7pkUl7785OTwTpLQ3LnCw1gAQrp7qZKWbzVLtM_18SlQcdqk_YW3zEOKIdMfGin5JFd45DLHyBP73KJ8 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4b75daabf84e4861ac29d01e41d90b79 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesNegativeTest-1064236090 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4b75daabf84e4861ac29d01e41d90b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b75daabf84e4861ac29d01e41d90b79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4b75daabf84e4861ac29d01e41d90b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4b75daabf84e4861ac29d01e41d90b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesNegativeTest-1064236090 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4b75daabf84e4861ac29d01e41d90b79 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesNegativeTest-1064236090 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesNegativeTest-1064236090-project Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: a1e677c1cd1e46e6b8a98b5f6f9cd140 Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesNegativeTest-1064236090-project Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b could not be found. Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e74613c2-6e0b-467c-83bc-7afcb88e7b3b'} Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b could not be found. Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b could not be found. Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:47:49.863057 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:49.869063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:47:49.869063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:47:49.869063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:47:49.869063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:47:49.869063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:47:49.869063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b could not be found. Nov 02 21:47:49.869063 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:47:49.870838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] Returning 404 to user: Instance e74613c2-6e0b-467c-83bc-7afcb88e7b3b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:47:49.872614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-842aec83-76f3-425e-9b4e-3724619ee025 tempest-VolumesNegativeTest-1064236090 tempest-VolumesNegativeTest-1064236090-project] 10.222.0.25 "GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b" status: 404 len: 111 microversion: 2.1 time: 0.081033 Nov 02 21:47:49.883157 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2437/4972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:49 2022] GET /compute/v2.1/servers/e74613c2-6e0b-467c-83bc-7afcb88e7b3b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:47:49.907835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:49.911607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: abfe24a6-81f0-46d7-8956-8a724a647a77] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:49.934642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.935142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.935591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:49.936380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:49.936886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:49.937314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:50.676873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:50.690389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3fc095fb-82d3-488f-a1a7-818a7490c7fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/abfe24a6-81f0-46d7-8956-8a724a647a77" status: 200 len: 1509 microversion: 2.1 time: 0.790915 Nov 02 21:47:50.690998 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2438/4973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:49 2022] GET /compute/v2.1/servers/abfe24a6-81f0-46d7-8956-8a724a647a77 => generated 1509 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:50.712623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:50.714041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: abfe24a6-81f0-46d7-8956-8a724a647a77] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:50.722139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:50.722934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:50.723945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:50.724839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:50.725829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:50.726435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:50.755531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: abfe24a6-81f0-46d7-8956-8a724a647a77] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:50.769243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:50.773800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:50.778597 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25a75f3a-242e-4b4f-8aaf-0e0d0503b312 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.990653 Nov 02 21:47:50.785052 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2536/4974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:49 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:51.100365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4c82801c-1d81-40b2-9878-122e2922c362 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abfe24a6-81f0-46d7-8956-8a724a647a77" status: 204 len: 0 microversion: 2.1 time: 0.391375 Nov 02 21:47:51.101087 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2439/4975] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:50 2022] DELETE /compute/v2.1/servers/abfe24a6-81f0-46d7-8956-8a724a647a77 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:47:51.112271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:51.112867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:51.125558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:51.126299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:51.127000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:51.128199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:51.131770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:51.133294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:51.200036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 1e718d3d-faf9-4032-b2f9-71f3a39b6048] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:47:51.647010 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39e4ff21-aa09-4b31-bd11-a5836cf1b48e tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048" status: 204 len: 0 microversion: 2.1 time: 0.540585 Nov 02 21:47:51.656963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2537/4976] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:47:51 2022] DELETE /compute/v2.1/servers/1e718d3d-faf9-4032-b2f9-71f3a39b6048 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:47:51.815198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:51.816370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:51.825952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:51.831618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:51.831618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:51.831618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:51.831618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:51.831618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:51.914668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1451762463", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "0d24f025-2d0e-45a1-8799-4036fd78c2a4"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:52.022082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] validate_networks() for [('0d24f025-2d0e-45a1-8799-4036fd78c2a4', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:47:52.640664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:52.652075 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-934a21d9-69ed-40b9-8638-ce4edb1d770c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.842982 Nov 02 21:47:52.656345 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2440/4977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:51 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:53.685293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:53.687535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:53.697646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:53.699252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:53.700381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:53.701347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:53.702005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:53.702766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:53.948584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:47:53.952857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:47:53.953786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:47:53.956293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:47:53.957035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:47:53.964961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:53.974265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:53.975191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:53.975832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:53.976767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:53.977371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:53.978372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:53.980944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:53.994752 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-51c01b29-1cd7-4b0a-a350-2073768b04c9 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.317420 Nov 02 21:47:53.997481 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2441/4978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:53 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:47:54.007468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Getting quotas for project 6164e68cad634d739964f17a76cdafda. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:47:54.014302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Getting quotas for user 00a7ed00fe564141ba3c5a7030ec4613 and project 6164e68cad634d739964f17a76cdafda. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:47:54.032659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Going to run 2 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:47:54.036372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:47:54.143576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1bfbb736-67fc-4f86-934c-064dfd642855 req-c7293fc0-e38b-4318-8a20-bf950ce09e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f64c21-3cf0-4469-9f2e-e01092e20951", "tag": "d5176c6c-e8c0-44bd-84e2-6cd837abe315"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:54.161030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1bfbb736-67fc-4f86-934c-064dfd642855 req-c7293fc0-e38b-4318-8a20-bf950ce09e80 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:54.161523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1bfbb736-67fc-4f86-934c-064dfd642855 req-c7293fc0-e38b-4318-8a20-bf950ce09e80 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:54.161953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1bfbb736-67fc-4f86-934c-064dfd642855 req-c7293fc0-e38b-4318-8a20-bf950ce09e80 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:54.195614 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1bfbb736-67fc-4f86-934c-064dfd642855 req-c7293fc0-e38b-4318-8a20-bf950ce09e80 service nova] Creating event network-changed:d5176c6c-e8c0-44bd-84e2-6cd837abe315 for instance f4f64c21-3cf0-4469-9f2e-e01092e20951 on n-h1-860863-4 Nov 02 21:47:54.201008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1bfbb736-67fc-4f86-934c-064dfd642855 req-c7293fc0-e38b-4318-8a20-bf950ce09e80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061821 Nov 02 21:47:54.204769 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2442/4979] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:54.259634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=ba29fd6d-f160-418e-9bd1-1637d119fd52,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:47:54.433260 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98486d74-d405-47d9-b623-7a608b467a12 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.526766 Nov 02 21:47:54.437815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2538/4980] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:47:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 2536 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 21:47:54.444741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:54.457058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:54.457860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Searching by: {'deleted': False, 'project_id': '6164e68cad634d739964f17a76cdafda'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:47:54.507398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:54.508085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:54.508553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:54.518251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:54.518970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:54.519227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:54.570476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:47:54.601040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:47:54.635581 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f85153a-f357-448f-9cc3-933fac717cb3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.195231 Nov 02 21:47:54.643472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2443/4981] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 21:47:54 2022] GET /compute/v2.1/servers => generated 1337 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:54.651222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f752f1a-23c1-4599-8216-c9e09f8523b9 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:54.651698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f752f1a-23c1-4599-8216-c9e09f8523b9 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:54.901960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f752f1a-23c1-4599-8216-c9e09f8523b9 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:54.910381 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f752f1a-23c1-4599-8216-c9e09f8523b9 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1218 microversion: 2.1 time: 0.264865 Nov 02 21:47:54.929930 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2539/4982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:54 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1218 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:55.021677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:55.023802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:55.054149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:55.054149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:55.054149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:55.054149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:55.054149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:55.054149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:55.511661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-66cb9299-b070-4a59-9502-02bffdc3e650 req-c73be450-fc3d-45d8-aa41-1e426d6aabe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfe24a6-81f0-46d7-8956-8a724a647a77", "name": "network-vif-deleted", "tag": "baac467a-6e2b-433c-b8ea-1d96ac1af3ca"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:55.540214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66cb9299-b070-4a59-9502-02bffdc3e650 req-c73be450-fc3d-45d8-aa41-1e426d6aabe8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:55.540845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66cb9299-b070-4a59-9502-02bffdc3e650 req-c73be450-fc3d-45d8-aa41-1e426d6aabe8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:55.541628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66cb9299-b070-4a59-9502-02bffdc3e650 req-c73be450-fc3d-45d8-aa41-1e426d6aabe8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:55.576757 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-66cb9299-b070-4a59-9502-02bffdc3e650 req-c73be450-fc3d-45d8-aa41-1e426d6aabe8 service nova] Creating event network-vif-deleted:baac467a-6e2b-433c-b8ea-1d96ac1af3ca for instance abfe24a6-81f0-46d7-8956-8a724a647a77 on n-h2-860863-4 Nov 02 21:47:55.589467 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-66cb9299-b070-4a59-9502-02bffdc3e650 req-c73be450-fc3d-45d8-aa41-1e426d6aabe8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082103 Nov 02 21:47:55.590779 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2540/4983] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:47:55.601193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:55.615289 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7de37d7-9e12-4c55-a3c4-4a616d24390d tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.599535 Nov 02 21:47:55.616086 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2444/4984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:55 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:55.949176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-263d41b2-a2d4-4b2a-8d3d-a8032b3e5731 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:55.951283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-263d41b2-a2d4-4b2a-8d3d-a8032b3e5731 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:56.168089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-263d41b2-a2d4-4b2a-8d3d-a8032b3e5731 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:56.188517 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-263d41b2-a2d4-4b2a-8d3d-a8032b3e5731 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1218 microversion: 2.1 time: 0.241326 Nov 02 21:47:56.189818 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2541/4985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:55 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1218 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:56.641186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:56.642380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:56.654699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:56.655249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:56.655802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:56.656444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:56.656899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:56.659428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:57.215764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:57.217096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:57.238760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:57.242225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:57.242850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:57.255131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:57.255800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:57.256252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:57.646924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:57.658493 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23c7c10d-a676-41bc-ac41-ee2c6b9a60ec tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1222 microversion: 2.1 time: 0.444399 Nov 02 21:47:57.659104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:57.680124 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2542/4986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:57 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1222 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:57.680124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d950ec62-6bf0-44b7-95b5-022eb81a7ec3 req-70584900-ed83-4f67-b431-a5ede3183e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e718d3d-faf9-4032-b2f9-71f3a39b6048", "name": "network-vif-deleted", "tag": "bef74976-58e0-4493-9857-75cf1aa4c9a8"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:47:57.693161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb558aaa-c963-48bb-915b-31290e0dae67 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 1.057136 Nov 02 21:47:57.698494 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2445/4987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:56 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:57.703212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d950ec62-6bf0-44b7-95b5-022eb81a7ec3 req-70584900-ed83-4f67-b431-a5ede3183e22 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:57.703212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d950ec62-6bf0-44b7-95b5-022eb81a7ec3 req-70584900-ed83-4f67-b431-a5ede3183e22 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:57.703212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d950ec62-6bf0-44b7-95b5-022eb81a7ec3 req-70584900-ed83-4f67-b431-a5ede3183e22 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:57.732515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d950ec62-6bf0-44b7-95b5-022eb81a7ec3 req-70584900-ed83-4f67-b431-a5ede3183e22 service nova] Creating event network-vif-deleted:bef74976-58e0-4493-9857-75cf1aa4c9a8 for instance 1e718d3d-faf9-4032-b2f9-71f3a39b6048 on n-h1-860863-4 Nov 02 21:47:57.744483 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d950ec62-6bf0-44b7-95b5-022eb81a7ec3 req-70584900-ed83-4f67-b431-a5ede3183e22 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078922 Nov 02 21:47:57.745688 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2543/4988] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:47:58.683851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:58.685029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:58.694964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:58.695601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:58.696205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:58.698515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:58.699183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:58.699910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:58.751432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:47:58.755226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:47:58.790046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:58.792770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:58.794608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:58.800839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:47:58.800839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:47:58.804604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:47:59.115989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:59.127600 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-28c6148b-6fe3-4e45-aacc-5997781fc715 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1270 microversion: 2.1 time: 0.449150 Nov 02 21:47:59.128200 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2446/4989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:58 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1270 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:47:59.510235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:47:59.523561 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-974cb7fe-95d8-4b09-a3d3-0c7c0378802c tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.800543 Nov 02 21:47:59.524518 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2544/4990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:47:58 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:00.156141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:00.156954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:00.171778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:00.174981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:00.175708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:00.176622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:00.178950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:00.180669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:00.545972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:00.547231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:00.555840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:00.556642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:00.557286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:00.558188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:00.558850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:00.559448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:01.044542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:01.053996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f4a94d4-0166-4103-9550-97b99814b534 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1276 microversion: 2.1 time: 0.902564 Nov 02 21:48:01.074357 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2447/4991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:00 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1276 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:01.271137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:01.280821 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-939c529c-3fc4-4173-8720-74c5bfb41580 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.738636 Nov 02 21:48:01.299219 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2545/4992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:00 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:02.085171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:02.086447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:02.099982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:02.104149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:02.110792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:02.110792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:02.110792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:02.110792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:02.306778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:02.309157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:02.328121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:02.328905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:02.330433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:02.333629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:02.335528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:02.336267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:02.431787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:02.445059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-640da339-7df6-4492-9d00-6506f1f348cd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1276 microversion: 2.1 time: 0.364774 Nov 02 21:48:02.449695 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2448/4993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:02 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1276 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:02.980742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:02.993053 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f2d60ae-41e6-4828-bb75-4213535031f8 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.691721 Nov 02 21:48:02.994301 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2546/4994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:02 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:03.473315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:03.475155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:03.493391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:03.495352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:03.495352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:03.499883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:03.500383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:03.505679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:04.019914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:04.019914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:04.044776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:04.053212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:04.053212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:04.053212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:04.054100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:04.055992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:04.058038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:04.149243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:04.160075 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-daca8f2e-4dc3-4eaa-86d3-b8615cb7131f tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.692091 Nov 02 21:48:04.163046 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2449/4995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:03 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:04.724058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:04.734649 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4a2d9ff-d8ac-4160-a7fd-3af0a2918ca7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.722394 Nov 02 21:48:04.756311 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2547/4996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:04 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:05.186165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:05.188096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:05.202362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:05.206557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:05.208532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:05.209223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:05.216409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:05.221038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:05.221867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:05.758343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:05.758976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:05.770032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:05.771614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:05.784697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:05.787633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:05.787633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:05.787633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:05.937834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:05.960116 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa782d6a-cb48-432c-84eb-168e8e301100 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.778310 Nov 02 21:48:05.977087 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2450/4997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:05 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:06.181796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:06.277975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:06.289150 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d011b97a-c7e3-40cf-bcf3-37b314e54606 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.534688 Nov 02 21:48:06.290535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2548/4998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:05 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:06.649774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8f1cb4e4-55b6-40af-b8c7-c4d0fc52db87 req-a8b1b00f-2ced-4c0d-9dcb-9462de926630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba29fd6d-f160-418e-9bd1-1637d119fd52", "tag": "52651b6a-3691-4032-831a-5f01285154fb"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:06.674558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8f1cb4e4-55b6-40af-b8c7-c4d0fc52db87 req-a8b1b00f-2ced-4c0d-9dcb-9462de926630 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:06.676202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8f1cb4e4-55b6-40af-b8c7-c4d0fc52db87 req-a8b1b00f-2ced-4c0d-9dcb-9462de926630 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:06.676850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8f1cb4e4-55b6-40af-b8c7-c4d0fc52db87 req-a8b1b00f-2ced-4c0d-9dcb-9462de926630 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:06.706877 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8f1cb4e4-55b6-40af-b8c7-c4d0fc52db87 req-a8b1b00f-2ced-4c0d-9dcb-9462de926630 service nova] Creating event network-changed:52651b6a-3691-4032-831a-5f01285154fb for instance ba29fd6d-f160-418e-9bd1-1637d119fd52 on n-h2-860863-4 Nov 02 21:48:06.712986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8f1cb4e4-55b6-40af-b8c7-c4d0fc52db87 req-a8b1b00f-2ced-4c0d-9dcb-9462de926630 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067552 Nov 02 21:48:06.714212 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2451/4999] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:06.991093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:06.991719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:07.000335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:07.001612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:07.002537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:07.003268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:07.003771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:07.004177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:07.317464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:07.325399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:07.338411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:07.339322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:07.340828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:07.342289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:07.346296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:07.347013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:07.357550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:07.369024 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-75247001-d06d-4465-a36c-d389c0c0d5b3 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.385782 Nov 02 21:48:07.391535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2549/5000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:06 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:07.474106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-dd46c279-0267-4da2-8199-ce64a976c0cc req-034eb8cb-7a35-44e1-8b94-0c6f7df037c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f64c21-3cf0-4469-9f2e-e01092e20951", "name": "network-vif-plugged", "status": "completed", "tag": "d5176c6c-e8c0-44bd-84e2-6cd837abe315"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:07.500968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dd46c279-0267-4da2-8199-ce64a976c0cc req-034eb8cb-7a35-44e1-8b94-0c6f7df037c6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:07.500968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dd46c279-0267-4da2-8199-ce64a976c0cc req-034eb8cb-7a35-44e1-8b94-0c6f7df037c6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:07.500968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dd46c279-0267-4da2-8199-ce64a976c0cc req-034eb8cb-7a35-44e1-8b94-0c6f7df037c6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:07.527067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-dd46c279-0267-4da2-8199-ce64a976c0cc req-034eb8cb-7a35-44e1-8b94-0c6f7df037c6 service nova] Creating event network-vif-plugged:d5176c6c-e8c0-44bd-84e2-6cd837abe315 for instance f4f64c21-3cf0-4469-9f2e-e01092e20951 on n-h1-860863-4 Nov 02 21:48:07.536997 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-dd46c279-0267-4da2-8199-ce64a976c0cc req-034eb8cb-7a35-44e1-8b94-0c6f7df037c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067702 Nov 02 21:48:07.537627 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2550/5001] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:48:07.803846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:07.803846 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9762a953-8786-466c-8dad-fb31870aa802 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.494400 Nov 02 21:48:07.804518 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2452/5002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:07 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:08.403599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:08.418018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:08.457892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:08.457892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:08.457892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:08.458251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:08.458734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:08.462452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:08.745860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-fa02ead9-772b-4fc1-a13a-9b76a0e4b514 req-f2c553b4-7564-42a9-8a58-884eafef926a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913c5a65-0a1c-4fdb-940c-6e8404c07d5e", "tag": "1060b013-68c4-4747-ad47-54d36d908bc7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:08.772724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa02ead9-772b-4fc1-a13a-9b76a0e4b514 req-f2c553b4-7564-42a9-8a58-884eafef926a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:08.773626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa02ead9-772b-4fc1-a13a-9b76a0e4b514 req-f2c553b4-7564-42a9-8a58-884eafef926a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:08.774213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-fa02ead9-772b-4fc1-a13a-9b76a0e4b514 req-f2c553b4-7564-42a9-8a58-884eafef926a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:08.807074 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-fa02ead9-772b-4fc1-a13a-9b76a0e4b514 req-f2c553b4-7564-42a9-8a58-884eafef926a service nova] Creating event network-changed:1060b013-68c4-4747-ad47-54d36d908bc7 for instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e on n-h2-860863-4 Nov 02 21:48:08.816291 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-fa02ead9-772b-4fc1-a13a-9b76a0e4b514 req-f2c553b4-7564-42a9-8a58-884eafef926a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075176 Nov 02 21:48:08.821552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2453/5003] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:08.862009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:08.863123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:08.871929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:08.874583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:08.878848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:08.878848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:08.878848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:08.878848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:09.184194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:09.206714 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea1d2779-9cbd-407d-af9a-ddb143fa6257 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.804083 Nov 02 21:48:09.225198 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2551/5004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:08 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:09.553949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:09.578600 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bbd504b3-1db7-40f7-a802-eb9329fca455 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.741800 Nov 02 21:48:09.583587 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2454/5005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:08 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:09.737597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-395fc5bc-cdad-4a03-a883-7dfafa0afb54 req-937a5967-cc07-4834-b8ad-739c0908a205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f64c21-3cf0-4469-9f2e-e01092e20951", "name": "network-vif-plugged", "status": "completed", "tag": "5c164a39-4d1e-4464-867d-573c68b0bc34"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:09.761903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-395fc5bc-cdad-4a03-a883-7dfafa0afb54 req-937a5967-cc07-4834-b8ad-739c0908a205 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:09.762778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-395fc5bc-cdad-4a03-a883-7dfafa0afb54 req-937a5967-cc07-4834-b8ad-739c0908a205 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:09.766874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-395fc5bc-cdad-4a03-a883-7dfafa0afb54 req-937a5967-cc07-4834-b8ad-739c0908a205 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:09.815918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-395fc5bc-cdad-4a03-a883-7dfafa0afb54 req-937a5967-cc07-4834-b8ad-739c0908a205 service nova] Creating event network-vif-plugged:5c164a39-4d1e-4464-867d-573c68b0bc34 for instance f4f64c21-3cf0-4469-9f2e-e01092e20951 on n-h1-860863-4 Nov 02 21:48:09.824182 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-395fc5bc-cdad-4a03-a883-7dfafa0afb54 req-937a5967-cc07-4834-b8ad-739c0908a205 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097979 Nov 02 21:48:09.825740 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2552/5006] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:48:10.242789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:10.246711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:10.263123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:10.263630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:10.264083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:10.264794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:10.265562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:10.266190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:10.606805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:10.607611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:10.622895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:10.623512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:10.625271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:10.631909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:10.632761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:10.633906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:10.887615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:10.895894 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-be099f89-6a87-4631-ace9-e62aadc544a7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.663950 Nov 02 21:48:10.896484 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2455/5007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:10 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:11.131702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:11.140832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ee6824f-f25a-4188-8509-14b3f8fcc84b tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1334 microversion: 2.1 time: 0.538796 Nov 02 21:48:11.153320 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2553/5008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:10 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1334 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:11.920482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:11.920482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:11.934225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:11.934797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:11.950384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:11.951153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:11.956112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:11.956902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:12.403997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:12.415617 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71696ddc-6040-4d24-ae69-9a45a9a12e58 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.499910 Nov 02 21:48:12.421940 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2554/5009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:11 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:12.436208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:12.437048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:12.442423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-497072502", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "c88a6d39-a614-49bc-8ae1-5aee4a50e212"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:12.457760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:12.464731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:12.472536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:12.476362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:12.476747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:12.478264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:12.525411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] validate_networks() for [('c88a6d39-a614-49bc-8ae1-5aee4a50e212', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:48:13.056634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:13.066718 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47a0595d-4e15-4807-87bb-8602ed36e920 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1669 microversion: 2.1 time: 0.649473 Nov 02 21:48:13.072127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2555/5010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:12 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1669 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:13.096170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:13.097223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:13.125116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.127977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.128644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:13.140109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.143362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.148112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:13.243578 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e557a6b3-0ada-4163-b782-3a34b4b531ea tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951/ips" status: 200 len: 179 microversion: 2.1 time: 0.145036 Nov 02 21:48:13.247557 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2556/5011] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:48:13 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951/ips => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:13.280824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:13.286380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:13.316055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.317680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.320806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:13.321830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.323409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.330321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:13.399434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:13.412094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:48:13.783250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:48:13.784375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:48:13.785075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:48:13.785672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:48:13.786245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:48:13.803774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.805718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.805718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:13.806428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.807069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.807667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:13.832132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c28f1c4c-511e-4bdb-950f-7b981eea0f33 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 204 len: 0 microversion: 2.1 time: 0.560375 Nov 02 21:48:13.834013 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2557/5012] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:48:13 2022] DELETE /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:48:13.838423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Getting quotas for project 27dc522851bc4f538dbf51131f62960e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:48:13.842543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Getting quotas for user fa3be96d4cf6478caef4fd48d9219c74 and project 27dc522851bc4f538dbf51131f62960e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:48:13.846662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:13.849738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:13.859553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:48:13.862896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:48:13.869831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.873156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.880284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:13.882776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:13.883605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:13.888764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:14.041548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10568a92-8af1-497c-8608-a97de434f2c3 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.210280 Nov 02 21:48:14.047267 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2456/5013] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:48:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:48:14.057594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:14.059943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:14.078747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:14.084171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:14.084171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:14.084171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:14.084171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:14.086561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:14.494253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:14.510998 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b291f91-3555-4e19-a6a2-4377835ea271 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.674397 Nov 02 21:48:14.514146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2558/5014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:13 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:14.527249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f3977c1-45b8-4a4b-ba08-9672ea6db842 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:14.529923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f3977c1-45b8-4a4b-ba08-9672ea6db842 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:14.716149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f3977c1-45b8-4a4b-ba08-9672ea6db842 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:14.725911 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f3977c1-45b8-4a4b-ba08-9672ea6db842 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1215 microversion: 2.1 time: 0.210365 Nov 02 21:48:14.729276 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2559/5015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:14 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:14.947672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:14.958584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ef6650d3-7824-4b37-8f98-f6f4082ee767 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1675 microversion: 2.1 time: 0.908697 Nov 02 21:48:14.961455 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2457/5016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:14 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1675 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:15.543948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:15.545363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:15.557938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:15.560248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:15.561008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:15.562235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:15.562986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:15.564448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:15.754646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:15.757903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:15.776116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:15.776800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:15.778486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:15.779327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:15.780241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:15.780901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:15.781923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:15.971602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:15.987025 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab47b3eb-acea-4f70-8b4c-dec2072071c7 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1219 microversion: 2.1 time: 0.237708 Nov 02 21:48:15.988583 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2458/5017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:15 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:15.998483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:15.999311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:16.011273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:16.013333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:16.013333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:16.014209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:16.015534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:16.019153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:16.103850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:16.119927 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b46c2283-6663-4fb1-bef8-4e3cc4b8782b tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.579377 Nov 02 21:48:16.120906 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2560/5018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:15 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:17.102551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:17.155787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fa75d3f-0ea6-449f-a756-86b92085f364 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1675 microversion: 2.1 time: 1.164910 Nov 02 21:48:17.158774 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2459/5019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:15 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1675 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:17.170588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:17.171465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:17.181904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:17.182758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:17.184047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:17.185809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:17.186575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:17.187295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:17.328293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1745801553", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "54236417-941b-4cda-94c4-ba88689081b5"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:17.411831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:17.416417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] validate_networks() for [('54236417-941b-4cda-94c4-ba88689081b5', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:48:17.441609 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ec15726-36a6-4534-a1ef-7369b3435e02 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1267 microversion: 2.1 time: 0.279660 Nov 02 21:48:17.446057 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2460/5020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:17 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:17.469934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:17.470883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:17.479971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:17.480773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:17.488406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:17.488406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:17.488406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:17.488406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:18.100234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:18.109684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2601108-1ffc-49ea-b943-ea8a22b4c1fd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.662222 Nov 02 21:48:18.113770 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2461/5021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:17 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:18.150895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-68874e51-e451-4ead-acb5-b3ddc32eeb07 req-e6dcb9f8-0d1f-4fa6-b428-fc6703ef8f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba29fd6d-f160-418e-9bd1-1637d119fd52", "name": "network-vif-plugged", "status": "completed", "tag": "52651b6a-3691-4032-831a-5f01285154fb"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:18.181229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-68874e51-e451-4ead-acb5-b3ddc32eeb07 req-e6dcb9f8-0d1f-4fa6-b428-fc6703ef8f6c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:18.190691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-68874e51-e451-4ead-acb5-b3ddc32eeb07 req-e6dcb9f8-0d1f-4fa6-b428-fc6703ef8f6c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:18.195521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-68874e51-e451-4ead-acb5-b3ddc32eeb07 req-e6dcb9f8-0d1f-4fa6-b428-fc6703ef8f6c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:18.207446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:18.229674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-68874e51-e451-4ead-acb5-b3ddc32eeb07 req-e6dcb9f8-0d1f-4fa6-b428-fc6703ef8f6c service nova] Creating event network-vif-plugged:52651b6a-3691-4032-831a-5f01285154fb for instance ba29fd6d-f160-418e-9bd1-1637d119fd52 on n-h2-860863-4 Nov 02 21:48:18.241278 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-68874e51-e451-4ead-acb5-b3ddc32eeb07 req-e6dcb9f8-0d1f-4fa6-b428-fc6703ef8f6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122640 Nov 02 21:48:18.243483 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2462/5022] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:18.258245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-9529ce8c-37db-471d-8d03-a0529c8beaa3 req-f6861ee3-06a6-4625-964a-4a44be697ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f64c21-3cf0-4469-9f2e-e01092e20951", "name": "network-vif-deleted", "tag": "5c164a39-4d1e-4464-867d-573c68b0bc34"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:18.288444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9529ce8c-37db-471d-8d03-a0529c8beaa3 req-f6861ee3-06a6-4625-964a-4a44be697ce7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:18.288885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9529ce8c-37db-471d-8d03-a0529c8beaa3 req-f6861ee3-06a6-4625-964a-4a44be697ce7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:18.289352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9529ce8c-37db-471d-8d03-a0529c8beaa3 req-f6861ee3-06a6-4625-964a-4a44be697ce7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:18.321260 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-9529ce8c-37db-471d-8d03-a0529c8beaa3 req-f6861ee3-06a6-4625-964a-4a44be697ce7 service nova] Creating event network-vif-deleted:5c164a39-4d1e-4464-867d-573c68b0bc34 for instance f4f64c21-3cf0-4469-9f2e-e01092e20951 on n-h1-860863-4 Nov 02 21:48:18.338720 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-9529ce8c-37db-471d-8d03-a0529c8beaa3 req-f6861ee3-06a6-4625-964a-4a44be697ce7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093784 Nov 02 21:48:18.340979 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2463/5023] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:18.347375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:18.351369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:18.373538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:18.374426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:18.375131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:18.376654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:18.377369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:18.378025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:18.994521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:19.002988 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-647f238b-ef31-44c5-bf99-a6d051cf063f tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1654 microversion: 2.1 time: 0.660434 Nov 02 21:48:19.003445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:48:19.003930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:48:19.004389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:48:19.017173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:48:19.017173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:48:19.041662 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2464/5024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:18 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1654 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:19.041662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:19.041662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:19.041966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:19.041966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:19.041966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:19.041966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:19.041966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:19.041966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:19.048886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:19.053222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:19.054089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:19.055644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:19.056388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:19.057040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:19.079711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Getting quotas for project 24c0e9c8bb7645f2b4a6272fb4fbb296. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:48:19.086039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Getting quotas for user eb61af9ce2bb4c928c1c2b907a6a6bbe and project 24c0e9c8bb7645f2b4a6272fb4fbb296. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:48:19.108053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:48:19.113045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:48:19.187697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:19.200844 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c50c5dd7-eaa7-4387-9c1f-3b82be6462c5 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1273 microversion: 2.1 time: 0.180234 Nov 02 21:48:19.215562 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2465/5025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:19 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:19.215562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:19.215562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:19.217862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:19.218677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:19.219932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:19.221173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:19.221872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:19.222541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:19.344826 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e4225339-d164-462c-92e2-b99a8de2b3aa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.340631 Nov 02 21:48:19.345763 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2561/5026] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:48:19.360427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c56a9ec2-e225-453e-8131-9933a530b44d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:19.361510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c56a9ec2-e225-453e-8131-9933a530b44d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:19.551614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c56a9ec2-e225-453e-8131-9933a530b44d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:19.585209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c56a9ec2-e225-453e-8131-9933a530b44d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:19.592094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c56a9ec2-e225-453e-8131-9933a530b44d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:19.593830 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c56a9ec2-e225-453e-8131-9933a530b44d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1262 microversion: 2.26 time: 0.240706 Nov 02 21:48:19.595416 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2562/5027] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:19 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1262 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:19.660425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:19.670779 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83105191-bf19-491c-be2f-50198cb00131 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.464930 Nov 02 21:48:19.674501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2466/5028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:19 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:20.038040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:20.041803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:20.059770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.060625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.061090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.063211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.065780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.065780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.193421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.194959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.195845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.196312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lazy-loading 'fault' on Instance uuid f4f64c21-3cf0-4469-9f2e-e01092e20951 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:20.243755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:20.243755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:20.302988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.303824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.304550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.306435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.313422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.314811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.349026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e67ab12debe4aba94cb5d0023931e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6de6b9842554c11a1e54fd084cfd316', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:20.368266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c64fa3c2-0a87-41b8-807a-f2df17d33e06 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 200 len: 1303 microversion: 2.1 time: 0.338437 Nov 02 21:48:20.369323 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2563/5029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:20 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 1303 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:20.378648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2a2f6a3f-8c79-4493-9e2f-155d7e92a788 req-7c733410-9503-478f-acf9-0263508b70f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913c5a65-0a1c-4fdb-940c-6e8404c07d5e", "name": "network-vif-plugged", "status": "completed", "tag": "1060b013-68c4-4747-ad47-54d36d908bc7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:20.399417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2a2f6a3f-8c79-4493-9e2f-155d7e92a788 req-7c733410-9503-478f-acf9-0263508b70f1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.407820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2a2f6a3f-8c79-4493-9e2f-155d7e92a788 req-7c733410-9503-478f-acf9-0263508b70f1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.413256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2a2f6a3f-8c79-4493-9e2f-155d7e92a788 req-7c733410-9503-478f-acf9-0263508b70f1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.437501 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2a2f6a3f-8c79-4493-9e2f-155d7e92a788 req-7c733410-9503-478f-acf9-0263508b70f1 service nova] Creating event network-vif-plugged:1060b013-68c4-4747-ad47-54d36d908bc7 for instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e on n-h2-860863-4 Nov 02 21:48:20.444254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2a2f6a3f-8c79-4493-9e2f-155d7e92a788 req-7c733410-9503-478f-acf9-0263508b70f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073426 Nov 02 21:48:20.452207 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2564/5030] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:20.458865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-62794718-0f31-4110-b991-e321c41b2378 req-17f2f377-0997-4055-8372-c30c68167819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f64c21-3cf0-4469-9f2e-e01092e20951", "name": "network-vif-deleted", "tag": "d5176c6c-e8c0-44bd-84e2-6cd837abe315"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:20.467013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:20.476895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-62794718-0f31-4110-b991-e321c41b2378 req-17f2f377-0997-4055-8372-c30c68167819 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.477581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-62794718-0f31-4110-b991-e321c41b2378 req-17f2f377-0997-4055-8372-c30c68167819 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.478370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-62794718-0f31-4110-b991-e321c41b2378 req-17f2f377-0997-4055-8372-c30c68167819 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.492413 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-62794718-0f31-4110-b991-e321c41b2378 req-17f2f377-0997-4055-8372-c30c68167819 service nova] Creating event network-vif-deleted:d5176c6c-e8c0-44bd-84e2-6cd837abe315 for instance f4f64c21-3cf0-4469-9f2e-e01092e20951 on n-h1-860863-4 Nov 02 21:48:20.500403 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-62794718-0f31-4110-b991-e321c41b2378 req-17f2f377-0997-4055-8372-c30c68167819 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045465 Nov 02 21:48:20.502315 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2565/5031] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:20.611194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:20.627024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6edf716d-a1b4-43bc-ab19-9e50b078d006 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:20.628046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6edf716d-a1b4-43bc-ab19-9e50b078d006 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:20.645260 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf7dac54-1af0-4fa5-9bc0-f3187b5c0fe8 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1273 microversion: 2.1 time: 0.417126 Nov 02 21:48:20.650991 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2467/5032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:20 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1273 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:20.712239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:20.713367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:20.722611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.723700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.724311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.725388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:20.726617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:20.730966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:20.779159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6edf716d-a1b4-43bc-ab19-9e50b078d006 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:20.793663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6edf716d-a1b4-43bc-ab19-9e50b078d006 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:20.798804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6edf716d-a1b4-43bc-ab19-9e50b078d006 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:20.801091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6edf716d-a1b4-43bc-ab19-9e50b078d006 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1262 microversion: 2.26 time: 0.179731 Nov 02 21:48:20.810031 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2566/5033] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:20 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1262 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:48:21.292173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:21.319280 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-503ff599-78a4-4319-9d94-74def5dce565 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 0.610169 Nov 02 21:48:21.323895 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2468/5034] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:20 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:21.402496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:21.403175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:21.429182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:21.430138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:21.430668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:21.433518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:21.434201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:21.434751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:21.510429 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] HTTP exception thrown: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Request method failure captured: Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 HTTP/1.1 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuUUTUtMhyBIqFdlPXYLyUzzoruz3buM7aXzBHpYpHVEZyAMUzum7EFss2vIlZGzWKdCdPkNejxUtJJjJYs0FQKIWIVSeOJzpJr9Gejsj__6C5zSSpxhoTR5bUh326uYhaJl-UWgfT3omcd46A8clbowoPlU4I__STYAMfcJwpsJ8ck Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8e67ab12debe4aba94cb5d0023931e2b Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f4f64c21-3cf0-4469-9f2e-e01092e20951'} Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:21.512358 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:21.520073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Returning 404 to user: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:21.521972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-096703d8-052e-4339-a8b6-bc4cc2083380 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 404 len: 111 microversion: 2.1 time: 0.126657 Nov 02 21:48:21.539311 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2567/5035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:21 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:48:21.673455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:21.674788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:21.686410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:21.687950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:21.693199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:21.694407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:21.694893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:21.695340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:21.841781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:21.842412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:21.867284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:21.868912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:21.873221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:21.874012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:21.876512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:21.881892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:22.203101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:22.223308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:22.224750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:22.231288 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33fc1728-da60-4906-be88-496e85368db7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1266 microversion: 2.26 time: 0.398953 Nov 02 21:48:22.232440 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2568/5036] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:21 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:22.350191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:22.350990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:22.372781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:22.374003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:22.374332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:22.374943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:22.381556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:22.382797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:22.998426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:23.024041 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed26ca58-cd56-443d-9346-2d8bcfcca91e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 1.356397 Nov 02 21:48:23.029245 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2469/5037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:21 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:23.262670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:23.264848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:23.289262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:23.302336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:23.302336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:23.303329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:23.303841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:23.304628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:23.435058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:23.449924 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7aa6bf31-fb38-4314-b1b3-b0651e6d0555 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1318 microversion: 2.1 time: 1.105299 Nov 02 21:48:23.451669 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2569/5038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:22 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1318 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:23.535843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:23.550718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:23.553489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:23.557998 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff445b92-23a7-43a7-974e-ee11c8e13540 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1314 microversion: 2.26 time: 0.302022 Nov 02 21:48:23.592776 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2470/5039] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:23 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:48:24.061600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:24.062227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:24.073544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:24.074386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:24.075971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:24.077016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:24.079424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:24.085354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:24.494493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:24.500913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:24.511479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:24.513774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:24.524288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:24.526529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:24.527242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:24.529960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:24.530682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:24.533472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:24.753350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:24.770538 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d1f281e-c5ca-4d34-a401-2cabec3d8070 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.711417 Nov 02 21:48:24.772982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2570/5040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:24 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:24.802738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:24.806054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:24.827448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:24.828333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:24.830969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:24.833847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:24.833847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:24.833847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:24.901894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:24.914654 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c2718d6-d071-4a7e-ad73-fbb9b72d92c5 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 200 len: 1506 microversion: 2.1 time: 0.429036 Nov 02 21:48:24.917021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2471/5041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:24 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:24.932850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-35ef1fed-9075-4990-8597-bc5361a8f6df req-13b2b2da-1cb3-42e3-8611-ef83dc0e14ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbc48ee-f133-41f0-b848-5ca1b9c14762", "tag": "de265ab1-991b-4cc2-addc-9b87de97608c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:24.955708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-35ef1fed-9075-4990-8597-bc5361a8f6df req-13b2b2da-1cb3-42e3-8611-ef83dc0e14ea service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:24.956137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-35ef1fed-9075-4990-8597-bc5361a8f6df req-13b2b2da-1cb3-42e3-8611-ef83dc0e14ea service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:24.960337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-35ef1fed-9075-4990-8597-bc5361a8f6df req-13b2b2da-1cb3-42e3-8611-ef83dc0e14ea service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:24.980300 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-35ef1fed-9075-4990-8597-bc5361a8f6df req-13b2b2da-1cb3-42e3-8611-ef83dc0e14ea service nova] Creating event network-changed:de265ab1-991b-4cc2-addc-9b87de97608c for instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 on n-h1-860863-4 Nov 02 21:48:24.987950 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-35ef1fed-9075-4990-8597-bc5361a8f6df req-13b2b2da-1cb3-42e3-8611-ef83dc0e14ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067001 Nov 02 21:48:24.994777 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2472/5042] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:25.000182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:25.015471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:25.026672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:25.036487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:25.042700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:25.051876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd27a3ed-589b-4eb1-bc14-b361ba37f9fb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1320 microversion: 2.26 time: 0.275305 Nov 02 21:48:25.055512 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2571/5043] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:24 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:25.079357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.081018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:25.084759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:25.085840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.087669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:25.091110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:25.417807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:25.429347 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dafeb984-59b3-45a2-8bbb-23fa90d5f2af tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 200 len: 1507 microversion: 2.1 time: 0.433206 Nov 02 21:48:25.441946 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2473/5044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:24 2022] GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 1507 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:25.468321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:25.468321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:25.476966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.484836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:25.485589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:25.489769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.489769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:25.489769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:25.547036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:48:25.796772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:25.797571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:25.815170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.828380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:25.828380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:25.828380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.828380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:25.829100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:25.972470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8acca7d6-021a-4157-823b-565a54e35552 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 204 len: 0 microversion: 2.1 time: 0.517323 Nov 02 21:48:25.975179 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2572/5045] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:48:25 2022] DELETE /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:48:25.983884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:25.986830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:25.996311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.997119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:25.997732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:25.998750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:25.999416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:26.000016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:26.041884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:48:26.192008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:26.217341 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48e746e9-241a-4f51-a56f-9c650d755c29 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.426239 Nov 02 21:48:26.237956 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2474/5046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:25 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:26.249348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:26.259586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:26.272471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:26.272471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:26.276098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:26.277171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:26.277819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:26.278429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:26.383849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:26.391845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-13348948-0e2f-4668-a78b-42be7e180d01 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "DELETE /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 204 len: 0 microversion: 2.1 time: 0.411098 Nov 02 21:48:26.396357 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2573/5047] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:48:25 2022] DELETE /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:48:26.402371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:26.403418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:26.404328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:26.407295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:26.409573 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7fad9851-d30b-43cf-b2fd-94df050ad50c tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1320 microversion: 2.26 time: 0.170802 Nov 02 21:48:26.411537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:26.417565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:26.417714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2475/5048] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:26 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:26.417816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:26.417816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:26.417816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:26.417816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:26.444530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:26.589670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:26.598270 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2a3a9a4-35c0-43e9-867d-8252823f954c tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 200 len: 1513 microversion: 2.1 time: 0.200138 Nov 02 21:48:26.613624 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2574/5049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:26 2022] GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:27.248973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:27.249596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:27.257084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:27.257890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:27.258508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:27.259402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:27.260133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:27.260754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:27.444329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:27.445140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:27.463548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:27.464050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:27.464852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:27.474938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:27.474938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:27.474938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:27.726787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:27.745179 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c08d316d-a6d7-474b-85d9-29b25ec0d78f tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.499861 Nov 02 21:48:27.746623 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2476/5050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:27 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:27.763482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:27.764364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:27.778352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:27.782417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:27.783170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:27.784418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:27.784880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:27.785805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:27.900913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:27.914736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:27.916186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:27.918415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ff4da95-353b-4791-96b3-61cd2702c679 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.477687 Nov 02 21:48:27.923829 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2575/5051] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:27 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:28.091799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:28.100829 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb17547a-a5b2-4bf1-a997-71b460adb8e7 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 200 len: 1513 microversion: 2.1 time: 0.352634 Nov 02 21:48:28.115478 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2477/5052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:27 2022] GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 1513 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:28.186821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:28.187705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:28.204110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.204110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.204110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.204110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.204110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.204110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.221069 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] HTTP exception thrown: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Request method failure captured: Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 HTTP/1.1 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuUUTUtMhyBIqFdlPXYLyUzzoruz3buM7aXzBHpYpHVEZyAMUzum7EFss2vIlZGzWKdCdPkNejxUtJJjJYs0FQKIWIVSeOJzpJr9Gejsj__6C5zSSpxhoTR5bUh326uYhaJl-UWgfT3omcd46A8clbowoPlU4I__STYAMfcJwpsJ8ck Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8e67ab12debe4aba94cb5d0023931e2b Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f4f64c21-3cf0-4469-9f2e-e01092e20951'} Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:28.222815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Returning 404 to user: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8e45c82-54f5-44af-a14a-6205d4c048f7 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 404 len: 111 microversion: 2.1 time: 0.042309 Nov 02 21:48:28.227641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2576/5053] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:48:28 2022] DELETE /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:48:28.234085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:28.234747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: f4f64c21-3cf0-4469-9f2e-e01092e20951] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:28.240860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.241388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.241831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.243609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.243609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.243860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.259830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] HTTP exception thrown: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Request method failure captured: Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 HTTP/1.1 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuUUTUtMhyBIqFdlPXYLyUzzoruz3buM7aXzBHpYpHVEZyAMUzum7EFss2vIlZGzWKdCdPkNejxUtJJjJYs0FQKIWIVSeOJzpJr9Gejsj__6C5zSSpxhoTR5bUh326uYhaJl-UWgfT3omcd46A8clbowoPlU4I__STYAMfcJwpsJ8ck Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8e67ab12debe4aba94cb5d0023931e2b Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f4f64c21-3cf0-4469-9f2e-e01092e20951'} Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.261543 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Returning 404 to user: Instance f4f64c21-3cf0-4469-9f2e-e01092e20951 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fed2e9df-079e-46da-bf3a-e4ece376fb6e tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951" status: 404 len: 111 microversion: 2.1 time: 0.033549 Nov 02 21:48:28.268763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2478/5054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:28 2022] GET /compute/v2.1/servers/f4f64c21-3cf0-4469-9f2e-e01092e20951 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:48:28.276786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:28.276786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:28.279672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.279672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.279946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.280659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.281198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.295711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.297448 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] HTTP exception thrown: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Request method failure captured: Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c HTTP/1.1 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuUUTUtMhyBIqFdlPXYLyUzzoruz3buM7aXzBHpYpHVEZyAMUzum7EFss2vIlZGzWKdCdPkNejxUtJJjJYs0FQKIWIVSeOJzpJr9Gejsj__6C5zSSpxhoTR5bUh326uYhaJl-UWgfT3omcd46A8clbowoPlU4I__STYAMfcJwpsJ8ck Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8e67ab12debe4aba94cb5d0023931e2b Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '67e818a2-c9ff-45be-bdbe-12c2821e543c'} Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:28.299222 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Returning 404 to user: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a1fdf885-ffcb-4e92-b2a8-67f6bd2792b6 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 404 len: 111 microversion: 2.1 time: 0.032927 Nov 02 21:48:28.305485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2577/5055] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:48:28 2022] DELETE /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:48:28.315564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:28.316296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] [instance: 67e818a2-c9ff-45be-bdbe-12c2821e543c] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:28.330978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.331374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.332160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.333030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.333574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.334081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.352146 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] HTTP exception thrown: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Request method failure captured: Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c HTTP/1.1 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuUUTUtMhyBIqFdlPXYLyUzzoruz3buM7aXzBHpYpHVEZyAMUzum7EFss2vIlZGzWKdCdPkNejxUtJJjJYs0FQKIWIVSeOJzpJr9Gejsj__6C5zSSpxhoTR5bUh326uYhaJl-UWgfT3omcd46A8clbowoPlU4I__STYAMfcJwpsJ8ck Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6de6b9842554c11a1e54fd084cfd316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: f6de6b9842554c11a1e54fd084cfd316 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersTestMultiNic-872713671 Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8e67ab12debe4aba94cb5d0023931e2b Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersTestMultiNic-872713671-project Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '67e818a2-c9ff-45be-bdbe-12c2821e543c'} Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:28.358735 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] Returning 404 to user: Instance 67e818a2-c9ff-45be-bdbe-12c2821e543c could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2e53e4e6-6032-49bf-b4a7-29e4570d0d12 tempest-ServersTestMultiNic-872713671 tempest-ServersTestMultiNic-872713671-project] 10.222.0.25 "GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c" status: 404 len: 111 microversion: 2.1 time: 0.045311 Nov 02 21:48:28.366773 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2479/5056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:28 2022] GET /compute/v2.1/servers/67e818a2-c9ff-45be-bdbe-12c2821e543c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:48:28.770336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:28.776333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:28.779174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.779911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.780643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.782306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.783344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.784064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.955957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:28.956723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:28.963969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.964393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.965031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:28.965560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:28.966553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:28.967160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:29.042274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:29.343273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:29.375838 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39f649a3-d151-42a3-944a-0d05d73501af tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.609851 Nov 02 21:48:29.379798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2578/5057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:28 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:29.390857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:29.392878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:29.413763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:29.414342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:29.414701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:29.415199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:29.422235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:29.424790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:29.425332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:29.434413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:29.436741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:29.441362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9396dc2-eb55-4b47-b4e7-ddfca7e5d336 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.493959 Nov 02 21:48:29.476968 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2480/5058] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:28 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:29.806469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:29.825285 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae7471fe-eae0-479b-b89b-167077b52c73 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 200 len: 1513 microversion: 2.1 time: 0.443528 Nov 02 21:48:29.831519 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2579/5059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:29 2022] GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:30.026290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-916c8a16-61cb-41e1-9661-adb4097d420e req-edbe6846-d277-4290-8198-17bad6c263d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913c5a65-0a1c-4fdb-940c-6e8404c07d5e", "name": "network-vif-deleted", "tag": "1060b013-68c4-4747-ad47-54d36d908bc7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:30.042858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-916c8a16-61cb-41e1-9661-adb4097d420e req-edbe6846-d277-4290-8198-17bad6c263d7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:30.049433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-916c8a16-61cb-41e1-9661-adb4097d420e req-edbe6846-d277-4290-8198-17bad6c263d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:30.049913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-916c8a16-61cb-41e1-9661-adb4097d420e req-edbe6846-d277-4290-8198-17bad6c263d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:30.083836 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-916c8a16-61cb-41e1-9661-adb4097d420e req-edbe6846-d277-4290-8198-17bad6c263d7 service nova] Creating event network-vif-deleted:1060b013-68c4-4747-ad47-54d36d908bc7 for instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e on n-h2-860863-4 Nov 02 21:48:30.118066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-916c8a16-61cb-41e1-9661-adb4097d420e req-edbe6846-d277-4290-8198-17bad6c263d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092860 Nov 02 21:48:30.120191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2481/5060] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:30.409056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:30.413634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:30.430486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:30.431107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:30.431415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:30.432131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:30.432592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:30.433046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:30.482336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:30.483758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:30.502781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:30.503748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:30.506620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:30.509011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:30.509666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:30.510342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:30.784606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:31.332986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:31.340062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:31.345883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:31.351602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:31.354592 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b6b2aa0-1293-4c15-aa32-a04cae16265d tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.878922 Nov 02 21:48:31.357265 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2482/5061] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:30 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:31.368230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:31.369234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:31.373717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:31.393703 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4097d8f6-5dab-4a90-8feb-a937cfedc2c4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.986768 Nov 02 21:48:31.396599 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2580/5062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:30 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:31.402637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:31.403137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:31.403577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:31.404306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:31.404764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:31.409903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c5ff7ce0-1c10-49a1-8cfd-3b2b499f81ea req-e3059039-2968-4b12-b162-143c3d558118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba29fd6d-f160-418e-9bd1-1637d119fd52", "name": "network-vif-deleted", "tag": "52651b6a-3691-4032-831a-5f01285154fb"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:31.426935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:31.504041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c5ff7ce0-1c10-49a1-8cfd-3b2b499f81ea req-e3059039-2968-4b12-b162-143c3d558118 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:31.510365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c5ff7ce0-1c10-49a1-8cfd-3b2b499f81ea req-e3059039-2968-4b12-b162-143c3d558118 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:31.510365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c5ff7ce0-1c10-49a1-8cfd-3b2b499f81ea req-e3059039-2968-4b12-b162-143c3d558118 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:31.561955 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c5ff7ce0-1c10-49a1-8cfd-3b2b499f81ea req-e3059039-2968-4b12-b162-143c3d558118 service nova] Creating event network-vif-deleted:52651b6a-3691-4032-831a-5f01285154fb for instance ba29fd6d-f160-418e-9bd1-1637d119fd52 on n-h2-860863-4 Nov 02 21:48:31.569131 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c5ff7ce0-1c10-49a1-8cfd-3b2b499f81ea req-e3059039-2968-4b12-b162-143c3d558118 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169020 Nov 02 21:48:31.570418 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2581/5063] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:31.675073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:31.693719 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e77f9916-cb86-459d-ae1d-f28aebfbe520 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 200 len: 1303 microversion: 2.1 time: 0.334270 Nov 02 21:48:31.695158 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2483/5064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:31 2022] GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 1303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:32.389218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:32.389993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:32.401489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:32.402044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:32.402477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:32.417394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:32.418645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:32.419185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:32.435955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:32.436897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:32.453133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:32.454757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:32.457094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:32.458059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:32.462688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:32.463323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:32.936459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:32.951225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:32.956450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:32.957965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fac4afdc-fb32-4e4e-ba29-2dcd303fc101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.573564 Nov 02 21:48:32.959689 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2582/5065] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:32 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:32.969899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:32.970951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:32.982577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:32.983512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:32.984131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:32.985700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:32.986353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:32.987006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:32.996910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:33.007237 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7105b59d-00b6-4065-a8d1-3e675c7e3afd tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.588212 Nov 02 21:48:33.018003 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2484/5066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:32 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:33.066737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:33.068346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:33.068826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:33.069322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lazy-loading 'fault' on Instance uuid ba29fd6d-f160-418e-9bd1-1637d119fd52 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:33.192670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a7ed00fe564141ba3c5a7030ec4613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6164e68cad634d739964f17a76cdafda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:33.207567 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c9e6270-9aa9-4a3f-bbf7-e1286c69af32 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 200 len: 1308 microversion: 2.1 time: 0.246466 Nov 02 21:48:33.217882 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2583/5067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:32 2022] GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:33.657409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-756f93c4-8781-42c6-a993-dce3cb2dc6a7 req-f75f83e3-483e-44ed-aee6-0e59e67195bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2581069-9890-4bc4-b3d1-9554dc2c1e3a", "tag": "9f969f8b-5e65-49ec-9438-0fc339101cca"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:33.670556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-55feb7f5-12ae-4bc0-bb97-c5f91fee2cbb req-861a3777-19ba-4b17-9321-4896d89551aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbc48ee-f133-41f0-b848-5ca1b9c14762", "name": "network-vif-plugged", "status": "completed", "tag": "de265ab1-991b-4cc2-addc-9b87de97608c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:33.685633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-756f93c4-8781-42c6-a993-dce3cb2dc6a7 req-f75f83e3-483e-44ed-aee6-0e59e67195bf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:33.686372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-756f93c4-8781-42c6-a993-dce3cb2dc6a7 req-f75f83e3-483e-44ed-aee6-0e59e67195bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:33.690106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-756f93c4-8781-42c6-a993-dce3cb2dc6a7 req-f75f83e3-483e-44ed-aee6-0e59e67195bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:33.697047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-55feb7f5-12ae-4bc0-bb97-c5f91fee2cbb req-861a3777-19ba-4b17-9321-4896d89551aa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:33.697770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-55feb7f5-12ae-4bc0-bb97-c5f91fee2cbb req-861a3777-19ba-4b17-9321-4896d89551aa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:33.699834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-55feb7f5-12ae-4bc0-bb97-c5f91fee2cbb req-861a3777-19ba-4b17-9321-4896d89551aa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:33.730688 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-55feb7f5-12ae-4bc0-bb97-c5f91fee2cbb req-861a3777-19ba-4b17-9321-4896d89551aa service nova] Creating event network-vif-plugged:de265ab1-991b-4cc2-addc-9b87de97608c for instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 on n-h1-860863-4 Nov 02 21:48:33.742524 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-55feb7f5-12ae-4bc0-bb97-c5f91fee2cbb req-861a3777-19ba-4b17-9321-4896d89551aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075520 Nov 02 21:48:33.743140 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2584/5068] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:48:33.743948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-756f93c4-8781-42c6-a993-dce3cb2dc6a7 req-f75f83e3-483e-44ed-aee6-0e59e67195bf service nova] Creating event network-changed:9f969f8b-5e65-49ec-9438-0fc339101cca for instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a on n-h2-860863-4 Nov 02 21:48:33.755955 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-756f93c4-8781-42c6-a993-dce3cb2dc6a7 req-f75f83e3-483e-44ed-aee6-0e59e67195bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104153 Nov 02 21:48:33.758003 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2485/5069] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:33.997151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:33.998812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:34.018632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.019360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.019977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.020870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.022742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.030008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.062071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:34.063926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:34.082932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.085337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.087865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.089805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.091487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.091995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.492640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:34.502853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:34.506144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:34.515386 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-853de258-bdef-4f26-ad3a-ff9b8075b145 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.467004 Nov 02 21:48:34.519569 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2486/5070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:34 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:34.533400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:34.533400 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a398027d-9cdc-46f4-8937-481d96d2af73 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.542010 Nov 02 21:48:34.533400 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2585/5071] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:33 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:34.558003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:34.558900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: ba29fd6d-f160-418e-9bd1-1637d119fd52] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:34.571640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.572245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.572759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.573576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.574107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.574600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.627362 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] HTTP exception thrown: Instance ba29fd6d-f160-418e-9bd1-1637d119fd52 could not be found. Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Request method failure captured: Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 HTTP/1.1 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuVlSUItoKiA1EFd7NUOTf3kxtXBRUwei0x_ATYiTuUstFn_KYEEASBBXEcoJlGhp9ufG3bqb66CRrYaXkjYtIFRoupgrgPiU-noTzohvqtb0ZeUKXIuojH3S0aKsmIKaUWhhWWE2AZ1QQInPJyM0-oxmQdwr5r__LHClrS4QnR_i5s Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 6164e68cad634d739964f17a76cdafda Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-MultipleCreateTestJSON-838502149 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6164e68cad634d739964f17a76cdafda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6164e68cad634d739964f17a76cdafda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6164e68cad634d739964f17a76cdafda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6164e68cad634d739964f17a76cdafda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-MultipleCreateTestJSON-838502149 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 6164e68cad634d739964f17a76cdafda Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-MultipleCreateTestJSON-838502149 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-MultipleCreateTestJSON-838502149-project Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 00a7ed00fe564141ba3c5a7030ec4613 Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-MultipleCreateTestJSON-838502149-project Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance ba29fd6d-f160-418e-9bd1-1637d119fd52 could not be found. Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'ba29fd6d-f160-418e-9bd1-1637d119fd52'} Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba29fd6d-f160-418e-9bd1-1637d119fd52 could not be found. Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba29fd6d-f160-418e-9bd1-1637d119fd52 could not be found. Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:34.636439 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba29fd6d-f160-418e-9bd1-1637d119fd52 could not be found. Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Returning 404 to user: Instance ba29fd6d-f160-418e-9bd1-1637d119fd52 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-869623d5-8978-417b-a9c0-246ef06acea6 tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52" status: 404 len: 111 microversion: 2.1 time: 0.086581 Nov 02 21:48:34.643956 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2586/5072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:34 2022] GET /compute/v2.1/servers/ba29fd6d-f160-418e-9bd1-1637d119fd52 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:48:34.648340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:34.649173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] [instance: 913c5a65-0a1c-4fdb-940c-6e8404c07d5e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:34.663945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.666109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.666109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.667735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:34.667735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:34.668124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:34.701140 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] HTTP exception thrown: Instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e could not be found. Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Request method failure captured: Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e HTTP/1.1 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuVlSUItoKiA1EFd7NUOTf3kxtXBRUwei0x_ATYiTuUstFn_KYEEASBBXEcoJlGhp9ufG3bqb66CRrYaXkjYtIFRoupgrgPiU-noTzohvqtb0ZeUKXIuojH3S0aKsmIKaUWhhWWE2AZ1QQInPJyM0-oxmQdwr5r__LHClrS4QnR_i5s Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 6164e68cad634d739964f17a76cdafda Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MultipleCreateTestJSON-838502149 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6164e68cad634d739964f17a76cdafda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6164e68cad634d739964f17a76cdafda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6164e68cad634d739964f17a76cdafda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6164e68cad634d739964f17a76cdafda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MultipleCreateTestJSON-838502149 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 6164e68cad634d739964f17a76cdafda Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MultipleCreateTestJSON-838502149 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MultipleCreateTestJSON-838502149-project Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 00a7ed00fe564141ba3c5a7030ec4613 Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MultipleCreateTestJSON-838502149-project Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e could not be found. Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '913c5a65-0a1c-4fdb-940c-6e8404c07d5e'} Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e could not be found. Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e could not be found. Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:34.702842 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e could not be found. Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] Returning 404 to user: Instance 913c5a65-0a1c-4fdb-940c-6e8404c07d5e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb6907b4-ed6f-432e-909f-a51628faa7bd tempest-MultipleCreateTestJSON-838502149 tempest-MultipleCreateTestJSON-838502149-project] 10.222.0.25 "GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e" status: 404 len: 111 microversion: 2.1 time: 0.060868 Nov 02 21:48:34.716272 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2487/5073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:34 2022] GET /compute/v2.1/servers/913c5a65-0a1c-4fdb-940c-6e8404c07d5e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:48:35.545416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:35.550967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:35.559263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:35.559895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:35.574073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:35.574582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:35.575027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:35.575710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:35.576264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:35.576705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:35.577444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:35.577902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:35.578457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:35.578923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:35.579352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:35.581624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:36.054069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:36.065214 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b75678d-a8e8-4629-8e20-fc04240a64e2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1315 microversion: 2.1 time: 0.523041 Nov 02 21:48:36.078002 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2587/5074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:35 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:36.121147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:36.143450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:36.151769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:36.154739 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-933f4dbf-ca1b-436d-bc6b-7f3458c5fc3f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.599157 Nov 02 21:48:36.155547 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2488/5075] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:35 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:48:37.096876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:37.098132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:37.115536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:37.116195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:37.116652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:37.117437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:37.117946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:37.118374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:37.184263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:37.185631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:37.200866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:37.204430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:37.205136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:37.206829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:37.209331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:37.213809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:38.257829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:38.281282 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bac7f658-5662-4d7f-a483-1f9428c9e6ca tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1503 microversion: 2.1 time: 1.190758 Nov 02 21:48:38.285035 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2588/5076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:37 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1503 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:38.309878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:38.310768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:38.318974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:38.319777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:38.320385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:38.321347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:38.326897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:38.326897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:38.341595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:38.355688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:38.357267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:38.359256 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a6e6258c-f94d-48cd-b3a2-20f973dccaf6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 1.180207 Nov 02 21:48:38.374402 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2489/5077] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:37 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:48:38.576013 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-985d686a-0a13-4147-b278-c74501acf71e tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.269971 Nov 02 21:48:38.577082 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2589/5078] 10.222.0.25 () {58 vars in 1296 bytes} [Wed Nov 2 21:48:38 2022] DELETE /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762/os-server-password => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 21:48:38.587617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:38.588239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:38.624904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:38.626107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:38.629864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:38.630692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:38.632196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:38.633887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:38.738301 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f7164a7-ec89-4b47-8016-e3e60e6de430 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.152594 Nov 02 21:48:38.739095 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2490/5079] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 21:48:38 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762/os-server-password => generated 16 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 21:48:38.754141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:38.755089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:38.763155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:38.766863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:38.785495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:38.789784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:38.792912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:38.793709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:38.894500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:48:39.338057 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-319ae951-15d8-48cf-93b5-f943634b8f92 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 204 len: 0 microversion: 2.1 time: 0.591813 Nov 02 21:48:39.349610 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2590/5080] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:48:38 2022] DELETE /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:48:39.350005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:39.350005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:39.355955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:39.361581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:39.365788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:39.366631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:39.367200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:39.367646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:39.395974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:39.396865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:39.414325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:39.417188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:39.419713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:39.426424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:39.429186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:39.430593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:39.461989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:39.899299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:39.899992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:39.907854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:39.909960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:39.911498 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cba01241-475a-4781-8037-2e75d3f7ad36 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.524645 Nov 02 21:48:39.929622 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2591/5081] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:39 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:48:39.933432 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e78becd-821e-40dd-8082-0c9f1bc406d2 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1509 microversion: 2.1 time: 0.590237 Nov 02 21:48:39.934409 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2491/5082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:39 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1509 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:40.314599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ee735894-e743-4272-96d9-a9afc5293f62 req-317472d5-e018-4c11-93cd-0d37cc4ad990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2581069-9890-4bc4-b3d1-9554dc2c1e3a", "name": "network-vif-plugged", "status": "completed", "tag": "9f969f8b-5e65-49ec-9438-0fc339101cca"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:40.326545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ee735894-e743-4272-96d9-a9afc5293f62 req-317472d5-e018-4c11-93cd-0d37cc4ad990 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:40.343299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ee735894-e743-4272-96d9-a9afc5293f62 req-317472d5-e018-4c11-93cd-0d37cc4ad990 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:40.343299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ee735894-e743-4272-96d9-a9afc5293f62 req-317472d5-e018-4c11-93cd-0d37cc4ad990 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:40.360486 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ee735894-e743-4272-96d9-a9afc5293f62 req-317472d5-e018-4c11-93cd-0d37cc4ad990 service nova] Creating event network-vif-plugged:9f969f8b-5e65-49ec-9438-0fc339101cca for instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a on n-h2-860863-4 Nov 02 21:48:40.373975 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ee735894-e743-4272-96d9-a9afc5293f62 req-317472d5-e018-4c11-93cd-0d37cc4ad990 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064013 Nov 02 21:48:40.377734 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2592/5083] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:40.944752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:40.946825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:40.954751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:40.958534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:40.959300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:40.969465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:40.969465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:40.972534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:40.973299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:40.973941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:40.983714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:40.983714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:40.983714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:40.983714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:40.983714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:40.983714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:41.420987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:41.447922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:41.455068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:41.457421 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8573ec3f-8132-45fe-bc67-aa77f5f574a7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1362 microversion: 2.26 time: 0.511554 Nov 02 21:48:41.472536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2492/5084] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:40 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:41.709806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:41.721516 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-06e4bb8b-9e5a-4628-bf46-969e0ed8a113 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1509 microversion: 2.1 time: 0.760943 Nov 02 21:48:41.722126 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2593/5085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:40 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1509 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:42.284274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a26d760e-cb63-4711-985e-fd7ddef1267d tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1165505309", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:42.304292 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a26d760e-cb63-4711-985e-fd7ddef1267d tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] HTTP exception thrown: min_count must be <= max_count Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a26d760e-cb63-4711-985e-fd7ddef1267d tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Request method failure captured: Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 184 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuW5xpDXqxo4QKJnGfjrhKFo5ksszFv0znMtEChwR_mXtWVOU2h7-R-W5y_trmfBXkaBKtzu0svFOFGfJjKRDvMB3ZNbX9acDG9i4unnoTOsnBCSSi-7CymGnT61SJFhdL187ZbFlkVc5WygSUClAN7b3-E4P-9rZQtBN_IKlovej1s Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1f7f5eacf7af46038ae7453b3aca60dc Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1165505309", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: exception: min_count must be <= max_count Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1165505309', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 02 21:48:42.307651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.321261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a26d760e-cb63-4711-985e-fd7ddef1267d tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Returning 400 to user: min_count must be <= max_count {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:42.323098 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a26d760e-cb63-4711-985e-fd7ddef1267d tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.350735 Nov 02 21:48:42.323946 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2493/5086] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:48:41 2022] POST /compute/v2.1/servers => generated 74 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:48:42.378378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-94b56ccf-f55f-4d2a-8f41-e4150545b6a8 req-11a3248a-3116-43a6-a088-94ff94f53dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbc48ee-f133-41f0-b848-5ca1b9c14762", "name": "network-vif-deleted", "tag": "de265ab1-991b-4cc2-addc-9b87de97608c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:42.406187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-94b56ccf-f55f-4d2a-8f41-e4150545b6a8 req-11a3248a-3116-43a6-a088-94ff94f53dec service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:42.408744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-94b56ccf-f55f-4d2a-8f41-e4150545b6a8 req-11a3248a-3116-43a6-a088-94ff94f53dec service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:42.417761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-94b56ccf-f55f-4d2a-8f41-e4150545b6a8 req-11a3248a-3116-43a6-a088-94ff94f53dec service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:42.455431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f997701b-dce7-49dd-b490-4be6e7f8da6b tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-438018342", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "max_count": 0}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:42.459608 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-94b56ccf-f55f-4d2a-8f41-e4150545b6a8 req-11a3248a-3116-43a6-a088-94ff94f53dec service nova] Creating event network-vif-deleted:de265ab1-991b-4cc2-addc-9b87de97608c for instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 on n-h1-860863-4 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f997701b-dce7-49dd-b490-4be6e7f8da6b tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Request method failure captured: Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 167 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuW5xpDXqxo4QKJnGfjrhKFo5ksszFv0znMtEChwR_mXtWVOU2h7-R-W5y_trmfBXkaBKtzu0svFOFGfJjKRDvMB3ZNbX9acDG9i4unnoTOsnBCSSi-7CymGnT61SJFhdL187ZbFlkVc5WygSUClAN7b3-E4P-9rZQtBN_IKlovej1s Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1f7f5eacf7af46038ae7453b3aca60dc Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-438018342", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "max_count": 0}} Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-438018342', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'max_count': 0}}} Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 0 Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:48:42.460326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 21:48:42.467975 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.469424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-94b56ccf-f55f-4d2a-8f41-e4150545b6a8 req-11a3248a-3116-43a6-a088-94ff94f53dec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100180 Nov 02 21:48:42.469767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f997701b-dce7-49dd-b490-4be6e7f8da6b tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:42.470762 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f997701b-dce7-49dd-b490-4be6e7f8da6b tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020246 Nov 02 21:48:42.473045 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2594/5087] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:48:42.476691 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2494/5088] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:48:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:48:42.500657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:42.501824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:42.523358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:42.523870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:42.525071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:42.530297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:42.545848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:42.545848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:42.612600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba62027a-d4d1-4037-8f4b-42b735bff014 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2062809333", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "max_count": 2.5}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba62027a-d4d1-4037-8f4b-42b735bff014 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Request method failure captured: Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 170 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuW5xpDXqxo4QKJnGfjrhKFo5ksszFv0znMtEChwR_mXtWVOU2h7-R-W5y_trmfBXkaBKtzu0svFOFGfJjKRDvMB3ZNbX9acDG9i4unnoTOsnBCSSi-7CymGnT61SJFhdL187ZbFlkVc5WygSUClAN7b3-E4P-9rZQtBN_IKlovej1s Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1f7f5eacf7af46038ae7453b3aca60dc Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2062809333", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "max_count": 2.5}} Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2062809333', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'max_count': 2.5}}} Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:48:42.619993 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 21:48:42.628579 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:42.648081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba62027a-d4d1-4037-8f4b-42b735bff014 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:42.649054 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ba62027a-d4d1-4037-8f4b-42b735bff014 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041922 Nov 02 21:48:42.653554 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2495/5089] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:48:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:48:42.750286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:42.752323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:42.763635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:42.766198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:42.766646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:42.767385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:42.781496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:42.781496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:42.979481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:42.994314 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a17379aa-9cc8-4f54-bb92-952629d92561 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1300 microversion: 2.1 time: 0.249386 Nov 02 21:48:43.010949 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2496/5090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:42 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1300 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:43.025162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21cb7efe-054c-46f7-8aae-119e046d7cf7 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-565126666", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 0}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21cb7efe-054c-46f7-8aae-119e046d7cf7 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Request method failure captured: Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 167 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuW5xpDXqxo4QKJnGfjrhKFo5ksszFv0znMtEChwR_mXtWVOU2h7-R-W5y_trmfBXkaBKtzu0svFOFGfJjKRDvMB3ZNbX9acDG9i4unnoTOsnBCSSi-7CymGnT61SJFhdL187ZbFlkVc5WygSUClAN7b3-E4P-9rZQtBN_IKlovej1s Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1f7f5eacf7af46038ae7453b3aca60dc Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-565126666", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 0}} Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-565126666', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'min_count': 0}}} Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 0 Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:48:43.033058 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21cb7efe-054c-46f7-8aae-119e046d7cf7 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-21cb7efe-054c-46f7-8aae-119e046d7cf7 tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023974 Nov 02 21:48:43.047054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2497/5091] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:48:43 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:48:43.130360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16426c0e-20af-4202-bec0-14f1424a20df tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1305316559", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 2.5}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16426c0e-20af-4202-bec0-14f1424a20df tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Request method failure captured: Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 170 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuW5xpDXqxo4QKJnGfjrhKFo5ksszFv0znMtEChwR_mXtWVOU2h7-R-W5y_trmfBXkaBKtzu0svFOFGfJjKRDvMB3ZNbX9acDG9i4unnoTOsnBCSSi-7CymGnT61SJFhdL187ZbFlkVc5WygSUClAN7b3-E4P-9rZQtBN_IKlovej1s Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/23f3f781a0fa4c01b65871a527f04a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 23f3f781a0fa4c01b65871a527f04a53 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1392006675 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1f7f5eacf7af46038ae7453b3aca60dc Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1392006675-project Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1305316559", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "min_count": 2.5}} Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1305316559', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'min_count': 2.5}}} Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:48:43.134500 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16426c0e-20af-4202-bec0-14f1424a20df tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-16426c0e-20af-4202-bec0-14f1424a20df tempest-MultipleCreateNegativeTestJSON-1392006675 tempest-MultipleCreateNegativeTestJSON-1392006675-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009805 Nov 02 21:48:43.149818 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2498/5092] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:48:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:48:43.319379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:43.340859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:43.355414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:43.357287 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd804cf6-7fd1-49d0-b550-6bb2c86a1bfb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1546 microversion: 2.26 time: 0.865880 Nov 02 21:48:43.358948 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2595/5093] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:42 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1546 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:43.400920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b694209d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:43.429859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.430599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.438228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.438860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:43.459776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.460287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.460736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.461491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.461956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.462396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.510134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.510629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.527350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.558435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.559248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.559895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.706626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:43.738268 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8523c97-3b0f-49b8-8417-666911696b10 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1415117384" status: 201 len: 0 microversion: 2.26 time: 0.341160 Nov 02 21:48:43.740731 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2499/5094] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 21:48:43 2022] PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1415117384 => generated 0 bytes in 344 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 21:48:43.749428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-397519d9-98a0-4872-84e3-a5d7d7e3b548 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b68ef9ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:43.767534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-397519d9-98a0-4872-84e3-a5d7d7e3b548 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.768318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-397519d9-98a0-4872-84e3-a5d7d7e3b548 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.768775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-397519d9-98a0-4872-84e3-a5d7d7e3b548 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.811248 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-397519d9-98a0-4872-84e3-a5d7d7e3b548 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1415117384" status: 204 len: 0 microversion: 2.26 time: 0.065528 Nov 02 21:48:43.817204 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2596/5095] 10.222.0.25 () {60 vars in 1361 bytes} [Wed Nov 2 21:48:43 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1415117384 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:43.829709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d1d93a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:43.867344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.875635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.876292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.877146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:43.910409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.911274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.918412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:43.920018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:43.926505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:43.929817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.010280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.010862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.011284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.028718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.029358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:44.040337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.040836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.041311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.042020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.042561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.042904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.133866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.134422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.151164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:44.157743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.158649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lazy-loading 'fault' on Instance uuid 3dbc48ee-f133-41f0-b848-5ca1b9c14762 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:44.184800 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01c321b0-e6d7-4e45-a692-0dcd1909cc3e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 204 len: 0 microversion: 2.26 time: 0.362823 Nov 02 21:48:44.192529 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2500/5096] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 21:48:43 2022] DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:44.199474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f740ceb-fd68-49d4-a4fb-799d0a268cc6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d1d9a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.209363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f740ceb-fd68-49d4-a4fb-799d0a268cc6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.210152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f740ceb-fd68-49d4-a4fb-799d0a268cc6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.210766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f740ceb-fd68-49d4-a4fb-799d0a268cc6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.223548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f740ceb-fd68-49d4-a4fb-799d0a268cc6 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 200 len: 12 microversion: 2.26 time: 0.028578 Nov 02 21:48:44.230211 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2501/5097] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:48:44 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:44.243125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d1d95e0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.257490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.267078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.267078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.267078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:44.267078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.267078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.267078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.271450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.275095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3be96d4cf6478caef4fd48d9219c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc522851bc4f538dbf51131f62960e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:44.280637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.283600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.288944 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b5d4efb-e7be-486d-ba0b-9c386e6e9e30 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 200 len: 1305 microversion: 2.1 time: 0.263391 Nov 02 21:48:44.292554 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2597/5098] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:44 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:48:44.334372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.335101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.335705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.347131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.347903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.348338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.443299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:44.450446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:44.475786 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8b31cf15-69d8-43a5-a0e2-cdf550846f07 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-93512762" status: 201 len: 0 microversion: 2.26 time: 0.243262 Nov 02 21:48:44.481904 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2502/5099] 10.222.0.25 () {62 vars in 1374 bytes} [Wed Nov 2 21:48:44 2022] PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-93512762 => generated 0 bytes in 245 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Nov 02 21:48:44.487893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fec2005-b045-4d1b-8170-d3f64c55111f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d152040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.498207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fec2005-b045-4d1b-8170-d3f64c55111f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.498973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fec2005-b045-4d1b-8170-d3f64c55111f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.499587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fec2005-b045-4d1b-8170-d3f64c55111f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.512043 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fec2005-b045-4d1b-8170-d3f64c55111f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 200 len: 34 microversion: 2.26 time: 0.028874 Nov 02 21:48:44.520868 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2598/5100] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:48:44 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 34 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:44.526159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b691a68b0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.536712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.538715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.540543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.552568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:44.565486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.566083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.568326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.569329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.570024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.570713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.597180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.597800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.598337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.744266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:44.766187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7f62ccf5-f2c8-4729-bec0-2767f16a2980 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-93512762" status: 204 len: 0 microversion: 2.26 time: 0.243556 Nov 02 21:48:44.766535 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2503/5101] 10.222.0.25 () {60 vars in 1358 bytes} [Wed Nov 2 21:48:44 2022] DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-93512762 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:44.776500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c5f0550e-8cae-4324-9190-e8453cd25aae tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d1523a0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.791107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5f0550e-8cae-4324-9190-e8453cd25aae tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.791601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5f0550e-8cae-4324-9190-e8453cd25aae tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.792040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5f0550e-8cae-4324-9190-e8453cd25aae tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.803945 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c5f0550e-8cae-4324-9190-e8453cd25aae tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 200 len: 12 microversion: 2.26 time: 0.032160 Nov 02 21:48:44.805206 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2599/5102] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:48:44 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:44.825495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b68b129d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.838035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.840419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.841125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.842063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:44.855800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.856305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.856741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.857724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.858390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.859006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.900877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.902006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.902687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.917622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:44.938467 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b4224702-687a-446b-b64c-14266c22b3ee tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 204 len: 0 microversion: 2.26 time: 0.126986 Nov 02 21:48:44.959529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d152d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:44.967502 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2504/5103] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 21:48:44 2022] DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:44.975442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.975925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.976389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.976952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:44.983394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.985322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.985322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:44.985322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:44.987075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:44.987075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.030728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.030728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.030728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.030728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.030728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.031427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.233167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:45.269807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf110055-b02a-48d8-86b6-20c38c63dc45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1476788884" status: 201 len: 0 microversion: 2.26 time: 0.318590 Nov 02 21:48:45.271110 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2600/5104] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 21:48:44 2022] PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1476788884 => generated 0 bytes in 320 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Nov 02 21:48:45.283160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b69175a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:45.304412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.305029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.305549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.306134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:45.316772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:45.317690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.317943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] [instance: 3dbc48ee-f133-41f0-b848-5ca1b9c14762] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:45.318094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.318585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.319353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.319901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.320403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.329317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.330991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.331837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.333764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.334420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.335045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.367471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.368046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.368721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.370395 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] HTTP exception thrown: Instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 could not be found. Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Request method failure captured: Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 HTTP/1.1 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuWbZ-J1fiu7RKbPZWZ2YK55p0Ee_hxtFGm00AWnbPcrHCBThDTPEbuwxuLtYy6jurO0EmPdOtFhdVMOXOPDlm0mWxo8NZs2eBYlGhNXTOWgBEUN7HoRo_ZJo-EiYOAXPG1jzB4UB3vnrBWu2-JYawopR_MS0iPDuMl8_mWPlNUeh_w Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 27dc522851bc4f538dbf51131f62960e Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerPasswordTestJSON-2022174073 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_27dc522851bc4f538dbf51131f62960e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27dc522851bc4f538dbf51131f62960e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/27dc522851bc4f538dbf51131f62960e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/27dc522851bc4f538dbf51131f62960e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerPasswordTestJSON-2022174073 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 27dc522851bc4f538dbf51131f62960e Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2022174073 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerPasswordTestJSON-2022174073-project Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: fa3be96d4cf6478caef4fd48d9219c74 Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerPasswordTestJSON-2022174073-project Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 could not be found. Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3dbc48ee-f133-41f0-b848-5ca1b9c14762'} Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 could not be found. Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 could not be found. Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:45.375523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 could not be found. Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] Returning 404 to user: Instance 3dbc48ee-f133-41f0-b848-5ca1b9c14762 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-070c994f-0f2b-4013-a2a8-b1570cf78af4 tempest-ServerPasswordTestJSON-2022174073 tempest-ServerPasswordTestJSON-2022174073-project] 10.222.0.25 "GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762" status: 404 len: 111 microversion: 2.1 time: 0.066860 Nov 02 21:48:45.384446 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2601/5105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:48:45 2022] GET /compute/v2.1/servers/3dbc48ee-f133-41f0-b848-5ca1b9c14762 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:48:45.397346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.398273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.398719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.557452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:45.582689 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-954818c4-7a3a-4a72-91e2-d134e339df45 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-150536810" status: 201 len: 0 microversion: 2.26 time: 0.305592 Nov 02 21:48:45.585054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2505/5106] 10.222.0.25 () {62 vars in 1377 bytes} [Wed Nov 2 21:48:45 2022] PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-150536810 => generated 0 bytes in 307 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 02 21:48:45.594026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d152ee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:45.596327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:45.604326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.605776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.606621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.607313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:45.615808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.616781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.617436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.618657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.619486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.620123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.649593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.650406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.651090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.753120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:45.784985 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4e249abf-eadf-427e-9a68-540574f2a8ef tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 204 len: 0 microversion: 2.26 time: 0.194842 Nov 02 21:48:45.787189 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2602/5107] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 21:48:45 2022] DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:45.795851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-700c7c2c-ec0d-4a4c-b29a-5dd2277800fa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6848aee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:45.809978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-700c7c2c-ec0d-4a4c-b29a-5dd2277800fa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.813567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-700c7c2c-ec0d-4a4c-b29a-5dd2277800fa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.814263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-700c7c2c-ec0d-4a4c-b29a-5dd2277800fa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.844350 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-700c7c2c-ec0d-4a4c-b29a-5dd2277800fa tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 200 len: 12 microversion: 2.26 time: 0.044914 Nov 02 21:48:45.844350 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2506/5108] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:48:45 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 12 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:45.848592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b691e6310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:45.861275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.866332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.868723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.870505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:45.884852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.885376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.885808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.886715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.888013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.888828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.926167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:45.927036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:45.928759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:45.946679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:45.995575 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b5b70d6-877a-46f6-87e8-502c6b737ca7 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 204 len: 0 microversion: 2.26 time: 0.151385 Nov 02 21:48:45.996806 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2603/5109] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 21:48:45 2022] DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:46.006368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d13ac10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:46.023634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:46.028777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.031870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.032606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.033434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:46.052120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.052120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.052120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.052120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.052120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.052120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.101550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.102045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.102503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.112009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.113055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.113692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.273125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:46.301415 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2417c9f-65e7-49b1-a62b-a2784863b12f tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1679406370" status: 201 len: 0 microversion: 2.26 time: 0.298954 Nov 02 21:48:46.302800 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2507/5110] 10.222.0.25 () {62 vars in 1380 bytes} [Wed Nov 2 21:48:46 2022] PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-1679406370 => generated 0 bytes in 301 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 21:48:46.313814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d1525e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:46.341136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.341136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.341136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.341136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:46.365124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.368224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.368224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.368759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.374312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.374782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.473037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.474663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.479212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.510560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.511452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.512086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.648143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:46.680130 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8d9611b-29e3-490a-8f9f-ae38b92de3cb tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-47683845" status: 201 len: 0 microversion: 2.26 time: 0.371738 Nov 02 21:48:46.681365 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2604/5111] 10.222.0.25 () {62 vars in 1374 bytes} [Wed Nov 2 21:48:46 2022] PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags/tempest-tag-47683845 => generated 0 bytes in 373 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Nov 02 21:48:46.691689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Action: 'update_all', calling method: .version_select at 0x7f9b68483b80>, body: {"tags": ["tempest-tag-137665665", "tempest-tag-494328815"]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:46.715190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.715190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.717987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.719092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:46.730916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.736551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.737507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.738581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.739497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.740154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.788450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:46.789056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:46.791881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:46.933565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:46.996725 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-60db4db4-4ddf-485f-9470-beb7793034d1 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 200 len: 60 microversion: 2.26 time: 0.309649 Nov 02 21:48:47.001982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2508/5112] 10.222.0.25 () {62 vars in 1312 bytes} [Wed Nov 2 21:48:46 2022] PUT /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 60 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:47.018642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76f04825-3f59-4c66-b0bb-1c6001992f86 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b68f7ca60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:47.028841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76f04825-3f59-4c66-b0bb-1c6001992f86 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.030096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76f04825-3f59-4c66-b0bb-1c6001992f86 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.033110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76f04825-3f59-4c66-b0bb-1c6001992f86 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.048094 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76f04825-3f59-4c66-b0bb-1c6001992f86 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 200 len: 60 microversion: 2.26 time: 0.033938 Nov 02 21:48:47.061272 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2605/5113] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Nov 2 21:48:47 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 60 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:48:47.068343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '.version_select at 0x7f9b6d23d670>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:47.076971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.077728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.086980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.087819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:47.115784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.116549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.117204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.118096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.119026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.119706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.165152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.183111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.185165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.310513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'flavor' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:47.352174 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0dcde724-2af0-45dc-9339-0a7ec8a66e8e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags" status: 204 len: 0 microversion: 2.26 time: 0.295485 Nov 02 21:48:47.352819 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2509/5114] 10.222.0.25 () {60 vars in 1295 bytes} [Wed Nov 2 21:48:47 2022] DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a/tags => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:47.365208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:47.366735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:47.385258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.385888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.386685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.388996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.391903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.393983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.460484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:48:47.463768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:48:47.831899 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8785b12f-8504-4b89-98b9-d07da6be0370 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 204 len: 0 microversion: 2.26 time: 0.471814 Nov 02 21:48:47.835820 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2606/5115] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:48:47 2022] DELETE /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:48:47.844900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:47.846166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:47.855467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.855968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.856419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:47.857166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:47.857885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:47.858138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:48.357843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:48.369955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:48.371492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:48.377126 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47b8a42b-570c-47d3-b675-87f684702101 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1552 microversion: 2.26 time: 0.539843 Nov 02 21:48:48.409512 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2510/5116] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:47 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1552 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:49.405672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:49.407121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:49.421240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:49.425611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:49.430003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:49.430003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:49.430003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:49.430003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:50.685305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:50.700056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:50.701705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:50.703000 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f1fc426-3c97-4196-bb1f-188d4f1816a5 tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1552 microversion: 2.26 time: 1.303252 Nov 02 21:48:50.713322 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2607/5117] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:49 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1552 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:51.059691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-af186cdf-1228-449c-9a12-68cdba18a8c5 req-6f42798f-55b8-49df-8a81-1bdd83cac489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2581069-9890-4bc4-b3d1-9554dc2c1e3a", "name": "network-vif-deleted", "tag": "9f969f8b-5e65-49ec-9438-0fc339101cca"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:48:51.090647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-af186cdf-1228-449c-9a12-68cdba18a8c5 req-6f42798f-55b8-49df-8a81-1bdd83cac489 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:51.091169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-af186cdf-1228-449c-9a12-68cdba18a8c5 req-6f42798f-55b8-49df-8a81-1bdd83cac489 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:51.091674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-af186cdf-1228-449c-9a12-68cdba18a8c5 req-6f42798f-55b8-49df-8a81-1bdd83cac489 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:51.123048 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-af186cdf-1228-449c-9a12-68cdba18a8c5 req-6f42798f-55b8-49df-8a81-1bdd83cac489 service nova] Creating event network-vif-deleted:9f969f8b-5e65-49ec-9438-0fc339101cca for instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a on n-h2-860863-4 Nov 02 21:48:51.135458 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-af186cdf-1228-449c-9a12-68cdba18a8c5 req-6f42798f-55b8-49df-8a81-1bdd83cac489 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079003 Nov 02 21:48:51.138808 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2511/5118] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:48:51.734816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:51.735446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:51.743104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:51.743599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:51.744039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:51.744747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:51.755177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:51.755734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:51.824469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:51.825039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:51.825444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:51.825894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lazy-loading 'fault' on Instance uuid a2581069-9890-4bc4-b3d1-9554dc2c1e3a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:48:51.973459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:51.994237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:51.997913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb61af9ce2bb4c928c1c2b907a6a6bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c0e9c8bb7645f2b4a6272fb4fbb296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:48:52.005257 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-54335012-d53c-4e9e-8d1d-660fb3f2415b tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 200 len: 1352 microversion: 2.26 time: 0.274196 Nov 02 21:48:52.007246 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2608/5119] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:51 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 1352 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:48:53.038056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:48:53.041213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] [instance: a2581069-9890-4bc4-b3d1-9554dc2c1e3a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:48:53.054981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:53.055501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:53.055956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:53.058264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:48:53.058742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:48:53.059183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:48:53.102001 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] HTTP exception thrown: Instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a could not be found. Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Request method failure captured: Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a HTTP/1.1 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuWgwBRpdRWH2Kmo-4jVJ-KsBeaszT5v6Tes91A0RglAtCA-8tcTqH3lwfx6KFx4ugXEzGOTf4hS1CsgBh2WQ0IDGzsXQniKofyb3Czw8dWbBmFzrZLmxvG-Scfwnmf8Rmgvmb5wLaAyfscMabsTCem6pDAVe748y5-sclWbKhqRIcQ Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.26 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 24c0e9c8bb7645f2b4a6272fb4fbb296 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerTagsTestJSON-667088346 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_24c0e9c8bb7645f2b4a6272fb4fbb296"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24c0e9c8bb7645f2b4a6272fb4fbb296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/24c0e9c8bb7645f2b4a6272fb4fbb296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/24c0e9c8bb7645f2b4a6272fb4fbb296"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerTagsTestJSON-667088346 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 24c0e9c8bb7645f2b4a6272fb4fbb296 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerTagsTestJSON-667088346 Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerTagsTestJSON-667088346-project Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: eb61af9ce2bb4c928c1c2b907a6a6bbe Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerTagsTestJSON-667088346-project Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a could not be found. Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'a2581069-9890-4bc4-b3d1-9554dc2c1e3a'} Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a could not be found. Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a could not be found. Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:48:53.103736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a could not be found. Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] Returning 404 to user: Instance a2581069-9890-4bc4-b3d1-9554dc2c1e3a could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c8d472a-be9a-4dda-a264-2f6e9e05555e tempest-ServerTagsTestJSON-667088346 tempest-ServerTagsTestJSON-667088346-project] 10.222.0.25 "GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a" status: 404 len: 111 microversion: 2.26 time: 0.072775 Nov 02 21:48:53.107206 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2512/5120] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:48:53 2022] GET /compute/v2.1/servers/a2581069-9890-4bc4-b3d1-9554dc2c1e3a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:49:06.553586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:06.802614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51880f68-07d2-471b-a766-412a979ca502 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Action: 'create', calling method: .version_select at 0x7f9b698dd1f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:06.860617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-51880f68-07d2-471b-a766-412a979ca502 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Getting quotas for project 529d5208689347cd94746d9c144a442e. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:06.867220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-51880f68-07d2-471b-a766-412a979ca502 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Getting quotas for user f9de42a25cbc4fbb9ccd6a94b6a9d2c3 and project 529d5208689347cd94746d9c144a442e. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:07.094748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-51880f68-07d2-471b-a766-412a979ca502 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Getting quotas for project 529d5208689347cd94746d9c144a442e. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:07.119902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-51880f68-07d2-471b-a766-412a979ca502 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Getting quotas for user f9de42a25cbc4fbb9ccd6a94b6a9d2c3 and project 529d5208689347cd94746d9c144a442e. Resources: {'server_groups'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:07.153412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51880f68-07d2-471b-a766-412a979ca502 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] 10.222.0.25 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.606894 Nov 02 21:49:07.154457 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2609/5121] 10.222.0.25 () {62 vars in 1214 bytes} [Wed Nov 2 21:49:06 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:49:07.166935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-481fb837-5b23-4097-8ba3-4a883e0de6ee tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:07.214622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=17 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:07.217276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=80,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:07.229951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-481fb837-5b23-4097-8ba3-4a883e0de6ee tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.067529 Nov 02 21:49:07.231184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2513/5122] 10.222.0.25 () {60 vars in 1193 bytes} [Wed Nov 2 21:49:07 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:49:07.242742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afba9fbd-89d7-4969-b1a2-95c09891668a tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:07.258953 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-afba9fbd-89d7-4969-b1a2-95c09891668a tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] 10.222.0.25 "GET /compute/v2.1/os-server-groups/e820a9b1-66bd-42e9-9498-f68a4378198a" status: 200 len: 235 microversion: 2.64 time: 0.018504 Nov 02 21:49:07.260250 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2610/5123] 10.222.0.25 () {60 vars in 1304 bytes} [Wed Nov 2 21:49:07 2022] GET /compute/v2.1/os-server-groups/e820a9b1-66bd-42e9-9498-f68a4378198a => generated 235 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:49:07.277223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f4412abf-a0ab-45a2-b3c4-4fbc46da8181 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:07.395983 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f4412abf-a0ab-45a2-b3c4-4fbc46da8181 tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/e820a9b1-66bd-42e9-9498-f68a4378198a" status: 204 len: 0 microversion: 2.64 time: 0.128914 Nov 02 21:49:07.397390 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2514/5124] 10.222.0.25 () {60 vars in 1307 bytes} [Wed Nov 2 21:49:07 2022] DELETE /compute/v2.1/os-server-groups/e820a9b1-66bd-42e9-9498-f68a4378198a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 21:49:07.411899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2227d526-58b5-47db-a756-678cf2862d2e tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:07.428207 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-2227d526-58b5-47db-a756-678cf2862d2e tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] HTTP exception thrown: Instance group e820a9b1-66bd-42e9-9498-f68a4378198a could not be found. Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2227d526-58b5-47db-a756-678cf2862d2e tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Request method failure captured: Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-server-groups/e820a9b1-66bd-42e9-9498-f68a4378198a HTTP/1.1 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuXSDsUozHSpDYLjOHN0kk6rvd1htsmVubz1wxJUXTNZrbQvAABqPmDn2NAvXHUPkCOLu6zceh5gJYVUOnqhtk0YtgRCzlGm8YQawpdxxhlK9I6EfgkiOWxHe8Cmr5WeETe3zfwGazRNpendxl9mGjpSnR5hRlOTC8f9P48S-sFCY3c Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.64 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 529d5208689347cd94746d9c144a442e Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerGroup264TestJSON-1772641569 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_529d5208689347cd94746d9c144a442e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/529d5208689347cd94746d9c144a442e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/529d5208689347cd94746d9c144a442e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/529d5208689347cd94746d9c144a442e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerGroup264TestJSON-1772641569 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 529d5208689347cd94746d9c144a442e Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1772641569 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerGroup264TestJSON-1772641569-project Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: f9de42a25cbc4fbb9ccd6a94b6a9d2c3 Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerGroup264TestJSON-1772641569-project Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance group e820a9b1-66bd-42e9-9498-f68a4378198a could not be found. Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e820a9b1-66bd-42e9-9498-f68a4378198a'} Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e820a9b1-66bd-42e9-9498-f68a4378198a could not be found. Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e820a9b1-66bd-42e9-9498-f68a4378198a could not be found. Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:49:07.431273 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:07.434531 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:49:07.434531 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:49:07.434531 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:49:07.434531 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:49:07.434531 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e820a9b1-66bd-42e9-9498-f68a4378198a could not be found. Nov 02 21:49:07.434531 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:49:07.438025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2227d526-58b5-47db-a756-678cf2862d2e tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] Returning 404 to user: Instance group e820a9b1-66bd-42e9-9498-f68a4378198a could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:49:07.439526 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2227d526-58b5-47db-a756-678cf2862d2e tempest-ServerGroup264TestJSON-1772641569 tempest-ServerGroup264TestJSON-1772641569-project] 10.222.0.25 "DELETE /compute/v2.1/os-server-groups/e820a9b1-66bd-42e9-9498-f68a4378198a" status: 404 len: 117 microversion: 2.64 time: 0.032306 Nov 02 21:49:07.441736 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2611/5125] 10.222.0.25 () {60 vars in 1307 bytes} [Wed Nov 2 21:49:07 2022] DELETE /compute/v2.1/os-server-groups/e820a9b1-66bd-42e9-9498-f68a4378198a => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:49:10.654289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1657449407", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": "none"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:10.797126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:49:10.799246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:49:10.800130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:49:10.803913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:49:10.804749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:49:10.829906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:10.831663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:10.831663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:10.832007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:10.833620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:10.834161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:10.886670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Getting quotas for project 3d78662da8194587927cea85a8e03393. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:10.911060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Getting quotas for user 65e97bbc5fdb494abf31a10059bde64e and project 3d78662da8194587927cea85a8e03393. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:10.935390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:49:10.946501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:49:11.193363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-29eac01d-afd5-469f-9ce9-39b6ab8640c0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.943416 Nov 02 21:49:11.201639 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2515/5126] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:49:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:49:11.210376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4ecbb18-f630-45b3-ae67-440c9ac50eb0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:11.210861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a4ecbb18-f630-45b3-ae67-440c9ac50eb0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:11.812145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1267040334", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "4e4b8a47-86de-49a1-84ca-9934650ecfb7"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:11.941790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a4ecbb18-f630-45b3-ae67-440c9ac50eb0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:11.947768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] validate_networks() for [('4e4b8a47-86de-49a1-84ca-9934650ecfb7', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:49:11.975460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a4ecbb18-f630-45b3-ae67-440c9ac50eb0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:11.978517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a4ecbb18-f630-45b3-ae67-440c9ac50eb0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:11.979766 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a4ecbb18-f630-45b3-ae67-440c9ac50eb0 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e" status: 200 len: 1278 microversion: 2.47 time: 0.777281 Nov 02 21:49:11.986292 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2612/5127] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:11 2022] GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e => generated 1278 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:12.121802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1249015336", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": "none"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:12.269736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:49:12.270411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:49:12.270506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:49:12.270869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:49:12.271280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:49:12.298769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:12.298900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:12.307441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:12.308583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:12.310955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:12.311633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:12.369919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Getting quotas for project 3d78662da8194587927cea85a8e03393. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:12.398340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Getting quotas for user 65e97bbc5fdb494abf31a10059bde64e and project 3d78662da8194587927cea85a8e03393. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:12.438338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:49:12.441321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:49:12.621179 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05a5ea14-1438-436f-9237-0a5a7c68e88f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.503197 Nov 02 21:49:12.627331 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2613/5128] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:49:12.643761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-428a75e3-4c65-4222-a9fa-7196de76d3e8 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:12.658061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-428a75e3-4c65-4222-a9fa-7196de76d3e8 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:12.814274 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-428a75e3-4c65-4222-a9fa-7196de76d3e8 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "PUT /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 992 microversion: 2.47 time: 0.179885 Nov 02 21:49:12.815243 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2614/5129] 10.222.0.25 () {62 vars in 1297 bytes} [Wed Nov 2 21:49:12 2022] PUT /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 992 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:49:12.837601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a4f29f6-9eb1-490a-9c97-30293cbe9ab4 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:12.842600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a4f29f6-9eb1-490a-9c97-30293cbe9ab4 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:13.410420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a4f29f6-9eb1-490a-9c97-30293cbe9ab4 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:13.422405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a4f29f6-9eb1-490a-9c97-30293cbe9ab4 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:13.429420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a4f29f6-9eb1-490a-9c97-30293cbe9ab4 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:13.430618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a4f29f6-9eb1-490a-9c97-30293cbe9ab4 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1278 microversion: 2.47 time: 0.597174 Nov 02 21:49:13.437889 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2615/5130] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:12 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1278 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:14.467554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:14.468223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:14.484564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:14.485129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:14.485584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:14.486315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:14.486775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:14.487212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:14.855029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:14.869345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:14.878874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:14.880330 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-efe30513-0cec-4292-9797-ab7bba329f72 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1282 microversion: 2.47 time: 0.416681 Nov 02 21:49:14.889079 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2616/5131] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:14 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1282 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:15.526866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:49:15.527672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:49:15.528653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:49:15.529380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:49:15.529958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:49:15.553998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:15.555433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:15.557620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:15.560465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:15.562555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:15.566021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:15.628527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Getting quotas for project 6a03fca0959b4f0eb20b97ad433ff66e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:15.636339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Getting quotas for user 8da13f36bb0542b69906ff04b75c351f and project 6a03fca0959b4f0eb20b97ad433ff66e. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:15.678484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:49:15.685639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:49:15.922123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:15.922123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:15.937218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:15.938039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:15.938496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:15.939221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:15.939680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:15.940109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:15.954455 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9169d5e2-a9c1-4305-abac-afd248aa8b5c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.324324 Nov 02 21:49:15.955135 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2516/5132] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:49:15.988578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-327c98b1-2fc2-470c-8487-a2ee0d0fed66 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:15.989240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-327c98b1-2fc2-470c-8487-a2ee0d0fed66 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:16.286065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:16.297662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:16.297997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-327c98b1-2fc2-470c-8487-a2ee0d0fed66 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:16.309635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-327c98b1-2fc2-470c-8487-a2ee0d0fed66 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1217 microversion: 2.1 time: 0.339733 Nov 02 21:49:16.309786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:16.311047 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ed53ace-f065-48df-b82b-725b36356671 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1330 microversion: 2.47 time: 0.395682 Nov 02 21:49:16.312625 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2617/5133] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:15 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1330 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:16.339046 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2517/5134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:15 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1217 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:17.350022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:17.355121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:17.370374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1cce6c1-f02b-4a24-9f2d-97e3c99d0bb5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:17.370374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1cce6c1-f02b-4a24-9f2d-97e3c99d0bb5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:17.410212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:17.416031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:17.416490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:17.425069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:17.428059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:17.428513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:17.618757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c1cce6c1-f02b-4a24-9f2d-97e3c99d0bb5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:17.627802 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1cce6c1-f02b-4a24-9f2d-97e3c99d0bb5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1217 microversion: 2.1 time: 0.267423 Nov 02 21:49:17.628404 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2518/5135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:17 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:17.770061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:17.781761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:17.789083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:17.790682 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-541ad76e-7f3e-4737-8319-e1aebd91ba49 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1336 microversion: 2.47 time: 0.451648 Nov 02 21:49:17.792726 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2618/5136] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:17 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1336 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:18.650671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:18.651472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:18.681866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:18.682401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:18.686689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:18.690061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:18.690609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:18.697510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:18.820793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:18.827127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:18.849034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:18.849920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:18.850513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:18.855835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:18.856619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:18.859169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:18.997555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:19.012531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92dcd944-69a8-4b0e-8355-f7b1397a957f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1269 microversion: 2.1 time: 0.365314 Nov 02 21:49:19.013037 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2519/5137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:18 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1269 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:19.124080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:19.139539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:19.149925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:19.160173 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dcdc58ce-7bd1-4d85-b7dd-2ec50e040f3a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1336 microversion: 2.47 time: 0.343694 Nov 02 21:49:19.161401 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2619/5138] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:18 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1336 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:20.039007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:20.039644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:20.073675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:20.074370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:20.074970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:20.078229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:20.079105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:20.079710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:20.188694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:20.189959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:20.200083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:20.200589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:20.201068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:20.201796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:20.202257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:20.203482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:20.326776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:20.341725 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89b961ae-7969-4ec9-8191-d352765501d9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1287 microversion: 2.1 time: 0.307211 Nov 02 21:49:20.342684 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2520/5139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:20 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1287 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:20.411614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:20.430339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:20.433277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:20.439810 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e809d6f-6834-4719-9cbb-a24d574122af tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1336 microversion: 2.47 time: 0.254489 Nov 02 21:49:20.447318 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2620/5140] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:20 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1336 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:21.150498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c96c872c-6a8a-449f-a0f2-5783d83610ba tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'create', calling method: .version_select at 0x7f9b68766b80>, body: {"keypair": {"name": "tempest-keypair-1691879944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLbCvB3wr7ls9mqHKlHvkIgD9eCjQS5FOeIkDjsrOrCKeJ+EZioqv3xbCj9EkLUhIaYmDOySEtLeYnI71MF3h9QHu+cUzgBGQSYYeNmOm4itgRKjrCNFoJQPTZU9gyV7A=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:21.180146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c96c872c-6a8a-449f-a0f2-5783d83610ba tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for project 679e722432214ed6a1217d618c2c4887. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:21.190324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-c96c872c-6a8a-449f-a0f2-5783d83610ba tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for user 98b623fd3cf64948af31caa837455fbe and project 679e722432214ed6a1217d618c2c4887. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:21.285819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c96c872c-6a8a-449f-a0f2-5783d83610ba tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.411106 Nov 02 21:49:21.286748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2521/5141] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:49:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 416 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:49:21.385518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:21.388031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:21.411919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:21.417601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:21.417601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:21.417601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:21.417601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:21.417601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:21.477816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:21.478631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:21.486849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:21.492419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:21.492419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:21.492419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:21.492419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:21.492419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:21.628752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:21.649795 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf829312-a971-4bb3-9c71-bd28ec56d665 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1275 microversion: 2.1 time: 0.279814 Nov 02 21:49:21.651333 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2621/5142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:21 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:21.711695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:21.752598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:21.754422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:21.756378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-998f8780-3825-4206-8b90-3a629a180d2b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1357 microversion: 2.47 time: 0.283250 Nov 02 21:49:21.758481 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2522/5143] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:21 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1357 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:21.790092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:21.793942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:21.813646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:21.814763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:21.816451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:21.817798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:21.818743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:21.819392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:21.969975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:49:21.972113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:49:21.972676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:49:21.973369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:49:21.975292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:49:22.324456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:22.388579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:22.396791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:22.398358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:22.400230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:22.401451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:22.402080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:22.402677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:22.467213 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ffcbc9a-c6e4-4eda-9743-d88fb5f4b0fe tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "POST /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf/action" status: 202 len: 1079 microversion: 2.47 time: 0.683429 Nov 02 21:49:22.489571 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2622/5144] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:49:21 2022] POST /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf/action => generated 1079 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 21:49:22.501198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:22.501958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:22.524185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:22.531518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:22.533686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:22.538065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:22.541116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:22.545783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:22.694961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:22.695474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:22.705345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:22.708586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:22.709273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:22.711961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:22.712621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:22.714353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:22.718291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:22.733417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:22.736366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:22.742739 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cef1b8ed-f8b0-4d3e-8ab4-7b2913010eda tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.247335 Nov 02 21:49:22.744190 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2523/5145] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:22 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:22.908913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:22.922443 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d141c50-bd9e-40ca-9eb2-a332373c79b5 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1275 microversion: 2.1 time: 0.232856 Nov 02 21:49:22.926477 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2623/5146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:22 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:49:23.776423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:23.777781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:23.812329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:23.813228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:23.814486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:23.815939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:23.825010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:23.831153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:23.953918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:23.955300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:23.966659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=18 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:23.973708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:23.975185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:23.975858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:23.977047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:23.977727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:23.978385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:24.069157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:24.080272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:24.112095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:24.115264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6be5aee4-ca4c-476b-9e26-9b4d890d3f15 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.343648 Nov 02 21:49:24.154098 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2524/5147] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:23 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:25.163650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:25.164408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:25.181305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:25.182025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:25.182621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:25.183491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:25.184240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:25.184811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:25.388042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:25.468244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d768f8f-7db0-49bc-92cb-a9a48675cbea tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 1.521580 Nov 02 21:49:25.468847 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2624/5148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:23 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:49:25.496339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:25.518008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:25.519948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:25.521238 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ffcf6a73-fb37-4f91-a2b4-1a00609cca89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.362295 Nov 02 21:49:25.527834 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2525/5149] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:25 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:26.496551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:26.497225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:26.511157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:26.515277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:26.515277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:26.515277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:26.515277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:26.515277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:26.565606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:26.569241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:26.579650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:26.588054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:26.588707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:26.589213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:26.592302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:26.592302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:26.592302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:26.981701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:26.997352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:27.003789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:27.005136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d35bbe73-8533-45b4-8afc-a7930d0f42b7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.451793 Nov 02 21:49:27.020991 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2526/5150] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:26 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:27.172827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:27.183399 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9618fb0a-0d87-426e-ae3d-faadaa93b37d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 0.691100 Nov 02 21:49:27.184803 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2625/5151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:26 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:27.467792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-850858139", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5fda8b-f492-48c5-94f3-5ae08b820ef8"}], "security_groups": [{"name": "tempest-securitygroup--2032166163"}], "key_name": "tempest-keypair-1691879944", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:27.710824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] validate_networks() for [('8b5fda8b-f492-48c5-94f3-5ae08b820ef8', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:49:28.037706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:28.038435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:28.047982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:28.049888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:28.050596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:28.051537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:28.052201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:28.058349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:28.078400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:28.250439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:28.262052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:28.263623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:28.274047 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c969248-2aa3-4d76-b932-768a9f98625f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.239923 Nov 02 21:49:28.275091 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2626/5152] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:28 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:28.279880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:28.282076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:28.298157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:28.299125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:28.299644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:28.302207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:28.302901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:28.304740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:28.484778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:49:28.484778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:49:28.484778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:49:28.484778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:49:28.484778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:49:28.490155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:28.491217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:28.492099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:28.493129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:28.494085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:28.494740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:28.569882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for project 679e722432214ed6a1217d618c2c4887. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:28.582977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for user 98b623fd3cf64948af31caa837455fbe and project 679e722432214ed6a1217d618c2c4887. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:28.620355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:49:28.635097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:49:28.768035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:28.776677 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad000a7a-7c7b-4a4a-96a4-8e0683cb6ff9 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 0.500391 Nov 02 21:49:28.777298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2627/5153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:28 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:28.808607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9b2b9698-50eb-469c-87f2-65211e27b42f req-85a505a8-2228-47f1-a1e2-de8dd84d78b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b149a7c8-c465-4b4b-a13c-4e36774dbd56", "tag": "1b67d6af-51de-4fa3-8806-37a329d2b45c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:28.825575 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd0b0b0e-1aca-4b6d-bae8-2433d7628c60 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.372937 Nov 02 21:49:28.826866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9b2b9698-50eb-469c-87f2-65211e27b42f req-85a505a8-2228-47f1-a1e2-de8dd84d78b0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:28.827484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9b2b9698-50eb-469c-87f2-65211e27b42f req-85a505a8-2228-47f1-a1e2-de8dd84d78b0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:28.827929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9b2b9698-50eb-469c-87f2-65211e27b42f req-85a505a8-2228-47f1-a1e2-de8dd84d78b0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:28.829862 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2527/5154] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:49:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:49:28.841279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-329be1c1-458a-4f70-a86b-190dbdb63a37 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:28.848671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-329be1c1-458a-4f70-a86b-190dbdb63a37 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:28.876056 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9b2b9698-50eb-469c-87f2-65211e27b42f req-85a505a8-2228-47f1-a1e2-de8dd84d78b0 service nova] Creating event network-changed:1b67d6af-51de-4fa3-8806-37a329d2b45c for instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 on n-h2-860863-4 Nov 02 21:49:28.893774 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9b2b9698-50eb-469c-87f2-65211e27b42f req-85a505a8-2228-47f1-a1e2-de8dd84d78b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100256 Nov 02 21:49:28.894428 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2628/5155] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:49:28.970370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-329be1c1-458a-4f70-a86b-190dbdb63a37 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:28.985589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-329be1c1-458a-4f70-a86b-190dbdb63a37 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:28.987199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-329be1c1-458a-4f70-a86b-190dbdb63a37 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:28.991215 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-329be1c1-458a-4f70-a86b-190dbdb63a37 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1281 microversion: 2.20 time: 0.154696 Nov 02 21:49:29.008362 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2528/5156] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:28 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:29.313332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:29.314683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:29.325562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:29.326522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:29.331642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:29.334340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:29.335970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:29.337445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:29.488505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:29.502065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:29.504857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:29.512205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47bd7c19-90b6-4e29-b022-b5d7ae3e96f5 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.206321 Nov 02 21:49:29.513238 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2629/5157] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:29 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:29.801132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:29.801934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:29.812982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:INSERT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:29.817644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:29.818286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:29.818839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:29.820469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:29.821749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:29.822446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:30.044159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a3807670-c804-4fa6-bafa-d1c44b87bcad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:30.051270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3807670-c804-4fa6-bafa-d1c44b87bcad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:30.211979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3807670-c804-4fa6-bafa-d1c44b87bcad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:30.224726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3807670-c804-4fa6-bafa-d1c44b87bcad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:30.226520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3807670-c804-4fa6-bafa-d1c44b87bcad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:30.239202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:30.252903 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a3807670-c804-4fa6-bafa-d1c44b87bcad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1281 microversion: 2.20 time: 0.221854 Nov 02 21:49:30.253535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2630/5158] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:30 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1281 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:30.256030 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8870cd4-9908-4380-a836-202c1128cd18 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 0.459800 Nov 02 21:49:30.273111 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2529/5159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:29 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:30.542672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:30.543561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:30.553309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:30.557357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:30.559308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:30.561268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:30.565838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:30.566741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:30.567469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:30.746521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:30.755906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:30.757499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:30.762546 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-722bde15-d6b3-4868-a9df-c03fb927fb3f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.221391 Nov 02 21:49:30.763561 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2631/5160] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:30 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:31.280009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:31.286037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:31.287015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:31.289258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:31.303607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:31.317332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:31.317332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:31.317332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:31.317332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:31.317332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:31.318164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:31.318164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:31.318164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:31.318164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:31.318164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:31.318164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:31.530471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:31.543618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:31.546840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:31.546965 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22583581-57b1-4436-81dc-ac4835363ad8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1333 microversion: 2.20 time: 0.272381 Nov 02 21:49:31.548756 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2530/5161] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:31 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1333 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:31.642272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:31.656379 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d4d9947-a117-4d0d-92c2-61fb5e2a7f05 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 0.374088 Nov 02 21:49:31.665825 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2632/5162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:31 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:31.800945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:31.803012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:31.810493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:31.811345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:31.812817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:31.814039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:31.814718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:31.815440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:31.932427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:31.945487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:31.949003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:31.951293 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d807c68-a0df-4182-866d-a195d33f1118 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.154295 Nov 02 21:49:31.952866 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2531/5163] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:31 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:32.576764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:32.577996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:32.591582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:32.592070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:32.594005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:32.594718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:32.595179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:32.595614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:32.681562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:32.682883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:32.698554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:32.699173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:32.699704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:32.712454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:32.713539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:32.714241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:32.779258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:32.800195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:32.802111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:32.806759 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-270b7a26-53d5-415a-b851-3ff4d2f18b6c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1351 microversion: 2.20 time: 0.234333 Nov 02 21:49:32.825943 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2633/5164] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:32 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1351 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:32.979038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:32.979936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:32.990729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:32.990729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:32.991202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:32.991940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:32.992407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:32.992837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:33.128428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:33.137247 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed3b15b3-3f00-46d5-abeb-f7db122046ca tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 0.460310 Nov 02 21:49:33.137847 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2532/5165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:32 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:33.184122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:33.194792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:33.198009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:33.204153 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-727ebdc5-0c43-4c5e-a37b-ae0797c29f62 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.226404 Nov 02 21:49:33.204985 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2634/5166] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:32 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:33.834677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:33.835295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:33.871121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:33.872005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:33.876021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:33.884960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:33.886826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:33.887248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:34.116051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:34.127775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:34.133898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:34.137402 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b6b4231-6033-48f5-b9e7-2641953135f4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1339 microversion: 2.20 time: 0.306647 Nov 02 21:49:34.139320 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2533/5167] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:33 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1339 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:34.160713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:34.162530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:34.196606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:34.197673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:34.198423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:34.199505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:34.200169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:34.200876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:34.231682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:34.236959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:34.253095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:34.253889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:34.254489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:34.255365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:34.256231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:34.256859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:34.454471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:34.471769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:34.473411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:34.479226 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bad6a63f-22db-4e03-ac7b-bbd41a303eff tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.251284 Nov 02 21:49:34.496534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2534/5168] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:34 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:34.507304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-748406d9-2bbe-47f2-bf43-d23d8844b92a req-123550d8-4aa0-4872-93c9-44dd6f807b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b149a7c8-c465-4b4b-a13c-4e36774dbd56", "name": "network-vif-plugged", "status": "completed", "tag": "1b67d6af-51de-4fa3-8806-37a329d2b45c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:34.529648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-748406d9-2bbe-47f2-bf43-d23d8844b92a req-123550d8-4aa0-4872-93c9-44dd6f807b55 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:34.529648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-748406d9-2bbe-47f2-bf43-d23d8844b92a req-123550d8-4aa0-4872-93c9-44dd6f807b55 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:34.529648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-748406d9-2bbe-47f2-bf43-d23d8844b92a req-123550d8-4aa0-4872-93c9-44dd6f807b55 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:34.545258 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-748406d9-2bbe-47f2-bf43-d23d8844b92a req-123550d8-4aa0-4872-93c9-44dd6f807b55 service nova] Creating event network-vif-plugged:1b67d6af-51de-4fa3-8806-37a329d2b45c for instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 on n-h2-860863-4 Nov 02 21:49:34.561651 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-748406d9-2bbe-47f2-bf43-d23d8844b92a req-123550d8-4aa0-4872-93c9-44dd6f807b55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062847 Nov 02 21:49:34.562953 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2535/5169] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:49:34.690500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:34.713148 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-943eb3bb-3c07-4cca-8f66-48f6f406b33f tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 0.543327 Nov 02 21:49:34.713148 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2635/5170] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:34 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:35.172806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:35.174057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:35.196303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:35.196849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:35.197341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:35.198753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:35.199229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:35.199666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:35.509732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:35.510891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:35.523500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:35.526454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:35.527111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:35.527801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:35.528667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:35.529328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:35.529909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:35.538156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:35.541176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:35.548739 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7c36469-099c-4754-a546-4f38b0b55ea6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.378043 Nov 02 21:49:35.551481 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2536/5171] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:35 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:35.724905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:35.725920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:35.735368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:35.736130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:35.736772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:35.737858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:35.738544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:35.739168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:35.755108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:35.769088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:35.770792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:35.772202 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9402d571-2603-4c29-923d-7f7ef4ab2b05 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.266367 Nov 02 21:49:35.773458 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2636/5172] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:35 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:36.043537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:36.053659 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91cf0fa8-b1ec-423e-8f86-f30d0f2df262 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1317 microversion: 2.1 time: 0.333208 Nov 02 21:49:36.060176 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2537/5173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:35 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:36.597994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:36.600488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:36.630033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:36.633504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:36.634081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:36.637188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:36.639038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:36.639832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:36.802155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:36.804144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:36.814597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:36.819663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:36.820135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:36.822283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:36.823167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:36.823316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:36.834303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:36.970924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:36.980725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:36.982403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:36.984313 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d9405eb4-7879-40ca-bfca-435d2d1eb2d3 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.189017 Nov 02 21:49:36.997278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:36.997784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:36.997948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2538/5174] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:36 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:37.000963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:37.004487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-607e7391-795e-4658-9b46-b036200f6e36 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.423161 Nov 02 21:49:37.005651 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2637/5175] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:36 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:37.084438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:37.085327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:37.099367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.099912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.100360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.106129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.107173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.107644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.369629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:37.381519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71a3b8cc-45f7-4934-805a-cd61e6e9ed23 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1505 microversion: 2.1 time: 0.300262 Nov 02 21:49:37.388989 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2539/5176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:37 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:37.409251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:37.409754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:37.416179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.416680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.417161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.417946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.418855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.419447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.477795 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-374f1ccc-706f-45c1-8da9-e993c540df0a tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56/ips" status: 200 len: 108 microversion: 2.1 time: 0.072696 Nov 02 21:49:37.478994 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2638/5177] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:49:37 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56/ips => generated 108 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:49:37.491732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:37.492767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:37.501905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.502903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.503655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.504848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.507069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.507725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.543082 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-18be1c25-fba6-4d87-860c-63ff6243577c tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56/ips" status: 200 len: 108 microversion: 2.1 time: 0.054141 Nov 02 21:49:37.544434 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2540/5178] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:49:37 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56/ips => generated 108 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:49:37.560729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:37.562820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:37.573820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.575057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.576266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.577736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.579507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.580578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.624086 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-172f1bb3-be8f-4cec-a8ad-816575b0e115 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56/ips/tempest-ServerAddressesTestJSON-956091903-network" status: 200 len: 93 microversion: 2.1 time: 0.070550 Nov 02 21:49:37.626065 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2639/5179] 10.222.0.25 () {58 vars in 1398 bytes} [Wed Nov 2 21:49:37 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56/ips/tempest-ServerAddressesTestJSON-956091903-network => generated 93 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:49:37.638871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:37.640149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:37.649265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.649823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.651311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.652921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:37.653486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:37.654145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:37.691108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:49:38.019790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:38.031838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:38.065412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:38.067948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:38.071060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:38.074162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:38.074802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:38.077926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:38.148986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-325a37cc-44ae-4997-af2b-7a2b662cc226 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 204 len: 0 microversion: 2.1 time: 0.513856 Nov 02 21:49:38.154205 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2541/5180] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:49:37 2022] DELETE /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:49:38.158379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:38.159092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:38.168724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:38.172826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:38.173478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:38.174394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:38.175158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:38.175755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:38.205016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:38.231531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:38.234188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:38.235523 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-655b2e21-76a0-4d1b-9f69-fca37c3dd7e7 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.220772 Nov 02 21:49:38.245555 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2640/5181] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:38 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:38.261310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:38.261637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:38.269467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:38.269963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:38.270424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:38.271149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:38.271627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:38.272070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:38.505955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:38.568102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:38.576695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4159f573-729f-4757-a8c0-7917e2045e0d tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1511 microversion: 2.1 time: 0.330019 Nov 02 21:49:38.577584 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2641/5182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:38 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:38.600892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:38.629070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:38.638179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:38.642878 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38de15a6-bcfa-4565-8513-bca29923c422 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.490020 Nov 02 21:49:38.646117 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2542/5183] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:38 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:39.074783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-15d35886-a497-46a3-b5ba-35ec7759be6a req-668040d7-a268-4e00-ba78-653ab20f35a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:39.132623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-15d35886-a497-46a3-b5ba-35ec7759be6a req-668040d7-a268-4e00-ba78-653ab20f35a6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:39.133334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-15d35886-a497-46a3-b5ba-35ec7759be6a req-668040d7-a268-4e00-ba78-653ab20f35a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:39.134343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-15d35886-a497-46a3-b5ba-35ec7759be6a req-668040d7-a268-4e00-ba78-653ab20f35a6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:39.168415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-15d35886-a497-46a3-b5ba-35ec7759be6a req-668040d7-a268-4e00-ba78-653ab20f35a6 service nova] Creating event network-changed:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h2-860863-4 Nov 02 21:49:39.180032 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-15d35886-a497-46a3-b5ba-35ec7759be6a req-668040d7-a268-4e00-ba78-653ab20f35a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110064 Nov 02 21:49:39.182706 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2642/5184] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:49:39.262924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:39.263779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:39.285915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=28 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:39.294546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:39.301376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:39.302625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:39.309184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:39.310052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:39.310824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:39.488959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:39.506182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:39.512577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:39.519528 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-157b414e-f4b8-4c47-8d95-cb0c76093663 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.259292 Nov 02 21:49:39.523529 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2543/5185] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:39 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:39.603757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:39.604538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:39.619917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:39.620432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:39.623556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:39.625516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:39.629461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:39.629990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:39.675258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:39.676247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:39.688613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:39.691066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:39.691735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:39.694758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:39.696892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:39.697591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:40.218951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:40.419184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:40.439019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:40.449110 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdc9c3a0-7b84-45c9-a3a1-922d9ed7ae63 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1511 microversion: 2.1 time: 0.838621 Nov 02 21:49:40.449816 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2643/5186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:39 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1511 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:40.470828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:40.475191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:40.486705 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-09198571-7a85-4daf-bfaf-d201805ef3f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.819150 Nov 02 21:49:40.487311 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2544/5187] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:39 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:40.551371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:40.552003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:40.566267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:40.566779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:40.567236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:40.567965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:40.568431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:40.568983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:41.298847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:41.312057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:41.315817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:41.333110 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b9e20aab-877c-40ea-9fbb-0544244ade9a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.772155 Nov 02 21:49:41.335612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2644/5188] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:40 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:41.479235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:41.480444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:41.494030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:41.494691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:41.495281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:41.496141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:41.496733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:41.497350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:41.528991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:41.529575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:41.549662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:41.552366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:41.555148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:41.556210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:41.557176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:41.560161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:42.493341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:42.497284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:42.509004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:42.513106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:42.519604 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d895f5e-6824-4155-9085-61b65f5f05b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.992758 Nov 02 21:49:42.519604 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2645/5189] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:41 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:42.524484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:42.525818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:42.550328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:42.568263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:42.568807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:42.569751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:42.571511 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab9ea249-09b2-4681-af93-367496544c93 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1511 microversion: 2.1 time: 1.097086 Nov 02 21:49:42.571927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:42.572438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:42.575088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:42.600032 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2545/5190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:41 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1511 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:42.764172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:42.783822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:42.785295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:42.786706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da6c49cc-b8ae-400e-b5e2-964aa25e203c tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.268678 Nov 02 21:49:42.787443 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2646/5191] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:42 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:42.971423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-722de592-cc65-4772-9d18-a1ee2e1fe662 req-8d3760c5-1788-46f9-8fad-40f542518fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b149a7c8-c465-4b4b-a13c-4e36774dbd56", "name": "network-vif-deleted", "tag": "1b67d6af-51de-4fa3-8806-37a329d2b45c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:42.981304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-722de592-cc65-4772-9d18-a1ee2e1fe662 req-8d3760c5-1788-46f9-8fad-40f542518fa6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:42.981785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-722de592-cc65-4772-9d18-a1ee2e1fe662 req-8d3760c5-1788-46f9-8fad-40f542518fa6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:42.982218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-722de592-cc65-4772-9d18-a1ee2e1fe662 req-8d3760c5-1788-46f9-8fad-40f542518fa6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:42.995531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-722de592-cc65-4772-9d18-a1ee2e1fe662 req-8d3760c5-1788-46f9-8fad-40f542518fa6 service nova] Creating event network-vif-deleted:1b67d6af-51de-4fa3-8806-37a329d2b45c for instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 on n-h2-860863-4 Nov 02 21:49:43.014035 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-722de592-cc65-4772-9d18-a1ee2e1fe662 req-8d3760c5-1788-46f9-8fad-40f542518fa6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046635 Nov 02 21:49:43.015170 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2546/5192] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:49:43.552399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:43.556076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:43.567737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:43.568536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:43.569258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:43.570350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:43.571056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:43.571717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:43.607127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:43.608010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:43.628057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:43.629040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:43.630978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:43.634204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:43.634946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:43.635556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:43.898159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8da13f36bb0542b69906ff04b75c351f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a03fca0959b4f0eb20b97ad433ff66e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:43.918619 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8420b26-bdf7-4f71-96d8-c34d504a063e tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 200 len: 1302 microversion: 2.1 time: 0.317824 Nov 02 21:49:43.920801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2547/5193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:43 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 1302 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:43.941395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:43.943745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:43.953469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:43.954665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:43.955319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:43.957189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:43.957888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:43.958986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:44.088092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:44.099346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:44.102566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:44.104557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:44.105978 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-33f8fdd5-9b32-4437-8381-914925dfa589 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.179116 Nov 02 21:49:44.121154 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2548/5194] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:43 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:44.121249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:44.121249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:44.121249 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dde26457-6ae7-44d6-ac7c-d643f3dfabda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.567994 Nov 02 21:49:44.121249 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2647/5195] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:43 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:44.948525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:44.949659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] [instance: b149a7c8-c465-4b4b-a13c-4e36774dbd56] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:44.959588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:44.960389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:44.961094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:44.962046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:44.962709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:44.963327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:44.985399 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] HTTP exception thrown: Instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 could not be found. Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Request method failure captured: Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 HTTP/1.1 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuXXmEe4RmomhKxmbLGnUf3YbbSAfhL1LWLWgiOZ0UvnT0KPu4ANEnnCSTQJV1Cm4qUbixg4pBj5ZNecnNOtoKMXQRze6-wrZk23xT9p_eHwyNLvqmiJQQIhxDtAWc7f4RNEaa5Bhmq0IxLJM958l1OMpBp9N-DxS3B64G8v0GWnDl8 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 6a03fca0959b4f0eb20b97ad433ff66e Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerAddressesTestJSON-1409641465 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6a03fca0959b4f0eb20b97ad433ff66e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a03fca0959b4f0eb20b97ad433ff66e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6a03fca0959b4f0eb20b97ad433ff66e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6a03fca0959b4f0eb20b97ad433ff66e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerAddressesTestJSON-1409641465 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 6a03fca0959b4f0eb20b97ad433ff66e Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1409641465 Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerAddressesTestJSON-1409641465-project Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8da13f36bb0542b69906ff04b75c351f Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerAddressesTestJSON-1409641465-project Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 could not be found. Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b149a7c8-c465-4b4b-a13c-4e36774dbd56'} Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 could not be found. Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 could not be found. Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:49:44.989243 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:44.993580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:44.993580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:49:44.993580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:49:44.993580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:49:44.993580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:49:44.993580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 could not be found. Nov 02 21:49:44.993580 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:44.995297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] Returning 404 to user: Instance b149a7c8-c465-4b4b-a13c-4e36774dbd56 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:49:44.996326 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fc0f0e8-f759-4f9d-b046-fb10e2c32fc0 tempest-ServerAddressesTestJSON-1409641465 tempest-ServerAddressesTestJSON-1409641465-project] 10.222.0.25 "GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56" status: 404 len: 111 microversion: 2.1 time: 0.052920 Nov 02 21:49:45.010409 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2549/5196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:44 2022] GET /compute/v2.1/servers/b149a7c8-c465-4b4b-a13c-4e36774dbd56 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:49:45.135621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:45.145648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:45.146862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:45.149570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:45.182209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:45.183328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:45.184345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:45.187869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:45.188560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:45.189120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:45.190087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:45.211062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:45.216454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:45.216454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:45.216454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:45.218803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:45.389390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:45.411146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:45.416525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:45.426922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ecc3085-af2c-4ee7-868a-537f6cba997f tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.294954 Nov 02 21:49:45.428535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2648/5197] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:45 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:45.672027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-178007719", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:45.752335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] validate_networks() for [('6dec2748-3171-417e-ae2c-73a937da2291', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:49:45.850766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:45.872791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:45.874715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:45.875943 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-87c86215-c487-4507-bb71-73e316ebc144 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.734998 Nov 02 21:49:45.876733 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2550/5198] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:45 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:46.455295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:46.456726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:46.463525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:46.464298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:46.469492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:46.469492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:46.469492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:46.469492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:46.639131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:46.663171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:46.676184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:46.680618 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3b9c78e-5972-434c-810c-ed6f24a575a2 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.227817 Nov 02 21:49:46.682295 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2551/5199] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:46 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:46.806059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:49:46.806561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:49:46.806823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:49:46.807810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:49:46.808298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:49:46.822387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:46.823052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:46.823504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:46.824299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:46.824758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:46.825209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:46.847868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Getting quotas for project af5da1bc0056403987c4a5d596e2e3fb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:49:46.854486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Getting quotas for user 4e3d53ccbfaf4c9b8d03ffb44f8e3660 and project af5da1bc0056403987c4a5d596e2e3fb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:49:46.897011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:49:46.903767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:49:46.906786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:46.907585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:46.925477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:46.927462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:46.933694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:46.934673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:46.935319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:46.935894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:47.184076 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ce7e01c-017a-4391-8c01-646fc2cf8b04 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.753469 Nov 02 21:49:47.184738 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2649/5200] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:49:47.203738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8fb4e542-b3be-4af3-b398-07882f23e3c5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:47.204388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8fb4e542-b3be-4af3-b398-07882f23e3c5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:47.451463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8fb4e542-b3be-4af3-b398-07882f23e3c5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:47.464205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8fb4e542-b3be-4af3-b398-07882f23e3c5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1216 microversion: 2.1 time: 0.271929 Nov 02 21:49:47.465074 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2650/5201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:47 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1216 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:47.667712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:47.679925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:47.681418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:47.687079 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-009057fb-719e-45b6-97a6-c86b94b47f56 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.784786 Nov 02 21:49:47.687766 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2552/5202] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:46 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:47.719198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:47.720240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:47.733745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:47.735465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:47.737119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:47.742901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:47.742901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:47.744594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:48.102361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-854dfe14-ce27-458c-b72f-2d429d13e2d0 req-249284ec-b9b8-4d9d-92c2-2a784305dc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "name": "network-vif-plugged", "status": "completed", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:48.121781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-854dfe14-ce27-458c-b72f-2d429d13e2d0 req-249284ec-b9b8-4d9d-92c2-2a784305dc58 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:48.122572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-854dfe14-ce27-458c-b72f-2d429d13e2d0 req-249284ec-b9b8-4d9d-92c2-2a784305dc58 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:48.124124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-854dfe14-ce27-458c-b72f-2d429d13e2d0 req-249284ec-b9b8-4d9d-92c2-2a784305dc58 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:48.178950 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-854dfe14-ce27-458c-b72f-2d429d13e2d0 req-249284ec-b9b8-4d9d-92c2-2a784305dc58 service nova] Creating event network-vif-plugged:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h2-860863-4 Nov 02 21:49:48.190959 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-854dfe14-ce27-458c-b72f-2d429d13e2d0 req-249284ec-b9b8-4d9d-92c2-2a784305dc58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092664 Nov 02 21:49:48.195432 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2553/5203] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:49:48.295301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:48.310024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:48.317502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:48.319398 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7059a0ca-655b-4b0b-919b-ca5019c7d245 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.611143 Nov 02 21:49:48.324291 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2651/5204] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:47 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:48.490221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61d93384-d5d1-4885-8d8c-ae804cae1527 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:48.491085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61d93384-d5d1-4885-8d8c-ae804cae1527 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:48.720185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:48.721613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:48.737611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:48.738168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:48.739689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:48.741661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:48.750386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:48.750974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:48.878900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-61d93384-d5d1-4885-8d8c-ae804cae1527 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:48.890705 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61d93384-d5d1-4885-8d8c-ae804cae1527 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1216 microversion: 2.1 time: 0.404675 Nov 02 21:49:48.909834 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2554/5205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:48 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1216 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:49.313628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:49.328838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:49.331144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:49.332756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8b3d727-7c96-4834-ae06-e150db4ea774 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1407 microversion: 2.20 time: 0.616875 Nov 02 21:49:49.334128 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2652/5206] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:48 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:49.349031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:49.350457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:49.371056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:49.379753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:49.381690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:49.383155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:49.386310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:49.390832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:49.570055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:49.584581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:49.587538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:49.589325 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-448d6570-f1aa-4fdc-afc0-373a6db6103a tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1366 microversion: 2.47 time: 0.244609 Nov 02 21:49:49.591729 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2555/5207] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:49 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:49.919323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:49.920154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:49.936907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:49.938662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:49.942566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:49.947701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:49.948297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:49.948755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:50.126985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:50.151718 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7f3ca78-8654-4ac3-afc2-2b1f407a14dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1212 microversion: 2.1 time: 0.226699 Nov 02 21:49:50.163482 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2653/5208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:49 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1212 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:50.365631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:50.374995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:50.394112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:50.397724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:50.400443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:50.415329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:50.415629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:50.416133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:50.461509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:50.622539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:50.623369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:50.648265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:50.648958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:50.649576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:50.650455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:50.651348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:50.651990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:50.802224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:50.835834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:50.840157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:50.845269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2d760fa-1426-4df6-92d0-99069c9ae31e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1372 microversion: 2.47 time: 0.229146 Nov 02 21:49:50.846079 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2654/5209] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:50 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:50.970364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:50.979677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:50.986115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:50.987749 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54b18d3c-98c9-499b-86e1-62a2a31ba0a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1599 microversion: 2.20 time: 0.632484 Nov 02 21:49:51.007807 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2556/5210] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:50 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1599 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:51.018848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:51.019421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:51.027936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:51.028437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:51.031901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:51.031901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:51.032185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:51.032593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:51.142374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef1f805c-3b3b-4af0-8ebe-99280cfdecd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127812 Nov 02 21:49:51.151977 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2655/5211] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:49:51 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:49:51.167745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:51.168672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:51.208519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:51.209273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:51.209879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:51.210748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:51.211350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:51.214558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:51.574836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:51.599894 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cc78f3f1-fbf3-43d1-aaab-284932203cb4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1276 microversion: 2.1 time: 0.427271 Nov 02 21:49:51.600996 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2557/5212] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:51 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1276 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:51.876017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:51.877312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:51.891484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:51.900147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:51.904631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:51.905958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:51.906586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:51.907168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:52.364921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:52.375022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:52.379969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:52.385937 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5447c4d3-a5ba-4981-90b9-ebac6be9242e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1372 microversion: 2.47 time: 0.516302 Nov 02 21:49:52.386815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2656/5213] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:51 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1372 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:52.653742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:52.661158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:52.689844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:52.690360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:52.690818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:52.691776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:52.692001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:52.692439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:53.051939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:53.075531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-82900b16-fc09-4b54-9469-bc2504fc7c68 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1274 microversion: 2.1 time: 0.441172 Nov 02 21:49:53.079844 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2558/5214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:52 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1274 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:53.418912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:53.419538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:53.436661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:53.437194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:53.437633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:53.438340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:53.438792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:53.439217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:53.574830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:53.590460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:53.595349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:53.596844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ee6dcac-2cdf-4107-aaaf-b9a196f588ad tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1357 microversion: 2.47 time: 0.183267 Nov 02 21:49:53.599157 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2657/5215] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:53 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:53.630462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:53.636522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:53.638305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Searching by: {'deleted': False, 'project_id': '3d78662da8194587927cea85a8e03393'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 21:49:53.645865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:53.646716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:53.647389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:53.648329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:53.649041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:53.649697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:53.824159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 21:49:53.980148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:54.011428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:54.013082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:54.016921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:54.076329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:54.087769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:54.109650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:54.110696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:54.124447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:54.127877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:54.128523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:54.129532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:54.130121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:54.132559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:54.367469 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3c108f4-1b05-4027-9c15-9923ce6c9011 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.741665 Nov 02 21:49:54.368073 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2559/5216] 10.222.0.25 () {60 vars in 1187 bytes} [Wed Nov 2 21:49:53 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:54.431671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:54.432695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:54.450146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:54.450460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:54.463600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:54.464792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:54.465308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:54.465868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:54.539591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:49:54.580863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:54.602252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bbcbf53a-a2c6-4b42-a9b0-841dccc30f63 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 0.498657 Nov 02 21:49:54.606371 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2658/5217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:54 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:49:55.069982 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f304f91-8eae-44ef-8341-2bb6353db725 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "DELETE /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 204 len: 0 microversion: 2.47 time: 0.657561 Nov 02 21:49:55.071472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2560/5218] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:49:54 2022] DELETE /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 21:49:55.082309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:55.083107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:55.101223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:55.101223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:55.101223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:55.101223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:55.105358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:55.105863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:55.234258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-45eb899a-5c33-4d90-92fa-9da043dfe445 req-b176bfaf-d869-48cb-9c09-31c595ed4496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:55.258674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-45eb899a-5c33-4d90-92fa-9da043dfe445 req-b176bfaf-d869-48cb-9c09-31c595ed4496 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:55.259495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-45eb899a-5c33-4d90-92fa-9da043dfe445 req-b176bfaf-d869-48cb-9c09-31c595ed4496 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:55.260407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-45eb899a-5c33-4d90-92fa-9da043dfe445 req-b176bfaf-d869-48cb-9c09-31c595ed4496 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:55.287740 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-45eb899a-5c33-4d90-92fa-9da043dfe445 req-b176bfaf-d869-48cb-9c09-31c595ed4496 service nova] Creating event network-changed:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h2-860863-4 Nov 02 21:49:55.303253 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-45eb899a-5c33-4d90-92fa-9da043dfe445 req-b176bfaf-d869-48cb-9c09-31c595ed4496 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076372 Nov 02 21:49:55.308427 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2561/5219] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:49:55.357208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:55.369497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:55.370988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:55.376555 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d9b3bed-3bd3-41dd-a028-97597d62df84 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1363 microversion: 2.47 time: 0.300770 Nov 02 21:49:55.380437 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2659/5220] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:55 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:55.636353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:55.637390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:55.652513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:55.654469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:55.655396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:55.658270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:55.658901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:55.659489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:56.138631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:56.151207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d76c4882-d41d-4cfc-a388-60f73b431211 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 0.521657 Nov 02 21:49:56.171724 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2562/5221] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:55 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:56.407788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:56.410947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:56.440206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:56.440971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:56.441608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:56.443569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:56.447526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:56.449390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:56.696585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:56.742237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:56.747935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:56.752968 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1c1e8c0-f031-4bee-8b5a-8e130b55cd89 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1363 microversion: 2.47 time: 0.349831 Nov 02 21:49:56.755583 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2660/5222] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:56 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:49:57.180042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:57.180715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:57.210206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:57.214458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:57.215937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:57.221939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:57.224077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:57.224699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:57.783339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:57.784987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:49:57.789221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:57.790243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:57.811621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:57.812588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:57.813296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:57.814252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:57.814903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:57.815513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:57.938237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:57.949857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:57.952116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:57.954741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lazy-loading 'fault' on Instance uuid 760c85c8-c8b4-402a-8a0d-58d5d566cebf {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:49:58.138013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:58.151452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:58.156100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:58.160328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f538999c-c6a2-4361-bb14-37957f14c339 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 200 len: 1368 microversion: 2.47 time: 0.377678 Nov 02 21:49:58.165826 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2661/5223] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:57 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 1368 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:49:58.232418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:58.252114 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98473617-2da5-4ba1-89c4-fd434175dc3d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 1.076175 Nov 02 21:49:58.255722 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2563/5224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:57 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:49:58.362176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-df3af1e6-a008-44bd-8c40-2867130026cd req-6688a25b-6cd0-4489-b26d-1a4dc7136982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40ad45b-ca57-4f29-bc34-1b46511dab23", "tag": "9890a9b2-b6e7-4c1d-b480-c80d93a563a2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:49:58.376471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-df3af1e6-a008-44bd-8c40-2867130026cd req-6688a25b-6cd0-4489-b26d-1a4dc7136982 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:58.376976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-df3af1e6-a008-44bd-8c40-2867130026cd req-6688a25b-6cd0-4489-b26d-1a4dc7136982 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:58.379159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-df3af1e6-a008-44bd-8c40-2867130026cd req-6688a25b-6cd0-4489-b26d-1a4dc7136982 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:58.440184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-df3af1e6-a008-44bd-8c40-2867130026cd req-6688a25b-6cd0-4489-b26d-1a4dc7136982 service nova] Creating event network-changed:9890a9b2-b6e7-4c1d-b480-c80d93a563a2 for instance d40ad45b-ca57-4f29-bc34-1b46511dab23 on n-h2-860863-4 Nov 02 21:49:58.456676 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-df3af1e6-a008-44bd-8c40-2867130026cd req-6688a25b-6cd0-4489-b26d-1a4dc7136982 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112149 Nov 02 21:49:58.457474 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2662/5225] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:49:59.214247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:59.215104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 760c85c8-c8b4-402a-8a0d-58d5d566cebf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:59.231784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:59.234704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:59.235964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:59.237120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:59.239065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:59.239674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:59.291472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:59.292296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:59.318890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:59.320326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:59.324451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:59.328202 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] HTTP exception thrown: Instance 760c85c8-c8b4-402a-8a0d-58d5d566cebf could not be found. Nov 02 21:49:59.329288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Request method failure captured: Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf HTTP/1.1 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuXWhbA4u42JDkQu0t_nnW1nduM38mcGnhK6C4jWlhC7nvNc6O0AOCQP8aws2xIgkTmWH6HI5iEzJWz0SG6zddN4Ofn_FRw2-vsNfm_2RiyiaB5cBGbi_F2o25YVUUV5JQCdXmoM_Hg3mHcPHOX6FI_OStYpaxWUveci-p0iZk5ro00 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 3d78662da8194587927cea85a8e03393 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerShowV247Test-514515701 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d78662da8194587927cea85a8e03393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d78662da8194587927cea85a8e03393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d78662da8194587927cea85a8e03393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d78662da8194587927cea85a8e03393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerShowV247Test-514515701 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 3d78662da8194587927cea85a8e03393 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerShowV247Test-514515701 Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerShowV247Test-514515701-project Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 65e97bbc5fdb494abf31a10059bde64e Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerShowV247Test-514515701-project Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 760c85c8-c8b4-402a-8a0d-58d5d566cebf could not be found. Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '760c85c8-c8b4-402a-8a0d-58d5d566cebf'} Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760c85c8-c8b4-402a-8a0d-58d5d566cebf could not be found. Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760c85c8-c8b4-402a-8a0d-58d5d566cebf could not be found. Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:49:59.329865 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760c85c8-c8b4-402a-8a0d-58d5d566cebf could not be found. Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:49:59.338804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Returning 404 to user: Instance 760c85c8-c8b4-402a-8a0d-58d5d566cebf could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:49:59.339369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:59.339369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:59.342633 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2df267fd-abfb-4eb0-8862-2e1d554ac9d6 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf" status: 404 len: 111 microversion: 2.47 time: 0.127057 Nov 02 21:49:59.347273 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2564/5226] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:49:59 2022] GET /compute/v2.1/servers/760c85c8-c8b4-402a-8a0d-58d5d566cebf => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:49:59.370036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:49:59.370620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:49:59.387013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:59.390641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:59.391314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:59.403708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:49:59.403708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:49:59.404581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:49:59.569144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:49:59.835381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:49:59.851067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2e41d3b-fc2e-44df-9ad7-3fc0f1e44cef tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 0.565096 Nov 02 21:49:59.852334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2663/5227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:49:59 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:00.023812 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e4b8690-0ec0-4c0c-a9e0-3b7672fb6e71 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e" status: 204 len: 0 microversion: 2.47 time: 0.674888 Nov 02 21:50:00.024626 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2565/5228] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:49:59 2022] DELETE /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:50:00.048546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:00.050357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:00.064372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:00.065049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:00.065506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:00.066590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:00.067188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:00.067768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:00.157507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:00.170231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:00.171862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:00.173597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:00.175332 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd776a68-c324-4cd1-90f4-571a7792518b tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e" status: 200 len: 1363 microversion: 2.47 time: 0.135726 Nov 02 21:50:00.175966 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2664/5229] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:00 2022] GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e => generated 1363 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:00.880885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:00.881736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:00.912696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:00.913314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:00.913870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:00.914660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:00.915675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:00.916179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:01.208008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:01.209339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:01.227226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:01.227992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:01.228441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:01.229217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:01.229663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:01.230098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:01.379164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:01.411628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:01.414104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:01.415673 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ebb40099-3ad7-4018-b026-52c1ec74b271 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e" status: 200 len: 1363 microversion: 2.47 time: 0.212740 Nov 02 21:50:01.416769 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2665/5230] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:01 2022] GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:01.615823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:01.627740 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d1db888b-3ffe-4e49-91a2-6cc7af86c21b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 0.752418 Nov 02 21:50:01.629366 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2566/5231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:00 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:02.457442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:02.461567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:02.503054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:02.516291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:02.518907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:02.520599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:02.522563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:02.523313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:02.523908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:02.570261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:02.571099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:02.571776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:02.572397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lazy-loading 'fault' on Instance uuid 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:50:02.652103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:02.652792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:02.656958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:02.667118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:02.668472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:02.669225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:02.670435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:02.671287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:02.671968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:02.709501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:02.726177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:02.727950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65e97bbc5fdb494abf31a10059bde64e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d78662da8194587927cea85a8e03393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:02.729740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48a8b2ac-6502-4e0d-ab3f-5af107cca305 tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e" status: 200 len: 1368 microversion: 2.47 time: 0.282215 Nov 02 21:50:02.730498 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2666/5232] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:02 2022] GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:02.898628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:02.910103 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a6be212-8974-49df-a9d8-24b5d900d2ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 0.261904 Nov 02 21:50:02.910902 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2567/5233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:02 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:03.759216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:03.761377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] [instance: 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:03.772036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:03.772853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:03.774646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:03.775600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:03.776282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:03.776984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:03.817876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] HTTP exception thrown: Instance 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e could not be found. Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Request method failure captured: Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e HTTP/1.1 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuXWhbA4u42JDkQu0t_nnW1nduM38mcGnhK6C4jWlhC7nvNc6O0AOCQP8aws2xIgkTmWH6HI5iEzJWz0SG6zddN4Ofn_FRw2-vsNfm_2RiyiaB5cBGbi_F2o25YVUUV5JQCdXmoM_Hg3mHcPHOX6FI_OStYpaxWUveci-p0iZk5ro00 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 3d78662da8194587927cea85a8e03393 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerShowV247Test-514515701 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3d78662da8194587927cea85a8e03393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d78662da8194587927cea85a8e03393"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3d78662da8194587927cea85a8e03393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3d78662da8194587927cea85a8e03393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerShowV247Test-514515701 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 3d78662da8194587927cea85a8e03393 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerShowV247Test-514515701 Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerShowV247Test-514515701-project Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 65e97bbc5fdb494abf31a10059bde64e Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerShowV247Test-514515701-project Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e could not be found. Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '7450110d-f69b-4a77-b4a8-9ba47f9c2b6e'} Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e could not be found. Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e could not be found. Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:03.821632 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e could not be found. Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] Returning 404 to user: Instance 7450110d-f69b-4a77-b4a8-9ba47f9c2b6e could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-451fa2fd-9afa-473b-ab9a-4225f412146e tempest-ServerShowV247Test-514515701 tempest-ServerShowV247Test-514515701-project] 10.222.0.25 "GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e" status: 404 len: 111 microversion: 2.47 time: 0.068513 Nov 02 21:50:03.830667 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2667/5234] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:03 2022] GET /compute/v2.1/servers/7450110d-f69b-4a77-b4a8-9ba47f9c2b6e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:03.934949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:03.936265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:03.941039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:03.952475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:03.955891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:03.956644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:03.958951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:03.959585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:03.961342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:03.962097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:04.332273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:04.356857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3eb80a12-9760-45ba-a787-d2c3524c3430 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 0.413604 Nov 02 21:50:04.364163 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2568/5235] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:03 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:05.388723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:05.391084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:05.412134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:05.412134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:05.412134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:05.412134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:05.412134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:05.412134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:05.985461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:05.999308 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5cce9a3-ca27-4365-9d12-bff0be9c4543 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 0.616292 Nov 02 21:50:05.999308 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2668/5236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:05 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:06.068878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ea54fb7b-a2ef-4588-b57f-fb8bdf34dce3 req-619c17cc-4474-4fe1-bba0-1e92539ca865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40ad45b-ca57-4f29-bc34-1b46511dab23", "name": "network-vif-plugged", "status": "completed", "tag": "9890a9b2-b6e7-4c1d-b480-c80d93a563a2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:06.087722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea54fb7b-a2ef-4588-b57f-fb8bdf34dce3 req-619c17cc-4474-4fe1-bba0-1e92539ca865 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:06.089050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea54fb7b-a2ef-4588-b57f-fb8bdf34dce3 req-619c17cc-4474-4fe1-bba0-1e92539ca865 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:06.089678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea54fb7b-a2ef-4588-b57f-fb8bdf34dce3 req-619c17cc-4474-4fe1-bba0-1e92539ca865 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:06.142934 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ea54fb7b-a2ef-4588-b57f-fb8bdf34dce3 req-619c17cc-4474-4fe1-bba0-1e92539ca865 service nova] Creating event network-vif-plugged:9890a9b2-b6e7-4c1d-b480-c80d93a563a2 for instance d40ad45b-ca57-4f29-bc34-1b46511dab23 on n-h2-860863-4 Nov 02 21:50:06.163228 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ea54fb7b-a2ef-4588-b57f-fb8bdf34dce3 req-619c17cc-4474-4fe1-bba0-1e92539ca865 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092141 Nov 02 21:50:06.166387 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2569/5237] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:07.025142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:07.025858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:07.038770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:07.042373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:07.042831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:07.046949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:07.047558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:07.048075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:08.140788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:08.151470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22fca689-2c9e-49a0-9d35-daa1d7d305b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1316 microversion: 2.1 time: 1.131134 Nov 02 21:50:08.157440 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2669/5238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:07 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1316 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:09.183937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:09.184864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:09.212473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:09.213016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:09.213466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:09.214192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:09.214645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:09.215076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:09.715176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:09.724176 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3917fdc-d4f7-4fa1-ac7e-df2a855c98ad tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.547762 Nov 02 21:50:09.725000 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2570/5239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:09 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:09.943420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1103582187", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:10.069576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] validate_networks() for [('6dec2748-3171-417e-ae2c-73a937da2291', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:50:11.153852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:50:11.156537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:50:11.157432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:50:11.158197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:50:11.158788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:50:11.178843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:11.180136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:11.181928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:11.187585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:11.187585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:11.187585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:11.294220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Getting quotas for project af5da1bc0056403987c4a5d596e2e3fb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:50:11.310709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Getting quotas for user 4e3d53ccbfaf4c9b8d03ffb44f8e3660 and project af5da1bc0056403987c4a5d596e2e3fb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:50:11.374787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:50:11.378526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:50:11.640957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a3d8ada2-30ff-4ba1-8e9c-ee438a2159da tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701319 Nov 02 21:50:11.652521 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2670/5240] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:50:11.664649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf8ef3e6-2ae5-4bb6-8040-387a1f6b8313 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:11.665314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf8ef3e6-2ae5-4bb6-8040-387a1f6b8313 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:11.870972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bf8ef3e6-2ae5-4bb6-8040-387a1f6b8313 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:11.883446 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf8ef3e6-2ae5-4bb6-8040-387a1f6b8313 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1217 microversion: 2.1 time: 0.222510 Nov 02 21:50:11.884630 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2571/5241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:11 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:12.909576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54df196f-9b3d-407a-b557-a5778a9ba57c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:12.911470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-54df196f-9b3d-407a-b557-a5778a9ba57c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:12.988343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54df196f-9b3d-407a-b557-a5778a9ba57c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:12.998075 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54df196f-9b3d-407a-b557-a5778a9ba57c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1217 microversion: 2.1 time: 0.094645 Nov 02 21:50:13.012973 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2572/5242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:12 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:13.115202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1827905629", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:13.190861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] validate_networks() for [('232e989f-e611-4c78-b23a-341996c6c8e4', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:50:14.023817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:14.024431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:14.043746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:14.043746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:14.043746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:14.043746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:14.043746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:14.055016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:14.060250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:14.266489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:14.289670 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-66e0f2a1-a1e2-4a5b-a926-c919706409ff tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1213 microversion: 2.1 time: 0.269553 Nov 02 21:50:14.290925 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2573/5243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:14 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1213 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:14.514620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:50:14.514620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:50:14.514620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:50:14.514620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:50:14.514620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:50:14.532171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:14.533333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:14.534876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:14.537470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:14.538058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:14.538544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:14.580212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Getting quotas for project fec9f56cefa240d792aca26fc4fb7be5. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:50:14.588500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Getting quotas for user 17fa727ca4e0408b987e39969df32b26 and project fec9f56cefa240d792aca26fc4fb7be5. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:50:14.622887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:50:14.626611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:50:14.782726 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f5d46b1-a41e-40ca-ba21-64a030957dc1 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.180493 Nov 02 21:50:14.786807 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2671/5244] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:50:14.798060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-439d2d8d-c492-4565-8941-0b274d1037e7 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:14.798686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-439d2d8d-c492-4565-8941-0b274d1037e7 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:15.077099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-439d2d8d-c492-4565-8941-0b274d1037e7 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:15.090286 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-439d2d8d-c492-4565-8941-0b274d1037e7 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1224 microversion: 2.1 time: 0.296062 Nov 02 21:50:15.108835 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2574/5245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:14 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1224 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:15.327980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:15.328612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:15.346812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:15.346991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:15.353138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:15.353916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:15.354400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:15.354840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:15.592962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:15.606398 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c6e51ab-fb1f-4668-bc55-ae3ded9637e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1277 microversion: 2.1 time: 0.282612 Nov 02 21:50:15.608257 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2672/5246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:15 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1277 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:16.121205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d1ef8424-627d-4681-982b-d9b3ea8c3a05 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:16.122100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d1ef8424-627d-4681-982b-d9b3ea8c3a05 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:16.348848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d1ef8424-627d-4681-982b-d9b3ea8c3a05 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:16.356473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d1ef8424-627d-4681-982b-d9b3ea8c3a05 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1224 microversion: 2.1 time: 0.240901 Nov 02 21:50:16.359799 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2575/5247] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:16 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1224 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:16.633610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:16.634923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:16.644673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:16.646837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:16.647940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:16.649756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:16.650955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:16.654105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:16.853367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:16.862110 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f4b0a71-0688-46b0-8e03-2eab45156ba7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1275 microversion: 2.1 time: 0.232815 Nov 02 21:50:16.864995 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2673/5248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:16 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:17.379634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:17.380254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:17.415095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:17.415922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:17.416035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:17.416741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:17.417235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:17.438722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:17.620827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:17.634304 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-838ce468-450d-47cc-8a2f-03f782c9e050 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1228 microversion: 2.1 time: 0.258346 Nov 02 21:50:17.640846 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2576/5249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:17 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1228 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:17.886851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:17.887438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:17.901355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:17.901871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:17.907348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:17.908170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:17.908664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:17.909159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:18.185162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:18.201881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cdffb7a4-880d-4b3f-80d8-5efcfbfb5877 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.310973 Nov 02 21:50:18.208730 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2674/5250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:17 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:18.660787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:18.662041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:18.676640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:18.679858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:18.680611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:18.684978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:18.686154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:18.689826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:19.103798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:19.112692 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2a78a46-64dd-4920-b3e8-e5ba67cfe839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1276 microversion: 2.1 time: 0.456294 Nov 02 21:50:19.115259 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2577/5251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:18 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1276 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:19.227407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:19.228016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:19.246267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:19.254951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:19.257124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:19.258969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:19.265794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:19.265794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:19.620906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:19.629923 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f18c1895-b3f1-4daa-a8ab-53b3a3d39937 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.407031 Nov 02 21:50:19.630385 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2675/5252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:19 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:20.137667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:20.139223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:20.149204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:20.150287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:20.155937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:20.155937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:20.155937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:20.155937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:20.298052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:20.311075 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d68ed88e-1907-444c-8765-aa3f35134682 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1282 microversion: 2.1 time: 0.178090 Nov 02 21:50:20.317869 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2578/5253] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:20 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:20.657225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:20.658425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:20.668665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:20.669437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:20.670201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:20.671525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:20.672191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:20.672808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:21.341329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:21.342526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:21.353569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:21.354068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:21.354531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:21.355482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:21.356197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:21.357114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:21.627068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:21.638966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c68acc62-f1e6-4542-a4ab-9565f117e6b1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.988679 Nov 02 21:50:21.644263 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2676/5254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:20 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:21.648188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-204c720c-de62-4a24-9e25-538051c6158b req-ddae3db4-aae7-44d9-91e8-12d0d8df1bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63309760-3556-4d65-9f7e-1e8a7323c102", "tag": "790506d8-862b-46a5-81db-c957db76a895"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:21.679066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-204c720c-de62-4a24-9e25-538051c6158b req-ddae3db4-aae7-44d9-91e8-12d0d8df1bf4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:21.679066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-204c720c-de62-4a24-9e25-538051c6158b req-ddae3db4-aae7-44d9-91e8-12d0d8df1bf4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:21.679066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-204c720c-de62-4a24-9e25-538051c6158b req-ddae3db4-aae7-44d9-91e8-12d0d8df1bf4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:21.711136 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-204c720c-de62-4a24-9e25-538051c6158b req-ddae3db4-aae7-44d9-91e8-12d0d8df1bf4 service nova] Creating event network-changed:790506d8-862b-46a5-81db-c957db76a895 for instance 63309760-3556-4d65-9f7e-1e8a7323c102 on n-h1-860863-4 Nov 02 21:50:21.723565 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-204c720c-de62-4a24-9e25-538051c6158b req-ddae3db4-aae7-44d9-91e8-12d0d8df1bf4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081499 Nov 02 21:50:21.726164 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2677/5255] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:22.009998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:22.023756 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86d48c77-8ba6-4ed9-b488-02ede85bd459 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.686912 Nov 02 21:50:22.024359 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2579/5256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:21 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:22.666743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:22.667487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:22.678469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:22.678969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:22.679416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:22.680143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:22.680919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:22.681497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:23.046960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:23.047569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:23.055310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:23.055802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:23.056243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:23.057560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:23.058302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:23.058953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:23.070653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:23.085078 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a4d2c08f-f862-432e-a91b-9d7d8ada8156 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.422406 Nov 02 21:50:23.088772 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2678/5257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:22 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:23.505690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:23.516574 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1849b716-998f-4007-80d4-6739fae06fa0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.473683 Nov 02 21:50:23.523832 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2580/5258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:23 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:23.855368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-582810e3-8319-4c8e-95af-578e69f16f18 req-15191cc8-e6dc-4e54-a405-5ba0860a1add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3430040c-34f2-444f-8da7-d2281759d76d", "tag": "661dcbf8-a04d-489f-ab89-6e6b4d8c376d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:23.869014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-582810e3-8319-4c8e-95af-578e69f16f18 req-15191cc8-e6dc-4e54-a405-5ba0860a1add service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:23.869790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-582810e3-8319-4c8e-95af-578e69f16f18 req-15191cc8-e6dc-4e54-a405-5ba0860a1add service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:23.870618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-582810e3-8319-4c8e-95af-578e69f16f18 req-15191cc8-e6dc-4e54-a405-5ba0860a1add service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:23.893094 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-582810e3-8319-4c8e-95af-578e69f16f18 req-15191cc8-e6dc-4e54-a405-5ba0860a1add service nova] Creating event network-changed:661dcbf8-a04d-489f-ab89-6e6b4d8c376d for instance 3430040c-34f2-444f-8da7-d2281759d76d on n-h1-860863-4 Nov 02 21:50:23.924174 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-582810e3-8319-4c8e-95af-578e69f16f18 req-15191cc8-e6dc-4e54-a405-5ba0860a1add service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073364 Nov 02 21:50:23.926208 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2679/5259] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:24.113395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:24.114709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:24.124693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:24.125412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:24.128637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:24.128637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:24.128637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:24.128637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:24.554167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:24.555102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:24.568360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:24.579182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:24.579818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:24.580513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:24.583602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:24.586396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:24.586871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:24.610541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:25.169231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:25.181014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-974e14ed-4948-4075-9416-75cb624de148 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 1.073050 Nov 02 21:50:25.181618 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2581/5260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:24 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:25.571887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:25.586818 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e677fab8-7711-4838-8339-ceb2fe923dd3 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 1.043156 Nov 02 21:50:25.591178 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2680/5261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:24 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:26.214392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:26.215248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:26.246372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:26.246872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:26.249741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:26.250459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:26.251934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:26.252384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:26.356123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:26.560466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:26.570271 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca613af9-654c-4f19-9706-785ae0475aba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.360182 Nov 02 21:50:26.570922 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2582/5262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:26 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:26.615477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:26.616846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:26.624253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:26.624956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:26.625584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:26.626538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:26.626994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:26.627420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:26.852213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:26.876645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a06d2c09-8d5f-4f9a-a336-c414833e953c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.265041 Nov 02 21:50:26.878064 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2681/5263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:26 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:27.599893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:27.600802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:27.620482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:27.622277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:27.626999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:27.631379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:27.633118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:27.634020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:27.748433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:27.749147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:27.761495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:27.765627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:27.770884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:27.770884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:27.770884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:27.770884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:27.823685 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6895b40e-9e39-4207-869e-00ee266996d4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/ips" status: 200 len: 152 microversion: 2.20 time: 0.079360 Nov 02 21:50:27.831976 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2682/5264] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Nov 2 21:50:27 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/ips => generated 152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:50:27.860279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:27.868138 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a76cf75-0b9c-417a-9574-62e18ab35500 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.278440 Nov 02 21:50:27.880953 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2583/5265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:27 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:27.921377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:27.922214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:27.936769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:27.937351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:27.937813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:27.938561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:27.939511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:27.940192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:28.194504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-418446627", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "56501cb9-79e3-48ff-8a35-b9a88fac8eee"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:28.294779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] validate_networks() for [('56501cb9-79e3-48ff-8a35-b9a88fac8eee', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:50:28.682799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:28.700825 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98d56d6c-a71e-4efb-b918-d16e69b3d373 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.795586 Nov 02 21:50:28.704213 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2683/5266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:27 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:28.713336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-877a8557-8a34-4634-8735-b2bac296d057 req-4c627d70-8c9f-416e-a824-27d24a54336d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63309760-3556-4d65-9f7e-1e8a7323c102", "name": "network-vif-plugged", "status": "completed", "tag": "790506d8-862b-46a5-81db-c957db76a895"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:28.725045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-877a8557-8a34-4634-8735-b2bac296d057 req-4c627d70-8c9f-416e-a824-27d24a54336d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:28.725774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-877a8557-8a34-4634-8735-b2bac296d057 req-4c627d70-8c9f-416e-a824-27d24a54336d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:28.726370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-877a8557-8a34-4634-8735-b2bac296d057 req-4c627d70-8c9f-416e-a824-27d24a54336d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:28.743835 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-877a8557-8a34-4634-8735-b2bac296d057 req-4c627d70-8c9f-416e-a824-27d24a54336d service nova] Creating event network-vif-plugged:790506d8-862b-46a5-81db-c957db76a895 for instance 63309760-3556-4d65-9f7e-1e8a7323c102 on n-h1-860863-4 Nov 02 21:50:28.770733 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-877a8557-8a34-4634-8735-b2bac296d057 req-4c627d70-8c9f-416e-a824-27d24a54336d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056860 Nov 02 21:50:28.777279 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2684/5267] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:28.917965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:28.918758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:28.928413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:28.929602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:28.931348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:28.933675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:28.935146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:28.935146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:28.987191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:29.324345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:29.333804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b5ae866-da04-496b-8aec-0b6512487103 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.422290 Nov 02 21:50:29.350442 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2685/5268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:28 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:29.410012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:50:29.411403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:50:29.412243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:50:29.412653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:50:29.413102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:50:29.432000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:29.432813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:29.434381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:29.436786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:29.458588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:29.462401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:29.529608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Getting quotas for project a0cff0fbcbb24d1a804e9a0b2f5e2e13. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:50:29.543621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Getting quotas for user 94e549ae9b7c4a74a0a68a20806ffa9e and project a0cff0fbcbb24d1a804e9a0b2f5e2e13. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:50:29.578037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:50:29.584677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:50:29.754718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:29.755704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:29.769617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:29.770594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:29.773914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:29.775901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:29.776157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:29.776801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:29.825419 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-afe8bf7b-2b24-4862-98c4-87c8fcc52294 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634766 Nov 02 21:50:29.857569 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2584/5269] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:50:29.870054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb518d81-0b8a-43c7-b93d-7ea94b89c5f5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:29.874043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb518d81-0b8a-43c7-b93d-7ea94b89c5f5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:30.137094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb518d81-0b8a-43c7-b93d-7ea94b89c5f5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:30.142989 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb518d81-0b8a-43c7-b93d-7ea94b89c5f5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1218 microversion: 2.1 time: 0.283998 Nov 02 21:50:30.168955 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2585/5270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:29 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1218 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:30.291531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:30.307911 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-697f3efd-6d3f-44f2-870e-280d7f021610 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.577656 Nov 02 21:50:30.331857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2686/5271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:29 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:30.358322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:30.359402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:30.376126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:30.378862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:30.379125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:30.383284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:30.384584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:30.386386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:31.185812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94c719c7-034b-4c6e-bbb6-3c31adf16f9f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:31.187820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94c719c7-034b-4c6e-bbb6-3c31adf16f9f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:31.264479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:31.301335 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f8fc7d9-f15e-405a-a5c1-428ed025e0f1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1317 microversion: 2.1 time: 0.943527 Nov 02 21:50:31.305690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2586/5272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:30 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1317 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:31.335312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:31.336234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:31.349658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:31.353509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:31.353962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:31.358082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:31.358548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:31.362333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:31.374002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-94c719c7-034b-4c6e-bbb6-3c31adf16f9f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:31.378624 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94c719c7-034b-4c6e-bbb6-3c31adf16f9f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1218 microversion: 2.1 time: 0.200495 Nov 02 21:50:31.379218 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2687/5273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:31 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:31.605588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:31.609413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:31.649268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:31.649268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:31.649268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:31.649268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:31.649268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:31.656055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:31.713085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lazy-loading 'flavor' on Instance uuid 3351f1dc-a844-4ca9-b336-09cb79dbca9d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:50:31.785575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:31.801770 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-074c48b0-dcb1-4eb9-bfd8-838cd7fb5839 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.470888 Nov 02 21:50:31.802601 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2587/5274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:31 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:32.156377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-9c85ff3b-659a-435e-a548-e3bb865721f2 req-80b63b54-8c8c-401c-836c-df0bbe52f64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430040c-34f2-444f-8da7-d2281759d76d", "name": "network-vif-plugged", "status": "completed", "tag": "661dcbf8-a04d-489f-ab89-6e6b4d8c376d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:32.172716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9c85ff3b-659a-435e-a548-e3bb865721f2 req-80b63b54-8c8c-401c-836c-df0bbe52f64c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.173466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9c85ff3b-659a-435e-a548-e3bb865721f2 req-80b63b54-8c8c-401c-836c-df0bbe52f64c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.174073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-9c85ff3b-659a-435e-a548-e3bb865721f2 req-80b63b54-8c8c-401c-836c-df0bbe52f64c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.202936 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-9c85ff3b-659a-435e-a548-e3bb865721f2 req-80b63b54-8c8c-401c-836c-df0bbe52f64c service nova] Creating event network-vif-plugged:661dcbf8-a04d-489f-ab89-6e6b4d8c376d for instance 3430040c-34f2-444f-8da7-d2281759d76d on n-h1-860863-4 Nov 02 21:50:32.215408 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-9c85ff3b-659a-435e-a548-e3bb865721f2 req-80b63b54-8c8c-401c-836c-df0bbe52f64c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062693 Nov 02 21:50:32.220663 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2588/5275] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:50:32.328508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:32.330275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:32.343615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.344602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.350358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.351418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.352049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.352834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.445842 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1bf88f2-a436-411d-980a-c15ac5a19154 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/action" status: 202 len: 0 microversion: 2.20 time: 0.849761 Nov 02 21:50:32.450487 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2688/5276] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:50:31 2022] POST /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/action => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:50:32.475242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:32.478344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:32.498036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.498912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.499376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.500376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.501040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.501686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.673406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:32.681691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:32.683899 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69eff3cf-324a-4872-a261-a6d24c5afb24 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1270 microversion: 2.1 time: 0.221276 Nov 02 21:50:32.688174 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2689/5277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:32 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:32.693629 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a36ba114-1d0f-4e5c-a112-a764bf820ded tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1506 microversion: 2.1 time: 0.370620 Nov 02 21:50:32.702245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:32.703866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:32.713627 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2589/5278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:32 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:32.717801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.718997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.720476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.723352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.724070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.724668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.728727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:32.729763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:32.748539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.753374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.758377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.759163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:32.759668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:32.760106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:32.833875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:50:33.009676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:33.023642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:33.025348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:33.026845 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2651fc60-f1bc-49de-9cbb-cf5af23ea772 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.337533 Nov 02 21:50:33.027420 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2690/5279] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:32 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:33.032320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:33.032946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:33.049861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:33.050519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:33.050963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:33.051709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:33.052120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:33.052561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:33.161462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22be36d6-5c46-422d-ad16-1c30a858e071 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 204 len: 0 microversion: 2.1 time: 0.437512 Nov 02 21:50:33.162889 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2590/5280] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:50:32 2022] DELETE /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:50:33.175419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:33.176142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:33.190602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:33.192644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:33.197064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:33.197898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:33.198364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:33.198815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:33.252570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:33.260738 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03911f93-43b3-4e91-8c65-860c2a24fcab tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.232199 Nov 02 21:50:33.277800 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2691/5281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:33 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:33.563997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:33.576238 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fcd2fe5d-6be0-4603-a3d1-ba3ab8f1a2bc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1512 microversion: 2.1 time: 0.406247 Nov 02 21:50:33.578219 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2591/5282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:33 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:33.719014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:33.719799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:33.747626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:33.748258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:33.749001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:33.750204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:33.751997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:33.753047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:33.896397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:33.911967 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a5b7ba3-7fac-4cee-99eb-5fe9f1d06919 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1278 microversion: 2.1 time: 0.201440 Nov 02 21:50:33.913049 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2692/5283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:33 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:34.066484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:34.067188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:34.082210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.082721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:34.083174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:34.086023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.086448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:34.086892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:34.130547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:34.289368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:34.290476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:34.306214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.306738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:34.307183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:34.310750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.315315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:34.315869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:34.493971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:34.503706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:34.505528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:34.507044 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5fe8294-ef5f-4c56-8c52-ef6ee90ea98a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.447275 Nov 02 21:50:34.507625 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2592/5284] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:34 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:34.606131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:34.607692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:34.621433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.622941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:34.623547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:34.625016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.625682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:34.626487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:34.851804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:34.875442 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4679899-7f77-43c4-a567-8c337f3eb880 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1324 microversion: 2.1 time: 0.590811 Nov 02 21:50:34.876442 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2693/5285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:34 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:34.944614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:34.957371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:34.989952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.990549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:34.991006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:34.991781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:34.998586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:35.000446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:35.084826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:35.095977 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2179ddf6-9eaf-4412-9e24-f5b02ff5c65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1512 microversion: 2.1 time: 0.493489 Nov 02 21:50:35.096867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2593/5286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:34 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:35.540693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:35.541579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:35.550637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:35.558018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:35.558527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:35.565990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:35.565990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:35.565990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:35.565990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:35.566311 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b507e29-fda8-466b-8af8-91ceb12d02a4 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.622001 Nov 02 21:50:35.566311 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2694/5287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:34 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:35.902100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:35.903512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:35.913529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:35.928863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:35.930104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:35.936039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:35.939755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:35.942496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:35.945213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:36.026599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:36.047953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:36.049349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:36.051154 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6bfb0d2f-5dc8-43f9-bccf-b0302118a793 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.515884 Nov 02 21:50:36.052086 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2594/5288] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:35 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:50:36.119488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:36.120254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:36.123292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:36.132441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:36.133309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:36.133986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:36.134892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:36.135507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:36.136092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:36.415762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:36.430736 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-617fb2bb-37ee-4b92-aea2-559bd98a738b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 200 len: 1470 microversion: 2.1 time: 0.315536 Nov 02 21:50:36.445393 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2595/5289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:36 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:36.574774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-cedc5863-f51e-47b2-b9e7-f71da2d0e524 req-94e9b24a-ec44-4a1f-950f-f7470c55f4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63309760-3556-4d65-9f7e-1e8a7323c102", "name": "network-vif-deleted", "tag": "790506d8-862b-46a5-81db-c957db76a895"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:36.582089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:36.592290 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90b22019-c099-4e4e-8d9a-3e380999dac0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1519 microversion: 2.1 time: 0.697130 Nov 02 21:50:36.592891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2695/5290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:35 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1519 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:36.599925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:36.600777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:36.602533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cedc5863-f51e-47b2-b9e7-f71da2d0e524 req-94e9b24a-ec44-4a1f-950f-f7470c55f4fa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:36.607787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cedc5863-f51e-47b2-b9e7-f71da2d0e524 req-94e9b24a-ec44-4a1f-950f-f7470c55f4fa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:36.608379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cedc5863-f51e-47b2-b9e7-f71da2d0e524 req-94e9b24a-ec44-4a1f-950f-f7470c55f4fa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:36.609785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:36.610465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:36.611066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:36.612162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:36.612770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:36.613393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:36.696463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-cedc5863-f51e-47b2-b9e7-f71da2d0e524 req-94e9b24a-ec44-4a1f-950f-f7470c55f4fa service nova] Creating event network-vif-deleted:790506d8-862b-46a5-81db-c957db76a895 for instance 63309760-3556-4d65-9f7e-1e8a7323c102 on n-h1-860863-4 Nov 02 21:50:36.715232 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-cedc5863-f51e-47b2-b9e7-f71da2d0e524 req-94e9b24a-ec44-4a1f-950f-f7470c55f4fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139615 Nov 02 21:50:36.717196 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2596/5291] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:36.834903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9ea3faf-60df-4ae8-952d-cc4966fac851 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1212386877", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9ea3faf-60df-4ae8-952d-cc4966fac851 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 243 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1212386877", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1212386877', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '232e989f-e611-4c78-b23a-341996c6c8e4'}]}}} Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:36.844991 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9ea3faf-60df-4ae8-952d-cc4966fac851 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9ea3faf-60df-4ae8-952d-cc4966fac851 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.016640 Nov 02 21:50:36.853899 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2597/5292] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:36 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:50:36.863794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2170992b-aa7c-4ef5-83eb-442dcab5afa2 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:36.864414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2170992b-aa7c-4ef5-83eb-442dcab5afa2 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: a04da394-d1a2-454d-951a-995f001d22ab] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:36.885863 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2170992b-aa7c-4ef5-83eb-442dcab5afa2 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] HTTP exception thrown: Instance a04da394-d1a2-454d-951a-995f001d22ab could not be found. Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2170992b-aa7c-4ef5-83eb-442dcab5afa2 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/a04da394-d1a2-454d-951a-995f001d22ab/metadata HTTP/1.1 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance a04da394-d1a2-454d-951a-995f001d22ab could not be found. Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': 'a04da394-d1a2-454d-951a-995f001d22ab'} Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a04da394-d1a2-454d-951a-995f001d22ab could not be found. Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a04da394-d1a2-454d-951a-995f001d22ab could not be found. Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:36.906585 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:36.910326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:36.910326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:36.910326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a04da394-d1a2-454d-951a-995f001d22ab could not be found. Nov 02 21:50:36.910326 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:36.910326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2170992b-aa7c-4ef5-83eb-442dcab5afa2 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 404 to user: Instance a04da394-d1a2-454d-951a-995f001d22ab could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:36.910326 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2170992b-aa7c-4ef5-83eb-442dcab5afa2 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/a04da394-d1a2-454d-951a-995f001d22ab/metadata" status: 404 len: 111 microversion: 2.1 time: 0.052276 Nov 02 21:50:36.911188 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2598/5293] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Nov 2 21:50:36 2022] GET /compute/v2.1/servers/a04da394-d1a2-454d-951a-995f001d22ab/metadata => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:50:36.947153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:36.957110 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d39e69a-c0da-405f-80a1-fd14abeeb04f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.361691 Nov 02 21:50:36.969286 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2696/5294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:36 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:37.002180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6943ee1b-26b3-4041-9815-c79735c6bf86 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1523087766", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6943ee1b-26b3-4041-9815-c79735c6bf86 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 499 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1523087766", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1523087766', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '232e989f-e611-4c78-b23a-341996c6c8e4'}]}}} Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:50:37.008687 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6943ee1b-26b3-4041-9815-c79735c6bf86 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6943ee1b-26b3-4041-9815-c79735c6bf86 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.013069 Nov 02 21:50:37.016599 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2599/5295] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:36 2022] POST /compute/v2.1/servers => generated 687 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:37.084393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:37.084393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:37.086820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:37.087485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:37.089407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:37.090351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:37.092617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:37.093493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:37.129491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a24dbfb-dbf3-4f97-bfaf-cc476d92836c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2015090566", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a24dbfb-dbf3-4f97-bfaf-cc476d92836c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 500 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2015090566", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2015090566', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '232e989f-e611-4c78-b23a-341996c6c8e4'}]}}} Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:50:37.147689 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a24dbfb-dbf3-4f97-bfaf-cc476d92836c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a24dbfb-dbf3-4f97-bfaf-cc476d92836c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.022973 Nov 02 21:50:37.157117 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2600/5296] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:37 2022] POST /compute/v2.1/servers => generated 689 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:37.549588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-989793062", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "5649331c-1413-4234-95ca-70239c22e815"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:37.626281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] validate_networks() for [('5649331c-1413-4234-95ca-70239c22e815', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:50:38.133257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:38.155288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:38.159757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:38.165618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ece4f13-7c02-49f7-8072-7efdcb503fb3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 1.091442 Nov 02 21:50:38.167716 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2697/5297] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:37 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:38.194466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0dca112-fc8d-470c-a6d2-e8f48f2d07a9 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-607307811", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0dca112-fc8d-470c-a6d2-e8f48f2d07a9 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 753 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-607307811", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-607307811', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '232e989f-e611-4c78-b23a-341996c6c8e4'}]}}} Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:38.205084 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:38.207515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:38.211396 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:38.211396 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.211396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0dca112-fc8d-470c-a6d2-e8f48f2d07a9 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:38.211396 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0dca112-fc8d-470c-a6d2-e8f48f2d07a9 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024172 Nov 02 21:50:38.214551 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2698/5298] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:38 2022] POST /compute/v2.1/servers => generated 1197 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 21:50:38.238298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:38.241426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:38.262750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.264953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.265435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:38.267612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.268106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.268667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:38.325716 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 HTTP/1.1 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '63309760-3556-4d65-9f7e-1e8a7323c102'} Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:38.330021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.337194 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:38.337194 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:38.337194 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:38.337194 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:38.337194 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:38.337194 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:50:38.337194 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:38.338380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:38.340066 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-30af427f-e71e-4383-b981-1963442c63eb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 404 len: 111 microversion: 2.1 time: 0.122449 Nov 02 21:50:38.341852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2699/5299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:38 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:50:38.363557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:38.364616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:38.399288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.401593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.403689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:38.409216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.409216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.409216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:38.778400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:38.787648 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7166f5b1-88c6-4858-8de9-6d8f601c5a71 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.444524 Nov 02 21:50:38.788238 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2700/5300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:38 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:38.811638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:38.812453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:38.820083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.820583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.821056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:38.821766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.822408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.823109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:38.932107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:50:38.932656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:50:38.933192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:50:38.935521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:50:38.939179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:50:38.960319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.963298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.966069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:38.969698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:38.970669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:38.974591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.057180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Getting quotas for project c0a2fbb5fb7d45f4acc040693bb00a3c. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:50:39.092863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Getting quotas for user 165f79a08a9942148b2d59d79ac543ec and project c0a2fbb5fb7d45f4acc040693bb00a3c. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:50:39.097810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:39.106642 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e07dcec9-0a44-47a5-b567-49af61230d12 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.302356 Nov 02 21:50:39.110394 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2701/5301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:38 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:39.117255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:50:39.119981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:50:39.148262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d08cc2d-1509-48e3-b8c4-3ac7cc1a35e5 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1300050586", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d08cc2d-1509-48e3-b8c4-3ac7cc1a35e5 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 1266 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1300050586", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "232e989f-e611-4c78-b23a-341996c6c8e4"}]}} Nov 02 21:50:39.163340 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1300050586', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '232e989f-e611-4c78-b23a-341996c6c8e4'}]}}} Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.165126 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:39.166869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:39.168379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 21:50:39.168379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.168379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d08cc2d-1509-48e3-b8c4-3ac7cc1a35e5 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:39.168379 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d08cc2d-1509-48e3-b8c4-3ac7cc1a35e5 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.035155 Nov 02 21:50:39.168379 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2702/5302] 10.222.0.25 () {60 vars in 1148 bytes} [Wed Nov 2 21:50:39 2022] POST /compute/v2.1/servers => generated 2221 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 21:50:39.176654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f286104a-24c0-4b1d-9e26-f1021430da1b req-b0764cb0-7eb6-4aa8-ad31-581dd4ce1ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "632c5b67-1b8c-48e2-98df-d4c4c5061d2a", "tag": "b3bc9654-dbdd-465b-97a7-200f8adc2106"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:39.187476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f286104a-24c0-4b1d-9e26-f1021430da1b req-b0764cb0-7eb6-4aa8-ad31-581dd4ce1ba2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.188025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f286104a-24c0-4b1d-9e26-f1021430da1b req-b0764cb0-7eb6-4aa8-ad31-581dd4ce1ba2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.188651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f286104a-24c0-4b1d-9e26-f1021430da1b req-b0764cb0-7eb6-4aa8-ad31-581dd4ce1ba2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.200456 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f286104a-24c0-4b1d-9e26-f1021430da1b req-b0764cb0-7eb6-4aa8-ad31-581dd4ce1ba2 service nova] Creating event network-changed:b3bc9654-dbdd-465b-97a7-200f8adc2106 for instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a on n-h2-860863-4 Nov 02 21:50:39.207332 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f286104a-24c0-4b1d-9e26-f1021430da1b req-b0764cb0-7eb6-4aa8-ad31-581dd4ce1ba2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039915 Nov 02 21:50:39.207939 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2703/5303] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:39.220452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ac89dad-6b16-48aa-8618-fe6af5166a7b tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:39.220452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ac89dad-6b16-48aa-8618-fe6af5166a7b tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 21cc1b9b-10ab-453f-ac71-1452ef3abe69] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:39.229106 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9ac89dad-6b16-48aa-8618-fe6af5166a7b tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] HTTP exception thrown: Instance 21cc1b9b-10ab-453f-ac71-1452ef3abe69 could not be found. Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ac89dad-6b16-48aa-8618-fe6af5166a7b tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/21cc1b9b-10ab-453f-ac71-1452ef3abe69/metadata/test2 HTTP/1.1 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 21cc1b9b-10ab-453f-ac71-1452ef3abe69 could not be found. Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': '21cc1b9b-10ab-453f-ac71-1452ef3abe69', 'id': 'test2'} Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cc1b9b-10ab-453f-ac71-1452ef3abe69 could not be found. Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cc1b9b-10ab-453f-ac71-1452ef3abe69 could not be found. Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:39.230928 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:39.237676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:39.237676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:39.237676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cc1b9b-10ab-453f-ac71-1452ef3abe69 could not be found. Nov 02 21:50:39.237676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.237676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ac89dad-6b16-48aa-8618-fe6af5166a7b tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 404 to user: Instance 21cc1b9b-10ab-453f-ac71-1452ef3abe69 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:39.237676 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ac89dad-6b16-48aa-8618-fe6af5166a7b tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/21cc1b9b-10ab-453f-ac71-1452ef3abe69/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.022209 Nov 02 21:50:39.241963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2704/5304] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 21:50:39 2022] GET /compute/v2.1/servers/21cc1b9b-10ab-453f-ac71-1452ef3abe69/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:50:39.248678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:39.250532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:39.260091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.261002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.261675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.262588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.263199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.264500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.290244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:39.395503 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42ee017d-1fb0-4123-a75c-86567a959f75 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243403 Nov 02 21:50:39.397197 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2601/5305] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:50:39.402912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:39.403754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:39.415021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.415847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.416537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.417535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.418231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.418923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.460008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:50:39.460246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:39.485351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:39.489209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:39.490632 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bbe89810-fdc2-4b48-a8a3-42e4bcf7450b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.247128 Nov 02 21:50:39.491389 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2705/5306] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:39 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:39.496312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d50d3546-a9dd-4c36-83a9-aaa4e5dea2ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d50d3546-a9dd-4c36-83a9-aaa4e5dea2ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 163 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": 12345, "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 12345 Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:39.502189 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d50d3546-a9dd-4c36-83a9-aaa4e5dea2ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d50d3546-a9dd-4c36-83a9-aaa4e5dea2ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.012297 Nov 02 21:50:39.509586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2706/5307] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:39 2022] POST /compute/v2.1/servers => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:39.514800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a62daa9-abe4-459d-8800-00d66a9ba8b7 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:39.515495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a62daa9-abe4-459d-8800-00d66a9ba8b7 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:39.615689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a62daa9-abe4-459d-8800-00d66a9ba8b7 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:39.631344 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a62daa9-abe4-459d-8800-00d66a9ba8b7 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1227 microversion: 2.1 time: 0.122972 Nov 02 21:50:39.632322 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2707/5308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:39 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1227 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:39.660542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:39.660542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:39.675427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.676125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.680206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.681888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.687350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.687350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.875024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:39.881376 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7a88a904-5216-43ac-aed4-be5a8832d653 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.246789 Nov 02 21:50:39.881952 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2708/5309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:39 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:39.887144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:39.887959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:39.896165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.896862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.897468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:39.898533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:39.899204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:39.899772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:40.055907 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1cd6ddf-d144-4603-92c2-514ca7dea985 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 204 len: 0 microversion: 2.1 time: 0.655439 Nov 02 21:50:40.056964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2602/5310] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:50:39 2022] DELETE /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:50:40.064508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:40.071773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:40.076024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:40.087716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:40.088215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:40.088653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:40.089288 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eee39bed-16ac-4595-8ff0-9dd6d7591487 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.201184 Nov 02 21:50:40.089919 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2709/5311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:39 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:40.109378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:40.112859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:40.113938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:40.117384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:40.120392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:40.132821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:40.137381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:40.138218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:40.139063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:40.139681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:40.140219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:40.415186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:40.427687 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dafb7981-b5b5-4bb4-bf59-a39f68781f64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.368246 Nov 02 21:50:40.430354 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2603/5312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:40 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:40.454155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:40.469088 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d51196ea-352c-4c42-80f0-a689795d9d53 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1525 microversion: 2.1 time: 0.375774 Nov 02 21:50:40.481389 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2710/5313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:40 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1525 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:40.524824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:40.525563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:40.539437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:40.540318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:40.541009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:40.542563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:40.546175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:40.547008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:40.659608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-357820f8-f39b-43bf-9e1b-605b5118544c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:40.660609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-357820f8-f39b-43bf-9e1b-605b5118544c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:40.777910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-357820f8-f39b-43bf-9e1b-605b5118544c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:40.787740 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-357820f8-f39b-43bf-9e1b-605b5118544c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1227 microversion: 2.1 time: 0.133049 Nov 02 21:50:40.789251 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2711/5314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:40 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1227 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:40.823912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:40.832586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:40.834526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:40.835830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-82977494-76b2-41ac-9dac-ee1e04a910e4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.319288 Nov 02 21:50:40.844961 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2604/5315] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:40 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:41.115747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:41.130929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:41.130929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:41.130929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:41.130929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:41.130929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:41.130929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:41.130929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:41.367258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:41.385627 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3cca067c-f36a-414c-89cd-a7005a1ee679 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.270050 Nov 02 21:50:41.387782 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2712/5316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:41 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:41.507816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:41.509765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:41.543279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:41.555033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:41.558342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:41.562833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:41.563614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:41.564598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:41.813430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:41.814061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:41.828039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:41.828765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:41.831562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:41.834111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:41.835191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:41.836415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:42.068414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:42.083667 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9441d2d6-d661-4433-a192-0c8ef6eb0017 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1223 microversion: 2.1 time: 0.275477 Nov 02 21:50:42.087605 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2713/5317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:41 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1223 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:42.124183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:42.128496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:42.154205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:42.154731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:42.156898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:42.158748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:42.159263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:42.159732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:42.191650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:42.209945 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-11531c61-7c8f-47bc-ade7-bafa0fa3dae0 tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1525 microversion: 2.1 time: 0.718068 Nov 02 21:50:42.211165 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2605/5318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:41 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1525 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:42.418389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:42.419245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:42.433929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:42.434693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:42.437614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:42.444185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:42.444185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:42.444185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:42.686944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:42.710574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:42.712119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:42.713540 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8af6885b-8b18-4d4b-a9a7-7ebfdaa5d9c2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.627638 Nov 02 21:50:42.720185 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2714/5319] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:42 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:42.789140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:42.803234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab0f1353-fde1-4b2d-a780-7b7e25622502 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.394797 Nov 02 21:50:42.804074 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2606/5320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:42 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:43.080137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0dc899a5-3ec5-4cbe-9bdb-1f6e1ddd4bbb req-1a9cde77-3da0-4e00-afab-3035b41e65a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3430040c-34f2-444f-8da7-d2281759d76d", "name": "network-vif-deleted", "tag": "661dcbf8-a04d-489f-ab89-6e6b4d8c376d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:43.093631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0dc899a5-3ec5-4cbe-9bdb-1f6e1ddd4bbb req-1a9cde77-3da0-4e00-afab-3035b41e65a0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.095116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0dc899a5-3ec5-4cbe-9bdb-1f6e1ddd4bbb req-1a9cde77-3da0-4e00-afab-3035b41e65a0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.095621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0dc899a5-3ec5-4cbe-9bdb-1f6e1ddd4bbb req-1a9cde77-3da0-4e00-afab-3035b41e65a0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.114606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:43.115264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:43.120315 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0dc899a5-3ec5-4cbe-9bdb-1f6e1ddd4bbb req-1a9cde77-3da0-4e00-afab-3035b41e65a0 service nova] Creating event network-vif-deleted:661dcbf8-a04d-489f-ab89-6e6b4d8c376d for instance 3430040c-34f2-444f-8da7-d2281759d76d on n-h1-860863-4 Nov 02 21:50:43.131766 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0dc899a5-3ec5-4cbe-9bdb-1f6e1ddd4bbb req-1a9cde77-3da0-4e00-afab-3035b41e65a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059138 Nov 02 21:50:43.135535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2715/5321] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:43.135971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.135971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.136646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.137787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.138618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.139519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.251518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:43.252639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:43.261720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.262698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.264403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.265446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.266094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.266715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.297741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:43.314584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2548056a-bc2b-41c9-8640-26687adaf83b tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1287 microversion: 2.1 time: 0.205271 Nov 02 21:50:43.329279 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2607/5322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:43 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1287 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:43.408138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17fa727ca4e0408b987e39969df32b26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fec9f56cefa240d792aca26fc4fb7be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:43.423210 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5fbf1eb-1b32-4256-99ed-cae5a99ed83c tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 200 len: 1309 microversion: 2.1 time: 0.183521 Nov 02 21:50:43.437658 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2716/5323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:43 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:43.636759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bcc5dbb-62df-4450-8022-b1f09ef7b1ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1993016276", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "83a4cbf0-a1e9-4043-aebe-55d8ba4a6662", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:43.747243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:43.748127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:43.762840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.763810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.771191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.772003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.772447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.772883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.787889 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-7bcc5dbb-62df-4450-8022-b1f09ef7b1ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Block Device 83a4cbf0-a1e9-4043-aebe-55d8ba4a6662 is not bootable. Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bcc5dbb-62df-4450-8022-b1f09ef7b1ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 358 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1993016276", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "83a4cbf0-a1e9-4043-aebe-55d8ba4a6662", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: exception: Block Device 83a4cbf0-a1e9-4043-aebe-55d8ba4a6662 is not bootable. Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1993016276', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '83a4cbf0-a1e9-4043-aebe-55d8ba4a6662'}], 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 83a4cbf0-a1e9-4043-aebe-55d8ba4a6662 is not bootable. Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:43.803275 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 83a4cbf0-a1e9-4043-aebe-55d8ba4a6662 is not bootable. Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 83a4cbf0-a1e9-4043-aebe-55d8ba4a6662 is not bootable. Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7bcc5dbb-62df-4450-8022-b1f09ef7b1ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Block Device 83a4cbf0-a1e9-4043-aebe-55d8ba4a6662 is not bootable. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7bcc5dbb-62df-4450-8022-b1f09ef7b1ce tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.173658 Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2608/5324] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:43 2022] POST /compute/v2.1/servers => generated 110 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:43.816240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:43.828243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.828729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.829209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:43.829911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:43.830693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:43.831459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.080449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:44.093182 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0f0ae6fb-a9be-4335-8bc4-89fac80818e6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.283142 Nov 02 21:50:44.094277 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2609/5325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:43 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:44.101760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:44.102386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:44.106579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:44.110952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.111539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.111976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.112883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.113522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.114562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.142956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:44.153353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:44.159707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b45c1fa-d4a8-4739-9809-5de687432251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1745 microversion: 2.20 time: 0.412766 Nov 02 21:50:44.159707 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2717/5326] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:43 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1745 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:50:44.168429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:44.170278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:44.178339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.179138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.179791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.182224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.182928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.183572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.406519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:44.418588 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-999f64b6-4a6d-454d-b72d-fbff1dcff094 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.320886 Nov 02 21:50:44.419120 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2610/5327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:44 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:44.433997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:44.448329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d33b236e-0bc9-4820-8caa-0c7d68aab0a5 req-7c3be49d-8fd7-4465-b5c9-7b1b75dc1552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c5b67-1b8c-48e2-98df-d4c4c5061d2a", "name": "network-vif-plugged", "status": "completed", "tag": "b3bc9654-dbdd-465b-97a7-200f8adc2106"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:44.449912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96468347-c8fc-407e-82b8-18f9916d57a1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.285258 Nov 02 21:50:44.451385 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2718/5328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:44 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:44.461025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:44.469511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:44.478146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d33b236e-0bc9-4820-8caa-0c7d68aab0a5 req-7c3be49d-8fd7-4465-b5c9-7b1b75dc1552 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.480580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d33b236e-0bc9-4820-8caa-0c7d68aab0a5 req-7c3be49d-8fd7-4465-b5c9-7b1b75dc1552 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.481703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d33b236e-0bc9-4820-8caa-0c7d68aab0a5 req-7c3be49d-8fd7-4465-b5c9-7b1b75dc1552 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.485916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.486738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.492502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.492502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.492502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.492502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.508597 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d33b236e-0bc9-4820-8caa-0c7d68aab0a5 req-7c3be49d-8fd7-4465-b5c9-7b1b75dc1552 service nova] Creating event network-vif-plugged:b3bc9654-dbdd-465b-97a7-200f8adc2106 for instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a on n-h2-860863-4 Nov 02 21:50:44.522649 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d33b236e-0bc9-4820-8caa-0c7d68aab0a5 req-7c3be49d-8fd7-4465-b5c9-7b1b75dc1552 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092236 Nov 02 21:50:44.526936 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2611/5329] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:44.537209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:44.541739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] [instance: 3430040c-34f2-444f-8da7-d2281759d76d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:44.553665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.554171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.554614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.555325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:44.555783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:44.556216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:44.619986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] HTTP exception thrown: Instance 3430040c-34f2-444f-8da7-d2281759d76d could not be found. Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Request method failure captured: Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d HTTP/1.1 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuYUlbCToMlFq-KsdIrpCXlSs3OX0dVez3XT9KV5YwuMoXKsIAMRJ9nU-jJtiJTUydYg8lKx-NzAFRWvjERDwSoPkJTXwE8awww57SVMwIdfPSfumjQXsT2UHuKmqJW23uheFELarOc6tDsK982MaztN0R3S4VHGbrTFCxma_y_VFKA Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fec9f56cefa240d792aca26fc4fb7be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: fec9f56cefa240d792aca26fc4fb7be5 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570823902 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 17fa727ca4e0408b987e39969df32b26 Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570823902-project Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 3430040c-34f2-444f-8da7-d2281759d76d could not be found. Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '3430040c-34f2-444f-8da7-d2281759d76d'} Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3430040c-34f2-444f-8da7-d2281759d76d could not be found. Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3430040c-34f2-444f-8da7-d2281759d76d could not be found. Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:44.624417 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3430040c-34f2-444f-8da7-d2281759d76d could not be found. Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:44.628613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] Returning 404 to user: Instance 3430040c-34f2-444f-8da7-d2281759d76d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:44.630370 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa4bcd36-d2e2-46aa-94d0-a037690b03bf tempest-ServerMetadataNegativeTestJSON-1570823902 tempest-ServerMetadataNegativeTestJSON-1570823902-project] 10.222.0.25 "GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d" status: 404 len: 111 microversion: 2.1 time: 0.097671 Nov 02 21:50:44.633846 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2612/5330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:44 2022] GET /compute/v2.1/servers/3430040c-34f2-444f-8da7-d2281759d76d => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:50:44.665887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:44.680863 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d7f453f-81fb-4551-8291-11e45a4339bd tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1285 microversion: 2.1 time: 0.221662 Nov 02 21:50:44.681559 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2719/5331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:44 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:45.186791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:45.187410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:45.207012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:45.207012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:45.207012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:45.207012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:45.207012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:45.207012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:45.442112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:45.448014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:45.466951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:45.468920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:45.470054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:45.471017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:45.472344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:45.473056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:45.819279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:45.833109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:45.833718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:45.834946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b5f3fd91-7467-4ccb-8a0e-3269d95fa528 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1745 microversion: 2.20 time: 0.652677 Nov 02 21:50:45.835489 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2613/5332] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:45 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1745 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:45.855829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:45.855829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:45.870411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:45.870411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:45.870634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:45.871357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:45.871823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:45.872255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:45.892795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:45.909023 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-079080f9-2000-46d2-9198-93b03d0c0f1f tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1318 microversion: 2.1 time: 0.463097 Nov 02 21:50:45.909912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2720/5333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:45 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:46.143106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:46.158219 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8cb7ab3-2f98-45a3-8f23-4519dd83d2c0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1327 microversion: 2.1 time: 0.316509 Nov 02 21:50:46.159086 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2614/5334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:45 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1327 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:46.561555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ef904676-866f-4e2a-92c8-841910b315cc req-e1f71263-8c4b-41d9-9693-150423aa5dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "name": "network-vif-plugged", "status": "completed", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:46.593323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef904676-866f-4e2a-92c8-841910b315cc req-e1f71263-8c4b-41d9-9693-150423aa5dd6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:46.594147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef904676-866f-4e2a-92c8-841910b315cc req-e1f71263-8c4b-41d9-9693-150423aa5dd6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:46.595403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef904676-866f-4e2a-92c8-841910b315cc req-e1f71263-8c4b-41d9-9693-150423aa5dd6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:46.624895 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ef904676-866f-4e2a-92c8-841910b315cc req-e1f71263-8c4b-41d9-9693-150423aa5dd6 service nova] Creating event network-vif-plugged:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h2-860863-4 Nov 02 21:50:46.640185 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ef904676-866f-4e2a-92c8-841910b315cc req-e1f71263-8c4b-41d9-9693-150423aa5dd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085225 Nov 02 21:50:46.641638 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2721/5335] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:46.862571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:46.863241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:46.876108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:46.876608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:46.877250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:46.878015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:46.878474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:46.878903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:46.883367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:46.938075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:46.938787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:46.952198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:46.952708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:46.953183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:46.953904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:46.954393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:46.954826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:47.300489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:47.308708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:47.315379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:47.315379 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1bbdded9-ebb5-41dc-bba3-b65831fd1cdc tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.452998 Nov 02 21:50:47.315379 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2615/5336] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:46 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:47.316694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:47.317543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:47.341203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:47.341813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:47.342353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:47.343214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:47.345006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:47.345006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:47.440813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:47.455128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-866397e2-96fc-44f6-b1b0-574e8673ac52 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1508 microversion: 2.1 time: 0.521902 Nov 02 21:50:47.465342 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2722/5337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:46 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:47.726465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5b8da843-1f79-4a9a-9845-f0cccffbb488 req-6461f60e-e611-4a3d-b94f-4a74d1f71594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4546650d-0874-4353-9544-ffa72be974fb", "tag": "42c558d8-9eca-482f-b3cb-644f1bd4c4a3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:47.762378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b8da843-1f79-4a9a-9845-f0cccffbb488 req-6461f60e-e611-4a3d-b94f-4a74d1f71594 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:47.766500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b8da843-1f79-4a9a-9845-f0cccffbb488 req-6461f60e-e611-4a3d-b94f-4a74d1f71594 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:47.766958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5b8da843-1f79-4a9a-9845-f0cccffbb488 req-6461f60e-e611-4a3d-b94f-4a74d1f71594 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:47.809248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:47.823681 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ebc5caa-f6f5-416c-b924-8129ac42cde1 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1327 microversion: 2.1 time: 0.510453 Nov 02 21:50:47.826490 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2616/5338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:47 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1327 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:47.839082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9be5f67e-dfa7-461c-9372-ec33f753dda9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-729657087", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "612221e9-0156-4770-a8ac-3a978f4e721c", "destination_type": "local"}, {"source_type": "volume", "uuid": "e2aba0a9-2d04-4247-bf1a-d86a5f293625", "destination_type": "invalid"}], "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:47.844101 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5b8da843-1f79-4a9a-9845-f0cccffbb488 req-6461f60e-e611-4a3d-b94f-4a74d1f71594 service nova] Creating event network-changed:42c558d8-9eca-482f-b3cb-644f1bd4c4a3 for instance 4546650d-0874-4353-9544-ffa72be974fb on n-h1-860863-4 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9be5f67e-dfa7-461c-9372-ec33f753dda9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 494 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-729657087", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "612221e9-0156-4770-a8ac-3a978f4e721c", "destination_type": "local"}, {"source_type": "volume", "uuid": "e2aba0a9-2d04-4247-bf1a-d86a5f293625", "destination_type": "invalid"}], "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-729657087', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '612221e9-0156-4770-a8ac-3a978f4e721c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'e2aba0a9-2d04-4247-bf1a-d86a5f293625', 'destination_type': 'invalid'}], 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:47.855964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:47.860808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9be5f67e-dfa7-461c-9372-ec33f753dda9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:47.862599 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9be5f67e-dfa7-461c-9372-ec33f753dda9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.033227 Nov 02 21:50:47.863756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5b8da843-1f79-4a9a-9845-f0cccffbb488 req-6461f60e-e611-4a3d-b94f-4a74d1f71594 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144462 Nov 02 21:50:47.867179 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2723/5339] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:47.874828 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2617/5340] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:47 2022] POST /compute/v2.1/servers => generated 155 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:47.884887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:47.890427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:47.917280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:47.917280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:47.917280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:47.917784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:47.921606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:47.922071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:48.183316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:48.205359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d90b6c0-bad3-4260-8412-83272be392d6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.334162 Nov 02 21:50:48.206246 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2724/5341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:47 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:48.249602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:48.250708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:48.280221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:48.281352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:48.282318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:48.283055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:48.283517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:48.287699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:48.347458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:48.348149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:48.360837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:48.361526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:48.362912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:48.363802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:48.365411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:48.368123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:49.033404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:49.061540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:49.085149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-edf1e1f3-71e6-4dde-a56b-d21d9d043a32 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.849595 Nov 02 21:50:49.087888 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2618/5342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:48 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:49.096236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:49.097001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:49.123566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:49.124465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:49.128249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:49.130952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:49.131730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:49.132413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:49.133712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=14 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:49.150488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:49.169794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:49.172486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:49.177787 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f71d20e4-ab8b-415c-bf89-31fa0cd35366 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.834702 Nov 02 21:50:49.179974 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2725/5343] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:48 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:50:49.239325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f06454a-879a-4e72-a45e-77fa5df6d049 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83058062", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f06454a-879a-4e72-a45e-77fa5df6d049 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 490 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83058062", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-83058062', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:49.246957 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:49.251120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f06454a-879a-4e72-a45e-77fa5df6d049 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:49.254548 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f06454a-879a-4e72-a45e-77fa5df6d049 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014850 Nov 02 21:50:49.255099 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2726/5344] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:49 2022] POST /compute/v2.1/servers => generated 624 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:50:49.267726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:49.269776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:49.305018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:49.307991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:49.308494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:49.309248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:49.309720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:49.321075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:49.792380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:49.819239 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-920d5643-f737-4497-a922-81929f039311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.555820 Nov 02 21:50:49.828311 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2727/5345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:49 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:49.857169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:49.857805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:49.886309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:49.887605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:49.889649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:49.892804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:49.894802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:49.897573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:49.925233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:49.958351 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b941f77e-9c5f-4d6b-bb36-702eb0c97eb2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1327 microversion: 2.1 time: 0.847173 Nov 02 21:50:49.971748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2619/5346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:49 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1327 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:49.985654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:50.207925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:50.209121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:50.228449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:50.228972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:50.229424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:50.230181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:50.230918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:50.231617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:50.789643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:50:51.364576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:51.374543 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6c76fdf-bb57-4946-9b3d-db9ff5d333dd tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 1.522503 Nov 02 21:50:51.399876 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2728/5347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:49 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:51.425393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:51.426281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:51.460813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:51.461985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:51.462440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:51.464550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:51.467688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:51.470445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:51.484694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:51.503167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:51.506070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:51.510204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c46a9151-477a-4aed-8a54-073f63768a80 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 1.306187 Nov 02 21:50:51.514264 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2620/5348] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:50 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:50:51.594445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e49f2613-920a-45c3-8b82-ce030f827720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e49f2613-920a-45c3-8b82-ce030f827720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 416 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:51.602076 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:50:51.605813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:51.611772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e49f2613-920a-45c3-8b82-ce030f827720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:51.615431 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e49f2613-920a-45c3-8b82-ce030f827720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.026507 Nov 02 21:50:51.617701 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2621/5349] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:51 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:51.627230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:51.628446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:51.636893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:51.637638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:51.638897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:51.639780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:51.640665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:51.641454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:51.982984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:51.995170 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c626a5f-a897-4297-82cd-a5408090a057 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1327 microversion: 2.1 time: 0.594200 Nov 02 21:50:52.016959 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2729/5350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:51 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1327 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:52.134094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:52.153186 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8f68c203-7883-4f18-b715-e46471013425 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.525431 Nov 02 21:50:52.158493 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2622/5351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:51 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:52.179509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:52.180258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:52.211258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:52.212103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:52.225329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:52.226196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:52.233624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:52.234281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:52.543978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:52.545549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:52.555866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:52.565361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:52.570423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:52.574862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:52.574862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:52.574862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:52.578063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:52.586482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c6ab5c0-ec49-492b-a11e-f506821607e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.411066 Nov 02 21:50:52.599064 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2730/5352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:52 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:52.694847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16aa9fb4-938a-4e81-8b8d-0d0a90bee874 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-906475431", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": -1, "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:52.733004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-16aa9fb4-938a-4e81-8b8d-0d0a90bee874 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Flavor -1 could not be found. Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16aa9fb4-938a-4e81-8b8d-0d0a90bee874 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 205 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-906475431", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": -1, "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: exception: Flavor -1 could not be found. Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-906475431', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': -1, 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:52.744533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16aa9fb4-938a-4e81-8b8d-0d0a90bee874 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:52.748215 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16aa9fb4-938a-4e81-8b8d-0d0a90bee874 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.056984 Nov 02 21:50:52.756759 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2731/5353] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:52 2022] POST /compute/v2.1/servers => generated 73 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 21:50:52.781844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:52.782464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:52.791224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:52.791709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:52.792660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:52.793878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:52.794971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:52.809441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:52.898615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:52.910903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:52.921629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:52.929584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-23851570-dca6-42d2-b80d-c180af15db44 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.383335 Nov 02 21:50:52.932431 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2623/5354] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:52 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:53.030232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:53.030828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:53.039987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:53.040696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:53.042039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:53.043494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:53.047479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:53.048109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:53.376400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:53.396266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fd2cbb8-9d44-49d4-ad49-ffbd715942f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.628418 Nov 02 21:50:53.409781 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2732/5355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:52 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:53.424992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:53.425905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:53.436955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:53.437771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:53.438437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:53.439504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:53.440164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:53.440770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:53.506523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:53.522544 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97035f8e-929f-49e6-bb05-83a4bca3b0e4 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1327 microversion: 2.1 time: 0.495214 Nov 02 21:50:53.524196 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2624/5356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:53 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1327 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:53.748159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:53.773750 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c81dbd05-a056-473f-9c07-a86091b5df69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.354577 Nov 02 21:50:53.779306 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2733/5357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:53 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:53.879593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d49332f2-29e1-4022-b954-59d40d881311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2026389333", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d49332f2-29e1-4022-b954-59d40d881311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 173 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2026389333", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2026389333', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi -1 Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:50:53.884736 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d49332f2-29e1-4022-b954-59d40d881311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:53.889365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d49332f2-29e1-4022-b954-59d40d881311 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.012608 Nov 02 21:50:53.893542 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2625/5358] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:53 2022] POST /compute/v2.1/servers => generated 145 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:53.898418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:53.899227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:53.914518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:53.915301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:53.915901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:53.919036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:53.920341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:53.923508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:53.972596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:53.982544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:53.999798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:54.004361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:54.006283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:54.009272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:54.015845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:54.016477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:54.303087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:54.314948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7428bc2f-de53-4999-b3c3-31737d571d01 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.419149 Nov 02 21:50:54.317010 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2734/5359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:53 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:54.336431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-544e6481-306c-4c46-9226-ad54f260b1a0 req-72745ee3-b6a8-4919-9248-5fe5038659dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4546650d-0874-4353-9544-ffa72be974fb", "name": "network-vif-plugged", "status": "completed", "tag": "42c558d8-9eca-482f-b3cb-644f1bd4c4a3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:54.370089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-544e6481-306c-4c46-9226-ad54f260b1a0 req-72745ee3-b6a8-4919-9248-5fe5038659dd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:54.373503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-544e6481-306c-4c46-9226-ad54f260b1a0 req-72745ee3-b6a8-4919-9248-5fe5038659dd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:54.375935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-544e6481-306c-4c46-9226-ad54f260b1a0 req-72745ee3-b6a8-4919-9248-5fe5038659dd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:54.406901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-544e6481-306c-4c46-9226-ad54f260b1a0 req-72745ee3-b6a8-4919-9248-5fe5038659dd service nova] Creating event network-vif-plugged:42c558d8-9eca-482f-b3cb-644f1bd4c4a3 for instance 4546650d-0874-4353-9544-ffa72be974fb on n-h1-860863-4 Nov 02 21:50:54.431538 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-544e6481-306c-4c46-9226-ad54f260b1a0 req-72745ee3-b6a8-4919-9248-5fe5038659dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112421 Nov 02 21:50:54.437810 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2735/5360] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:50:54.483260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:54.491420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:54.528053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:54.529414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:54.530383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:54.531284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:54.531859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:54.534379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:54.564411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:54.584027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:54.585517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:54.600865 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3151287-bb55-4571-b57e-ecd1b1a0402a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.639264 Nov 02 21:50:54.617597 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2626/5361] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:53 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:54.629222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:54.630032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:54.644548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:54.645989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:54.650270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:54.652017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:54.653443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:54.655427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:54.917713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:54.929689 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eaae7d4c-4447-4033-ab8e-7aa2a584a41c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.490515 Nov 02 21:50:54.930293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2736/5362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:54 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:55.018717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1965aeec-dc00-4818-bf0e-840c97fbab65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-793509541", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:55.024207 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-1965aeec-dc00-4818-bf0e-840c97fbab65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1965aeec-dc00-4818-bf0e-840c97fbab65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 215 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-793509541", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-793509541', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:50:55.036108 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:55.040751 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:50:55.040751 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:50:55.040751 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:50:55.040751 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:50:55.040751 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:50:55.040751 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 21:50:55.040751 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:50:55.043476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1965aeec-dc00-4818-bf0e-840c97fbab65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:50:55.044548 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1965aeec-dc00-4818-bf0e-840c97fbab65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.029834 Nov 02 21:50:55.056685 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2737/5363] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:55 2022] POST /compute/v2.1/servers => generated 123 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:50:55.065071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:55.071132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:55.086714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:55.087463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:55.088246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:55.089196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:55.089812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:55.090410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:55.117688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:55.134495 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-afe97c98-2d93-4e77-b750-9a0c626f7705 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1327 microversion: 2.1 time: 0.514750 Nov 02 21:50:55.161730 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2627/5364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:54 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1327 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:55.378823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:55.388185 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7392b57-37b4-44e2-aac6-7c67769755aa tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.326726 Nov 02 21:50:55.389278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2738/5365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:55 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:50:55.415663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:55.417048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:55.430197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:55.431484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:55.432712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:55.434646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:55.436138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:55.437398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:55.632676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:55.633560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:55.655470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:55.659164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:55.661576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:55.663951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:55.666793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:55.672776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:55.915154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:55.929853 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6470472b-7e88-4056-9cab-92bf29e688f3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.518135 Nov 02 21:50:55.931218 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2628/5366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:55 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:56.039953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c5cf3dd-fa0b-4cb4-8c85-b2eba3d0c7f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1050078890", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-key-1610999178", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:50:56.242967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:56.255996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:56.258064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:56.259599 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79baefdb-ba55-4301-a829-507a90f13f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.631342 Nov 02 21:50:56.277868 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2739/5367] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:55 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:50:56.289653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:56.290290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:56.298651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:56.299727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:56.300655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:56.301530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:56.302394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:56.302838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:56.630878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:56.643929 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c482df14-784c-47a2-a108-1449325d61b2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1327 microversion: 2.1 time: 0.363941 Nov 02 21:50:56.645433 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2740/5368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:56 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1327 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:57.291042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:57.291665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:57.309020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:57.309020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:57.309268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:57.325793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:57.326300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:57.326800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:57.694333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:57.707471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:57.708785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:57.710695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-623df226-ea26-4b3c-974b-0102e5e8b9cb tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.424473 Nov 02 21:50:57.725126 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2741/5369] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:57 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:50:57.725126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:57.725126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:57.725861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:57.726692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:57.732903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:57.734186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:57.734935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:57.735595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:58.250246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:58.267670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cfb7b490-c741-4ebc-b72f-e813e61e3740 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1526 microversion: 2.1 time: 0.548541 Nov 02 21:50:58.288183 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2742/5370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:57 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1526 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:58.306727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:58.310358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:58.334525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:58.335011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:58.335509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:58.336305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:58.347326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:58.347916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:59.382496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:59.400361 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6285b0c1-4f17-4fcc-8b1f-3c316e588663 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1526 microversion: 2.1 time: 1.106635 Nov 02 21:50:59.401427 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2743/5371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:50:58 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1526 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:50:59.417501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:50:59.420953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:50:59.434439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:59.436766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:59.440910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:59.442103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:50:59.442861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:50:59.443535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:50:59.797747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:59.810458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:59.826493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:50:59.826493 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-75e650ec-aabb-4093-8d39-e11d215470b4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.409742 Nov 02 21:50:59.826493 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2744/5372] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:50:59 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:00.409021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:00.409661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:00.424795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.425412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.425860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:00.431443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.435594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.436081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] HTTP exception thrown: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Request method failure captured: Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb HTTP/1.1 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuYspa3CM3ydLA7TMlVQJnq_C5iUhS76Pn382Q6NtoJRMmrNX2olnTLeOGiXHY4x99elGPoh_HvxQpla_vlDA7WE6Bz4uCFf3GPlxHos-zaWN1M1uH2Bih4iAJGfRWgFLN8AXAAlbYVikwlAJSB-zVzgzAlfzP_QSpWPMPL0Ajx1xcA Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: f4b32f5e792649c2b7fd4d49b17da161 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1413102496 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1413102496 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: f4b32f5e792649c2b7fd4d49b17da161 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1413102496 Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1413102496-project Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 3560c539f38341b6bace42a3ed2f84af Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1413102496-project Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4546650d-0874-4353-9544-ffa72be974fb'} Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:51:00.480233 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.484718 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.486874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Returning 404 to user: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:00.488385 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e7f878b-c238-413e-a4e4-cee2c83ee8ef tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 404 len: 111 microversion: 2.1 time: 0.673661 Nov 02 21:51:00.489552 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2745/5373] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:50:59 2022] DELETE /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 111 bytes in 675 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:00.502442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:00.503735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:00.511687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.515021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.515021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:00.515021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.515021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.515676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:00.785814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:00.796548 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa581fa4-d550-4b0b-8984-f37ae6751d77 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1526 microversion: 2.1 time: 0.301194 Nov 02 21:51:00.797420 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2746/5374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:00 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1526 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:00.827030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Action: 'update', calling method: >, body: {"server": {"name": "4546650d-0874-4353-9544-ffa72be974fb_new"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:00.830726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:00.843098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.844234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.844989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:00.845871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.846936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.847693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:00.900105 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] HTTP exception thrown: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Request method failure captured: Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb HTTP/1.1 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 64 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuYspa3CM3ydLA7TMlVQJnq_C5iUhS76Pn382Q6NtoJRMmrNX2olnTLeOGiXHY4x99elGPoh_HvxQpla_vlDA7WE6Bz4uCFf3GPlxHos-zaWN1M1uH2Bih4iAJGfRWgFLN8AXAAlbYVikwlAJSB-zVzgzAlfzP_QSpWPMPL0Ajx1xcA Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: f4b32f5e792649c2b7fd4d49b17da161 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1413102496 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f4b32f5e792649c2b7fd4d49b17da161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1413102496 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: f4b32f5e792649c2b7fd4d49b17da161 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1413102496 Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1413102496-project Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 3560c539f38341b6bace42a3ed2f84af Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1413102496-project Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "4546650d-0874-4353-9544-ffa72be974fb_new"}} Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4546650d-0874-4353-9544-ffa72be974fb', 'body': {'server': {'name': '4546650d-0874-4353-9544-ffa72be974fb_new'}}} Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:00.906911 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:00.911382 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:00.916768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] Returning 404 to user: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:00.924817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ade83d3-5dff-4c1f-b9f0-a7c7d72a0431 tempest-ServersNegativeTestMultiTenantJSON-1413102496 tempest-ServersNegativeTestMultiTenantJSON-1413102496-project] 10.222.0.25 "PUT /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 404 len: 111 microversion: 2.1 time: 0.106660 Nov 02 21:51:00.934158 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2747/5375] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:51:00 2022] PUT /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:00.955260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:00.955895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:00.970776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:00.988081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.989985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.991868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:00.993981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:00.994468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:00.994906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:01.511155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:01.516442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:01.530485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:01.536142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:01.545487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9ba0d8e-27f4-4643-8414-b6233ba3d2a9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.593402 Nov 02 21:51:01.545766 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2748/5376] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:00 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:01.555708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:01.556210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:01.570516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:01.571358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:01.572149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:01.573486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:01.574117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:01.574558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:01.657891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:51:02.043993 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-241056cd-b36f-4d0e-8589-a855c14008f2 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 204 len: 0 microversion: 2.1 time: 0.496351 Nov 02 21:51:02.052182 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2749/5377] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:51:01 2022] DELETE /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:51:02.070536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:02.076105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:02.095233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:02.098651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:02.100371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:02.101733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:02.106734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:02.106734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:02.708355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:02.722147 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1feb227-9546-403f-a302-61dbf01e2f2a tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1532 microversion: 2.1 time: 0.666685 Nov 02 21:51:02.723905 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2750/5378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:02 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1532 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:02.731350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:02.732253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:02.753217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:02.753981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:02.754597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:02.755474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:02.756192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:02.756802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:03.158024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:03.166808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:03.168719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:03.171187 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f406ef8c-91ec-46ea-9437-bd9b0584aa6a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.445738 Nov 02 21:51:03.185637 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2751/5379] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:02 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:03.756764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:03.757755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:03.772197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:03.773654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:03.774325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:03.775634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:03.778245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:03.782856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:04.204504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:04.221855 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15006211-6711-44e3-b1c4-cd845e9bf54c tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1532 microversion: 2.1 time: 0.469024 Nov 02 21:51:04.223250 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2752/5380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:03 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1532 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:04.232309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:04.235086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:04.246533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:04.248666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:04.249397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:04.250355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:04.251046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:04.251711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:04.827505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:04.839166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:04.843311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:04.847783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aabb1076-1052-4938-bbef-530bf864cd9b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.621531 Nov 02 21:51:04.857349 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2753/5381] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:04 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:04.870037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2fa58417-7580-481d-aac3-0303bed78212 req-a1624ee2-7a49-4b34-a18d-d3bb2f6537d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4546650d-0874-4353-9544-ffa72be974fb", "name": "network-vif-deleted", "tag": "42c558d8-9eca-482f-b3cb-644f1bd4c4a3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:04.881420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2fa58417-7580-481d-aac3-0303bed78212 req-a1624ee2-7a49-4b34-a18d-d3bb2f6537d1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:04.882180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2fa58417-7580-481d-aac3-0303bed78212 req-a1624ee2-7a49-4b34-a18d-d3bb2f6537d1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:04.882844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2fa58417-7580-481d-aac3-0303bed78212 req-a1624ee2-7a49-4b34-a18d-d3bb2f6537d1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:04.909860 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2fa58417-7580-481d-aac3-0303bed78212 req-a1624ee2-7a49-4b34-a18d-d3bb2f6537d1 service nova] Creating event network-vif-deleted:42c558d8-9eca-482f-b3cb-644f1bd4c4a3 for instance 4546650d-0874-4353-9544-ffa72be974fb on n-h1-860863-4 Nov 02 21:51:04.915460 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2fa58417-7580-481d-aac3-0303bed78212 req-a1624ee2-7a49-4b34-a18d-d3bb2f6537d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056793 Nov 02 21:51:04.931662 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2754/5382] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:51:05.245821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:05.246827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:05.258823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:05.264676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:05.265549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:05.266476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:05.267593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:05.268202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:05.363022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:05.367750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:05.369946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:05.370828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lazy-loading 'fault' on Instance uuid 4546650d-0874-4353-9544-ffa72be974fb {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:51:05.527867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f79a08a9942148b2d59d79ac543ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a2fbb5fb7d45f4acc040693bb00a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:05.538067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa5af6ed-6953-47da-955e-560fef0aaaa0 tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 200 len: 1317 microversion: 2.1 time: 0.296765 Nov 02 21:51:05.561376 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2755/5383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:05 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:05.877438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:05.878086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:05.888662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:05.892375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:05.892375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:05.892375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:05.892375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:05.892375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:05.926286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=64 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:06.111817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:06.347443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:06.364376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:06.367281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:06.370077 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19db1634-f137-4228-8d99-056a1dc8bc20 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.497601 Nov 02 21:51:06.380980 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2756/5384] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:05 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:06.569618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:06.570755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] [instance: 4546650d-0874-4353-9544-ffa72be974fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:06.580425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:06.581271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:06.582526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:06.583844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:06.584383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:06.585272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:06.608359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] HTTP exception thrown: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Request method failure captured: Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb HTTP/1.1 Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuYgiXap2HtB7ZRklAsSGy9_mPqTa0F8cKydXx8iyA7AKSkvCaOMeD-Y4hzBWS34qaaMqKqdGdB8_BuMVn0fT3RGUw59Z_Dmef158X7AHzwKvqxUEmXEkK24akHbnoWt8dFQxwSLbPZ8H6C_wUIDtLQN-mfCXIExnTD8TPhzs-qoz1Q Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: c0a2fbb5fb7d45f4acc040693bb00a3c Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1196205193 Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c0a2fbb5fb7d45f4acc040693bb00a3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c0a2fbb5fb7d45f4acc040693bb00a3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c0a2fbb5fb7d45f4acc040693bb00a3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c0a2fbb5fb7d45f4acc040693bb00a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1196205193 Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: c0a2fbb5fb7d45f4acc040693bb00a3c Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1196205193 Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1196205193-project Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 165f79a08a9942148b2d59d79ac543ec Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1196205193-project Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4546650d-0874-4353-9544-ffa72be974fb'} Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:06.610532 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] Returning 404 to user: Instance 4546650d-0874-4353-9544-ffa72be974fb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5662ac0a-a624-4a1f-be60-72c3d77135ce tempest-ServersNegativeTestMultiTenantJSON-1196205193 tempest-ServersNegativeTestMultiTenantJSON-1196205193-project] 10.222.0.25 "GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb" status: 404 len: 111 microversion: 2.1 time: 0.047598 Nov 02 21:51:06.614880 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2757/5385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:06 2022] GET /compute/v2.1/servers/4546650d-0874-4353-9544-ffa72be974fb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:51:07.399154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:07.403211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:07.427142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:07.427630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:07.430359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:07.432244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:07.432954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:07.438739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:08.640962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:08.665645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:08.673124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:08.674808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-522eaa77-fe4f-4765-8162-24eeee23d38d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 1.279519 Nov 02 21:51:08.679295 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2758/5386] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:07 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:51:09.710418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:09.711890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:09.731670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:09.732557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:09.733275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:09.734182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:09.734644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:09.735087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:10.201327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:10.254253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:10.261722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:10.264191 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b57e4e3a-5665-4e30-a59c-00751faf4f45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.559116 Nov 02 21:51:10.264770 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2759/5387] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:09 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:11.006602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-6c5cf3dd-fa0b-4cb4-8c85-b2eba3d0c7f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] validate_networks() for [('6dec2748-3171-417e-ae2c-73a937da2291', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:51:11.326505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:11.327229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:11.339487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:11.340003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:11.340451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:11.344603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:11.346427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:11.348629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:12.132191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:12.152375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:12.153962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:12.155313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b146d0d3-5dda-4767-baa0-d037585238a0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1740 microversion: 2.20 time: 0.833313 Nov 02 21:51:12.155882 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2760/5388] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:11 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1740 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-6c5cf3dd-fa0b-4cb4-8c85-b2eba3d0c7f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Invalid key_name provided. Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c5cf3dd-fa0b-4cb4-8c85-b2eba3d0c7f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 247 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1050078890", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-key-1610999178", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid key_name provided. Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1050078890', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'key_name': 'tempest-key-1610999178', 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1610999178 not found for user 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:12.233710 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 02 21:51:12.237812 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:12.260580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c5cf3dd-fa0b-4cb4-8c85-b2eba3d0c7f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid key_name provided. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:12.262444 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c5cf3dd-fa0b-4cb4-8c85-b2eba3d0c7f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 16.226867 Nov 02 21:51:12.266833 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2629/5389] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:50:56 2022] POST /compute/v2.1/servers => generated 70 bytes in 16232 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 21:51:12.276687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:12.277576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:12.289412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:12.289925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:12.290600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:12.291092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:12.291547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:12.297657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:13.215431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:13.216622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:13.241552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:13.243750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:13.250531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:13.253363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:13.260219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:13.261411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:13.262313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98146a59-4949-469e-b787-4105eda26044 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.990952 Nov 02 21:51:13.265741 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2761/5390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:12 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:13.266860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:13.289714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:13.291177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:13.316220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:13.320551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:13.325736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:13.328217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:13.335408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:13.336454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:14.282778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:14.297120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:14.302492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:14.304031 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5cd91889-9a82-4415-aab0-237b6914f7d1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1722 microversion: 2.20 time: 1.110889 Nov 02 21:51:14.310846 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2630/5391] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:13 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1722 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:14.366085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:14.375266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89e1069e-1575-4e5e-b8a6-9756c9b51308 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 1.090195 Nov 02 21:51:14.383823 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2762/5392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:13 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:14.563372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-901fbd0b-b3d2-4aaf-b794-b44e3b92ef3c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1840263993", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:14.750760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.security_group_api [None req-901fbd0b-b3d2-4aaf-b794-b44e3b92ef3c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Neutron security group does_not_exist not found {{(pid=121039) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 02 21:51:14.751642 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-901fbd0b-b3d2-4aaf-b794-b44e3b92ef3c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-901fbd0b-b3d2-4aaf-b794-b44e3b92ef3c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 258 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1840263993", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1840263993', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 02 21:51:14.786010 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:14.790298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-901fbd0b-b3d2-4aaf-b794-b44e3b92ef3c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:14.798651 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-901fbd0b-b3d2-4aaf-b794-b44e3b92ef3c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.230485 Nov 02 21:51:14.798651 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2631/5393] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:51:14 2022] POST /compute/v2.1/servers => generated 106 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:51:14.800826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:14.801584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:14.813892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:14.817803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:14.818211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:14.819379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:14.819522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:14.821415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:15.196428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:15.211590 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a13d03c5-ac19-416a-898a-52c6f8f72090 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.416468 Nov 02 21:51:15.213721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2763/5394] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:14 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:15.238244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:15.238839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:15.252494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:15.252909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:15.255574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:15.256318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:15.256785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:15.258990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:15.342598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:15.343224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:15.354247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:15.357683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:15.375245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:15.378786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:15.385850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:15.391172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:16.182470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:16.194007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24f3b6ae-8e12-4993-852e-88677d1b6e62 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.959554 Nov 02 21:51:16.205103 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2632/5395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:15 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:16.216590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7ff755e0-1b9e-440a-b8d4-8297ba1f0b3c req-11442d1a-2b1a-4b79-aa61-333e123e8742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "name": "network-vif-unplugged", "status": "completed", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:16.242952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ff755e0-1b9e-440a-b8d4-8297ba1f0b3c req-11442d1a-2b1a-4b79-aa61-333e123e8742 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:16.243595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ff755e0-1b9e-440a-b8d4-8297ba1f0b3c req-11442d1a-2b1a-4b79-aa61-333e123e8742 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:16.244356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ff755e0-1b9e-440a-b8d4-8297ba1f0b3c req-11442d1a-2b1a-4b79-aa61-333e123e8742 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:16.279037 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7ff755e0-1b9e-440a-b8d4-8297ba1f0b3c req-11442d1a-2b1a-4b79-aa61-333e123e8742 service nova] Creating event network-vif-unplugged:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h2-860863-4 Nov 02 21:51:16.297887 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7ff755e0-1b9e-440a-b8d4-8297ba1f0b3c req-11442d1a-2b1a-4b79-aa61-333e123e8742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089834 Nov 02 21:51:16.300871 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2633/5396] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:51:16.309081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd81e3d1-c30a-4f99-be4c-ebaf468121e9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:16.310878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bd81e3d1-c30a-4f99-be4c-ebaf468121e9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 9fe4f1ee-447f-4917-b382-a3028e9c9aef] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:16.328768 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-bd81e3d1-c30a-4f99-be4c-ebaf468121e9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 9fe4f1ee-447f-4917-b382-a3028e9c9aef could not be found. Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd81e3d1-c30a-4f99-be4c-ebaf468121e9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/9fe4f1ee-447f-4917-b382-a3028e9c9aef HTTP/1.1 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 9fe4f1ee-447f-4917-b382-a3028e9c9aef could not be found. Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9fe4f1ee-447f-4917-b382-a3028e9c9aef'} Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe4f1ee-447f-4917-b382-a3028e9c9aef could not be found. Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe4f1ee-447f-4917-b382-a3028e9c9aef could not be found. Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:16.334296 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe4f1ee-447f-4917-b382-a3028e9c9aef could not be found. Nov 02 21:51:16.338016 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:16.342907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bd81e3d1-c30a-4f99-be4c-ebaf468121e9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 9fe4f1ee-447f-4917-b382-a3028e9c9aef could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:16.344676 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bd81e3d1-c30a-4f99-be4c-ebaf468121e9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fe4f1ee-447f-4917-b382-a3028e9c9aef" status: 404 len: 111 microversion: 2.1 time: 0.042067 Nov 02 21:51:16.348154 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2634/5397] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:51:16 2022] DELETE /compute/v2.1/servers/9fe4f1ee-447f-4917-b382-a3028e9c9aef => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:16.366143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:16.369890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:16.381119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:16.383984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:16.385530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:16.387045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:16.387593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:16.388040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:16.714703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:16.718694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:16.725167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:16.733791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:16.738726 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2064bbc-e5df-42ff-9926-766526f76316 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1722 microversion: 2.20 time: 1.397484 Nov 02 21:51:16.738726 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2764/5398] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:15 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1722 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:16.774935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:16.783384 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-966c47f6-9ea1-43aa-ad75-4f83b1acc7ba tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.428955 Nov 02 21:51:16.786972 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2635/5399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:16 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:16.819534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:16.820223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:16.836405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:16.839085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:16.840375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:16.842367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:16.843147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:16.845840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:17.697557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:17.712520 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c64048c-e77b-4a92-a688-0d3db1b21f40 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.904849 Nov 02 21:51:17.713169 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2765/5400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:16 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:17.748080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac63a2db-3180-4d0e-b726-1ad531c63c4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac63a2db-3180-4d0e-b726-1ad531c63c4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Failed to fetch instance by id 9223372036854775808 {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-ac63a2db-3180-4d0e-b726-1ad531c63c4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac63a2db-3180-4d0e-b726-1ad531c63c4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 9223372036854775808 could not be found. Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '9223372036854775808'} Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:17.751141 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac63a2db-3180-4d0e-b726-1ad531c63c4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:17.760174 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac63a2db-3180-4d0e-b726-1ad531c63c4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.019217 Nov 02 21:51:17.763076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:17.763076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:17.779136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:17.779661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:17.781728 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2636/5401] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Nov 2 21:51:17 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:51:17.796095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:17.797115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:17.797802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:17.799464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:17.801192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:17.814509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:17.844809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:17.849440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:17.850020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:17.851369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:17.857346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:17.859393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:18.253494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:18.272432 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c693fcb-2a3e-448f-8e17-b6abfcf73df2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.515493 Nov 02 21:51:18.273517 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2766/5402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:17 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:18.449414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:18.458575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:18.460023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:18.461220 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0bda838f-6e91-4aea-8356-b59279d4f033 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1665 microversion: 2.20 time: 0.678208 Nov 02 21:51:18.477297 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2637/5403] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:17 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1665 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:18.482516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:18.483135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:18.490426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:18.490913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:18.493452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:18.495865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:18.496495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:18.501648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:18.524045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1517990730", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:18.615060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] validate_networks() for [('0032e117-cd5d-4ec1-ab19-10fbc1753cb6', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:51:18.970714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:19.008127 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd3fab57-d9a7-45b3-9cf4-656d771a0a4d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.529400 Nov 02 21:51:19.029242 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2638/5404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:18 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:19.036694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bf2ceec-e71b-4d01-b7b2-200e57d7441e"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:19.047004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:19.047004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:19.047501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:19.047953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:19.048729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:19.049220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:19.049653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:19.788341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:51:19.788874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:51:19.789245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:51:19.789657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:51:19.790072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:51:19.807651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:19.810161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:19.812576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:19.813849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:19.816277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:19.816885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:19.839897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Getting quotas for project 5f4e9d83fc7d45d581f167e2cc6a6705. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:51:19.848360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Getting quotas for user 7b5b0e068d2f4dadbf174537649474ea and project 5f4e9d83fc7d45d581f167e2cc6a6705. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:51:19.870644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:51:19.876847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:51:20.076880 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a747cde-ada7-4610-97a5-ed9d2e09582f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.801775 Nov 02 21:51:20.077853 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2767/5405] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:51:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:51:20.085829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-079ee961-5016-4713-ad57-195450c7f360 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:20.087897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-079ee961-5016-4713-ad57-195450c7f360 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Failed to fetch instance by id -1 {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 21:51:20.088528 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-079ee961-5016-4713-ad57-195450c7f360 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance -1 could not be found. Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-079ee961-5016-4713-ad57-195450c7f360 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance -1 could not be found. Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '-1'} Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:20.092859 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:20.097715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:20.097715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:20.097715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 02 21:51:20.097715 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:20.098180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-079ee961-5016-4713-ad57-195450c7f360 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance -1 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:20.102596 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-079ee961-5016-4713-ad57-195450c7f360 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023234 Nov 02 21:51:20.103279 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2768/5406] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:51:20 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:51:20.117893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f94ca2a-1d07-4b51-812f-758060be7664 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:20.118745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f94ca2a-1d07-4b51-812f-758060be7664 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:20.337727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f94ca2a-1d07-4b51-812f-758060be7664 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:20.346736 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f94ca2a-1d07-4b51-812f-758060be7664 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1214 microversion: 2.1 time: 0.242046 Nov 02 21:51:20.350750 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2769/5407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:20 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1214 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:20.366167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:20.369428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:20.382468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:20.384131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:20.386153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:20.388737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:20.393090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:20.395515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:20.482528 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a3fe0631-3d82-4f44-a4cd-25a13adf2e42 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.451395 Nov 02 21:51:20.483767 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2639/5408] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Nov 2 21:51:19 2022] POST /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 188 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:51:20.733345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:20.733888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:20.750677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:20.751168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:20.751606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:20.752317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:20.752764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:20.760320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:20.895129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121039) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 21:51:20.972217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:20.988565 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-389e9dbd-4f54-445b-8453-1e7a13824b8f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.633813 Nov 02 21:51:20.990767 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2770/5409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:20 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:21.017488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:21.017488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:21.027943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:21.028625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:21.029207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:21.029990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:21.030506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:21.037585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:21.364042 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7a070abd-ac69-407d-891a-e547f6a74af7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/action" status: 202 len: 0 microversion: 2.20 time: 0.633995 Nov 02 21:51:21.367649 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2640/5410] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:51:20 2022] POST /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:51:21.380999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:21.388814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:21.401362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:21.402107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:21.403507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:21.404636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:21.405330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:21.405943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:21.430619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:21.447570 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e66792e5-ef59-42d6-b544-e2d9e4f7419b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.436620 Nov 02 21:51:21.461332 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2771/5411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:21 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:21.484201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-031d904b-e9bc-4a18-b586-71e66f53b37a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:21.486348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-031d904b-e9bc-4a18-b586-71e66f53b37a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:22.219720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-031d904b-e9bc-4a18-b586-71e66f53b37a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:22.230378 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-031d904b-e9bc-4a18-b586-71e66f53b37a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1214 microversion: 2.1 time: 0.779432 Nov 02 21:51:22.230994 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2772/5412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:21 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1214 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:22.244687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99cc3dbb-dd1f-48fa-a037-37fc1c7e3e22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:22.244687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99cc3dbb-dd1f-48fa-a037-37fc1c7e3e22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 77b0be89-623f-43a4-bfdf-cfec99a993ed] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:22.255651 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-99cc3dbb-dd1f-48fa-a037-37fc1c7e3e22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 77b0be89-623f-43a4-bfdf-cfec99a993ed could not be found. Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99cc3dbb-dd1f-48fa-a037-37fc1c7e3e22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/77b0be89-623f-43a4-bfdf-cfec99a993ed/action HTTP/1.1 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 19 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: {"forceDelete": {}} Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 77b0be89-623f-43a4-bfdf-cfec99a993ed could not be found. Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '77b0be89-623f-43a4-bfdf-cfec99a993ed', 'body': {'forceDelete': {}}} Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77b0be89-623f-43a4-bfdf-cfec99a993ed could not be found. Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77b0be89-623f-43a4-bfdf-cfec99a993ed could not be found. Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:22.265393 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:22.285062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:22.285062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:22.285062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77b0be89-623f-43a4-bfdf-cfec99a993ed could not be found. Nov 02 21:51:22.285062 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:22.285062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99cc3dbb-dd1f-48fa-a037-37fc1c7e3e22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 77b0be89-623f-43a4-bfdf-cfec99a993ed could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:22.285062 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99cc3dbb-dd1f-48fa-a037-37fc1c7e3e22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/77b0be89-623f-43a4-bfdf-cfec99a993ed/action" status: 404 len: 111 microversion: 2.1 time: 0.046005 Nov 02 21:51:22.285062 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2773/5413] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:22 2022] POST /compute/v2.1/servers/77b0be89-623f-43a4-bfdf-cfec99a993ed/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:22.292920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:22.294443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:22.301367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:22.302111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:22.302832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:22.303656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:22.304221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:22.305232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:22.439327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:22.459234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:22.466975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:22.468613 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41cae8b4-25ce-4e61-af07-68b28f3830b7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1751 microversion: 2.20 time: 1.095671 Nov 02 21:51:22.469628 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2641/5414] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:21 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1751 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:22.661648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:22.679317 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-722deb98-8801-4d46-bc6a-e5ecb25a793c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.387636 Nov 02 21:51:22.679317 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2774/5415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:22 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:22.704386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:22.705052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:22.720447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:22.720447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:22.720447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:22.720447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:22.720447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:22.720447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.112474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:23.125585 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ba0f6c9e-4ece-4519-a35f-aa59ae689e59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.423945 Nov 02 21:51:23.128015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2642/5416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:22 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:23.152004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b413722b-b345-4d95-9359-08974052f5e4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:23.155591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b413722b-b345-4d95-9359-08974052f5e4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 948ab80c-de77-4b66-bb21-d6c677529ada] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:23.164185 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b413722b-b345-4d95-9359-08974052f5e4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 948ab80c-de77-4b66-bb21-d6c677529ada could not be found. Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b413722b-b345-4d95-9359-08974052f5e4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/948ab80c-de77-4b66-bb21-d6c677529ada/action HTTP/1.1 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 39 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: {"os-getConsoleOutput": {"length": 10}} Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 948ab80c-de77-4b66-bb21-d6c677529ada could not be found. Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '948ab80c-de77-4b66-bb21-d6c677529ada', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 948ab80c-de77-4b66-bb21-d6c677529ada could not be found. Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 948ab80c-de77-4b66-bb21-d6c677529ada could not be found. Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:23.174645 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 948ab80c-de77-4b66-bb21-d6c677529ada could not be found. Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b413722b-b345-4d95-9359-08974052f5e4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 948ab80c-de77-4b66-bb21-d6c677529ada could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b413722b-b345-4d95-9359-08974052f5e4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/948ab80c-de77-4b66-bb21-d6c677529ada/action" status: 404 len: 111 microversion: 2.1 time: 0.029812 Nov 02 21:51:23.183783 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2775/5417] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:23 2022] POST /compute/v2.1/servers/948ab80c-de77-4b66-bb21-d6c677529ada/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:23.197046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:23.198300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:23.208182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.209022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.209705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.211081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.211760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.212389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.259520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:23.260191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:23.278155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.281422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.281422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.281422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.283518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.288520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.493949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:23.507639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e88a495-eef9-4d43-a52c-caf6c836374b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1266 microversion: 2.1 time: 0.252291 Nov 02 21:51:23.511429 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2776/5418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:23 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:23.524495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:23.530591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:23.556700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.557290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.561472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.562566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.563041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.563473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.757037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:23.771854 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9859ca60-c7b2-48e2-89a4-15ebf2d31ba5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.583697 Nov 02 21:51:23.775234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2643/5419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:23 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:23.806787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:23.807770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:23.821168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.825685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.826663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.827680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:23.830400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:23.830847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:23.863312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:23.890940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:23.902657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:23.909546 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36432d64-08ef-4a43-9a11-2b108669954c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1751 microversion: 2.20 time: 0.391783 Nov 02 21:51:23.909546 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2777/5420] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:23 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1751 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:24.098042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:24.115222 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-470dce1b-a68a-459e-8b57-536835627948 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.307885 Nov 02 21:51:24.116826 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2644/5421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:23 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:24.143502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffcb73be-47e7-44db-85cd-0dfeb9920326 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:24.144378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffcb73be-47e7-44db-85cd-0dfeb9920326 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 472b64dc-8785-4541-a582-7471b69359d2] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:24.151749 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ffcb73be-47e7-44db-85cd-0dfeb9920326 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 472b64dc-8785-4541-a582-7471b69359d2 could not be found. Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffcb73be-47e7-44db-85cd-0dfeb9920326 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/472b64dc-8785-4541-a582-7471b69359d2 HTTP/1.1 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 472b64dc-8785-4541-a582-7471b69359d2 could not be found. Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '472b64dc-8785-4541-a582-7471b69359d2'} Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472b64dc-8785-4541-a582-7471b69359d2 could not be found. Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472b64dc-8785-4541-a582-7471b69359d2 could not be found. Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:24.154582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:24.158263 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:24.158263 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:24.158263 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:24.158263 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472b64dc-8785-4541-a582-7471b69359d2 could not be found. Nov 02 21:51:24.158263 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.160691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffcb73be-47e7-44db-85cd-0dfeb9920326 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 472b64dc-8785-4541-a582-7471b69359d2 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:24.161820 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffcb73be-47e7-44db-85cd-0dfeb9920326 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/472b64dc-8785-4541-a582-7471b69359d2" status: 404 len: 111 microversion: 2.1 time: 0.022997 Nov 02 21:51:24.162494 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2778/5422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:24 2022] GET /compute/v2.1/servers/472b64dc-8785-4541-a582-7471b69359d2 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:51:24.173187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:24.173909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:24.182188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.182926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.185926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.185926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.185926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.185926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.432828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:24.443473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6916f039-7287-44a0-9dda-e05916f4ad1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.276042 Nov 02 21:51:24.444710 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2645/5423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:24 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:24.471172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:24.473994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:24.480330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.481208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.481895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.482912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.483714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.484494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.546608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:24.547659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:24.564610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.565564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.566488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.567441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.568112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.569364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.623798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:24.705412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:24.717247 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2592833e-1f4e-4e3d-a6fa-5feefeb6bbc6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1272 microversion: 2.1 time: 0.175578 Nov 02 21:51:24.718022 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2646/5424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:24 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:24.736903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:24.745098 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee5afad1-f3b4-4cef-beee-606555e7a801 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.277629 Nov 02 21:51:24.760082 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2779/5425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:24 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:24.923601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c64a61d8-2d14-4335-a9d1-a9adcbc29437 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-753950907", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:24.936633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:24.937293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:24.945404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c64a61d8-2d14-4335-a9d1-a9adcbc29437 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 237 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-753950907", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-753950907', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.945752 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c64a61d8-2d14-4335-a9d1-a9adcbc29437 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c64a61d8-2d14-4335-a9d1-a9adcbc29437 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027884 Nov 02 21:51:24.956712 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2647/5426] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:51:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:51:24.958467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.958467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.958467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.958467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.958467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.966325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:24.967515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:24.979936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.980479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.981584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:24.982792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:24.989232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:24.989232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:25.223712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:25.238358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:25.242375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:25.243809 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c86e8a98-413a-4152-8e3d-e022ff1b2aca tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1753 microversion: 2.20 time: 0.312040 Nov 02 21:51:25.246584 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2780/5427] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:24 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1753 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:51:25.350848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:25.375312 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2590c04f-57aa-4f24-99d2-24c4c9520b0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.418325 Nov 02 21:51:25.375938 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2648/5428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:24 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:25.407643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:25.408715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:25.415843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:25.416735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:25.422107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:25.423240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:25.424074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:25.424734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:25.727620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:25.736881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed70f4e1-45f5-4131-82dc-911232a7c649 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.336065 Nov 02 21:51:25.752966 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2781/5429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:25 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:25.754537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:25.755580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:25.787680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:25.790139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:25.792621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:25.795558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:25.800223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:25.801790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:25.945709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-785e3052-a54d-489f-9645-3515e36e8eb9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1014357858", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-785e3052-a54d-489f-9645-3515e36e8eb9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 235 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1014357858", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1014357858', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.953107 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 21:51:25.965231 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:25.968819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-785e3052-a54d-489f-9645-3515e36e8eb9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:25.972807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-785e3052-a54d-489f-9645-3515e36e8eb9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031472 Nov 02 21:51:25.980197 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2782/5430] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:51:25 2022] POST /compute/v2.1/servers => generated 133 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:51:25.989446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:26.001123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:26.020569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:26.021559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:26.031644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:26.033651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:26.035751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:26.036457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:26.039567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:26.046021 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc6a78d9-e72b-4469-aaf8-08c7a0e05655 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1272 microversion: 2.1 time: 0.300589 Nov 02 21:51:26.061715 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2649/5431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:25 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:26.275507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:26.276653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:26.292508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:26.293466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:26.294826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:26.295778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:26.298084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:26.299875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:26.319028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:26.330869 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd0daf26-7c1c-4f42-9cb1-2d89ef8dafb6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.347026 Nov 02 21:51:26.349410 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2783/5432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:25 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:26.364230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:26.365325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:26.381869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:26.385099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:26.385821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:26.386599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:26.387081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:26.391141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:26.927156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:26.946107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:26.959953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:26.967580 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4550c3f4-9a09-462e-8887-f1262c818d91 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1753 microversion: 2.20 time: 0.696148 Nov 02 21:51:26.970999 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2650/5433] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:26 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1753 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:51:27.026897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:27.037031 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-670cd241-3f38-47a8-b1ad-86d0ad9b4120 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.677174 Nov 02 21:51:27.040483 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2784/5434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:26 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:27.076414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:27.077984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3aa1805f-495f-4eb5-a2f0-71dd429bc5a5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:27.078597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3aa1805f-495f-4eb5-a2f0-71dd429bc5a5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: bee03ce4-9f94-4c64-adbb-6b1bb820a86f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:27.079314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:27.092041 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-3aa1805f-495f-4eb5-a2f0-71dd429bc5a5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance bee03ce4-9f94-4c64-adbb-6b1bb820a86f could not be found. Nov 02 21:51:27.095461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:27.099682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:27.101253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3aa1805f-495f-4eb5-a2f0-71dd429bc5a5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/bee03ce4-9f94-4c64-adbb-6b1bb820a86f/action HTTP/1.1 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 13 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: {"pause": {}} Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance bee03ce4-9f94-4c64-adbb-6b1bb820a86f could not be found. Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'bee03ce4-9f94-4c64-adbb-6b1bb820a86f', 'body': {'pause': {}}} Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee03ce4-9f94-4c64-adbb-6b1bb820a86f could not be found. Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee03ce4-9f94-4c64-adbb-6b1bb820a86f could not be found. Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:27.107832 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:27.112502 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:27.112502 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:27.112502 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee03ce4-9f94-4c64-adbb-6b1bb820a86f could not be found. Nov 02 21:51:27.112502 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:27.116320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3aa1805f-495f-4eb5-a2f0-71dd429bc5a5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance bee03ce4-9f94-4c64-adbb-6b1bb820a86f could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:27.118400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:27.119218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:27.121363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:27.127211 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3aa1805f-495f-4eb5-a2f0-71dd429bc5a5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/bee03ce4-9f94-4c64-adbb-6b1bb820a86f/action" status: 404 len: 111 microversion: 2.1 time: 0.057279 Nov 02 21:51:27.142703 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2651/5435] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:27 2022] POST /compute/v2.1/servers/bee03ce4-9f94-4c64-adbb-6b1bb820a86f/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:27.153035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:27.156965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:27.183282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:27.183777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:27.184300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:27.185155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:27.185627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:27.186232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:27.870763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:27.889247 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-261492db-fbcd-4913-9fc8-432cd818625d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.734760 Nov 02 21:51:27.890340 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2652/5436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:27 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:27.923325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:27.924572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:27.940784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:27.941564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:27.942177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:27.943099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:27.943568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:27.944004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:28.039560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:28.050327 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-660770b4-cc9a-4d19-9b30-8e85402492c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 0.979223 Nov 02 21:51:28.056343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2785/5437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:27 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:28.065516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:28.066465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:28.073096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:28.075929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:28.076843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:28.077828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:28.078513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:28.079163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:28.490322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:28.507895 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-79871c9b-0468-4214-80b8-09ba11c3b09c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.588893 Nov 02 21:51:28.508890 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2653/5438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:27 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:28.538798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:28.539347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:28.558316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:28.560539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:28.561199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:28.564855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:28.566425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:28.568676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:28.614524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:28.625523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:28.629056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:28.630555 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d4c36b7-b87b-42ce-81b8-2c97f7e42cf0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1753 microversion: 2.20 time: 0.575413 Nov 02 21:51:28.634782 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2786/5439] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:28 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1753 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:28.914245 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-51d93be2-5191-462c-8f10-3b8f6510d2d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 202 len: 0 microversion: 2.1 time: 0.376365 Nov 02 21:51:28.917913 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2654/5440] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:28 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:51:28.928551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:28.929269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:28.939013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:28.941937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:28.944739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:28.948417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:28.949211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:28.949686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:28.950208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:29.077207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:29.077927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:29.092490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:29.096162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:29.096866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:29.097865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:29.099503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:29.101615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:29.825658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:30.160484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:30.165301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:30.179221 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7cf83c3-90e8-4412-a788-ef1837693cbd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 1.106749 Nov 02 21:51:30.179816 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2655/5441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:29 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:30.189397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f439933-8cbb-458e-a2d1-5e03661a8c9d", "device": "/dev/sdb"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:30.200432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:30.200584 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d63e6d12-8ae0-4f7a-be7c-ee8a1a8c6c43 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1510 microversion: 2.1 time: 1.278949 Nov 02 21:51:30.213225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:30.216365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:30.217020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:30.223240 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2787/5442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:28 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1510 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:30.226685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:30.226685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:30.226685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:30.227033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:30.227033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:30.234562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:30.235372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:30.236005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:30.236917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:30.238320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:30.238985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:30.637281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:30.674990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:30.677234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:30.679108 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22adcfef-729c-4a0c-b210-20937d701b0a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1753 microversion: 2.20 time: 0.459023 Nov 02 21:51:30.680233 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2788/5443] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:30 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1753 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:30.687747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4fa43fe9-5c10-48eb-844d-a529e015ecfd req-e1cc0916-8173-4a1c-8de2-df60584e6a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74364f-d34e-4954-bfbe-8144635e3349", "tag": "2b7dcbef-dd23-4577-9807-3dc39f202ada"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:30.702924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4fa43fe9-5c10-48eb-844d-a529e015ecfd req-e1cc0916-8173-4a1c-8de2-df60584e6a78 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:30.703680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4fa43fe9-5c10-48eb-844d-a529e015ecfd req-e1cc0916-8173-4a1c-8de2-df60584e6a78 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:30.704317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4fa43fe9-5c10-48eb-844d-a529e015ecfd req-e1cc0916-8173-4a1c-8de2-df60584e6a78 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:30.713829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:30.726503 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4fa43fe9-5c10-48eb-844d-a529e015ecfd req-e1cc0916-8173-4a1c-8de2-df60584e6a78 service nova] Creating event network-changed:2b7dcbef-dd23-4577-9807-3dc39f202ada for instance 8b74364f-d34e-4954-bfbe-8144635e3349 on n-h1-860863-4 Nov 02 21:51:30.739796 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4fa43fe9-5c10-48eb-844d-a529e015ecfd req-e1cc0916-8173-4a1c-8de2-df60584e6a78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057975 Nov 02 21:51:30.741183 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2789/5444] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:51:31.203854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:31.204809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:31.211750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.212400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.212981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.213932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.214636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.215132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.317298 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ad7efb0e-deed-4d2f-96c7-9b02bf258c4b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "POST /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.134362 Nov 02 21:51:31.325758 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2656/5445] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:51:30 2022] POST /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a/os-volume_attachments => generated 194 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:51:31.342688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:31.343404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:31.386462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.386969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.387964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.390389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.392382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.392882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.468542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:31.504518 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33387d7d-14df-4631-a79b-35a6cb3cd5aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 0.292778 Nov 02 21:51:31.504518 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2790/5446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:31 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:31.696196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:31.707697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:31.708704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:31.723015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.723755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.723980 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b48c12b2-3add-45f2-8a77-95265d9726af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1490 microversion: 2.1 time: 0.394889 Nov 02 21:51:31.725417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.725816 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2657/5447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:31 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1490 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:31.726812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.727419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.728061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.748414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:31.749400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:31.755819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.756611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.757291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.762716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.762716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.762716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.787782 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Cannot 'pause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state paused Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action HTTP/1.1 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 13 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: {"pause": {}} Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'pause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state paused Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'pause': {}}} Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 in vm_state paused. Cannot pause while the instance is in this state. Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state paused Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:31.793550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state paused Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 409 to user: Cannot 'pause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state paused {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac1e1b60-486b-471a-b372-bb23a0557e2c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 409 len: 143 microversion: 2.1 time: 0.046849 Nov 02 21:51:31.797548 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2658/5448] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:31 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 143 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 21:51:31.801809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:31.802426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:31.808675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.809878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.810426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.811312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:31.812014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:31.812661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:31.991306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:32.003825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:32.008885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:32.013074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28e40633-b095-44c1-9ee9-3f543cbf3b16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1753 microversion: 2.20 time: 0.309705 Nov 02 21:51:32.013684 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2791/5449] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:31 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1753 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:51:32.073687 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77f5c27e-af03-4519-a638-a21f7f010642 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 202 len: 0 microversion: 2.1 time: 0.276607 Nov 02 21:51:32.075693 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2659/5450] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:31 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:51:32.091470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:32.096713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:32.110100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:32.110595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:32.111034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:32.116090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:32.116728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:32.117204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:32.227290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:32.469614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:32.491636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1eea897c-3913-4d81-8d0c-be46b4c6fb7d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1497 microversion: 2.1 time: 0.409894 Nov 02 21:51:32.493715 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2792/5451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:32 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1497 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:32.517519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:32.518944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:32.527481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:32.528433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:32.529155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:32.530068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:32.531847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:32.532482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:32.978460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:32.998809 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-834710d3-b9ce-4e20-9c74-3eff5907242e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 0.484954 Nov 02 21:51:33.003563 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2660/5452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:32 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:33.044567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:33.045226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:33.053710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.054828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.055669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.057342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.058184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.058990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.290797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:33.301404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:33.306245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:33.307478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-efae6689-2c18-402b-b8d4-1b801a627383 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1753 microversion: 2.20 time: 0.267851 Nov 02 21:51:33.308058 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2793/5453] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:33 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:33.515518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:33.516157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:33.523889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.524497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.524810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.525566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.526211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.526719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.694057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:33.703860 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb55ba60-b8c5-4f4c-b679-fff62621321f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.192218 Nov 02 21:51:33.705214 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2661/5454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:33 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:33.732086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:33.732739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:33.740693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.741267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.742333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.743194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.743811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.744354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.901150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:33.911593 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56ee5e32-5aa8-448f-80b9-7c9f1346cc90 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.184057 Nov 02 21:51:33.912793 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2794/5455] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:33 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:33.943380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:33.945916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:33.959681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.962596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.963213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.965692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:33.967055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:33.968160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:33.977872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:33.989689 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102/action HTTP/1.1 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 28 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: {"reboot": {"type": "SOFT"}} Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '63309760-3556-4d65-9f7e-1e8a7323c102', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:33.991712 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:33.995493 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:33.998468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:33.999544 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-efcd8ebc-9db0-4ac9-ac96-992b8f519d80 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102/action" status: 404 len: 111 microversion: 2.1 time: 0.068145 Nov 02 21:51:34.000692 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2662/5456] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:33 2022] POST /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:34.009312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:34.009914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:34.020735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.023054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:34.023208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.023647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.023796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:34.024680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.027639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.029920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.037898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.038401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.038843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.039548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.040006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.040913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.382857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:34.385828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:34.393512 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-777a0ecc-9133-4ae8-8a7f-b4d6474c8a98 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 0.374767 Nov 02 21:51:34.395149 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2663/5457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:34 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:34.399832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:34.400602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:34.405918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6967edf4-dabd-485e-b154-b517d78690b3 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.388155 Nov 02 21:51:34.406657 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2795/5458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:34 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:34.408362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.409064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.409505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.410329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.410786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.411215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.432490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:34.433173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:34.442537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.443124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.443579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.444292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.444753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.445215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.696138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:34.711730 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c63256db-29b8-445b-8750-1673cd28cd47 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.283057 Nov 02 21:51:34.718813 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2796/5459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:34 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:34.745131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6350693e-ca33-4d50-97b3-b2df9bea30dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:34.748422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6350693e-ca33-4d50-97b3-b2df9bea30dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 2665524d-e8a0-48b3-8b8a-6d1412c856ad] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:34.765591 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6350693e-ca33-4d50-97b3-b2df9bea30dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 2665524d-e8a0-48b3-8b8a-6d1412c856ad could not be found. Nov 02 21:51:34.768091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6350693e-ca33-4d50-97b3-b2df9bea30dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/2665524d-e8a0-48b3-8b8a-6d1412c856ad/action HTTP/1.1 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 28 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: {"reboot": {"type": "SOFT"}} Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 2665524d-e8a0-48b3-8b8a-6d1412c856ad could not be found. Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2665524d-e8a0-48b3-8b8a-6d1412c856ad', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2665524d-e8a0-48b3-8b8a-6d1412c856ad could not be found. Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2665524d-e8a0-48b3-8b8a-6d1412c856ad could not be found. Nov 02 21:51:34.769091 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2665524d-e8a0-48b3-8b8a-6d1412c856ad could not be found. Nov 02 21:51:34.773137 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:34.775467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6350693e-ca33-4d50-97b3-b2df9bea30dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 2665524d-e8a0-48b3-8b8a-6d1412c856ad could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:34.776628 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6350693e-ca33-4d50-97b3-b2df9bea30dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/2665524d-e8a0-48b3-8b8a-6d1412c856ad/action" status: 404 len: 111 microversion: 2.1 time: 0.035629 Nov 02 21:51:34.777514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2797/5460] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:34 2022] POST /compute/v2.1/servers/2665524d-e8a0-48b3-8b8a-6d1412c856ad/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:34.786247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:34.789819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:34.792200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:34.798479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:34.800161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b27492c9-0573-4b60-8a21-4f4d082c455f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1753 microversion: 2.20 time: 0.403885 Nov 02 21:51:34.804152 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2664/5461] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:34 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1753 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:34.808241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.809966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.810654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:34.811617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:34.812364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:34.813079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.051099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:35.066426 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-daa9360b-ad03-4728-a865-3576ff831fae tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.283268 Nov 02 21:51:35.085689 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2798/5462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:34 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:35.096978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:35.097727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:35.108509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.111497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.112130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.113831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.115609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.116126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.384296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:35.397999 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff974bf3-2fcc-4123-86a1-d993581e896c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.305260 Nov 02 21:51:35.399103 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2665/5463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:35 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:35.422549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:35.424898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:35.434011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:35.439113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:35.441667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.442158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.442605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.451545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.457649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.457811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.457909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.458001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.458146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.458146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.458146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.458146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.476024 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102/action HTTP/1.1 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 65 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '63309760-3556-4d65-9f7e-1e8a7323c102', 'body': {'rebuild': {'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c'}}} Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 21:51:35.486651 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-70c414be-53f0-4723-b1d8-dd9ab274a033 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102/action" status: 404 len: 111 microversion: 2.1 time: 0.060958 Nov 02 21:51:35.498471 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2666/5464] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:35 2022] POST /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:35.501747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:35.503558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:35.508832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.509656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.510101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.510807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.511258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.511680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.849076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:35.857041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:35.861405 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ebcaa922-6760-48a1-9fe9-bc360c17c3ff tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 0.442489 Nov 02 21:51:35.862500 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2799/5465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:35 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:35.874257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:35.877341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:35.881727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63f851b1-c742-4229-ad14-4fb19804c09a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.385892 Nov 02 21:51:35.884105 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2667/5466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:35 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:35.905721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.906534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.908734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.912499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.913326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.914185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.919952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:35.926546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:35.927968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.928750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.929228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:35.930265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:35.930912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:35.931641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:36.191537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:36.200463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4cd7a81d-d5e7-48cb-8fb9-a65f17fc07d7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.284359 Nov 02 21:51:36.217393 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2668/5467] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:35 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:36.223744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0d57bd7-6c85-4942-a9de-f034cbf92eb1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:36.226905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a0d57bd7-6c85-4942-a9de-f034cbf92eb1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: a5cd065e-5a64-4057-a71b-a135e83086c2] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:36.238333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a0d57bd7-6c85-4942-a9de-f034cbf92eb1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance a5cd065e-5a64-4057-a71b-a135e83086c2 could not be found. Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0d57bd7-6c85-4942-a9de-f034cbf92eb1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/a5cd065e-5a64-4057-a71b-a135e83086c2/action HTTP/1.1 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 65 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance a5cd065e-5a64-4057-a71b-a135e83086c2 could not be found. Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'a5cd065e-5a64-4057-a71b-a135e83086c2', 'body': {'rebuild': {'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c'}}} Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5cd065e-5a64-4057-a71b-a135e83086c2 could not be found. Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 21:51:36.240236 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5cd065e-5a64-4057-a71b-a135e83086c2 could not be found. Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5cd065e-5a64-4057-a71b-a135e83086c2 could not be found. Nov 02 21:51:36.249820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:36.250654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:36.252227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0d57bd7-6c85-4942-a9de-f034cbf92eb1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance a5cd065e-5a64-4057-a71b-a135e83086c2 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:36.253374 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a0d57bd7-6c85-4942-a9de-f034cbf92eb1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/a5cd065e-5a64-4057-a71b-a135e83086c2/action" status: 404 len: 111 microversion: 2.1 time: 0.033985 Nov 02 21:51:36.257653 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2669/5468] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:36 2022] POST /compute/v2.1/servers/a5cd065e-5a64-4057-a71b-a135e83086c2/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:51:36.272543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:36.273896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:36.274717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:36.283013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:36.286965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:36.288985 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b75904ae-cc8b-48c2-b63f-7f261eb25451 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.423910 Nov 02 21:51:36.289737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:36.290494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:36.291445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:36.301620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:36.302394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:36.308083 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2800/5469] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:35 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:36.570107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:36.582565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03624a6a-bc19-4525-b9e0-acd2af766a55 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.323546 Nov 02 21:51:36.596963 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2670/5470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:36 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:36.614381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-237fd931-6e9e-4c89-bf62-c0b24bbe368b req-98b933e8-a38b-4626-b421-f353b30637ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74364f-d34e-4954-bfbe-8144635e3349", "name": "network-vif-plugged", "status": "completed", "tag": "2b7dcbef-dd23-4577-9807-3dc39f202ada"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:36.616199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:36.616898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:36.631260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:36.631764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:36.634711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:36.635305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:36.637308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:36.639610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:36.642835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-237fd931-6e9e-4c89-bf62-c0b24bbe368b req-98b933e8-a38b-4626-b421-f353b30637ad service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:36.643922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-237fd931-6e9e-4c89-bf62-c0b24bbe368b req-98b933e8-a38b-4626-b421-f353b30637ad service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:36.646287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-237fd931-6e9e-4c89-bf62-c0b24bbe368b req-98b933e8-a38b-4626-b421-f353b30637ad service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:36.669264 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-237fd931-6e9e-4c89-bf62-c0b24bbe368b req-98b933e8-a38b-4626-b421-f353b30637ad service nova] Creating event network-vif-plugged:2b7dcbef-dd23-4577-9807-3dc39f202ada for instance 8b74364f-d34e-4954-bfbe-8144635e3349 on n-h1-860863-4 Nov 02 21:51:36.695511 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-237fd931-6e9e-4c89-bf62-c0b24bbe368b req-98b933e8-a38b-4626-b421-f353b30637ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079336 Nov 02 21:51:36.696689 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2801/5471] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:51:36.888605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:36.889479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:36.908480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:36.909277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:36.909986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:36.912783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:36.913880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:36.914585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:37.286123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:37.301007 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ddf72b00-14d9-4527-a4f3-5d1b14bac6f9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.691779 Nov 02 21:51:37.325601 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2671/5472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:36 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:37.335179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:37.336072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:37.349683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:37.350582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:37.353483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:37.354472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:37.355171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:37.355869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:37.712040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:37.725160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-abbfcf90-a0a2-4cca-84a3-fcc83f0f01b9 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 0.842380 Nov 02 21:51:37.726531 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2802/5473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:36 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:37.739124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4935cf6c-8092-4ab3-8619-b5ba1fcd33d5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:37.739676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4935cf6c-8092-4ab3-8619-b5ba1fcd33d5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 871aee96-53d3-48ef-b866-e1154e938d02] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:37.759645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-4935cf6c-8092-4ab3-8619-b5ba1fcd33d5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 871aee96-53d3-48ef-b866-e1154e938d02 could not be found. Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4935cf6c-8092-4ab3-8619-b5ba1fcd33d5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/871aee96-53d3-48ef-b866-e1154e938d02/action HTTP/1.1 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 15 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: {"restore": {}} Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 871aee96-53d3-48ef-b866-e1154e938d02 could not be found. Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '871aee96-53d3-48ef-b866-e1154e938d02', 'body': {'restore': {}}} Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871aee96-53d3-48ef-b866-e1154e938d02 could not be found. Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871aee96-53d3-48ef-b866-e1154e938d02 could not be found. Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:37.767154 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:37.776676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:37.776676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:37.776676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871aee96-53d3-48ef-b866-e1154e938d02 could not be found. Nov 02 21:51:37.776676 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:37.776676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4935cf6c-8092-4ab3-8619-b5ba1fcd33d5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 871aee96-53d3-48ef-b866-e1154e938d02 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:37.776676 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4935cf6c-8092-4ab3-8619-b5ba1fcd33d5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/871aee96-53d3-48ef-b866-e1154e938d02/action" status: 404 len: 111 microversion: 2.1 time: 0.043819 Nov 02 21:51:37.776676 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2803/5474] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:37 2022] POST /compute/v2.1/servers/871aee96-53d3-48ef-b866-e1154e938d02/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:37.794996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:37.795921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:37.809897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:37.810284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:37.810899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:37.811920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:37.812531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:37.813178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:37.924560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:37.940375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:37.941915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:37.943160 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-23189179-0ca0-4061-88b2-ff467199ffdf tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.613855 Nov 02 21:51:37.943739 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2672/5475] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:37 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:38.411061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:38.430922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1be02dde-e9b4-49ca-95e2-4d477edc2595 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.645892 Nov 02 21:51:38.431518 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2804/5476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:37 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:38.462386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:38.465468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:38.479091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:38.486373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:38.493005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:38.493668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:38.494633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:38.495457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:38.496102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:38.755032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:38.757118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:38.767454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:38.768488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:38.777037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:38.778978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:38.779919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:38.780602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.014970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:39.035420 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f7f16f71-b115-472c-bc37-51afc8d94758 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.569482 Nov 02 21:51:39.036156 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2673/5477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:38 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:39.073217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:39.077305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:39.097651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.122911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.122911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.122911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.122911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.122911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.123785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:39.123785 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0d6e97c5-f335-4756-a668-da6b0bf38c7a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1314 microversion: 2.1 time: 0.369222 Nov 02 21:51:39.127462 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2805/5478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:38 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:39.140950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:39.148152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:39.164336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.164990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.176366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.177353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.177909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.180739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.225902 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Cannot 'restore' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action HTTP/1.1 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 15 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: {"restore": {}} Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: exception: Cannot 'restore' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'restore': {}}} Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 in vm_state active. Cannot restore while the instance is in this state. Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:39.231543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 409 to user: Cannot 'restore' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-66af1605-7b9b-4e3a-8858-33c5e242c766 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 409 len: 145 microversion: 2.1 time: 0.104137 Nov 02 21:51:39.236204 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2806/5479] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:39 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 145 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:51:39.247049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:39.247739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:39.271847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.275463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.281014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.281014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.281014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.281014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.497919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:39.522288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:39.524123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:39.529813 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7023e72e-7a0a-49a6-aff4-f34df308023a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.477922 Nov 02 21:51:39.530919 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2674/5480] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:39 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:39.605708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:39.616721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b9b59938-5ae6-414a-93ae-3ecbb85f1188 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.377595 Nov 02 21:51:39.618356 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2807/5481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:39 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:39.647344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6824fad0-9979-4262-9f78-6729d9aac8ec req-0fe0af6c-aa05-4515-8d80-820f25306edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:39.648299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:39.649184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:39.658413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.659098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.659705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.660597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.661233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.662158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.688554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6824fad0-9979-4262-9f78-6729d9aac8ec req-0fe0af6c-aa05-4515-8d80-820f25306edf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:39.695385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6824fad0-9979-4262-9f78-6729d9aac8ec req-0fe0af6c-aa05-4515-8d80-820f25306edf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:39.695866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6824fad0-9979-4262-9f78-6729d9aac8ec req-0fe0af6c-aa05-4515-8d80-820f25306edf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:39.734860 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6824fad0-9979-4262-9f78-6729d9aac8ec req-0fe0af6c-aa05-4515-8d80-820f25306edf service nova] Creating event network-changed:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h1-860863-4 Nov 02 21:51:39.745696 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6824fad0-9979-4262-9f78-6729d9aac8ec req-0fe0af6c-aa05-4515-8d80-820f25306edf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103318 Nov 02 21:51:39.747563 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2675/5482] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:51:40.148418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:40.149239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:40.160761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:40.161578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:40.162175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:40.173931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:40.179433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:40.180335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:40.793389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:40.808752 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edca16eb-0f29-4972-82b8-2209aa8fd9df tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 1.161856 Nov 02 21:51:40.808752 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2808/5483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:39 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:40.823982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:40.825063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:40.836264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:40.854749 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6de1b971-997d-411f-9577-aa51c2164152 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1501 microversion: 2.1 time: 0.708170 Nov 02 21:51:40.855689 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2676/5484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:40 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1501 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:40.857360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:40.858485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:40.861183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:40.865781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:40.865781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:40.865979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:40.868228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e30d8339-ad3b-4b8f-9a3b-9d1f587ca132 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:40.872411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e30d8339-ad3b-4b8f-9a3b-9d1f587ca132 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 7d5251b2-311a-47b7-9384-be118b1c6cda] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:40.887681 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e30d8339-ad3b-4b8f-9a3b-9d1f587ca132 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 7d5251b2-311a-47b7-9384-be118b1c6cda could not be found. Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e30d8339-ad3b-4b8f-9a3b-9d1f587ca132 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/7d5251b2-311a-47b7-9384-be118b1c6cda/action HTTP/1.1 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 14 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: {"resume": {}} Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 7d5251b2-311a-47b7-9384-be118b1c6cda could not be found. Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '7d5251b2-311a-47b7-9384-be118b1c6cda', 'body': {'resume': {}}} Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5251b2-311a-47b7-9384-be118b1c6cda could not be found. Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5251b2-311a-47b7-9384-be118b1c6cda could not be found. Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:40.898637 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:40.904550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:40.904550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:40.904550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5251b2-311a-47b7-9384-be118b1c6cda could not be found. Nov 02 21:51:40.904550 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:40.907045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e30d8339-ad3b-4b8f-9a3b-9d1f587ca132 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 7d5251b2-311a-47b7-9384-be118b1c6cda could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:40.908236 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e30d8339-ad3b-4b8f-9a3b-9d1f587ca132 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/7d5251b2-311a-47b7-9384-be118b1c6cda/action" status: 404 len: 111 microversion: 2.1 time: 0.051062 Nov 02 21:51:40.909108 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2677/5485] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:40 2022] POST /compute/v2.1/servers/7d5251b2-311a-47b7-9384-be118b1c6cda/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:40.915878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:40.921263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:40.924053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:40.933701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:40.935465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:40.936129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:40.937323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:40.938014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:40.939982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:40.976661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lazy-loading 'flavor' on Instance uuid 8b74364f-d34e-4954-bfbe-8144635e3349 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:51:41.337209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3195298f-82dd-48c0-8fa0-67ab41418e53 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "POST /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349/action" status: 200 len: 32 microversion: 2.1 time: 0.424937 Nov 02 21:51:41.338094 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2678/5486] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:40 2022] POST /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349/action => generated 32 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:51:41.350037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:41.350817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:41.366875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:41.367378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:41.367827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:41.368539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:41.369018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:41.369626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:41.465684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:41.496692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:41.500781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:41.504155 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-64ea57e6-8642-416d-bdf2-e4b1118b5f94 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.690095 Nov 02 21:51:41.508838 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2809/5487] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:40 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:41.521016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:41.522074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:41.531815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:41.533140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:41.533759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:41.535106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:41.535718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:41.537244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.114525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:42.122604 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cc398757-49f3-43f7-9b4b-0fa4291dfdda tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.783327 Nov 02 21:51:42.136394 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2679/5488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:41 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:42.150992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:42.154648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:42.164385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.167835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.167835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.167835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.167835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.167835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.318248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:42.331515 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-30a367d0-5481-4f13-93ea-19d6df76a310 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.822762 Nov 02 21:51:42.332589 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2810/5489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:41 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:42.534245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:42.534855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:42.540958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.541661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.542092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.542970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.544068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.544502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.582411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:42.590801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:42.603869 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-244524d9-f790-4b59-b616-f07a94c7c5b0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.456382 Nov 02 21:51:42.607233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2680/5490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:42 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:42.626738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:42.627479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:42.634511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.635248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.635854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.636727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.638085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.638832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.666173 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Cannot 'resume' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action HTTP/1.1 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 14 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: {"resume": {}} Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'resume' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'resume': {}}} Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 in vm_state active. Cannot resume while the instance is in this state. Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:42.668874 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:42.673634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:42.673634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:42.673634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:42.673634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:42.673634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:42.673634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:51:42.673634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:42.675835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 409 to user: Cannot 'resume' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:42.677085 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8b2fee7d-2a8e-4dc9-b1f6-812f44cd283e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 409 len: 144 microversion: 2.1 time: 0.054288 Nov 02 21:51:42.682187 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2681/5491] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:42 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 144 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:51:42.688742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:42.694759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:42.699146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.700451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.701232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:42.702195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:42.702896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:42.703617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:43.006803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:43.024379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:43.025988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:43.028350 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-142c8984-ceb4-45e3-860c-ba35fa733a79 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.497478 Nov 02 21:51:43.029176 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2811/5492] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:42 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:43.238277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:43.247360 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2db6133-2b15-4a16-a347-f357c657a412 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.563620 Nov 02 21:51:43.262510 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2682/5493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:42 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:43.286469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:43.287217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:43.298010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:43.304322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:43.305241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:43.306252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:43.307068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:43.307768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:43.371690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:43.374539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:43.396827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:43.403282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:43.404161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:43.405360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:43.406165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:43.406636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:44.727436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:44.749957 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86a6a5eb-435e-4556-9357-2ed3e266212c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 1.397846 Nov 02 21:51:44.751294 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2683/5494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:43 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:44.756552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:44.757413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:44.768710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:44.769518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:44.773449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:44.774476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:44.775220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:44.775902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:44.897257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:44.907939 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae297734-ade6-49f1-9687-7ad71ff489b4 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 1.631075 Nov 02 21:51:44.909234 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2812/5495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:43 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:45.148770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-441f5023-999b-4461-a07e-02788ed1118c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-441f5023-999b-4461-a07e-02788ed1118c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 160 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6dec2748-3171-417e-ae2c-73a937da2291"}]}} Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'server': {'name': '', 'imageRef': '612221e9-0156-4770-a8ac-3a978f4e721c', 'flavorRef': '452', 'networks': [{'uuid': '6dec2748-3171-417e-ae2c-73a937da2291'}]}}} Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '' Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:51:45.153155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:51:45.157261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-441f5023-999b-4461-a07e-02788ed1118c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:45.159023 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-441f5023-999b-4461-a07e-02788ed1118c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.014206 Nov 02 21:51:45.163373 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2813/5496] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:51:45 2022] POST /compute/v2.1/servers => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:51:45.174640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:45.178878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:45.193468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:45.198858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:45.200347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:45.202085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:45.202782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:45.206847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:45.587375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:45.597410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:45.599560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:45.601304 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7fdd2ca5-a01b-4c58-8503-ca88839558f8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.848701 Nov 02 21:51:45.616403 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2684/5497] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:44 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:45.721648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:45.734387 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c5f6a34-ecbe-4eaa-9648-9f627ba72d69 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.569721 Nov 02 21:51:45.735166 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2814/5498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:45 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:45.764338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:45.765876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:45.782589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:45.783204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:45.787330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:45.788230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:45.789272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:45.790495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:45.794662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:45.795497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:45.800596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:45.803900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:45.805163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:45.810449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:45.811112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:45.811993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:46.481566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:46.494296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6b9e60df-0898-4c26-9f17-38eea0cbefe5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.735780 Nov 02 21:51:46.494969 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2685/5499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:45 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:46.550710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92ec3405-2c4d-4250-ad97-96da5ecb6a79 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:46.551658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92ec3405-2c4d-4250-ad97-96da5ecb6a79 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 54e51ff8-21e2-4260-918b-399eb3d6c733] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:46.559987 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-92ec3405-2c4d-4250-ad97-96da5ecb6a79 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 54e51ff8-21e2-4260-918b-399eb3d6c733 could not be found. Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92ec3405-2c4d-4250-ad97-96da5ecb6a79 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/54e51ff8-21e2-4260-918b-399eb3d6c733/action HTTP/1.1 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 14 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: {"shelve": {}} Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 54e51ff8-21e2-4260-918b-399eb3d6c733 could not be found. Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '54e51ff8-21e2-4260-918b-399eb3d6c733', 'body': {'shelve': {}}} Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e51ff8-21e2-4260-918b-399eb3d6c733 could not be found. Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e51ff8-21e2-4260-918b-399eb3d6c733 could not be found. Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:51:46.563298 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:51:46.568133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:51:46.568133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:51:46.568133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e51ff8-21e2-4260-918b-399eb3d6c733 could not be found. Nov 02 21:51:46.568133 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:51:46.568133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92ec3405-2c4d-4250-ad97-96da5ecb6a79 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 54e51ff8-21e2-4260-918b-399eb3d6c733 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:51:46.568133 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92ec3405-2c4d-4250-ad97-96da5ecb6a79 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/54e51ff8-21e2-4260-918b-399eb3d6c733/action" status: 404 len: 111 microversion: 2.1 time: 0.030835 Nov 02 21:51:46.570021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2686/5500] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:46 2022] POST /compute/v2.1/servers/54e51ff8-21e2-4260-918b-399eb3d6c733/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:51:46.578444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:46.579321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:46.584395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:46.590425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:46.591098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:46.591840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:46.592704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:46.593420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:46.594065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:46.599565 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d20e436-2488-4d20-8174-82e81acad968 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.823935 Nov 02 21:51:46.600142 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2815/5501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:45 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:46.632688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:46.633598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:46.659501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:46.661260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:46.661719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:46.665575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:46.666208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:46.667100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:47.096595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:47.119933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:47.130684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-02bf88bd-a253-4e33-99e6-59900b4ffb77 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.558888 Nov 02 21:51:47.133230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:47.135982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2687/5502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:46 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:47.146024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:47.147574 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c39bc38c-c786-4964-81fb-44358ed2aa2a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.521619 Nov 02 21:51:47.166787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:47.167470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:47.167700 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2816/5503] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:46 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:51:47.185408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:47.192163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:47.194112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:47.197883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:47.199200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:47.202248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:47.627367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:47.627979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:47.643229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:47.643667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:47.644120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:47.644839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:47.645593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:47.646025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:48.333006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:48.339648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:48.347785 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c237afc4-b725-4e0b-bb13-f69bc3cd9ff5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 1.189318 Nov 02 21:51:48.348363 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2991de1e-1eff-4a3d-ba6d-ff1b35c429ee tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.725005 Nov 02 21:51:48.349506 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2688/5504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:47 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:48.351924 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2817/5505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:47 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:48.372905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:48.373524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:48.374088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:48.376159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:48.382308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:48.387594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:48.388081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:48.388797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:48.389314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:48.389728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:48.400601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:48.403479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:48.405343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:48.408584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:48.410655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:48.411131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:48.443419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lazy-loading 'flavor' on Instance uuid d40ad45b-ca57-4f29-bc34-1b46511dab23 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:51:48.971028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:48.986731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:48.991115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:48.994446 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fd92116f-ed68-4a60-a934-4b0d19585188 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.641580 Nov 02 21:51:49.000379 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2689/5506] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:48 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:49.245432 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db256210-0f05-4a72-821a-264952c55d2b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 202 len: 0 microversion: 2.1 time: 0.876377 Nov 02 21:51:49.256397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:49.266560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:49.268806 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2818/5507] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:51:48 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:51:49.285168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:49.287472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:49.288791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:49.295171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:49.295801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:49.301138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:49.379011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:49.380043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:49.415980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:49.416863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:49.417534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:49.418683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:49.419548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:49.421236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:50.133612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:50.143385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3f14c1f-5673-46db-8dc3-18307509cc78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.890896 Nov 02 21:51:50.170963 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2690/5508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:49 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:50.178259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:50.192998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:50.201844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:50.202713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:50.203172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:50.203949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:50.204504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:50.212067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:50.563069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:50.563069 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23dadb69-1081-4a6f-bc4c-7370915a05aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 1.171762 Nov 02 21:51:50.563069 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2819/5509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:49 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:50.827355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:50.849415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:50.852006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:50.853741 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7cb014a9-4f47-44de-aa94-57bbb0e38f22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.679754 Nov 02 21:51:50.854851 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2691/5510] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:50 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:51.191095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:51.195091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:51.216756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:51.219256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:51.219905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:51.221334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:51.224091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:51.224749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:51.586174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:51.586893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:51.603819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:51.604325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:51.604775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:51.605557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:51.606560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:51.607002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:51.678353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:51.696046 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f640c339-8e40-4175-bea6-622ee84a1907 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.518112 Nov 02 21:51:51.705054 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2820/5511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:51 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:51.892350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:51.893068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:51.913132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:51.917803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:51.919093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:51.920282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:51.920906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:51.921735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:52.229936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:52.241738 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72b381c8-e3f0-48c2-a01c-4e8b2354cf57 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.659777 Nov 02 21:51:52.278290 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2692/5512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:51 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:52.448319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:52.464467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:52.466863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:52.468468 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27018fcf-f57a-4bcb-900f-3f18df93cd9c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.583801 Nov 02 21:51:52.471845 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2821/5513] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:51 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:52.735359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:52.737329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:52.755884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:52.757789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:52.759681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:52.766294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:52.771661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:52.771661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:53.249299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:53.261578 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d79625a-1f46-4a3e-b582-57d8c420c66f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.539853 Nov 02 21:51:53.273096 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2693/5514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:52 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:53.306960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:53.313809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:53.322823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:53.329448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:53.330046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:53.330976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:53.331571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:53.332085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:53.407668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52e26e83-6945-422b-bc5c-01c05b6e17ce tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'create', calling method: .version_select at 0x7f9b63c149d0>, body: {"keypair": {"name": "tempest-keypair-617689661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrFDmA3tsunQ0AsWv7FBXeK84kdS48hpIZ9DuUkRh7W+ttBk7jhqpbu1ijfweBGN+qbESN+nmiVDs5IL1aU9gQLj/0NDvU7cbep1SQyaO3SgEIeGOVe+Hd5NdUX6vMlLA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:53.500114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-52e26e83-6945-422b-bc5c-01c05b6e17ce tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:51:53.522021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-52e26e83-6945-422b-bc5c-01c05b6e17ce tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for user 1fc99ef958a4434ca4f43354d45ade7d and project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:51:53.663517 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52e26e83-6945-422b-bc5c-01c05b6e17ce tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.693236 Nov 02 21:51:53.676026 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2822/5515] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:51:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:51:53.676026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:53.676026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:53.703086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:53.708017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:53.709455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:53.716023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:53.718046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:53.720026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:53.804688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:53.826621 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ed0b645-a577-4855-a9b2-a3fa6eaa1d42 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.533304 Nov 02 21:51:53.841474 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2694/5516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:53 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:54.072958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:54.085676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:54.094776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:54.096585 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b03800cc-d762-4812-9bef-5a5dfad98aac tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.430689 Nov 02 21:51:54.109290 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2823/5517] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:53 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:54.295104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:54.295696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:54.304646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:54.305519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:54.306341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:54.307576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:54.308301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:54.309788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:54.566459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:54.591238 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ec9e3d2-8286-4a01-ae66-04d10f55596e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.300806 Nov 02 21:51:54.598599 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2695/5518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:54 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:54.863643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:54.864263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:54.882421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:54.882938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:54.883391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:54.884120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:54.884576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:54.887534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:55.130159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:55.130786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:55.149376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:55.151341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:55.153918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:55.156349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:55.157780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:55.159519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:55.513776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:55.527406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:55.530149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:55.531829 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c33e9aa4-273c-4ec5-829f-132323bba60f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.405882 Nov 02 21:51:55.532812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2696/5519] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:55 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:55.570844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:55.583172 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aaf244c6-c9d5-4eaf-a0fe-34e0ac5260bf tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.723352 Nov 02 21:51:55.607644 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2824/5520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:54 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:55.619016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:55.619869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:55.626917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:55.627922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:55.628699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:55.629623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:55.630294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:55.630903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:56.174304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:56.188824 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42f14542-be0a-4234-b8d2-a3478527da22 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.570672 Nov 02 21:51:56.205292 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2697/5521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:55 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:56.558462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:56.562009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:56.578607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:56.579373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:56.579958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:56.580807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:56.581427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:56.583307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:56.622427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:56.622427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:56.633944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:56.634716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:56.635171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:56.635910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:56.636323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:56.636880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:57.011003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:57.016282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:57.024670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:57.030385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d9315106-bdbe-4018-8b06-9364ebf7edbe tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.411122 Nov 02 21:51:57.032996 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2698/5522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:56 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:57.051328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:57.052784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:57.054007 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4f13cb6c-354c-436f-be26-c3dcde7c1964 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.499419 Nov 02 21:51:57.067406 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2825/5523] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:56 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:57.219315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:57.219315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:57.240065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:57.240560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:57.241031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:57.241745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:57.242201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:57.242628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:57.519954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:57.533038 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3dc8ddef-deb8-444c-b949-964d71d5a102 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.325150 Nov 02 21:51:57.536360 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2699/5524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:57 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:58.055253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:58.056443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:58.075715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:58.075715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:58.076102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:58.078920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:58.081309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:58.086397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:58.097106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:58.098474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:58.129014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:58.129917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:58.131254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:58.132787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:58.135844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:58.136833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:58.138434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:51:58.860466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:58.870592 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb508520-6950-4362-8ad2-4b4b446186a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.819324 Nov 02 21:51:58.872707 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2826/5525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:58 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:51:58.884508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:58.884508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:58.896765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:58.897869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:58.906111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:58.907908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:58.909661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:58.911318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:59.036852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:59.046950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:59.048467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:59.049776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5fe73db9-bb30-4ee7-a0a5-15a9264fc3da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.961238 Nov 02 21:51:59.050417 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2700/5526] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:51:58 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:51:59.187261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:51:59.200835 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b88df9c-1636-43c4-926e-0d31e1242c9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.326630 Nov 02 21:51:59.203603 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2827/5527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:58 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:51:59.508760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-404079799", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b18a2238-2c90-4855-b50c-1faaa9d3b3ed"}], "security_groups": [{"name": "tempest-securitygroup--514741417"}], "key_name": "tempest-keypair-617689661", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:51:59.719703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] validate_networks() for [('b18a2238-2c90-4855-b50c-1faaa9d3b3ed', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:51:59.916490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:51:59.917546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:51:59.926262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:59.926776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:59.927536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:51:59.928321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:51:59.928948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:51:59.929618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:00.170396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:00.178140 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca7e2e25-c416-4fb2-bd5a-d9de6272d786 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.283377 Nov 02 21:52:00.178719 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2828/5528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:51:59 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:00.185487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:00.186105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:00.187862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:00.193189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:00.194450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:00.194450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:00.195168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:00.195779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:00.196271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:00.287225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:52:00.287664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:52:00.288272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:52:00.288763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:52:00.289957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:52:00.301687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:00.302664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:00.303083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:00.303809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:00.304257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:00.304948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:00.325266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:52:00.332094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for user 1fc99ef958a4434ca4f43354d45ade7d and project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:52:00.346872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:52:00.349764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:52:00.403710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:00.414974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:00.417203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:00.421225 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8295a239-8d8f-424c-8408-ac515cb3ff66 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.239009 Nov 02 21:52:00.421225 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2829/5529] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:00 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:52:00.424207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:00.424880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:00.431038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:00.431601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:00.432101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:00.432843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:00.433338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:00.434522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:00.485790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fba50066-d3cb-4709-bac2-cf365355732f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.983455 Nov 02 21:52:00.486457 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2701/5530] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:51:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:52:00.502820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-64792917-a543-46ad-9b43-c4b3138ccf6d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:00.503451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-64792917-a543-46ad-9b43-c4b3138ccf6d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:00.596472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-64792917-a543-46ad-9b43-c4b3138ccf6d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:00.620228 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-64792917-a543-46ad-9b43-c4b3138ccf6d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1236 microversion: 2.1 time: 0.122024 Nov 02 21:52:00.623849 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2702/5531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:00 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1236 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:00.662086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:00.690353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8dfe1312-2ea7-4ba5-b220-a8bb8586eb9c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1532 microversion: 2.1 time: 0.255575 Nov 02 21:52:00.690353 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2830/5532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:00 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1532 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:01.202368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:01.203631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:01.211140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:01.213215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:01.213215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:01.213215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:01.213926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:01.215338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:01.444550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:01.447619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:01.448227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:01.454016 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7d4a528-a27c-4e4a-95ed-1664d4fb481a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.255658 Nov 02 21:52:01.454612 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2703/5533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:01 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:01.472162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:01.472162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:01.472162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:01.472162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:01.472162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:01.472162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:01.647973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ee4183c-b2d3-4e95-ad67-73e892dbcf41 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:01.648807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ee4183c-b2d3-4e95-ad67-73e892dbcf41 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:01.755291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ee4183c-b2d3-4e95-ad67-73e892dbcf41 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:01.771359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:01.795008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ee4183c-b2d3-4e95-ad67-73e892dbcf41 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1236 microversion: 2.1 time: 0.135477 Nov 02 21:52:01.796321 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2704/5534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:01 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1236 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:01.799875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:01.802194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:01.806036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:01.806661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:01.807958 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-038536c5-a29b-497f-b4ba-b0f0e5725f52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.364989 Nov 02 21:52:01.821140 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2831/5535] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:01 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:52:01.821371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:01.821371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:01.821371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:01.821371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:01.821371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:01.821371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:02.123601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:02.139490 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c4510a11-67ae-45f5-95ce-978180e55b1f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1532 microversion: 2.1 time: 0.336909 Nov 02 21:52:02.140406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2705/5536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:01 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1532 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:02.482646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:02.483404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:02.494228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:02.497458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:02.499318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:02.500176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:02.502528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:02.503050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:02.827252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:02.833393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:02.854221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:02.856832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:02.858610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:02.859530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:02.860001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:02.860445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:02.911397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:02.924826 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdf69094-d7ef-4d9f-803c-ee6b7b973ab4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.450633 Nov 02 21:52:02.926423 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2832/5537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:02 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:02.931920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:02.932953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:02.943249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:02.944152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:02.944908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:02.945848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:02.946508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:02.947434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:02.987308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:03.005091 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-879cd459-0224-405c-9254-2e3be3b6b7ac tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1288 microversion: 2.1 time: 0.184157 Nov 02 21:52:03.007299 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2706/5538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:02 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1288 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:03.165955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:03.166680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:03.174609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:03.175437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:03.176419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:03.177497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:03.178168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:03.178806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:03.542219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:03.568560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:03.570717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:03.586492 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e7ecdbb-ad66-42df-b81a-38ffd47346de tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.426671 Nov 02 21:52:03.595208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:03.595208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:03.595208 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2df4c48-bda7-4bc8-92ae-453e514f915c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.665241 Nov 02 21:52:03.595579 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2707/5539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:03 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:03.595670 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2833/5540] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:02 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:52:03.955873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:03.957213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:03.982316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:03.987264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:03.988140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:03.989149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:03.989827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:03.990487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:04.037635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:04.039059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:04.061345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:04.063171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:04.063816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:04.065799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:04.066934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:04.069880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:04.719678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:04.751895 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-01eafeae-38d9-464d-9395-d729cbf4a01c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1294 microversion: 2.1 time: 0.707722 Nov 02 21:52:04.755168 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2834/5541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:04 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1294 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:04.769600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b5457b28-33ae-48dd-92e2-3e25975841cf req-e8b79a48-c031-4059-98a9-a29b74bdc0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40ad45b-ca57-4f29-bc34-1b46511dab23", "name": "network-vif-plugged", "status": "completed", "tag": "9890a9b2-b6e7-4c1d-b480-c80d93a563a2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:04.788826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:04.792654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b5457b28-33ae-48dd-92e2-3e25975841cf req-e8b79a48-c031-4059-98a9-a29b74bdc0b1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:04.795523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b5457b28-33ae-48dd-92e2-3e25975841cf req-e8b79a48-c031-4059-98a9-a29b74bdc0b1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:04.797393 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1eca4b52-9c0c-47c5-bdad-5378358e47e6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.846083 Nov 02 21:52:04.797853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b5457b28-33ae-48dd-92e2-3e25975841cf req-e8b79a48-c031-4059-98a9-a29b74bdc0b1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:04.797988 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2708/5542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:03 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:04.816610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:04.817762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:04.825577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:04.827569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:04.828643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:04.829670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:04.830301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:04.830891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:04.845868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b5457b28-33ae-48dd-92e2-3e25975841cf req-e8b79a48-c031-4059-98a9-a29b74bdc0b1 service nova] Creating event network-vif-plugged:9890a9b2-b6e7-4c1d-b480-c80d93a563a2 for instance d40ad45b-ca57-4f29-bc34-1b46511dab23 on n-h2-860863-4 Nov 02 21:52:04.859352 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b5457b28-33ae-48dd-92e2-3e25975841cf req-e8b79a48-c031-4059-98a9-a29b74bdc0b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101573 Nov 02 21:52:04.860583 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2835/5543] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:04.878965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:04.881906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:04.919751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:04.927664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:04.928158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:04.938757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:04.945851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:04.949719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:05.612653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:05.622613 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89defab9-5f25-4c0c-8fda-c7461d3f8b88 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.818908 Nov 02 21:52:05.626784 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2709/5544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:04 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:05.634435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-779056758", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "42d3bf5f-6d06-4c0b-8027-d9ac3784b89e"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:05.672110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:05.684552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:05.686934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:05.698095 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1a25131-7d58-4c5c-90f0-66d158e307a3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.833489 Nov 02 21:52:05.700194 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2836/5545] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:04 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:52:05.749510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] validate_networks() for [('42d3bf5f-6d06-4c0b-8027-d9ac3784b89e', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:52:05.783499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:05.784242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:05.799356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:05.801466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:05.802505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:05.805715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:05.806430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:05.807037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:06.349533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:06.357856 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d48b7120-fdd4-4f78-9882-003a94996e67 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1361 microversion: 2.1 time: 0.578386 Nov 02 21:52:06.365356 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2837/5546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:05 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:06.375832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:06.376458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:06.394469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:06.394892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:06.395600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:06.396308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:06.396758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:06.397210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:06.930487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:06.940744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0affa240-450a-4d67-b170-6617b304ba60 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.581196 Nov 02 21:52:06.945548 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2838/5547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:06 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:06.962141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f8bf4780-e975-4aca-848e-d2c148e7c51c req-914667cc-b6cc-47b6-9d78-360ab850c441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329bf1b5-31f6-4107-a823-5a0c6bbbc201", "tag": "12dc2634-311e-477f-bf15-98f0b4ae6435"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:07.040126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f8bf4780-e975-4aca-848e-d2c148e7c51c req-914667cc-b6cc-47b6-9d78-360ab850c441 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.040624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f8bf4780-e975-4aca-848e-d2c148e7c51c req-914667cc-b6cc-47b6-9d78-360ab850c441 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.045325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f8bf4780-e975-4aca-848e-d2c148e7c51c req-914667cc-b6cc-47b6-9d78-360ab850c441 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.075883 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f8bf4780-e975-4aca-848e-d2c148e7c51c req-914667cc-b6cc-47b6-9d78-360ab850c441 service nova] Creating event network-changed:12dc2634-311e-477f-bf15-98f0b4ae6435 for instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 on n-h2-860863-4 Nov 02 21:52:07.095275 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f8bf4780-e975-4aca-848e-d2c148e7c51c req-914667cc-b6cc-47b6-9d78-360ab850c441 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148253 Nov 02 21:52:07.095896 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2839/5548] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:07.123682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:07.130089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:07.130797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:52:07.131297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:52:07.131802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:52:07.132492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:52:07.133281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:52:07.138729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.139349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.139799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.141190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.142394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.142996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.158941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.158941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.158941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.158941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.160415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.161826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.212484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Getting quotas for project 263f01641eb84587bc355ada260870d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:52:07.219037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:07.220414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Getting quotas for user 547b50d61a8948d9a5a6b9367716d4b6 and project 263f01641eb84587bc355ada260870d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:52:07.238351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:52:07.242274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:52:07.380210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:07.402709 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1531e52-342e-4f87-979f-f3cb13d016dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.304915 Nov 02 21:52:07.414127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2840/5549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:07 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:07.421706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:07.424571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:07.430261 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85cbcad9-3e98-4913-a811-795864679e6e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802034 Nov 02 21:52:07.440789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.444297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.445473 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2710/5550] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:52:07.445836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.446884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.447569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.448615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.464800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dbdc077c-6222-4a61-9594-d0360060c7b8 req-5ef67b79-98ee-4b56-82f6-e83b3910389d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "name": "network-vif-plugged", "status": "completed", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:07.518831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dbdc077c-6222-4a61-9594-d0360060c7b8 req-5ef67b79-98ee-4b56-82f6-e83b3910389d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.519327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dbdc077c-6222-4a61-9594-d0360060c7b8 req-5ef67b79-98ee-4b56-82f6-e83b3910389d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.521832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dbdc077c-6222-4a61-9594-d0360060c7b8 req-5ef67b79-98ee-4b56-82f6-e83b3910389d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.568460 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dbdc077c-6222-4a61-9594-d0360060c7b8 req-5ef67b79-98ee-4b56-82f6-e83b3910389d service nova] Creating event network-vif-plugged:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h1-860863-4 Nov 02 21:52:07.585035 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dbdc077c-6222-4a61-9594-d0360060c7b8 req-5ef67b79-98ee-4b56-82f6-e83b3910389d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135083 Nov 02 21:52:07.586761 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2711/5551] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:07.598755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:07.599215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:07.623733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.624241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.624808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.625490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:07.626145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:07.627258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:07.890291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:07.907529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:07.909223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:07.910607 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b389e20-ca14-4514-8ca6-4d57263dd491 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.493718 Nov 02 21:52:07.918271 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2841/5552] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:07 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:52:07.925969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1aaf30d-e9c4-4eae-acf6-ff7f5d48474c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:07.926815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1aaf30d-e9c4-4eae-acf6-ff7f5d48474c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:08.061834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1aaf30d-e9c4-4eae-acf6-ff7f5d48474c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:08.072209 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1aaf30d-e9c4-4eae-acf6-ff7f5d48474c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1213 microversion: 2.1 time: 0.152472 Nov 02 21:52:08.086753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2842/5553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:07 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:08.099596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:08.100531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:08.104268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:08.109801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:08.110713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:08.111518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:08.112585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:08.112803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5530fb6a-8c31-48b8-9e4b-26ec4b16a20c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1361 microversion: 2.1 time: 0.524465 Nov 02 21:52:08.113479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:08.114055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:08.129142 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2712/5554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:07 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1361 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:08.395725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:08.406449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1377406-b586-4c52-9f5f-6cc69d9e37b0 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.318308 Nov 02 21:52:08.408438 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2843/5555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:08 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:08.446433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:08.447656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:08.460621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:08.465488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:08.466537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:08.467523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:08.468361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:08.469092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:08.759304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:08.769736 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5582bd3a-f0c9-442a-98fd-3a98e067b31c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.328917 Nov 02 21:52:08.773165 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2713/5556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:08 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:08.938777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:08.945790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:08.950324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:08.951073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:08.951683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:08.952544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:08.953247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:08.954090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:09.102128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-93c0867a-4946-4e4d-977a-24def3ba8392 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:09.103200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-93c0867a-4946-4e4d-977a-24def3ba8392 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:09.233370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-93c0867a-4946-4e4d-977a-24def3ba8392 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:09.249512 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-93c0867a-4946-4e4d-977a-24def3ba8392 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1213 microversion: 2.1 time: 0.149570 Nov 02 21:52:09.251617 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2714/5557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:09 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:09.262361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:09.266234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:09.266378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:09.275833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:09.277531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:09.279093 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a9a21c7-ef93-48f3-b414-856058eff7ad tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.344374 Nov 02 21:52:09.279565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:09.280447 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2844/5558] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:08 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:52:09.280912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:09.282071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:09.282836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:09.283305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:09.284095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:09.442747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:09.443478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:09.457571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:09.458380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:09.459420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:09.460143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:09.460596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:09.463000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:09.485813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:09.703514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:09.730632 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-965d34f2-c413-4141-955b-6b104fad9f8c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1361 microversion: 2.1 time: 0.477139 Nov 02 21:52:09.736866 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2715/5559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:09 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:09.803734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:09.807949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:09.829162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:09.829976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:09.830639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:09.831669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:09.832516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:09.833206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:09.846722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:09.862802 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc5bd719-9843-449e-9e24-be9bf7c049e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.429673 Nov 02 21:52:09.874129 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2845/5560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:09 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:10.116120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:10.125679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24ccd19b-e382-4964-8dae-b836110ccf0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.335275 Nov 02 21:52:10.126285 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2716/5561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:09 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:10.284275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:10.288090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:10.301840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.302342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.303006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:10.304047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.304569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.305659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:10.310458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:10.311087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:10.325466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.330265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.330724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:10.335201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.335695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.336150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:10.390060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:10.422132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4747df92-7ae6-47f5-9117-e0433559c59b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1217 microversion: 2.1 time: 0.151544 Nov 02 21:52:10.424992 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2846/5562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:10 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:10.611205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:10.623690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:10.628844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:10.635519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89d6866c-0e4a-444a-87ff-925bcb1e07e8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.329593 Nov 02 21:52:10.635519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2717/5563] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:10 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:52:10.759565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:10.761201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:10.769104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.769982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.770957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:10.771981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.773560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.774285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:10.920041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:10.920733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:10.931961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.937083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.938158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:10.938899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:10.939373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:10.940400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.081757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:11.094018 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74d26b71-08b5-4367-87ca-1e1dda78ee04 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1361 microversion: 2.1 time: 0.338014 Nov 02 21:52:11.095146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2847/5564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:10 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:11.151946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:11.161308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:11.161308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:11.163930 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d0fd60c-6643-41c7-b444-c6de119bfb35 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1507 microversion: 2.1 time: 0.272494 Nov 02 21:52:11.167123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.167932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.168487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.169575 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2718/5565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:10 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:11.169704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.170454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.170990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.427532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:11.437826 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe9d3378-4f24-4cff-90ac-032b91ee257f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.287442 Nov 02 21:52:11.463615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:11.463615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:11.465535 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2848/5566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:11 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:11.469893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.470388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.470831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.471532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.472012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.472417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.553550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:11.554049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:11.562862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.568580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.568580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.568580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.569023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:11.582130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.582311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b7d9e48a-255b-486f-9de5-c4786f4b8057 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1265 microversion: 2.1 time: 0.126626 Nov 02 21:52:11.582605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.591539 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2719/5567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:11 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:11.661403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:11.662206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:11.670288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.670788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.671235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.671944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:11.672565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:11.673039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:11.695820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:11.699553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lazy-loading 'services' on Instance uuid 632c5b67-1b8c-48e2-98df-d4c4c5061d2a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:11.948387 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70204262-68fe-48dd-8514-f8ad3cb2e9bc tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "DELETE /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a/os-volume_attachments/0f439933-8cbb-458e-a2d1-5e03661a8c9d" status: 202 len: 0 microversion: 2.1 time: 0.398444 Nov 02 21:52:11.954031 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2849/5568] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:52:11 2022] DELETE /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a/os-volume_attachments/0f439933-8cbb-458e-a2d1-5e03661a8c9d => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:52:12.007244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:12.022399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:12.022399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:12.025256 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85a5ce02-1008-402d-a82d-b23d809b2f92 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1809 microversion: 2.20 time: 0.368231 Nov 02 21:52:12.030133 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2720/5569] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:11 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1809 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:52:12.118093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:12.119255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:12.134626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.138738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.139395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.140416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.141078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.142801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.196339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:12.198379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:12.224757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.225292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.227353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.229540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.231043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.231440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.479320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:12.489422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ab4d73c-cef5-436e-8dcb-847957b8ed2c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1361 microversion: 2.1 time: 0.375429 Nov 02 21:52:12.492013 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2850/5570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:12 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:12.506399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:12.507420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:12.518771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.525752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.526550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.528307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.529171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.529825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.644504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:12.659660 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b17a261e-98b0-48fe-a732-f412349f3283 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1487 microversion: 2.1 time: 0.470614 Nov 02 21:52:12.663781 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2721/5571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:12 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1487 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:12.680961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:12.686739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:12.703964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.705358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.708354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.709457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.710664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.715637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.900535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:12.910313 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69009e03-8589-47ec-8af4-001e3e212b73 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1271 microversion: 2.1 time: 0.245171 Nov 02 21:52:12.914184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2722/5572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:12 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:12.935639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ea4f2be9-81f5-4051-b89b-1cf6a2d84b6c req-c9ea04ee-ac0b-47dc-ab36-4bf4edbcf030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329bf1b5-31f6-4107-a823-5a0c6bbbc201", "name": "network-vif-plugged", "status": "completed", "tag": "12dc2634-311e-477f-bf15-98f0b4ae6435"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:12.963685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea4f2be9-81f5-4051-b89b-1cf6a2d84b6c req-c9ea04ee-ac0b-47dc-ab36-4bf4edbcf030 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:12.966383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea4f2be9-81f5-4051-b89b-1cf6a2d84b6c req-c9ea04ee-ac0b-47dc-ab36-4bf4edbcf030 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:12.967044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ea4f2be9-81f5-4051-b89b-1cf6a2d84b6c req-c9ea04ee-ac0b-47dc-ab36-4bf4edbcf030 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:12.996991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:13.010235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83c7a9a9-d74f-4245-8d60-009189bb2de5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.517071 Nov 02 21:52:13.010825 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2851/5573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:12 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:13.038333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ea4f2be9-81f5-4051-b89b-1cf6a2d84b6c req-c9ea04ee-ac0b-47dc-ab36-4bf4edbcf030 service nova] Creating event network-vif-plugged:12dc2634-311e-477f-bf15-98f0b4ae6435 for instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 on n-h2-860863-4 Nov 02 21:52:13.064093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1567956926", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:13.069583 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ea4f2be9-81f5-4051-b89b-1cf6a2d84b6c req-c9ea04ee-ac0b-47dc-ab36-4bf4edbcf030 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151575 Nov 02 21:52:13.071966 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2723/5574] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:13.092161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:13.107326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:13.127674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:13.129915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:13.130461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:13.131290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:13.132491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:13.134251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:13.219493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] validate_networks() for [('0032e117-cd5d-4ec1-ab19-10fbc1753cb6', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:52:13.571126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:13.587064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:13.587880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:13.589148 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5b43352c-fb0c-4ecc-9bb6-884ad50d543d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1796 microversion: 2.20 time: 0.515922 Nov 02 21:52:13.593881 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2724/5575] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:13 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1796 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:52:13.598634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:13.604041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:13.618448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:13.618946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:13.619388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:13.620171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:13.620634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:13.621153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:14.065260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:14.073202 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2f5c04c-698b-4b19-84cd-12cbcf05744c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1361 microversion: 2.1 time: 0.478225 Nov 02 21:52:14.078022 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2725/5576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:13 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1361 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:14.091566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:14.092207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:14.103509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:14.104023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:14.104475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:14.105278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:14.107391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:14.110579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:14.560852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:52:14.561435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:52:14.561783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:52:14.562206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:52:14.562672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:52:14.594722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:14.595518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:14.596128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:14.597106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:14.597748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:14.598356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:14.643354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Getting quotas for project 5f4e9d83fc7d45d581f167e2cc6a6705. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:52:14.661005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Getting quotas for user 7b5b0e068d2f4dadbf174537649474ea and project 5f4e9d83fc7d45d581f167e2cc6a6705. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:52:14.691568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:52:14.694733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:52:14.705576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:14.714302 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f229cbda-ec5c-416f-9e99-c75c304c9642 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1313 microversion: 2.1 time: 0.635120 Nov 02 21:52:14.716585 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2726/5577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:14 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:14.740810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:14.743181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:14.752167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:14.752973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:14.753661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:14.755052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:14.756181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:14.757733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:15.006719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:15.021603 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d41de12b-88b1-4c27-be47-1075a7fcc932 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.303499 Nov 02 21:52:15.031817 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2727/5578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:14 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:15.097594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:15.098989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:15.119380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:15.120150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:15.120946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:15.122641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:15.123320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:15.123957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:15.193885 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e2bb372-b5dd-407f-83c5-521ff1327ae8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.157142 Nov 02 21:52:15.197133 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2852/5579] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:52:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:52:15.213128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e9be949-1e3b-4c25-909a-ae1506d451c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:15.216383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e9be949-1e3b-4c25-909a-ae1506d451c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:15.841726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e9be949-1e3b-4c25-909a-ae1506d451c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:15.853092 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e9be949-1e3b-4c25-909a-ae1506d451c3 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1214 microversion: 2.1 time: 0.646208 Nov 02 21:52:15.853683 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2853/5580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:15 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1214 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:15.858939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:15.859556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:15.866363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:15.867037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:15.867676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:15.868570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:15.869053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:15.869491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:15.907210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:15.920457 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9a331e14-44aa-4e79-a26b-742a4444f1b7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1548 microversion: 2.1 time: 0.825575 Nov 02 21:52:15.933413 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2728/5581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:15 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1548 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:15.940101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-47572012-61cd-4c68-8580-c437eba44ab0 req-2be4cd6e-ca34-4848-b93e-fdb619831977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e", "tag": "819752a3-03d1-42ce-a874-c4e7efdf5ef1"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:15.955243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-47572012-61cd-4c68-8580-c437eba44ab0 req-2be4cd6e-ca34-4848-b93e-fdb619831977 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:15.956108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-47572012-61cd-4c68-8580-c437eba44ab0 req-2be4cd6e-ca34-4848-b93e-fdb619831977 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:15.956832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-47572012-61cd-4c68-8580-c437eba44ab0 req-2be4cd6e-ca34-4848-b93e-fdb619831977 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:15.972550 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-47572012-61cd-4c68-8580-c437eba44ab0 req-2be4cd6e-ca34-4848-b93e-fdb619831977 service nova] Creating event network-changed:819752a3-03d1-42ce-a874-c4e7efdf5ef1 for instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e on n-h1-860863-4 Nov 02 21:52:15.979877 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-47572012-61cd-4c68-8580-c437eba44ab0 req-2be4cd6e-ca34-4848-b93e-fdb619831977 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044219 Nov 02 21:52:15.986153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2729/5582] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:15.995032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:15.996752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:16.015456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:16.016767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:16.020663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:16.021748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:16.022485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:16.023136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:16.144146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:16.154396 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6505b359-1206-47f0-98ba-01c02e921f53 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1313 microversion: 2.1 time: 0.299407 Nov 02 21:52:16.166949 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41557356-8e7f-4caa-9f73-d76995f89124 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173975 Nov 02 21:52:16.166949 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2730/5583] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:52:15 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:16.176199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:16.176826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:16.191514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2854/5584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:15 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:16.197479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:16.198205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:16.198987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:16.199911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:16.200537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:16.205977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:16.877703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:16.881923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:16.910269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:16.910857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:16.911708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:16.912172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:16.912723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:16.914732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:17.030885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:17.050455 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-66d8b3a6-f072-4868-be9b-04e01e88c8d8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.868112 Nov 02 21:52:17.051843 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2731/5585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:16 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:17.129912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:17.173876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d21b307-dea6-4196-8cfe-7fa52169f8e4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1218 microversion: 2.1 time: 0.294888 Nov 02 21:52:17.176124 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2855/5586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:16 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1218 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:17.210440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:17.211063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:17.226045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:17.227705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:17.228174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:17.228623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:17.229594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:17.230607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:17.231521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:17.729998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:17.742282 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9a045d2-1aaa-4ee2-b0f1-5b3b196921b7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1313 microversion: 2.1 time: 0.536324 Nov 02 21:52:17.744542 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2732/5587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:17 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:18.081294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:18.081912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:18.096560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:18.097079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:18.097737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:18.098620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:18.099241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:18.099820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:18.203855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:18.205368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:18.234257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:18.235465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:18.236110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:18.236836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:18.237323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:18.237777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:18.459920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:18.476922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:18.488572 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82917b0e-a97a-4918-9912-740fef5dad65 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.411319 Nov 02 21:52:18.489308 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44ff3488-1581-4e6a-b308-fd46a28a1b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1266 microversion: 2.1 time: 0.288655 Nov 02 21:52:18.490130 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2733/5588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:18 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:18.492162 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2856/5589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:18 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:18.769992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:18.780212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:18.797180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:18.798924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:18.801480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:18.802497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:18.803175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:18.805102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:19.225659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:19.237694 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d8697bb-d284-4d4e-a671-0cea756e39ab tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1313 microversion: 2.1 time: 0.471630 Nov 02 21:52:19.249210 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2734/5590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:18 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:19.360348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7bbef40e-16c1-456f-b0e9-3738d632fecf req-be621c7d-8326-402c-80e6-5264e2c48960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329bf1b5-31f6-4107-a823-5a0c6bbbc201", "tag": "12dc2634-311e-477f-bf15-98f0b4ae6435"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:19.383801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7bbef40e-16c1-456f-b0e9-3738d632fecf req-be621c7d-8326-402c-80e6-5264e2c48960 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:19.385660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7bbef40e-16c1-456f-b0e9-3738d632fecf req-be621c7d-8326-402c-80e6-5264e2c48960 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:19.386311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7bbef40e-16c1-456f-b0e9-3738d632fecf req-be621c7d-8326-402c-80e6-5264e2c48960 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:19.416035 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7bbef40e-16c1-456f-b0e9-3738d632fecf req-be621c7d-8326-402c-80e6-5264e2c48960 service nova] Creating event network-changed:12dc2634-311e-477f-bf15-98f0b4ae6435 for instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 on n-h2-860863-4 Nov 02 21:52:19.423349 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7bbef40e-16c1-456f-b0e9-3738d632fecf req-be621c7d-8326-402c-80e6-5264e2c48960 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068538 Nov 02 21:52:19.425841 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2857/5591] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:19.523340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:19.524188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:19.524895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:19.525826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:19.537208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=18 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:19.539548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:19.543743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:19.544533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:19.545384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:19.546417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:19.547633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:19.547874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:19.548495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:19.549703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:19.550235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:19.551535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:19.555169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:20.207704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:20.219953 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a906a316-1f2c-4f8c-a202-478e6edb3907 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.699790 Nov 02 21:52:20.220845 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2858/5592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:19 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:20.265223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:20.266645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:20.277269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:20.278829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:20.279435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:20.281785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:20.282945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:20.285257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:20.309251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:20.321399 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-20b39e12-12ba-48b6-83b1-bfabca837a59 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.807550 Nov 02 21:52:20.337561 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2735/5593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:19 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:20.812276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:20.823021 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3868421e-5255-4812-a6b9-7ee958d8bbb1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1313 microversion: 2.1 time: 0.563274 Nov 02 21:52:20.825152 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2859/5594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:20 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:20.924481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:20.925007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:20.940577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:20.941122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:20.941574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:20.942290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:20.942752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:20.943185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.005808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:52:21.244437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:21.245330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:21.256998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.258229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.258732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.259456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.259920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.260351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.395735 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dffb89ba-8c53-46b0-a62f-1e71ab9d2c31 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "DELETE /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 204 len: 0 microversion: 2.1 time: 0.475928 Nov 02 21:52:21.402823 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2736/5595] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:52:20 2022] DELETE /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:52:21.406346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:21.409955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:21.421967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.422718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.423411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.424876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.425718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.426317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.433702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:21.608188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:21.619555 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-236136c7-b38d-4770-823f-02d843ff4f2c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.379793 Nov 02 21:52:21.621050 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2860/5596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:21 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:21.626338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:21.626959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:21.634244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.634733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.635170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.635870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.636882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.637416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.757846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:21.779909 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4234b3fc-72da-4135-b2ac-d4e3d3604440 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.378664 Nov 02 21:52:21.793191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2737/5597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:21 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:21.793191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0b48a86e-0a77-4515-9a76-15b2f8f552d4 req-e5c13246-d0bb-44d6-b7f1-542c246abd16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e24092b0-4024-40ed-968c-ac378dfcb3fb", "tag": "26dbede2-4592-4cf9-81e3-2047215efd08"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:21.798425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0b48a86e-0a77-4515-9a76-15b2f8f552d4 req-e5c13246-d0bb-44d6-b7f1-542c246abd16 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.803585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0b48a86e-0a77-4515-9a76-15b2f8f552d4 req-e5c13246-d0bb-44d6-b7f1-542c246abd16 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.803585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0b48a86e-0a77-4515-9a76-15b2f8f552d4 req-e5c13246-d0bb-44d6-b7f1-542c246abd16 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.813077 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0b48a86e-0a77-4515-9a76-15b2f8f552d4 req-e5c13246-d0bb-44d6-b7f1-542c246abd16 service nova] Creating event network-changed:26dbede2-4592-4cf9-81e3-2047215efd08 for instance e24092b0-4024-40ed-968c-ac378dfcb3fb on n-h2-860863-4 Nov 02 21:52:21.818897 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0b48a86e-0a77-4515-9a76-15b2f8f552d4 req-e5c13246-d0bb-44d6-b7f1-542c246abd16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036581 Nov 02 21:52:21.819721 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2738/5598] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:21.868733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:21.869393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:21.871729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:21.881161 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6251a798-e1f4-4c52-9bee-43f691fb135a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1514 microversion: 2.1 time: 0.259011 Nov 02 21:52:21.882157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.882293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2861/5599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:21 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:21.883002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.884614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:21.885409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:21.897061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:21.897061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:22.120010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:22.131342 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff409a6d-2445-4c5f-8f5b-3a8b805571ea tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1313 microversion: 2.1 time: 0.283244 Nov 02 21:52:22.132361 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2739/5600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:21 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:22.567244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6e8182e7-daf6-4d44-9098-a76c4fe1ad78 req-2364b5f0-d5fc-4973-9a41-c10a9f58ad11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e", "name": "network-vif-plugged", "status": "completed", "tag": "819752a3-03d1-42ce-a874-c4e7efdf5ef1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:22.590562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6e8182e7-daf6-4d44-9098-a76c4fe1ad78 req-2364b5f0-d5fc-4973-9a41-c10a9f58ad11 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:22.593462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6e8182e7-daf6-4d44-9098-a76c4fe1ad78 req-2364b5f0-d5fc-4973-9a41-c10a9f58ad11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:22.593462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6e8182e7-daf6-4d44-9098-a76c4fe1ad78 req-2364b5f0-d5fc-4973-9a41-c10a9f58ad11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:22.616328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6e8182e7-daf6-4d44-9098-a76c4fe1ad78 req-2364b5f0-d5fc-4973-9a41-c10a9f58ad11 service nova] Creating event network-vif-plugged:819752a3-03d1-42ce-a874-c4e7efdf5ef1 for instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e on n-h1-860863-4 Nov 02 21:52:22.633938 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6e8182e7-daf6-4d44-9098-a76c4fe1ad78 req-2364b5f0-d5fc-4973-9a41-c10a9f58ad11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070296 Nov 02 21:52:22.634889 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2862/5601] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:22.643262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:22.644500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:22.664557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:22.668675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:22.668675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:22.668675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:22.668675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:22.668675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:22.804139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:22.805308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:22.823901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:22.824837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:22.825500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:22.826371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:22.826985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:22.827574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:23.253088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:23.256645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:23.260833 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-518b1700-da92-44bd-bd33-ed303d1156be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.460769 Nov 02 21:52:23.263974 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2863/5602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:22 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:23.270858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:23.271716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:23.279068 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2176a6d6-1dac-4a4a-bca2-81b6da2a8060 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.639826 Nov 02 21:52:23.279682 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2740/5603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:22 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:23.281735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:23.286963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:23.286963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:23.286963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:23.286963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:23.286963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:23.289982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:23.302130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:23.302761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:23.315265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:23.315696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:23.316137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:23.316844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:23.317332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:23.317759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:23.585044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:23.596204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91cd961b-bc6a-4ed3-b2fe-c8f20d79b026 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1313 microversion: 2.1 time: 0.310160 Nov 02 21:52:23.599497 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2741/5604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:23 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:23.616851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:23.631295 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fa6ae2c-82b0-4401-9c54-d497f773b20b tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1514 microversion: 2.1 time: 0.363188 Nov 02 21:52:23.633234 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2864/5605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:23 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:24.028712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0784ace0-a496-4fdd-a461-d5f8bfc22932 req-2b083782-9825-4f74-b598-2fd3f34861b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "632c5b67-1b8c-48e2-98df-d4c4c5061d2a", "name": "network-vif-deleted", "tag": "b3bc9654-dbdd-465b-97a7-200f8adc2106"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:24.044739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0784ace0-a496-4fdd-a461-d5f8bfc22932 req-2b083782-9825-4f74-b598-2fd3f34861b8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.045490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0784ace0-a496-4fdd-a461-d5f8bfc22932 req-2b083782-9825-4f74-b598-2fd3f34861b8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.046130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0784ace0-a496-4fdd-a461-d5f8bfc22932 req-2b083782-9825-4f74-b598-2fd3f34861b8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.062847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0784ace0-a496-4fdd-a461-d5f8bfc22932 req-2b083782-9825-4f74-b598-2fd3f34861b8 service nova] Creating event network-vif-deleted:b3bc9654-dbdd-465b-97a7-200f8adc2106 for instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a on n-h2-860863-4 Nov 02 21:52:24.067760 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0784ace0-a496-4fdd-a461-d5f8bfc22932 req-2b083782-9825-4f74-b598-2fd3f34861b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047138 Nov 02 21:52:24.068371 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2742/5606] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:24.290853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:24.291467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:24.298538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.299167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.299529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.300215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.300668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.301141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.308717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:24.309480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:24.315723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.316209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.316650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.317403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.317908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.318287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.526569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:24.534564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:24.540475 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d79e386-2d27-4555-9742-90932865d6a9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.253495 Nov 02 21:52:24.541089 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2865/5607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:24 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:24.546446 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f98e3445-726d-4013-8f72-a5eac0a6bc00 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.242227 Nov 02 21:52:24.547207 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2743/5608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:24 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:24.620753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:24.621864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:24.630027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:24.632150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.632834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.633986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.634708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.635323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.635988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.656372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:24.657374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:24.666605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.667533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.668136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.670830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.670830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.670830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.703488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:24.703966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:24.704589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:24.705074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lazy-loading 'fault' on Instance uuid 632c5b67-1b8c-48e2-98df-d4c4c5061d2a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:24.763440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:24.772349 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ac34e8c-f7b2-4f82-94e9-4e5b6db33298 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1308 microversion: 2.1 time: 0.120556 Nov 02 21:52:24.773184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2744/5609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:24 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:24.881060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:24.889607 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-087e459d-806f-42f4-a780-3e7bdce5c0fd tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1498 microversion: 2.1 time: 0.273551 Nov 02 21:52:24.890186 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2866/5610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:24 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1498 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:25.574728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:25.575368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:25.576913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:25.577562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:25.587785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.588344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.588895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.589372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.589502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.590102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.590228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.590732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.591175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.591458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.592071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.592658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.816264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:25.831086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:25.832547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a8c0e39-70f6-4162-aeab-2b4ddaf0ec81 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.265363 Nov 02 21:52:25.841575 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2867/5611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:25 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:25.847554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:25.848173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:25.851141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:25.854912 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a6596ad0-6654-4277-a34b-3235e53d7bf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1527 microversion: 2.1 time: 0.293492 Nov 02 21:52:25.855054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.855389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.856105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.857105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.857773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.858268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.862377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2745/5612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:25 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1527 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:25.903714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.904527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.905264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.906613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lazy-loading 'fault' on Instance uuid 632c5b67-1b8c-48e2-98df-d4c4c5061d2a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:25.939736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:25.940977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:25.948283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.949438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.952489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.952489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:25.952489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:25.952489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:25.957011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:25.967209 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fffe2632-9739-40f3-b9e4-6bafc33a5441 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 200 len: 1308 microversion: 2.1 time: 0.124468 Nov 02 21:52:25.973067 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2868/5613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:25 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:25.981700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:52:26.334946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-beb73c3e-4838-4c6f-867e-ec5741d27ff2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 204 len: 0 microversion: 2.1 time: 0.398344 Nov 02 21:52:26.340091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2746/5614] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:52:25 2022] DELETE /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:52:26.349632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:26.351131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:26.361525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:26.365482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:26.365482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:26.365482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:26.367161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:26.367927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:26.368362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:26.690939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:26.701945 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65b7f687-27d0-4184-87b8-904632ef6563 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1504 microversion: 2.1 time: 0.358163 Nov 02 21:52:26.702797 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2869/5615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:26 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:26.865224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:26.866871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:26.880007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:26.880694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:26.881852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:26.884467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:26.884913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:26.885994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:26.889448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:26.890086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:26.899803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:26.900300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:26.911584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:26.912480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:26.912991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:26.914589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:27.221603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:27.237363 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-99bb5d96-d4ee-42ef-b552-0bb1db371fcb tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.383361 Nov 02 21:52:27.238258 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2747/5616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:26 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:27.249001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:27.250555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: 632c5b67-1b8c-48e2-98df-d4c4c5061d2a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:27.258028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:27.260074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:27.260727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:27.265186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:27.265186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:27.265186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:27.265186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:27.285965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:27.293775 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] HTTP exception thrown: Instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a could not be found. Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Request method failure captured: Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a HTTP/1.1 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuWaMY0w9DQ4xcxVJ4ByD8WP51dh-M6OPb5hQ2qf4rBI2jZI8jDMJOjWivOsBIS1ZBu3jP6kS6uA9du42t9sROcBCgP6UYdzwsSkwdmh1GnPr9vGe1QO7pTuxKulG7sGO8FlCtG_15akEDq2Bug_-7acBkwD73R4JeMMCa95Gp1zo58 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a0cff0fbcbb24d1a804e9a0b2f5e2e13 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesSnapshotTestJSON-626344921 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesSnapshotTestJSON-626344921 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a0cff0fbcbb24d1a804e9a0b2f5e2e13 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-626344921 Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesSnapshotTestJSON-626344921-project Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 94e549ae9b7c4a74a0a68a20806ffa9e Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesSnapshotTestJSON-626344921-project Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a could not be found. Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '632c5b67-1b8c-48e2-98df-d4c4c5061d2a'} Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a could not be found. Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a could not be found. Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:27.295478 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a could not be found. Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Returning 404 to user: Instance 632c5b67-1b8c-48e2-98df-d4c4c5061d2a could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4256fc7b-c167-4f36-a16b-4e9c5e779313 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a" status: 404 len: 111 microversion: 2.1 time: 0.057241 Nov 02 21:52:27.300773 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2748/5617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:27 2022] GET /compute/v2.1/servers/632c5b67-1b8c-48e2-98df-d4c4c5061d2a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:52:27.318810 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6407e7da-e3b2-49d7-8493-3f3007bad982 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1509 microversion: 2.1 time: 0.441505 Nov 02 21:52:27.320681 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2870/5618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:26 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:27.726044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:27.726665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:27.742372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:27.742840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:27.743283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:27.743980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:27.744462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:27.744887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:27.943836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:27.951931 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c5792ba-3fc8-41f1-8d85-e23ffdc997bb tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1504 microversion: 2.1 time: 0.229907 Nov 02 21:52:27.952557 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2749/5619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:27 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:28.269375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:28.270839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:28.282990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.282990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.282990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:28.282990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.282990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.282990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:28.359556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:28.360183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:28.372363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.372862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.373353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:28.374063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.374957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.376266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:28.668340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:28.681100 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2bbf72b-29fe-416f-9d5c-4d0b48c722b4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.417577 Nov 02 21:52:28.682458 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2871/5620] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:28 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:28.688010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5a3d9c99-1a71-4ab3-8824-1b58667b8fb6 req-ae53163e-2201-4e5b-8ff5-f03df9e3513d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24092b0-4024-40ed-968c-ac378dfcb3fb", "name": "network-vif-plugged", "status": "completed", "tag": "26dbede2-4592-4cf9-81e3-2047215efd08"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:28.698441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5a3d9c99-1a71-4ab3-8824-1b58667b8fb6 req-ae53163e-2201-4e5b-8ff5-f03df9e3513d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.699323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5a3d9c99-1a71-4ab3-8824-1b58667b8fb6 req-ae53163e-2201-4e5b-8ff5-f03df9e3513d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.701368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5a3d9c99-1a71-4ab3-8824-1b58667b8fb6 req-ae53163e-2201-4e5b-8ff5-f03df9e3513d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:28.714865 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5a3d9c99-1a71-4ab3-8824-1b58667b8fb6 req-ae53163e-2201-4e5b-8ff5-f03df9e3513d service nova] Creating event network-vif-plugged:26dbede2-4592-4cf9-81e3-2047215efd08 for instance e24092b0-4024-40ed-968c-ac378dfcb3fb on n-h2-860863-4 Nov 02 21:52:28.720775 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5a3d9c99-1a71-4ab3-8824-1b58667b8fb6 req-ae53163e-2201-4e5b-8ff5-f03df9e3513d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036078 Nov 02 21:52:28.721758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2872/5621] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:28.727250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b21eb266-773b-4a2e-90af-3f2dd089bbbc req-cb0a048c-e8ac-4267-94b4-397f98ddfbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e", "name": "network-vif-deleted", "tag": "819752a3-03d1-42ce-a874-c4e7efdf5ef1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:28.738632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b21eb266-773b-4a2e-90af-3f2dd089bbbc req-cb0a048c-e8ac-4267-94b4-397f98ddfbab service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.739009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:28.739333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b21eb266-773b-4a2e-90af-3f2dd089bbbc req-cb0a048c-e8ac-4267-94b4-397f98ddfbab service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.739840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b21eb266-773b-4a2e-90af-3f2dd089bbbc req-cb0a048c-e8ac-4267-94b4-397f98ddfbab service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:28.751619 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91a9dfd7-7a44-4dea-87bb-6dae67b1965e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1509 microversion: 2.1 time: 0.396547 Nov 02 21:52:28.764955 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b21eb266-773b-4a2e-90af-3f2dd089bbbc req-cb0a048c-e8ac-4267-94b4-397f98ddfbab service nova] Creating event network-vif-deleted:819752a3-03d1-42ce-a874-c4e7efdf5ef1 for instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e on n-h1-860863-4 Nov 02 21:52:28.764955 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b21eb266-773b-4a2e-90af-3f2dd089bbbc req-cb0a048c-e8ac-4267-94b4-397f98ddfbab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035058 Nov 02 21:52:28.764955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2873/5622] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:28.766605 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2750/5623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:28 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:28.976287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:28.977020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:28.984267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.984958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.985402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:28.986127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:28.986546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:28.987229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:29.029618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:29.030104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:29.030686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:29.031146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lazy-loading 'fault' on Instance uuid 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:29.074953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:29.082739 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8ffc1d0-019e-4e10-b9d4-7122705d6649 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 200 len: 1303 microversion: 2.1 time: 0.110791 Nov 02 21:52:29.096516 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2874/5624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:28 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:29.710458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:29.711662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:29.729350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:29.730797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:29.733283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:29.734313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:29.736188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:29.738775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:29.789556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:29.790369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:29.802108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:29.803818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:29.804428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:29.806772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:29.807702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:29.808908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.110300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:30.125625 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f8442d9-6ed7-4ba3-86fb-4fef99860959 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1512 microversion: 2.1 time: 0.350965 Nov 02 21:52:30.126470 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2875/5625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:29 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:30.131320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:30.131934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:30.138361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.138863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.139303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.140001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.140457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.140883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.151612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:30.156691 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] HTTP exception thrown: Instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e could not be found. Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Request method failure captured: Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e HTTP/1.1 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuaBSlxDn--iP1v7huh9PChKzpF3OgHrfdp80nSDaQL9dZLcFVfvJ9lKojddiUuDbmKMmNxbg3oQXVZu37E7Krb2ft3Hn1J6zFGUjlFypcdEs9Y8F2s-XCoAfOJSCYYiHl9iUqaLdI43_V8sN726jNkx4VgCJ-olwdi6kduKXu2ogSo Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 263f01641eb84587bc355ada260870d3 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesActionsTest-1665142977 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_263f01641eb84587bc355ada260870d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/263f01641eb84587bc355ada260870d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/263f01641eb84587bc355ada260870d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/263f01641eb84587bc355ada260870d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesActionsTest-1665142977 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 263f01641eb84587bc355ada260870d3 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesActionsTest-1665142977 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesActionsTest-1665142977-project Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 547b50d61a8948d9a5a6b9367716d4b6 Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesActionsTest-1665142977-project Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e could not be found. Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e'} Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e could not be found. Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e could not be found. Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:30.158950 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.163240 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:30.163240 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:30.163240 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:30.163240 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:52:30.163240 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:52:30.163240 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e could not be found. Nov 02 21:52:30.163240 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.164278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Returning 404 to user: Instance 9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:52:30.164521 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-11e271ea-16f9-4954-81e0-9575df649ee4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1314 microversion: 2.1 time: 0.458080 Nov 02 21:52:30.165472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2751/5626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:29 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:30.165978 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-30025e34-0a49-44f2-828c-baffb6971c65 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e" status: 404 len: 111 microversion: 2.1 time: 0.037882 Nov 02 21:52:30.167041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2876/5627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:30 2022] GET /compute/v2.1/servers/9a7d6b3b-210e-4a7a-8e2e-5a32da584c6e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:52:30.170304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:30.171071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:30.205195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.209886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.210409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.211162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.212516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.212995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.294222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-449987865", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "42d3bf5f-6d06-4c0b-8027-d9ac3784b89e"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:30.381353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] validate_networks() for [('42d3bf5f-6d06-4c0b-8027-d9ac3784b89e', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:52:30.543380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:30.553621 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-29a81c2b-606b-43a8-9cd4-60b8feda65d9 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1452 microversion: 2.1 time: 0.387086 Nov 02 21:52:30.556615 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2752/5628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:30 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1452 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:30.647457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:30.647997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:30.654898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.655391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.657679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.657679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.657679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.657679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.683703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lazy-loading 'flavor' on Instance uuid d40ad45b-ca57-4f29-bc34-1b46511dab23 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:30.687773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:30.697204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Cannot 'shelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state shelved_offloaded Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action HTTP/1.1 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 14 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: {"shelve": {}} Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'shelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state shelved_offloaded Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'shelve': {}}} Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:52:30.699634 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state shelved_offloaded Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state shelved_offloaded Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 409 to user: Cannot 'shelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state shelved_offloaded {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-edeb8d1f-b9f3-4fdf-bc61-89b9ac898b93 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 409 len: 155 microversion: 2.1 time: 0.057814 Nov 02 21:52:30.707757 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2753/5629] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:52:30 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 155 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:52:30.711836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:30.713263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:30.721038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.721181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.721812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.722535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.723151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.723591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.759258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121039) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 21:52:30.961990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:52:30.964268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:52:30.964268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:52:30.964268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:52:30.964268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:52:30.972698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.973251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.976501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:30.981198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:30.981981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:30.982614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.001918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Getting quotas for project 263f01641eb84587bc355ada260870d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:52:31.007679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Getting quotas for user 547b50d61a8948d9a5a6b9367716d4b6 and project 263f01641eb84587bc355ada260870d3. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:52:31.022489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:52:31.024973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:52:31.139575 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1698a77f-b9f0-46db-9bde-fafc271bc65f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 202 len: 0 microversion: 2.1 time: 0.433202 Nov 02 21:52:31.140337 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2754/5630] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:52:30 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:52:31.146438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-07ce5681-78cf-49ad-8a30-bc7a176af525 req-2ecd0dbc-e415-40fc-953d-aa941c6fe19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40ad45b-ca57-4f29-bc34-1b46511dab23", "name": "network-vif-unplugged", "status": "completed", "tag": "9890a9b2-b6e7-4c1d-b480-c80d93a563a2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:31.159172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-07ce5681-78cf-49ad-8a30-bc7a176af525 req-2ecd0dbc-e415-40fc-953d-aa941c6fe19d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:31.161369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-07ce5681-78cf-49ad-8a30-bc7a176af525 req-2ecd0dbc-e415-40fc-953d-aa941c6fe19d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:31.161369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-07ce5681-78cf-49ad-8a30-bc7a176af525 req-2ecd0dbc-e415-40fc-953d-aa941c6fe19d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.172470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.compute.server_external_events [req-07ce5681-78cf-49ad-8a30-bc7a176af525 req-2ecd0dbc-e415-40fc-953d-aa941c6fe19d service nova] Unable to find a host for instance d40ad45b-ca57-4f29-bc34-1b46511dab23. Dropping event network-vif-unplugged {{(pid=121039) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 21:52:31.173517 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-07ce5681-78cf-49ad-8a30-bc7a176af525 req-2ecd0dbc-e415-40fc-953d-aa941c6fe19d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031675 Nov 02 21:52:31.174065 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2755/5631] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 21:52:31.178839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:31.179840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:31.187120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:31.187637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:31.189829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.189829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:31.189829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:31.189829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.202055 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d639b736-0fd9-4e05-aba7-a23c73fb8e7b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911921 Nov 02 21:52:31.203410 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2877/5632] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:52:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:52:31.214204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:31.215659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:31.225688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:31.226513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:31.227340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.228283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:31.229002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:31.229900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.524015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:31.543929 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33a1da2f-e0f8-4f97-94ca-c319c68d4314 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1500 microversion: 2.1 time: 0.336619 Nov 02 21:52:31.574105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2878/5633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:31 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1500 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:31.584571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f81241a-c98b-48c5-b69d-7e098f746144 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:31.585255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f81241a-c98b-48c5-b69d-7e098f746144 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:31.632026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:31.641881 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab49ca79-32e1-4a61-979b-23e16820b194 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1460 microversion: 2.1 time: 0.466620 Nov 02 21:52:31.642483 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2756/5634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:31 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1460 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:31.662030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:31.664325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:31.677493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:31.677724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:31.678075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.688877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:31.689426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:31.689885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:31.736762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f81241a-c98b-48c5-b69d-7e098f746144 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:31.754751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f81241a-c98b-48c5-b69d-7e098f746144 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1213 microversion: 2.1 time: 0.178773 Nov 02 21:52:31.760629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lazy-loading 'flavor' on Instance uuid e24092b0-4024-40ed-968c-ac378dfcb3fb {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:31.764386 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2879/5635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:31 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:32.143619 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-56a5a02a-92ec-4fd2-bd41-ec66dffd7bfd tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "POST /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb/action" status: 200 len: 32 microversion: 2.1 time: 0.485277 Nov 02 21:52:32.149383 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2757/5636] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:52:31 2022] POST /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb/action => generated 32 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:52:32.155813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:32.157113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:32.177757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:32.178260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:32.178772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:32.179504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:32.179969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:32.180415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:32.672984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:32.674272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:32.689108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:32.689857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:32.690498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:32.691489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:32.692129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:32.694295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:32.732868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:32.753031 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c8ddf0e-d7dc-48a5-8c08-493886b3867f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.602211 Nov 02 21:52:32.753624 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2880/5637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:32 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:32.778661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:32.780226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:32.794057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:32.794947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:32.795624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:32.812549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:32.823919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:32.825958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:33.096463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:33.106806 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ffac6cc-83a6-40f4-9c04-cd6e23ae5624 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1217 microversion: 2.1 time: 0.332838 Nov 02 21:52:33.107407 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2881/5638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:32 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:33.202758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:33.211357 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ebbde7c3-bf15-47c4-ad4e-3980d1b3baeb tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1460 microversion: 2.1 time: 0.542840 Nov 02 21:52:33.226549 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2758/5639] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:32 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1460 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:33.779782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:33.780390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:33.790453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:33.791028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:33.791505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:33.792742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:33.794843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:33.794843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:34.130744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:34.132384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:34.147486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:34.150488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:34.150488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:34.150488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:34.150488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:34.151075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:34.271239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:34.283899 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-73950d0e-20a2-40b1-bab6-0e038c8e445b tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1273 microversion: 2.1 time: 0.156912 Nov 02 21:52:34.302027 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2759/5640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:34 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:34.305119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:34.307453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:34.308799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:34.314738 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b60c3dae-0a1f-4c2f-9874-c1abd68bde25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.542261 Nov 02 21:52:34.317130 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2882/5641] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:33 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:34.317245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:34.317638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:34.318412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:34.319357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:34.319767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:34.320188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:34.474977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:34.483862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3979b756-4f1f-4a30-bb1e-8dbf9d3b748f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.180446 Nov 02 21:52:34.484423 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2760/5642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:34 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:35.310956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:35.314053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:35.381779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:35.381779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:35.383025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:35.383025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:35.383025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:35.383025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:35.383025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:35.383025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:35.384036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:35.384036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:35.384036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:35.384036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:35.384036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:35.384036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:35.643888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:35.655811 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7fd93687-acb1-4c99-a1f7-629ae03c9a4b tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.320234 Nov 02 21:52:35.657238 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2761/5643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:35 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:35.663101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:35.663720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:35.670514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:35.671904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:35.672849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:35.673604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:35.674060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:35.674492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:35.678576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:35.682209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:35.688022 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e914255-3536-4b39-a8e1-1a8ed3a53d59 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.384030 Nov 02 21:52:35.709125 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2883/5644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:35 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:35.919916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:35.935663 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-deacabd4-60c5-4a4c-963a-3b256854f93b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.277120 Nov 02 21:52:35.952746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2762/5645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:35 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:36.248018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6b5b9410-c06b-45a0-91bb-55941ff9b676 req-c5bda878-0b10-4360-a221-1cbbebaa3260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40ad45b-ca57-4f29-bc34-1b46511dab23", "tag": "9890a9b2-b6e7-4c1d-b480-c80d93a563a2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:36.267744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6b5b9410-c06b-45a0-91bb-55941ff9b676 req-c5bda878-0b10-4360-a221-1cbbebaa3260 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:36.268777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6b5b9410-c06b-45a0-91bb-55941ff9b676 req-c5bda878-0b10-4360-a221-1cbbebaa3260 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:36.271213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6b5b9410-c06b-45a0-91bb-55941ff9b676 req-c5bda878-0b10-4360-a221-1cbbebaa3260 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:36.291907 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6b5b9410-c06b-45a0-91bb-55941ff9b676 req-c5bda878-0b10-4360-a221-1cbbebaa3260 service nova] Creating event network-changed:9890a9b2-b6e7-4c1d-b480-c80d93a563a2 for instance d40ad45b-ca57-4f29-bc34-1b46511dab23 on n-h1-860863-4 Nov 02 21:52:36.303117 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6b5b9410-c06b-45a0-91bb-55941ff9b676 req-c5bda878-0b10-4360-a221-1cbbebaa3260 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059508 Nov 02 21:52:36.306043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2884/5646] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:36.679635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:36.681009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:36.691396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:36.692852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:36.694153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:36.696219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:36.697076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:36.698055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:36.723331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:36.724050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:36.739863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:36.740376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:36.740821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:36.742750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:36.743411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:36.744008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:37.087243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:37.100156 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cb4fc382-2639-45a4-a275-2492b3e27c23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.424853 Nov 02 21:52:37.102124 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2763/5647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:36 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:37.108649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:37.109977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:37.120105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:37.121412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:37.122406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:37.123525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:37.124202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:37.124855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:37.128826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:37.143924 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba026458-354d-453c-93bf-170d6a107b61 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.422248 Nov 02 21:52:37.148524 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2885/5648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:36 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:37.314749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6d2ffda0-5c67-4c00-a33b-0058301e10fe req-21828a5b-25b3-404b-9d2d-d54275e23523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9", "tag": "8145e9e5-e9a8-4e94-8d2f-73e675eb295e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:37.327660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6d2ffda0-5c67-4c00-a33b-0058301e10fe req-21828a5b-25b3-404b-9d2d-d54275e23523 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:37.331117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6d2ffda0-5c67-4c00-a33b-0058301e10fe req-21828a5b-25b3-404b-9d2d-d54275e23523 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:37.331667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6d2ffda0-5c67-4c00-a33b-0058301e10fe req-21828a5b-25b3-404b-9d2d-d54275e23523 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:37.400655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:37.414197 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-590ca4f4-005b-457f-b1cc-0dd2e9aa19d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.310488 Nov 02 21:52:37.431858 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2764/5649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:37 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:37.686554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6d2ffda0-5c67-4c00-a33b-0058301e10fe req-21828a5b-25b3-404b-9d2d-d54275e23523 service nova] Creating event network-changed:8145e9e5-e9a8-4e94-8d2f-73e675eb295e for instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 on n-h1-860863-4 Nov 02 21:52:37.687466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6d2ffda0-5c67-4c00-a33b-0058301e10fe req-21828a5b-25b3-404b-9d2d-d54275e23523 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.498545 Nov 02 21:52:37.688547 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2886/5650] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:52:38.127031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:38.128831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:38.137024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:38.137863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:38.138802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:38.139759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:38.140441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:38.141133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:38.176354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:38.178125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:38.204785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:38.205479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:38.208460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:38.209849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:38.210563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:38.212408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:38.490838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:38.504919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7aec24da-384e-47e7-ab0d-29379dba0195 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.381701 Nov 02 21:52:38.506210 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2765/5651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:38 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:38.519141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:38.519764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:38.534138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:38.534950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:38.535633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:38.536663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:38.537372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:38.538098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:38.639217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:38.648406 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b6b805f-06ce-4375-839c-ae96de63bf7c tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.476337 Nov 02 21:52:38.662777 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2887/5652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:38 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:38.675909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-564280580", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "56501cb9-79e3-48ff-8a35-b9a88fac8eee"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:38.750487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] validate_networks() for [('56501cb9-79e3-48ff-8a35-b9a88fac8eee', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:52:38.760113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:38.769475 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-364e83d5-33e2-4d45-91d4-cae1a4a1f6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.260876 Nov 02 21:52:38.770153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2766/5653] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:38 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:39.125616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:52:39.126046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:52:39.126600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:52:39.126993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:52:39.127409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:52:39.136878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.137397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.137846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:39.138575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.139033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.139463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:39.157455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Getting quotas for project a0cff0fbcbb24d1a804e9a0b2f5e2e13. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:52:39.166710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Getting quotas for user 94e549ae9b7c4a74a0a68a20806ffa9e and project a0cff0fbcbb24d1a804e9a0b2f5e2e13. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:52:39.181068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:52:39.186533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:52:39.304400 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffd78727-c17a-46a1-ad13-a7b548900008 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632749 Nov 02 21:52:39.312142 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2888/5654] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:52:39.317450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f782389-e358-4283-abb3-8615b12c52d5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:39.318279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f782389-e358-4283-abb3-8615b12c52d5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:39.446030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f782389-e358-4283-abb3-8615b12c52d5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:39.469296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f782389-e358-4283-abb3-8615b12c52d5 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1218 microversion: 2.1 time: 0.155674 Nov 02 21:52:39.470210 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2767/5655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:39 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:39.533897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:39.534969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:39.544024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.547810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.547810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:39.547810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.547810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.547810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:39.678575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:39.680699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:39.694635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.695904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.697375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:39.726220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.728118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.730458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:39.813621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:39.828410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3752e485-5379-4335-9305-6565421f2da2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.294154 Nov 02 21:52:39.831544 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2889/5656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:39 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:39.847999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:39.848643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:39.858040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.858825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.859479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:39.861025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:39.868189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:39.868769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:40.123605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:40.130651 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-232ddb1d-d151-4130-b250-8137488a00f0 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.456739 Nov 02 21:52:40.132742 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2768/5657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:39 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:40.190768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:40.202018 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7979658-175f-49f4-8527-14976d64c720 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.366331 Nov 02 21:52:40.203969 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2890/5658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:39 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:40.498358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fa2659b5-1065-4d4b-9da6-5378dd91751e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:40.498958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fa2659b5-1065-4d4b-9da6-5378dd91751e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:40.561183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fa2659b5-1065-4d4b-9da6-5378dd91751e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:40.571166 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fa2659b5-1065-4d4b-9da6-5378dd91751e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1218 microversion: 2.1 time: 0.077224 Nov 02 21:52:40.571970 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2769/5659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:40 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:40.856299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:40.856824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:40.864117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:40.864613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:40.869600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:40.873838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:40.873838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:40.873838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:41.116995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:41.126743 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e361485f-0b4f-43fe-9591-b39401e92d31 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.274410 Nov 02 21:52:41.127566 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2891/5660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:40 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:41.155732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:41.156743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:41.165607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:41.166403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:41.167112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:41.169003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:41.170058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:41.171035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:41.176174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:41.228679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:41.229375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:41.242545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:41.249449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:41.250228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:41.251352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:41.252170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:41.253509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:41.499122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:41.516813 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b0fd6a9-82f3-4004-bf46-e99f519f6453 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.365518 Nov 02 21:52:41.519359 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2770/5661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:41 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:41.556900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:41.570961 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c613eaa0-d3e2-4d53-a4d4-33eabf73e5af tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.346868 Nov 02 21:52:41.586540 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2892/5662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:41 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:41.600415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:41.601538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:41.611469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:41.611980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:41.612428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:41.613184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:41.613643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:41.614070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:41.742757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:41.752230 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8943947a-efc8-4d08-a130-a25ba42b2c65 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1270 microversion: 2.1 time: 0.157702 Nov 02 21:52:41.753933 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2771/5663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:41 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:42.150424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:42.151105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:42.170731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:42.171528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:42.172173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:42.173115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:42.173726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:42.174311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:42.518722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:42.530500 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-62c2dfac-aaf3-46c0-94a4-fe8d5efb7b6e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.383578 Nov 02 21:52:42.543739 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2893/5664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:42 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:42.553278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:42.553847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:42.567469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:42.570052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:42.570052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:42.570052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:42.570781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:42.571425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:42.602964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:42.608028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:42.610809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:42.611597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:42.612383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:42.613647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:42.614433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:42.614934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:43.064434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:43.068532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:43.082642 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-968cce78-2f0c-4cd1-87a1-6587af5b96b2 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.533837 Nov 02 21:52:43.085065 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2772/5665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:42 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:43.090440 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d0e1aad-f85b-4f6e-8ba2-81e396dacaea tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.485834 Nov 02 21:52:43.106815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2894/5666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:42 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:43.106815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e32de963-71f8-4f61-a0d7-a40567c2a07c req-184f95f5-9fbc-49ab-9e21-d146980b56a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9", "name": "network-vif-plugged", "status": "completed", "tag": "8145e9e5-e9a8-4e94-8d2f-73e675eb295e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:43.119607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:43.121048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:43.122880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e32de963-71f8-4f61-a0d7-a40567c2a07c req-184f95f5-9fbc-49ab-9e21-d146980b56a2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:43.125286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e32de963-71f8-4f61-a0d7-a40567c2a07c req-184f95f5-9fbc-49ab-9e21-d146980b56a2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:43.125740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e32de963-71f8-4f61-a0d7-a40567c2a07c req-184f95f5-9fbc-49ab-9e21-d146980b56a2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:43.142092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:43.143023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:43.143500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:43.144245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:43.144709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:43.145177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:43.149505 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e32de963-71f8-4f61-a0d7-a40567c2a07c req-184f95f5-9fbc-49ab-9e21-d146980b56a2 service nova] Creating event network-vif-plugged:8145e9e5-e9a8-4e94-8d2f-73e675eb295e for instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 on n-h1-860863-4 Nov 02 21:52:43.168000 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e32de963-71f8-4f61-a0d7-a40567c2a07c req-184f95f5-9fbc-49ab-9e21-d146980b56a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074902 Nov 02 21:52:43.171290 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2895/5667] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:43.286857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:43.298675 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fc108b01-bba3-437b-b809-dd0163a0acc6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1276 microversion: 2.1 time: 0.208674 Nov 02 21:52:43.300589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2773/5668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:43 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:43.562492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:43.565125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:43.571894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:43.578273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:43.580176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:43.582601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:43.583337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:43.583931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:44.108211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:44.109894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:44.123914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:44.124542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:44.125069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:44.125855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:44.133365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:44.133922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:44.278122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:44.286354 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8080bbf3-cae7-4b21-88dc-498676de8c25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.728249 Nov 02 21:52:44.294370 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2896/5669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:43 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:44.301179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:44.305493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:44.315356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:44.319228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:44.325425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:44.326360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:44.326962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:44.327519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:44.622101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:44.631505 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1af41e43-6e02-4382-bac0-fb14e82a5ae3 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.527843 Nov 02 21:52:44.641630 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2774/5670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:44 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:44.647666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:44.649793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:44.678124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:44.678950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:44.679635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:44.680584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:44.681845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:44.682492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:44.895500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:44.917693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63e6179f-89ef-4c22-8a48-a4669c88586d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.618475 Nov 02 21:52:44.919082 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2897/5671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:44 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:45.147985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:45.159647 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-11bf082e-3615-47e7-98e9-34449d079eca tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1318 microversion: 2.1 time: 0.516461 Nov 02 21:52:45.160273 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2775/5672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:44 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:45.321284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:45.322403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:45.346625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.376743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.376743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.376743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.376743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.376743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.594199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7f43fc44-0c46-40c3-99af-c0d595dd6a0f req-e368b6a6-3568-4cd3-a86f-8d1334f89e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02ee7ab-62a7-4c97-b717-4770f68661dc", "tag": "6d4b8438-4134-4153-9711-28a24d99a70d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:45.621617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7f43fc44-0c46-40c3-99af-c0d595dd6a0f req-e368b6a6-3568-4cd3-a86f-8d1334f89e4c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.632882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7f43fc44-0c46-40c3-99af-c0d595dd6a0f req-e368b6a6-3568-4cd3-a86f-8d1334f89e4c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.633470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7f43fc44-0c46-40c3-99af-c0d595dd6a0f req-e368b6a6-3568-4cd3-a86f-8d1334f89e4c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.649365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:45.658877 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7f43fc44-0c46-40c3-99af-c0d595dd6a0f req-e368b6a6-3568-4cd3-a86f-8d1334f89e4c service nova] Creating event network-changed:6d4b8438-4134-4153-9711-28a24d99a70d for instance a02ee7ab-62a7-4c97-b717-4770f68661dc on n-h2-860863-4 Nov 02 21:52:45.675243 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b547bac-4933-455e-8000-a252992dbaf4 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.359087 Nov 02 21:52:45.689860 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2898/5673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:45 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:45.702268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:45.702543 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7f43fc44-0c46-40c3-99af-c0d595dd6a0f req-e368b6a6-3568-4cd3-a86f-8d1334f89e4c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112787 Nov 02 21:52:45.703371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:45.706087 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2776/5674] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:52:45.718771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.719276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.719557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:45.720210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.721259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.721718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:45.722165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.723218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.757797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.763056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.763677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.764577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.765214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.765760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.801289 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a051573f-6c62-4910-82e7-192e20a5c5c5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments/2bf2ceec-e71b-4d01-b7b2-200e57d7441e" status: 200 len: 194 microversion: 2.20 time: 0.109617 Nov 02 21:52:45.814780 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2899/5675] 10.222.0.25 () {60 vars in 1454 bytes} [Wed Nov 2 21:52:45 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments/2bf2ceec-e71b-4d01-b7b2-200e57d7441e => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:45.955423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:45.956197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:45.986592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.986592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.986592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:45.986592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:45.986592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:45.986592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.006548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:46.019774 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7058a9b2-5cfd-452f-bf2c-c7d470242f7e tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.312118 Nov 02 21:52:46.020981 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2777/5676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:45 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:46.030482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:46.037636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:46.062019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.063489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.072085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.077965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.077965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.077965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.262797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lazy-loading 'services' on Instance uuid 3351f1dc-a844-4ca9-b336-09cb79dbca9d {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:46.299370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:46.313054 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d020bfa-c85c-4852-88c6-0a02a0babc25 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.365833 Nov 02 21:52:46.316168 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2900/5677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:45 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:46.338656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:46.344392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:46.386801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.387938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.388615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.389760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.390448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.391132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.588333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-661f3fd3-736a-48a0-ae93-9cb59f80064b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments/2bf2ceec-e71b-4d01-b7b2-200e57d7441e" status: 202 len: 0 microversion: 2.20 time: 0.565767 Nov 02 21:52:46.591002 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2778/5678] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Nov 2 21:52:46 2022] DELETE /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments/2bf2ceec-e71b-4d01-b7b2-200e57d7441e => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:52:46.607161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:46.613687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:46.642678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.644873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.645355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.646367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.646821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.647016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:46.648349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.665634 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-170807b9-f33b-4cc9-8c1c-ccf4f9ed49a6 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1318 microversion: 2.1 time: 0.329881 Nov 02 21:52:46.668511 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2901/5679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:46 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:46.705006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:46.706515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:46.717007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.718003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.718903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.719602 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2cb73e4e-8de3-4403-b3e2-e3f43aaf27c0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123573 Nov 02 21:52:46.720278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:46.721208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:46.721938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:46.733312 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2779/5680] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:46 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:46.903207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:46.924335 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f337d05a-2e28-480a-acc9-09ec092c3df6 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.223619 Nov 02 21:52:46.924961 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2902/5681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:46 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:47.049694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:47.049694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:47.058514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.059686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.060426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.061399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.062173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.062868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.282547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:47.288580 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8363622-cc73-429f-aed9-d9b603d468d4 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.248220 Nov 02 21:52:47.289524 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2780/5682] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:47 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:47.340678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:47.341428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:47.349027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:47.350921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.351479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.351959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.352664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.353167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.358393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.360069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:47.570748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:47.587691 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-498f1262-6ef3-4e55-9756-2a8ad16e23be tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.251736 Nov 02 21:52:47.592974 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2903/5683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:47 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:47.692523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:47.693523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:47.708480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.709452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.717038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.718118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.721266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.723253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.747535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:47.750086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:47.763449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.765610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.766736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.768158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.769984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.772019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.825189 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce386ded-babf-481f-835c-8a5649125461 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083343 Nov 02 21:52:47.826466 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2904/5684] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:47 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:47.947740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:47.949403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:47.979757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.980347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.984121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:47.984968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:47.985449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:47.985883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:48.299628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:48.313271 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f91a4fed-0506-474c-b186-d7cc5d4f237a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1318 microversion: 2.1 time: 0.621841 Nov 02 21:52:48.314762 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2781/5685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:47 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:48.325168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:48.326047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:48.340100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:48.353838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:48.363934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:48.365494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:48.366297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:48.367123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:48.541439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:48.552567 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e00442ae-bbc4-406b-b60f-34e0904e2ee5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.608526 Nov 02 21:52:48.561004 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2905/5686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:47 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:48.615622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:48.616731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:48.632676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:48.635437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:48.637697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:48.639017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:48.644572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:48.646075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:49.139147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:49.147300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:49.153070 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4990a8ed-0c47-4e14-a387-8c37f1654b11 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1313 microversion: 2.1 time: 0.834748 Nov 02 21:52:49.153677 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2782/5687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:48 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1313 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:49.160419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:49.164128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:49.174550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:49.174841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:49.176179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:49.177023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:49.177930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:49.178779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:49.179884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:49.216476 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7ba18684-b9e3-45a6-a871-c9ca37579771 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061439 Nov 02 21:52:49.217346 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2783/5688] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:49 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:49.253280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:49.261608 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-73389518-e708-48f3-a950-96f6d51dadf7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.651649 Nov 02 21:52:49.262388 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2906/5689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:48 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:49.341982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:49.342613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:49.349647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:49.350426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:49.351028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:49.351927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:49.352380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:49.353002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:49.571496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:49.582490 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cef6b8e3-902d-42f1-8188-da47b5041a4a tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1318 microversion: 2.1 time: 0.244770 Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:49.596875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:49.601129 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2784/5690] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:49 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:49.789811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:49.789811 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4076c09e-95e1-4e96-9a68-d812f0ac4580 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.207611 Nov 02 21:52:49.789811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2907/5691] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:49 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:50.179976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:50.180789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:50.189584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.190074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.194813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.194813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.194813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.194813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.229185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:50.231844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:50.243077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.245650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.246341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.247346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.248603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.249312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.300378 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf75be1a-3b60-43d2-ac88-eed8f9468f7c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075099 Nov 02 21:52:50.301338 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2908/5692] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:50 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:50.306280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:50.309575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:50.313923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.314422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.315013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.315760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.316249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.316751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.376536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:50.390133 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c725ee5-c776-41b2-8e48-79d9f1867035 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1497 microversion: 2.1 time: 0.213677 Nov 02 21:52:50.396459 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2785/5693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:50 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:50.523110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:50.530579 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5811bac-4230-4b69-b3b5-d6d65481e362 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.228137 Nov 02 21:52:50.532239 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2909/5694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:50 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:50.570339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:50.607119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:50.608530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:50.613862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-279b527a-62d2-4ed5-aa82-3b3db3c8c37e req-9e0a98d5-2656-4560-8a4c-a7cae4523468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02ee7ab-62a7-4c97-b717-4770f68661dc", "name": "network-vif-plugged", "status": "completed", "tag": "6d4b8438-4134-4153-9711-28a24d99a70d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:50.616921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.617500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.618256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.619116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.619913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.621280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.629997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-279b527a-62d2-4ed5-aa82-3b3db3c8c37e req-9e0a98d5-2656-4560-8a4c-a7cae4523468 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.630756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-279b527a-62d2-4ed5-aa82-3b3db3c8c37e req-9e0a98d5-2656-4560-8a4c-a7cae4523468 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.631797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-279b527a-62d2-4ed5-aa82-3b3db3c8c37e req-9e0a98d5-2656-4560-8a4c-a7cae4523468 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.646626 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-279b527a-62d2-4ed5-aa82-3b3db3c8c37e req-9e0a98d5-2656-4560-8a4c-a7cae4523468 service nova] Creating event network-vif-plugged:6d4b8438-4134-4153-9711-28a24d99a70d for instance a02ee7ab-62a7-4c97-b717-4770f68661dc on n-h2-860863-4 Nov 02 21:52:50.660563 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-279b527a-62d2-4ed5-aa82-3b3db3c8c37e req-9e0a98d5-2656-4560-8a4c-a7cae4523468 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140016 Nov 02 21:52:50.661743 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2786/5695] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:52:50.775665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:50.786074 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-938a19f6-24e8-442f-b1d5-bb1d24e14017 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1318 microversion: 2.1 time: 0.183405 Nov 02 21:52:50.786652 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2910/5696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:50 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:50.821296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:50.824497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:50.852025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.862442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.862442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.862442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:50.862442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:50.862442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:50.881501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:51.215872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:51.222025 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c367975b-5df8-4d05-a9ca-4b91eeece0f5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.412526 Nov 02 21:52:51.222745 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2787/5697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:50 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:51.226964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:51.227642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:51.234490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.234980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.235470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.236240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.237084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.237518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.263548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:52:51.317108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:51.317108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:51.322104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.322592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.323036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.324453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.325495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.325495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.361069 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cff286df-96a4-4093-a0ff-ac2a9f2eb1db tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051334 Nov 02 21:52:51.361653 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2788/5698] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:51 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:52:51.555757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:51.557520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:51.564829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.565740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.566419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.567487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.568160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.569465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.733196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:51.744348 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a978cf4c-5380-4da8-8f52-643a37df42ab tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.194507 Nov 02 21:52:51.745633 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2789/5699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:51 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:51.812251 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3cb1c55b-fdf1-4ad6-8168-d03be205b246 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 204 len: 0 microversion: 2.1 time: 0.589268 Nov 02 21:52:51.812812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:51.813023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:51.813639 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2911/5700] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:52:51 2022] DELETE /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:52:51.825695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:51.826911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:51.833905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.834406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.834662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.834850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.835356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.835564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.836025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.836155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.836461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:51.837060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:51.837649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:51.839554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.123108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:52.141080 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-55168abd-1642-4fde-af0f-05f7c476865e tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1318 microversion: 2.1 time: 0.335020 Nov 02 21:52:52.141693 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2790/5701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:51 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:52.160876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:52.166291 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2192c63e-778a-4b65-977c-05669c8defe7 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1503 microversion: 2.1 time: 0.347810 Nov 02 21:52:52.167955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2912/5702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:51 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:52.246184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:52.246830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:52.264706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.265376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.265836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.266584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.267044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.267489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.374077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:52.377184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:52.390061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.397338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.398010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.399124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.399331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.399892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.469351 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-68af6c36-73b2-4101-8d99-ba261ba059a6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086589 Nov 02 21:52:52.469922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2913/5703] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:52 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:52:52.485938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:52.498667 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3593fd97-b987-4a70-9fb5-4bbbad95c0a5 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.256965 Nov 02 21:52:52.500139 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2791/5704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:52 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:52.769865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:52.771299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:52.792644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.792644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.797298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.799206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.800951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.801758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.965185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:52.966346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:52.972850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.973646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.974310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.975284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:52.975942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:52.976582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:52.989988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:53.002645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-de18f5dc-af18-40d0-a869-8f106532c978 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.238368 Nov 02 21:52:53.003823 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2914/5705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:52 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:53.045942 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7fb1cca1-b4d1-4f34-9f78-bbc173805314 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/ips" status: 200 len: 147 microversion: 2.1 time: 0.085775 Nov 02 21:52:53.052855 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2792/5706] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:52:52 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/ips => generated 147 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:53.167962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:53.168595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:53.177897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.178644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.179250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.180134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.180755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.181371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.190503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:53.191458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:53.194976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:53.207071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.207815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.208891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.213434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.214603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.215241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.546434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:53.555207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2fb1cdc-bcd2-49bf-b817-785a449f2d98 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1503 microversion: 2.1 time: 0.368837 Nov 02 21:52:53.556062 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2793/5707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:53 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:53.562194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:53.564717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:53.571808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.572525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.573475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.574485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.575136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.575890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.615012 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d8403ef-0c58-4af6-ba91-3fb9034c1aea tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057534 Nov 02 21:52:53.616343 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2794/5708] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:53 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:53.624845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:53.628982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:53.632646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.633405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.634247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.635202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.635922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.636589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.686726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:53.699717 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c35ed8ea-91d3-47a3-8d03-870d0fba0398 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1507 microversion: 2.1 time: 0.534259 Nov 02 21:52:53.701412 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2915/5709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:53 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1507 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:53.725820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47b5effc-8a0f-4197-b9e2-7c4589965721", "device": "/dev/sdb"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:53.730607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:53.741196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.741761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.742132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.746995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:53.747799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:53.748821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:53.873602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:53.916413 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-68f4d0b3-5d3e-4606-83fd-dca2e8284553 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.297795 Nov 02 21:52:53.918521 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2795/5710] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:53 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:54.028628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:54.029333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:54.042152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.043683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.043683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.043889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.044339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.044772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.277966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:54.287727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30bf70fe-e2f5-4084-90ab-03575ed69c3a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.263836 Nov 02 21:52:54.290739 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2796/5711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:54 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:54.503683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6a175874-a1d8-4217-813b-ab08bb3bef60 req-741dc1cb-4a12-4267-a837-12c181bf781f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9", "name": "network-vif-deleted", "tag": "8145e9e5-e9a8-4e94-8d2f-73e675eb295e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:54.520324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6a175874-a1d8-4217-813b-ab08bb3bef60 req-741dc1cb-4a12-4267-a837-12c181bf781f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.521024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6a175874-a1d8-4217-813b-ab08bb3bef60 req-741dc1cb-4a12-4267-a837-12c181bf781f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.521452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6a175874-a1d8-4217-813b-ab08bb3bef60 req-741dc1cb-4a12-4267-a837-12c181bf781f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.536430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:54.540868 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6a175874-a1d8-4217-813b-ab08bb3bef60 req-741dc1cb-4a12-4267-a837-12c181bf781f service nova] Creating event network-vif-deleted:8145e9e5-e9a8-4e94-8d2f-73e675eb295e for instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 on n-h1-860863-4 Nov 02 21:52:54.585756 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6a175874-a1d8-4217-813b-ab08bb3bef60 req-741dc1cb-4a12-4267-a837-12c181bf781f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085707 Nov 02 21:52:54.594162 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2797/5712] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:52:54.605687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:54.606775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:54.615825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.616703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.617398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.620469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.623666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.625977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.681471 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8104ba1e-38d0-492b-ab9d-1155f84e40ce tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "POST /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959418 Nov 02 21:52:54.688868 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2916/5713] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:52:53 2022] POST /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc/os-volume_attachments => generated 194 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:52:54.718586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:54.748468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:54.763053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.763846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.764487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.765613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.766317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.766963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.798442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:54.808636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-754c87e4-5bad-490a-b975-afe629962a52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115891 Nov 02 21:52:54.809352 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2917/5714] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:54 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:54.811248 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1b5532d-81f2-48fe-be35-93b930a54dc1 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1461 microversion: 2.1 time: 0.214754 Nov 02 21:52:54.814739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b6663675-aad3-451c-a706-2aa09f459cde req-0dc721e9-9be0-4e27-9a2d-fd0b4e193020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40ad45b-ca57-4f29-bc34-1b46511dab23", "name": "network-vif-plugged", "status": "completed", "tag": "9890a9b2-b6e7-4c1d-b480-c80d93a563a2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:54.818499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2798/5715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:54 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1461 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:54.825389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b6663675-aad3-451c-a706-2aa09f459cde req-0dc721e9-9be0-4e27-9a2d-fd0b4e193020 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.826060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b6663675-aad3-451c-a706-2aa09f459cde req-0dc721e9-9be0-4e27-9a2d-fd0b4e193020 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.826489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b6663675-aad3-451c-a706-2aa09f459cde req-0dc721e9-9be0-4e27-9a2d-fd0b4e193020 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.838398 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b6663675-aad3-451c-a706-2aa09f459cde req-0dc721e9-9be0-4e27-9a2d-fd0b4e193020 service nova] Creating event network-vif-plugged:9890a9b2-b6e7-4c1d-b480-c80d93a563a2 for instance d40ad45b-ca57-4f29-bc34-1b46511dab23 on n-h1-860863-4 Nov 02 21:52:54.843839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b6663675-aad3-451c-a706-2aa09f459cde req-0dc721e9-9be0-4e27-9a2d-fd0b4e193020 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033347 Nov 02 21:52:54.844435 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2918/5716] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:54.941883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:54.943733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:54.951298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.954979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.955937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:54.957012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:54.958424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:54.959047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.206170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:55.210644 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1bb6e9c-30b7-48e4-a690-19a1f9f5a496 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.271812 Nov 02 21:52:55.214254 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2799/5717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:54 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:55.323838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:55.324752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:55.332906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:55.334705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:55.335332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.336233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:55.336852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:55.337464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.563297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:55.571996 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd089a98-3c1a-4ff6-a8b7-b16a47c38b3b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.253291 Nov 02 21:52:55.573696 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2919/5718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:55 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:55.821737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:55.824444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:55.836701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:55.837551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:55.843306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:55.845123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:55.847968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.850467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:55.850772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:55.851344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:55.851489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:55.852069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.853286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:55.853715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.858143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:55.862705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.903265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:55.904025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:55.904999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:55.905764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lazy-loading 'fault' on Instance uuid c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:52:55.950152 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3361ea2-a1e1-45ea-91e3-e23f891101aa tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.132399 Nov 02 21:52:55.951267 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2800/5719] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:55 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:56.030606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547b50d61a8948d9a5a6b9367716d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263f01641eb84587bc355ada260870d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:56.041249 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc361df4-ede9-4ece-98c0-eaeee990cf78 tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 200 len: 1303 microversion: 2.1 time: 0.208288 Nov 02 21:52:56.045043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2920/5720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:55 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:56.237229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:56.238566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:56.248415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:56.249452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:56.253846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:56.255017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:56.255699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:56.256308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:56.606613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:56.609087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:56.624344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:56.624344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:56.624344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:56.625758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:56.626438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:56.627208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:57.048237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:57.060816 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34c59a4d-ebd0-414e-834a-c7916c089dfa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.827605 Nov 02 21:52:57.061922 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2801/5721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:56 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:57.070385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:57.072671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:57.088985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:57.090159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:57.090771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:57.091660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:57.092422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:57.094342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:57.102323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:57.113653 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1388f5f-1a7d-40d8-ac28-3d5c29e4b9d0 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1518 microversion: 2.1 time: 0.518748 Nov 02 21:52:57.115456 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2921/5722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:56 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1518 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:52:57.126949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:57.127799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] [instance: c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:57.144570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:57.144570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:57.144570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:57.145018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:57.149524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:57.149983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:57.174532 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] HTTP exception thrown: Instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 could not be found. Nov 02 21:52:57.178941 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ed9681e-4d34-4599-b568-9f2b8078ffe9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115561 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Request method failure captured: Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 HTTP/1.1 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuaBSlxDn--iP1v7huh9PChKzpF3OgHrfdp80nSDaQL9dZLcFVfvJ9lKojddiUuDbmKMmNxbg3oQXVZu37E7Krb2ft3Hn1J6zFGUjlFypcdEs9Y8F2s-XCoAfOJSCYYiHl9iUqaLdI43_V8sN726jNkx4VgCJ-olwdi6kduKXu2ogSo Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 263f01641eb84587bc355ada260870d3 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesActionsTest-1665142977 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_263f01641eb84587bc355ada260870d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/263f01641eb84587bc355ada260870d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/263f01641eb84587bc355ada260870d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/263f01641eb84587bc355ada260870d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesActionsTest-1665142977 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 263f01641eb84587bc355ada260870d3 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesActionsTest-1665142977 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesActionsTest-1665142977-project Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 547b50d61a8948d9a5a6b9367716d4b6 Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesActionsTest-1665142977-project Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 could not be found. Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9'} Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 could not be found. Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 could not be found. Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:57.182409 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:57.187446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:57.187446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:57.187446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:57.187446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:52:57.187446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:52:57.187446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 could not be found. Nov 02 21:52:57.187446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:57.189024 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2802/5723] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:57 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:52:57.192501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] Returning 404 to user: Instance c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:52:57.193839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-620834b4-be7d-4167-ae93-ca5f3c706a4a tempest-VolumesActionsTest-1665142977 tempest-VolumesActionsTest-1665142977-project] 10.222.0.25 "GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9" status: 404 len: 111 microversion: 2.1 time: 0.076854 Nov 02 21:52:57.197945 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2922/5724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:57 2022] GET /compute/v2.1/servers/c3f3ce1f-fb45-4fe4-a88b-e52ae2b288f9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:52:57.503767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a14a59b-fa47-4628-a86f-2e6658ff1ab6"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:57.506175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:57.519429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:57.519991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:57.520456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:57.521455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:57.522093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:57.522692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.089455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:58.094615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:58.106818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.107376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.107823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.108544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.109071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.109526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.484875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:58.496265 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cb52cf6-16cd-4f1e-bedd-eb0837e4172d tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.411514 Nov 02 21:52:58.513397 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2923/5725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:58 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:58.521538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:58.522443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:58.529433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.530205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.530833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.531730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.532347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.533689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.692283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:52:58.778709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:58.788808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1028b82e-5a6b-4671-830a-02e4d56546e1 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.274121 Nov 02 21:52:58.790443 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2924/5726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:58 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:58.795635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:58.800335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:58.812491 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8ef3705-4d0e-444d-96ff-51c1eb040fd1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.312390 Nov 02 21:52:58.813421 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2803/5727] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:52:57 2022] POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-volume_attachments => generated 194 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:52:58.819089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.822706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.823402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:58.823955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.824115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:58.825539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.829396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.829974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.859577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.860505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.861180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.862119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:58.862759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:58.863391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:58.890048 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc250308-6fcb-400e-b178-061658315ef6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.098256 Nov 02 21:52:58.899348 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2925/5728] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:52:58 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:59.139518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:59.157141 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-83c11b75-3a47-40d0-808c-0d75a0e7fc0c tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.330396 Nov 02 21:52:59.157141 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2804/5729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:58 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:59.184019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:59.184647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:59.188285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:59.188817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:59.200511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.204075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.205493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.209852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.210785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.211720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.212894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.216742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.216964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.217700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.220521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.221029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.281534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:52:59.597055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:59.605708 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a0cf9cb-75f5-4893-a5e4-bf9baa13ddca tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.429979 Nov 02 21:52:59.607757 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2805/5730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:59 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:59.618192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:59.620956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:59.627744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.628400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.628977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.629837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.630541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.631208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.779369 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-baed5707-f0cb-4e71-8703-8175e32e23e3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 204 len: 0 microversion: 2.20 time: 0.599298 Nov 02 21:52:59.785086 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2926/5731] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:52:59 2022] DELETE /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:52:59.794488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ec0a8f4-c0aa-4933-972c-3ec32487e763 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:52:59.816206 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6ec0a8f4-c0aa-4933-972c-3ec32487e763 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance fec8df34-6f6c-4e47-b81b-6025fd5773b9 has no mapping to a cell. Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ec0a8f4-c0aa-4933-972c-3ec32487e763 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/fec8df34-6f6c-4e47-b81b-6025fd5773b9/action HTTP/1.1 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 15 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: {"os-stop": {}} Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance fec8df34-6f6c-4e47-b81b-6025fd5773b9 has no mapping to a cell. Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'fec8df34-6f6c-4e47-b81b-6025fd5773b9', 'body': {'os-stop': {}}} Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance fec8df34-6f6c-4e47-b81b-6025fd5773b9 has no mapping to a cell. Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:52:59.820864 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec8df34-6f6c-4e47-b81b-6025fd5773b9 has no mapping to a cell. Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec8df34-6f6c-4e47-b81b-6025fd5773b9 has no mapping to a cell. Nov 02 21:52:59.825836 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:52:59.827742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ec0a8f4-c0aa-4933-972c-3ec32487e763 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance fec8df34-6f6c-4e47-b81b-6025fd5773b9 has no mapping to a cell. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:52:59.828773 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ec0a8f4-c0aa-4933-972c-3ec32487e763 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/fec8df34-6f6c-4e47-b81b-6025fd5773b9/action" status: 404 len: 117 microversion: 2.1 time: 0.045548 Nov 02 21:52:59.830413 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2927/5732] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:52:59 2022] POST /compute/v2.1/servers/fec8df34-6f6c-4e47-b81b-6025fd5773b9/action => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:52:59.834983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:52:59.840374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:59.841480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:59.848768 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3cc6d539-3de9-41a3-abc7-a346a9b1c53a tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.238278 Nov 02 21:52:59.849538 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2806/5733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:59 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:52:59.861333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:52:59.862874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:52:59.869509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.872226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.872907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.876317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.878421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.879490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.879490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.881466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.882236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:52:59.884314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:52:59.884797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:52:59.885275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.355014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:00.358349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:00.366383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:00.367022 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ce4a059-4efc-4c53-906f-329dff4eebf8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.515071 Nov 02 21:53:00.368755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:00.370801 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1bb7c5f-e791-45d2-b94f-895d57560fe3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.537713 Nov 02 21:53:00.371849 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2928/5734] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:52:59 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:00.381499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2807/5735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:52:59 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:00.393391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:00.394442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:00.403671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.404168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.405863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.406597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.407061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.407498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.638357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:00.649851 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5c00d346-e0f6-4df6-9da8-964729b0b67b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.262406 Nov 02 21:53:00.651027 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2929/5736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:00 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:00.673365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e443e97-9862-41fa-a5bb-99342a0e65c8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:00.674064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e443e97-9862-41fa-a5bb-99342a0e65c8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: b4b60cf4-ebfe-4a16-a263-8f91effd511f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:00.680470 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-7e443e97-9862-41fa-a5bb-99342a0e65c8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance b4b60cf4-ebfe-4a16-a263-8f91effd511f could not be found. Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e443e97-9862-41fa-a5bb-99342a0e65c8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/b4b60cf4-ebfe-4a16-a263-8f91effd511f/action HTTP/1.1 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 15 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: {"suspend": {}} Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance b4b60cf4-ebfe-4a16-a263-8f91effd511f could not be found. Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'b4b60cf4-ebfe-4a16-a263-8f91effd511f', 'body': {'suspend': {}}} Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b60cf4-ebfe-4a16-a263-8f91effd511f could not be found. Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b60cf4-ebfe-4a16-a263-8f91effd511f could not be found. Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:00.682258 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:00.687137 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:00.687137 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:00.687137 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b60cf4-ebfe-4a16-a263-8f91effd511f could not be found. Nov 02 21:53:00.687137 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:00.688842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e443e97-9862-41fa-a5bb-99342a0e65c8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance b4b60cf4-ebfe-4a16-a263-8f91effd511f could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:00.689883 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e443e97-9862-41fa-a5bb-99342a0e65c8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/b4b60cf4-ebfe-4a16-a263-8f91effd511f/action" status: 404 len: 111 microversion: 2.1 time: 0.020802 Nov 02 21:53:00.690467 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2808/5737] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:00 2022] POST /compute/v2.1/servers/b4b60cf4-ebfe-4a16-a263-8f91effd511f/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:53:00.699321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:00.702260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:00.706032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.706522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.706965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.707665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.708122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.708551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.876864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:00.878967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:00.889900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.890807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.891564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.892572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.893301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.894016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.907692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:00.933809 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa9436ab-bb12-4fd9-b262-14aca27a7b78 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.236587 Nov 02 21:53:00.934792 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2930/5738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:00 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:00.960643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:00.966067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:00.970176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.970910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.971508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:00.972367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:00.973647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:00.974879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.242548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:01.251738 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8bfde2e-3078-48e4-a9aa-9c6d473448aa tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1486 microversion: 2.1 time: 0.379126 Nov 02 21:53:01.252674 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2809/5739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:00 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1486 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:01.280362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:01.280576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:01.281163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:01.289354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.290095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.290729 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-49313c3a-c99f-4f9b-a963-5072846764b7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.333543 Nov 02 21:53:01.290863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.291938 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2931/5740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:00 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:53:01.293432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.294067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.294665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.314780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:01.316220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:01.322510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.323779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.324405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.325945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.326558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.327139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.353863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lazy-loading 'flavor' on Instance uuid d40ad45b-ca57-4f29-bc34-1b46511dab23 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:01.487338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:01.513389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ee68b8ee-087d-4503-a2ed-c5b831f63e1f tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "POST /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb/action" status: 202 len: 0 microversion: 2.1 time: 0.237999 Nov 02 21:53:01.514227 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2810/5741] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:01 2022] POST /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:53:01.519636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:01.520747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:01.529171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.529932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.530581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.531473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.532357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.532972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.654503 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ebf005c-892d-4175-87ef-0ec5f022e98b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 202 len: 0 microversion: 2.1 time: 0.343363 Nov 02 21:53:01.656069 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2932/5742] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:01 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:53:01.678588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:01.679382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:01.688770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.689301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.689806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.690957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.691427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.691864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.850176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:01.865910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:01.867891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:01.871335 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da5140c6-367d-4f7d-957f-bbf6f524e52f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1724 microversion: 2.20 time: 0.354442 Nov 02 21:53:01.875453 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2811/5743] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:01 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:01.897260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:01.913555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:01.925596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.926258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.928675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:01.929584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:01.931490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:01.932037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:02.057887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:02.066047 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39f2fe28-d681-4a0b-8f02-8640df0d4455 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1494 microversion: 2.1 time: 0.408511 Nov 02 21:53:02.066854 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2933/5744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:01 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1494 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:02.162239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:02.174117 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb007a2e-e795-4380-99cd-8848c9d467e5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1513 microversion: 2.1 time: 0.294216 Nov 02 21:53:02.175106 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2812/5745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:01 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1513 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:02.909562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:02.910222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:02.921804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:02.922525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:02.924441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:02.932893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:02.933603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:02.934475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.014990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d641acf6-a994-4d4a-a5ba-b156a76fc929 req-8f828582-d456-4224-88a2-3494738bbdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351f1dc-a844-4ca9-b336-09cb79dbca9d", "name": "network-vif-deleted", "tag": "fb47b1a6-2e53-4bb1-b3fc-3382539fd883"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:03.040561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d641acf6-a994-4d4a-a5ba-b156a76fc929 req-8f828582-d456-4224-88a2-3494738bbdc7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.051738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d641acf6-a994-4d4a-a5ba-b156a76fc929 req-8f828582-d456-4224-88a2-3494738bbdc7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.054910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d641acf6-a994-4d4a-a5ba-b156a76fc929 req-8f828582-d456-4224-88a2-3494738bbdc7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.086093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d641acf6-a994-4d4a-a5ba-b156a76fc929 req-8f828582-d456-4224-88a2-3494738bbdc7 service nova] Creating event network-vif-deleted:fb47b1a6-2e53-4bb1-b3fc-3382539fd883 for instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d on n-h1-860863-4 Nov 02 21:53:03.096551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:03.102935 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d641acf6-a994-4d4a-a5ba-b156a76fc929 req-8f828582-d456-4224-88a2-3494738bbdc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091986 Nov 02 21:53:03.106787 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2813/5746] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:53:03.116678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:03.118077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:03.125851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.126500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:03.126694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.127774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.129130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.129834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.130692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.141602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:03.149307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7971640-cdbb-41a0-9dcf-7099d69e28f5 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1656 microversion: 2.20 time: 0.241899 Nov 02 21:53:03.151999 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2934/5747] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:02 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1656 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:03.200301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:03.201314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:03.212957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.214166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.214820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.215773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.216384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.217426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.506797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:03.519211 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-09ae6205-6598-424c-b82e-2c672f5861e8 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1494 microversion: 2.1 time: 0.410414 Nov 02 21:53:03.519958 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2814/5748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:03 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1494 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:03.572743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:03.586378 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ba4c2a1-481d-40fa-bb17-2fa5b43d0d23 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1496 microversion: 2.1 time: 0.392654 Nov 02 21:53:03.596412 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2935/5749] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:03 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1496 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:03.611042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:03.611996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:03.621210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.623856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.623856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.624298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.625438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.626131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.655158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lazy-loading 'flavor' on Instance uuid d40ad45b-ca57-4f29-bc34-1b46511dab23 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:03.669487 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Cannot 'suspend' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state suspended Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action HTTP/1.1 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 15 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: {"suspend": {}} Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'suspend' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state suspended Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'suspend': {}}} Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 in vm_state suspended. Cannot suspend while the instance is in this state. Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Nov 02 21:53:03.671426 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state suspended Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state suspended Nov 02 21:53:03.675940 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:03.680194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 409 to user: Cannot 'suspend' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state suspended {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:03.685493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9040e162-f5a5-4de8-a882-5380943478b6 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 409 len: 148 microversion: 2.1 time: 0.075209 Nov 02 21:53:03.685493 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2815/5750] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:03 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 148 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:53:03.691898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:03.692749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:03.701581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.705032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.705535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:03.706294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:03.706769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:03.710166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.032576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78003b94-9b7f-4f15-b8ee-d659d346e5f8 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 202 len: 0 microversion: 2.1 time: 0.345088 Nov 02 21:53:04.037976 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2936/5751] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:03 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:53:04.042918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:04.045536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:04.054171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.054732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.055206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.056011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.056637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.057116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.181172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:04.184003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:04.197519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.204102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.204102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.205968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.206486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.206943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.315282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.315793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.316262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.316715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lazy-loading 'fault' on Instance uuid 3351f1dc-a844-4ca9-b336-09cb79dbca9d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:04.324823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:04.338291 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a27eb820-5f20-40f6-90dc-c40228034540 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1502 microversion: 2.1 time: 0.299545 Nov 02 21:53:04.343492 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2816/5752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:04 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1502 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:53:04.405220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:04.415667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:04.423163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:04.429627 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8789273-71ba-4c75-82ca-069951f220b0 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 200 len: 1371 microversion: 2.20 time: 0.254050 Nov 02 21:53:04.430815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2937/5753] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:04 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:53:04.544617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:04.545629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:04.553441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.554492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.554672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.555716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.556287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.556964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.804979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:04.815093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a8ce63f-634c-48e8-a0ef-811a327194ef tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1500 microversion: 2.1 time: 0.275664 Nov 02 21:53:04.829751 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2817/5754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:04 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1500 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:04.849620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:04.854720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:04.859813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.860434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.860964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.862001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:04.862675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:04.863537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:04.898060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:53:05.166482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e03a6469-0a6f-495d-9927-4e33fb156ea2 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 204 len: 0 microversion: 2.1 time: 0.321846 Nov 02 21:53:05.171160 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2938/5755] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:53:04 2022] DELETE /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:53:05.176903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:05.177539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:05.184818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:05.185364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:05.185801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:05.186682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:05.187131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:05.187552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:05.339890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:05.352952 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a4c591e-a294-4111-9bc7-e12def520e23 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.177607 Nov 02 21:53:05.352952 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2818/5756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:05 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:05.369203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:05.370005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:05.387702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:05.388201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:05.397287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:05.402319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:05.402319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:05.402319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:05.467019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:05.467980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:05.475197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:05.476022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:05.476667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:05.477641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:05.478297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:05.479391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:05.495323 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] HTTP exception thrown: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Request method failure captured: Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d HTTP/1.1 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuXgJMAZqrV7R4qhQsIzbv1Gl1T7wBoCH7AN7T0pvhtQpTGC-XLqm2SX54AVJTQA7v7SAp-QitUkOYKYBuueYORIYqMDJjH9sx0a8H5Xbx_afvhhfgvxerH3uF4Pg8EE8Fqq8UlWH2FTHDM1Zelk93DWPAsvhcwcDT2SU88K-aJ6gDk Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_679e722432214ed6a1217d618c2c4887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/679e722432214ed6a1217d618c2c4887"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 98b623fd3cf64948af31caa837455fbe Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '3351f1dc-a844-4ca9-b336-09cb79dbca9d'} Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:05.497370 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Returning 404 to user: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:05.506973 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-09238fd7-3175-40eb-9c41-386f78b44446 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 404 len: 111 microversion: 2.20 time: 0.036994 Nov 02 21:53:05.509220 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2819/5757] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:05 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:53:05.515057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bad26abf-9684-4149-866b-2c0c1139a4af tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '.version_select at 0x7f9b63b3a280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:05.597962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bad26abf-9684-4149-866b-2c0c1139a4af tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691879944" status: 204 len: 0 microversion: 2.20 time: 0.086664 Nov 02 21:53:05.598941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:05.601564 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2820/5758] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691879944 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:53:05.610121 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22ba0ef2-659d-4f20-a92c-71fc7e18b7dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1502 microversion: 2.1 time: 0.246221 Nov 02 21:53:05.611305 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2939/5759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:05 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:06.380733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:06.382366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:06.390249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:06.391027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:06.391817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:06.394428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:06.395067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:06.396452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:06.613541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:06.639579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:06.645056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:06.650194 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-49afccfd-24c4-45eb-a2d4-50deede9ff25 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.276526 Nov 02 21:53:06.664727 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2821/5760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:06 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:06.667002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:06.668103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:06.668490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:06.669268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:06.674078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:06.674886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:06.892350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:06.905756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83292b4d-4428-4330-832e-39760ca31028 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.270327 Nov 02 21:53:06.931695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:06.932509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:06.936294 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2940/5761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:06 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:06.939474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:06.939971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:06.940437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:06.941183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:06.941641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:06.942071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:07.061401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04dfd703-afa0-4f1b-861b-cab871acd952 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'create', calling method: .version_select at 0x7f9b686cba60>, body: {"keypair": {"name": "tempest-keypair-1071730979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTUqsu1E6NveWpKuUZlX2EbW71HMbseNzgtWA6Qdcod5+vvfoHQAVHKHOZAtHJ0VQn9jcfoFYxr8k6LTFxKGa+kClq6ZLywArzIp+BotHLzYvjl8IV0RpgqrNy2nUVk6Q=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:07.078038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:07.086127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-04dfd703-afa0-4f1b-861b-cab871acd952 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for project 679e722432214ed6a1217d618c2c4887. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:53:07.092470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-04dfd703-afa0-4f1b-861b-cab871acd952 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for user 98b623fd3cf64948af31caa837455fbe and project 679e722432214ed6a1217d618c2c4887. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:53:07.130090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:07.134134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:07.140366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2388123-df2e-4102-a2c1-18e819b1ec98 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.212486 Nov 02 21:53:07.140968 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2822/5762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:06 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:07.173672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2918b9f3-d5e0-494e-abb9-73b5dfdddc52 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:07.173672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2918b9f3-d5e0-494e-abb9-73b5dfdddc52 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 16efb9ac-c4bf-4b27-9b94-d1153315e5c7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:07.183196 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2918b9f3-d5e0-494e-abb9-73b5dfdddc52 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 16efb9ac-c4bf-4b27-9b94-d1153315e5c7 could not be found. Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2918b9f3-d5e0-494e-abb9-73b5dfdddc52 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/16efb9ac-c4bf-4b27-9b94-d1153315e5c7/action HTTP/1.1 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 15 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: {"unpause": {}} Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 16efb9ac-c4bf-4b27-9b94-d1153315e5c7 could not be found. Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '16efb9ac-c4bf-4b27-9b94-d1153315e5c7', 'body': {'unpause': {}}} Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16efb9ac-c4bf-4b27-9b94-d1153315e5c7 could not be found. Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16efb9ac-c4bf-4b27-9b94-d1153315e5c7 could not be found. Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:07.185511 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:07.190218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:07.190218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:07.190218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16efb9ac-c4bf-4b27-9b94-d1153315e5c7 could not be found. Nov 02 21:53:07.190218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:07.191134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2918b9f3-d5e0-494e-abb9-73b5dfdddc52 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 16efb9ac-c4bf-4b27-9b94-d1153315e5c7 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:07.195853 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04dfd703-afa0-4f1b-861b-cab871acd952 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.152006 Nov 02 21:53:07.197171 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2918b9f3-d5e0-494e-abb9-73b5dfdddc52 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/16efb9ac-c4bf-4b27-9b94-d1153315e5c7/action" status: 404 len: 111 microversion: 2.1 time: 0.031191 Nov 02 21:53:07.197384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2941/5763] 10.222.0.25 () {62 vars in 1200 bytes} [Wed Nov 2 21:53:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 21:53:07.201015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2823/5764] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:07 2022] POST /compute/v2.1/servers/16efb9ac-c4bf-4b27-9b94-d1153315e5c7/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:53:07.219669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:07.220737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:07.229892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:07.230635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:07.231274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:07.232607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:07.233314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:07.233985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:07.510795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:07.522271 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25ba7878-4c27-4375-8bbe-9ba054d2965a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.307269 Nov 02 21:53:07.526650 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2942/5765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:07 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:53:07.554366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:07.555591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:07.579297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:07.581252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:07.583336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:07.584690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:07.589494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:07.590384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:07.675569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:07.676948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:07.692370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:07.696149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:07.696899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:07.700417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:07.701276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:07.705536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:08.589678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:08.607193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b3fc5b2-408b-419d-aa0a-8f27c686b8dc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 1.058161 Nov 02 21:53:08.607431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:08.629864 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2824/5766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:07 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:08.642971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:08.643670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:08.644881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8745178a-0846-4df0-930c-9dc6cec0b613 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1506 microversion: 2.1 time: 0.973272 Nov 02 21:53:08.646279 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2943/5767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:07 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1506 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:08.650305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:08.651839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:08.652457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:08.653358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:08.653916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:08.654488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:08.684136 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Cannot 'unpause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action HTTP/1.1 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 15 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: {"unpause": {}} Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: exception: Cannot 'unpause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'unpause': {}}} Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 in vm_state active. Cannot unpause while the instance is in this state. Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:08.686012 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 409 to user: Cannot 'unpause' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de55ac8f-8927-482a-b79a-fc9557e46626 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 409 len: 145 microversion: 2.1 time: 0.057000 Nov 02 21:53:08.695705 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2825/5768] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:08 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:53:08.701420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:08.702127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:08.708553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:08.709079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:08.710120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:08.710850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:08.711360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:08.711753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:08.966800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:08.978011 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4cffa7d6-1efd-4e14-98aa-4b1a94f5415f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.283374 Nov 02 21:53:08.993127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2944/5769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:08 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:09.008610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:09.009616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:09.036720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:09.037772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:09.039703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:09.040691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:09.058650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:09.060028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:09.558134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:09.575784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bfeadc6e-e76d-44d7-a4ef-24308456760a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.573536 Nov 02 21:53:09.592772 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2826/5770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:09 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:09.612223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc239baa-a591-4a5f-806a-d72dd6cadeed tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:09.617334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc239baa-a591-4a5f-806a-d72dd6cadeed tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: e8f2fab3-ad17-4cf4-9ec1-77099c47252a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:09.632109 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-fc239baa-a591-4a5f-806a-d72dd6cadeed tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance e8f2fab3-ad17-4cf4-9ec1-77099c47252a could not be found. Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc239baa-a591-4a5f-806a-d72dd6cadeed tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/e8f2fab3-ad17-4cf4-9ec1-77099c47252a/action HTTP/1.1 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 18 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: {"unshelve": null} Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e8f2fab3-ad17-4cf4-9ec1-77099c47252a could not be found. Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e8f2fab3-ad17-4cf4-9ec1-77099c47252a', 'body': {'unshelve': None}} Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f2fab3-ad17-4cf4-9ec1-77099c47252a could not be found. Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f2fab3-ad17-4cf4-9ec1-77099c47252a could not be found. Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:09.634650 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f2fab3-ad17-4cf4-9ec1-77099c47252a could not be found. Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc239baa-a591-4a5f-806a-d72dd6cadeed tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance e8f2fab3-ad17-4cf4-9ec1-77099c47252a could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc239baa-a591-4a5f-806a-d72dd6cadeed tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/e8f2fab3-ad17-4cf4-9ec1-77099c47252a/action" status: 404 len: 111 microversion: 2.1 time: 0.036940 Nov 02 21:53:09.647543 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2945/5771] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:09 2022] POST /compute/v2.1/servers/e8f2fab3-ad17-4cf4-9ec1-77099c47252a/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:53:09.652891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:09.654275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:09.668174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:09.673929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:09.673929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:09.673929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:09.673929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:09.674324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:09.674324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:09.675329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:09.683389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:09.684492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:09.685389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:09.686517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:09.687159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:09.688673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:09.866379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:09.887513 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c228b26e-7068-4b6b-9571-5835bac739be tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1464 microversion: 2.1 time: 0.215983 Nov 02 21:53:09.890339 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2946/5772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:09 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1464 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:10.030100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-917cb210-a130-40ea-8245-1f6e5e0ccdb2 req-596d5c8c-6eca-451f-80cc-e4457ff352b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e24092b0-4024-40ed-968c-ac378dfcb3fb", "name": "network-vif-deleted", "tag": "26dbede2-4592-4cf9-81e3-2047215efd08"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:10.040463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:10.083367 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f1c4a81-6035-4840-9fc2-4d66296bb6fe tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.416884 Nov 02 21:53:10.094801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2827/5773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:09 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:10.100755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-917cb210-a130-40ea-8245-1f6e5e0ccdb2 req-596d5c8c-6eca-451f-80cc-e4457ff352b1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.101605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-917cb210-a130-40ea-8245-1f6e5e0ccdb2 req-596d5c8c-6eca-451f-80cc-e4457ff352b1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.102136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-917cb210-a130-40ea-8245-1f6e5e0ccdb2 req-596d5c8c-6eca-451f-80cc-e4457ff352b1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.123336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:10.123555 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-917cb210-a130-40ea-8245-1f6e5e0ccdb2 req-596d5c8c-6eca-451f-80cc-e4457ff352b1 service nova] Creating event network-vif-deleted:26dbede2-4592-4cf9-81e3-2047215efd08 for instance e24092b0-4024-40ed-968c-ac378dfcb3fb on n-h2-860863-4 Nov 02 21:53:10.123746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:10.130219 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-917cb210-a130-40ea-8245-1f6e5e0ccdb2 req-596d5c8c-6eca-451f-80cc-e4457ff352b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105729 Nov 02 21:53:10.131683 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2947/5774] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:53:10.154413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.154925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.155377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.156109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.156576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.160409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.514041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:10.523011 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d87ec64c-5865-4507-b939-ea221465039b tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.426914 Nov 02 21:53:10.524075 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2828/5775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:10 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:10.549474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:10.550164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:10.560366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.560870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.561648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.563046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.563154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.563785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.595567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:10.620814 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Cannot 'unshelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action HTTP/1.1 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 18 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: {"unshelve": null} Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: exception: Cannot 'unshelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'unshelve': None}} Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 in vm_state active. Cannot unshelve while the instance is in this state. Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 21:53:10.621235 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 409 to user: Cannot 'unshelve' instance d40ad45b-ca57-4f29-bc34-1b46511dab23 while it is in vm_state active {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff00f2ef-0c14-4c7a-80dd-3f4f8f29457a tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action" status: 409 len: 146 microversion: 2.1 time: 0.080054 Nov 02 21:53:10.626218 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2948/5776] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:10 2022] POST /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23/action => generated 146 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:53:10.632135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:10.636697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:10.655596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.656103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.656553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.657355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.657819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.658256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.912969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:10.913571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:10.925047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.925548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.940256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:10.944111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.947258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.950387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.951053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb78cd3b-50f6-4663-8dd7-cc219b71ca75 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.321789 Nov 02 21:53:10.951748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.955447 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2829/5777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:10 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:10.983442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:10.984076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:10.994416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.995496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.995922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:10.996669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:10.997122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:10.997556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:11.021831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:11.022366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:11.022813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:11.027553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lazy-loading 'fault' on Instance uuid e24092b0-4024-40ed-968c-ac378dfcb3fb {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:11.192162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:11.211128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc8838e5-39bf-48bb-9dba-d2a7fda48322 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 200 len: 1304 microversion: 2.1 time: 0.301894 Nov 02 21:53:11.217241 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2949/5778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:10 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 1304 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:11.420085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:11.430579 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e51f3da-f088-488b-aad6-63ea43403f5e tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.451595 Nov 02 21:53:11.431676 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2830/5779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:10 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:11.454848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ea05322-3257-415a-87ed-2615dd17f52d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1978077110_updated"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:11.463961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8ea05322-3257-415a-87ed-2615dd17f52d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: c37d23f8-af63-4ca0-9317-31bc46f8b286] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:11.488716 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8ea05322-3257-415a-87ed-2615dd17f52d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance c37d23f8-af63-4ca0-9317-31bc46f8b286 could not be found. Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ea05322-3257-415a-87ed-2615dd17f52d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/servers/c37d23f8-af63-4ca0-9317-31bc46f8b286 HTTP/1.1 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 81 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1978077110_updated"}} Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance c37d23f8-af63-4ca0-9317-31bc46f8b286 could not be found. Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'c37d23f8-af63-4ca0-9317-31bc46f8b286', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1978077110_updated'}}} Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37d23f8-af63-4ca0-9317-31bc46f8b286 could not be found. Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 21:53:11.490699 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37d23f8-af63-4ca0-9317-31bc46f8b286 could not be found. Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37d23f8-af63-4ca0-9317-31bc46f8b286 could not be found. Nov 02 21:53:11.495446 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:11.497406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ea05322-3257-415a-87ed-2615dd17f52d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance c37d23f8-af63-4ca0-9317-31bc46f8b286 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:11.498526 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ea05322-3257-415a-87ed-2615dd17f52d tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "PUT /compute/v2.1/servers/c37d23f8-af63-4ca0-9317-31bc46f8b286" status: 404 len: 111 microversion: 2.1 time: 0.047927 Nov 02 21:53:11.499572 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2950/5780] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:53:11 2022] PUT /compute/v2.1/servers/c37d23f8-af63-4ca0-9317-31bc46f8b286 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:53:11.507972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:11.508693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:11.516371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:11.517890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:11.518837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:11.524094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:11.524094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:11.524094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:11.741307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:11.752358 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71431bc9-3c47-49c9-89ff-5f92a0d74bb7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.248048 Nov 02 21:53:11.753179 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2831/5781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:11 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:11.781786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:11.782573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:11.795154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:11.796475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:11.798298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:11.799737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:11.800810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:11.802096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.125283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:12.137321 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff660176-5a89-4b32-a879-145659afec64 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.359934 Nov 02 21:53:12.154395 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2951/5782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:11 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:12.161372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-409b0cf8-b831-4101-bed1-2a881cbc4324 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-409b0cf8-b831-4101-bed1-2a881cbc4324 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: request: PUT /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 HTTP/1.1 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 280 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.165820 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-409b0cf8-b831-4101-bed1-2a881cbc4324 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-409b0cf8-b831-4101-bed1-2a881cbc4324 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "PUT /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 400 len: 619 microversion: 2.1 time: 0.011220 Nov 02 21:53:12.173468 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2832/5783] 10.222.0.25 () {60 vars in 1257 bytes} [Wed Nov 2 21:53:12 2022] PUT /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:53:12.180815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:12.183463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:12.192473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.193181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.193733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.194550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.195286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.195962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.245976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:12.246916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: e24092b0-4024-40ed-968c-ac378dfcb3fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:12.263217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.266871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.270704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.272667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.273426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.274594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.308139 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] HTTP exception thrown: Instance e24092b0-4024-40ed-968c-ac378dfcb3fb could not be found. Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Request method failure captured: Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb HTTP/1.1 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuZV4M9qYAJ__Ol8g9DHg3tGcOcrs2Yd8Bb6b9US5_vuuvT47RA7fBsh1oo5DzNS6KVbhlHsi6KT18ovg72te6bAeusApzKryqM517aT19il-313t0tpfk1CpFgCk2ArI68ULf3RzX3tuJO05EE_-wvMy92U5e3OFsOPBIn_W0pRrCU Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 5f4e9d83fc7d45d581f167e2cc6a6705 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerRescueTestJSON-962506298 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerRescueTestJSON-962506298 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 5f4e9d83fc7d45d581f167e2cc6a6705 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerRescueTestJSON-962506298 Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerRescueTestJSON-962506298-project Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 7b5b0e068d2f4dadbf174537649474ea Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerRescueTestJSON-962506298-project Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e24092b0-4024-40ed-968c-ac378dfcb3fb could not be found. Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e24092b0-4024-40ed-968c-ac378dfcb3fb'} Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24092b0-4024-40ed-968c-ac378dfcb3fb could not be found. Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24092b0-4024-40ed-968c-ac378dfcb3fb could not be found. Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:12.313520 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24092b0-4024-40ed-968c-ac378dfcb3fb could not be found. Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Returning 404 to user: Instance e24092b0-4024-40ed-968c-ac378dfcb3fb could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:12.320959 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8f1dfa6-eae9-4e08-8e3a-2362b1acc2ba tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb" status: 404 len: 111 microversion: 2.1 time: 0.075195 Nov 02 21:53:12.325962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2833/5784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:12 2022] GET /compute/v2.1/servers/e24092b0-4024-40ed-968c-ac378dfcb3fb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:53:12.336697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:12.339729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:12.353824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.355081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.358626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.359383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.359855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.360299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.420917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:53:12.493000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:12.547991 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93f3a604-9943-4b7f-8ff7-e023df0991f5 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.353599 Nov 02 21:53:12.550467 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2952/5785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:12 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:12.581878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:12.582746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:12.594103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.594866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.595787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.596769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.597472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.599775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.784025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:12.796857 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc2cad75-9cd4-467a-9843-67cadaedf042 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.223601 Nov 02 21:53:12.797648 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2953/5786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:12 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:53:12.819671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0a5a5a6-fbcb-4217-b606-e9ea9ff13fcf tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0a5a5a6-fbcb-4217-b606-e9ea9ff13fcf tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: request: PUT /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 HTTP/1.1 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 24 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: {"server": {"name": ""}} Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23', 'body': {'server': {'name': ''}}} Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '' Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:53:12.824449 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0a5a5a6-fbcb-4217-b606-e9ea9ff13fcf tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0a5a5a6-fbcb-4217-b606-e9ea9ff13fcf tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "PUT /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 400 len: 108 microversion: 2.1 time: 0.010450 Nov 02 21:53:12.830612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2954/5787] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 21:53:12 2022] PUT /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:53:12.835910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:12.836593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:12.845044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.845622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.846136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.846908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.847518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.848173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.886303 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aaa0335f-e452-4357-ba87-793fc409200e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 204 len: 0 microversion: 2.1 time: 0.557855 Nov 02 21:53:12.887404 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2834/5788] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:53:12 2022] DELETE /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:53:12.896317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:12.897747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:12.913288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.916580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.917573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:12.918442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:12.921352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:12.927664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:13.017373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:13.026427 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2c544e7-e738-459d-a51a-3b2b8bd53c0f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1505 microversion: 2.1 time: 0.194571 Nov 02 21:53:13.026942 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2955/5789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:12 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:13.187055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:13.196486 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-753a23ad-8332-44ed-811a-a7961f2b1f28 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1493 microversion: 2.1 time: 0.304810 Nov 02 21:53:13.212764 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2835/5790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:12 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1493 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:13.489029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1801454292", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5fda8b-f492-48c5-94f3-5ae08b820ef8"}], "security_groups": [{"name": "tempest-securitygroup--1695437289"}], "key_name": "tempest-keypair-1071730979", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:13.781255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] validate_networks() for [('8b5fda8b-f492-48c5-94f3-5ae08b820ef8', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:53:14.222133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:14.223580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:14.232750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:14.233525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:14.234145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:14.235069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:14.235697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:14.236294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:14.471390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:14.488053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7528c7b1-e6d7-461b-ab39-dbfe19212970 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1493 microversion: 2.1 time: 0.270147 Nov 02 21:53:14.490456 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2836/5791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:14 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1493 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:14.614838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:53:14.616583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:53:14.617300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:53:14.617915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:53:14.618538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:53:14.630567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:14.631471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:14.632141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:14.633428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:14.634221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:14.635020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:14.659597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for project 679e722432214ed6a1217d618c2c4887. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:53:14.665473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Getting quotas for user 98b623fd3cf64948af31caa837455fbe and project 679e722432214ed6a1217d618c2c4887. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:53:14.684553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:53:14.687354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:53:14.981422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-06d3ee81-ac26-4df3-92d6-a7730f6a5139 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.498556 Nov 02 21:53:14.982708 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2956/5792] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Nov 2 21:53:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 21:53:14.999829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8be34a9-1e1b-4a08-a4dc-f5498eb8c734 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:15.000454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8be34a9-1e1b-4a08-a4dc-f5498eb8c734 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:15.112840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8be34a9-1e1b-4a08-a4dc-f5498eb8c734 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:15.120626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8be34a9-1e1b-4a08-a4dc-f5498eb8c734 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:15.124848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8be34a9-1e1b-4a08-a4dc-f5498eb8c734 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:15.132137 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8be34a9-1e1b-4a08-a4dc-f5498eb8c734 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1282 microversion: 2.20 time: 0.142096 Nov 02 21:53:15.136167 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2837/5793] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:14 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:15.521935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:15.522871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:15.537244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:15.546714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:15.546714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:15.546714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:15.546714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:15.546714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:15.981108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-940cd40b-76a6-40b3-bc7d-6c249f707fc2 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:15.997491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940cd40b-76a6-40b3-bc7d-6c249f707fc2 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:15.999829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940cd40b-76a6-40b3-bc7d-6c249f707fc2 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:16.002216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-940cd40b-76a6-40b3-bc7d-6c249f707fc2 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:16.097384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-940cd40b-76a6-40b3-bc7d-6c249f707fc2 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Going to try to stop instance {{(pid=121039) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:53:16.127583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:16.141361 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4e630c5-292e-4580-8390-ebef47617f4c tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1493 microversion: 2.1 time: 0.623797 Nov 02 21:53:16.154710 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2957/5794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:15 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1493 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:16.173724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba361aeb-71ff-4087-9957-44fcf11f5e74 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:16.174264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba361aeb-71ff-4087-9957-44fcf11f5e74 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:16.299961 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-940cd40b-76a6-40b3-bc7d-6c249f707fc2 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action" status: 202 len: 0 microversion: 2.1 time: 0.324099 Nov 02 21:53:16.300564 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2838/5795] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:15 2022] POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:53:16.320027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:16.320760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:16.327639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba361aeb-71ff-4087-9957-44fcf11f5e74 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:16.351675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba361aeb-71ff-4087-9957-44fcf11f5e74 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:16.353169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ba361aeb-71ff-4087-9957-44fcf11f5e74 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:16.355332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:16.358594 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba361aeb-71ff-4087-9957-44fcf11f5e74 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1282 microversion: 2.20 time: 0.199829 Nov 02 21:53:16.359237 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2958/5796] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:16 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:16.374709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:16.374709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:16.374709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:16.374709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:16.375510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:16.385572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:16.449861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2c6e4172-e4e9-49b7-b24e-5cf57b5220a3 req-477504a2-1f9a-4acd-8180-5ef81211b57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74364f-d34e-4954-bfbe-8144635e3349", "name": "network-vif-deleted", "tag": "2b7dcbef-dd23-4577-9807-3dc39f202ada"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:16.459098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2c6e4172-e4e9-49b7-b24e-5cf57b5220a3 req-477504a2-1f9a-4acd-8180-5ef81211b57a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:16.460032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2c6e4172-e4e9-49b7-b24e-5cf57b5220a3 req-477504a2-1f9a-4acd-8180-5ef81211b57a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:16.460761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2c6e4172-e4e9-49b7-b24e-5cf57b5220a3 req-477504a2-1f9a-4acd-8180-5ef81211b57a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:16.474229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2c6e4172-e4e9-49b7-b24e-5cf57b5220a3 req-477504a2-1f9a-4acd-8180-5ef81211b57a service nova] Creating event network-vif-deleted:2b7dcbef-dd23-4577-9807-3dc39f202ada for instance 8b74364f-d34e-4954-bfbe-8144635e3349 on n-h1-860863-4 Nov 02 21:53:16.479760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2c6e4172-e4e9-49b7-b24e-5cf57b5220a3 req-477504a2-1f9a-4acd-8180-5ef81211b57a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036760 Nov 02 21:53:16.484616 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2959/5797] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:53:16.784517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:16.794314 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8273cd16-a15a-43a3-bfe6-074e9b1a497a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.482705 Nov 02 21:53:16.795128 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2839/5798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:16 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:53:17.170658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:17.172555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:17.191182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:17.192973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:17.195620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:17.196910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:17.198284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:17.199108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:17.246477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:17.247128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:17.247809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:17.248472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lazy-loading 'fault' on Instance uuid 8b74364f-d34e-4954-bfbe-8144635e3349 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:17.340808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:17.348831 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f88958e-15d8-4ed7-8536-b868b3557149 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1304 microversion: 2.1 time: 0.184758 Nov 02 21:53:17.352334 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2960/5799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:17 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:17.392009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:17.405565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:17.442475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:17.443192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:17.443800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:17.444706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:17.445507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:17.446099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:17.611089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:17.616831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:17.624970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:17.627133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:17.628472 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92020998-08fb-4f96-aaf7-e0071cb708c6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1334 microversion: 2.20 time: 0.241045 Nov 02 21:53:17.631448 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2840/5800] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:17 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1334 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:17.820343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:17.821268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:17.829730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:17.837784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:17.846703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:17.846703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:17.846703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:17.846703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:18.363106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:18.377086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:18.378054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:18.383378 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecee9184-6a43-4781-8b3b-5fc9dec80ac6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.562620 Nov 02 21:53:18.394731 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2961/5801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:17 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:18.396567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:18.403196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:18.404049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:18.406801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:18.408031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:18.412082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:18.554676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:18.555170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:18.555607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:18.556060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lazy-loading 'fault' on Instance uuid 8b74364f-d34e-4954-bfbe-8144635e3349 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:18.663416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:18.664566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:18.678268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:18.678822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:18.679429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:18.680481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:18.682424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:18.683323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:18.882885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b0e068d2f4dadbf174537649474ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4e9d83fc7d45d581f167e2cc6a6705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:18.898544 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0aac452c-8d9e-4ae0-b9ef-39d331fa485e tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 200 len: 1304 microversion: 2.1 time: 0.526663 Nov 02 21:53:18.918720 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2841/5802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:18 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 1304 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:53:19.107199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:19.122350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:19.138177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:19.141429 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d1c9ae0-6d56-41e0-b8f6-41c3e06a470c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1342 microversion: 2.20 time: 0.483480 Nov 02 21:53:19.143503 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2962/5803] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:18 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1342 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:19.411855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:19.412679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:19.429396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:19.437860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:19.438590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:19.439566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:19.441558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:19.448697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:19.936551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:19.938198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] [instance: 8b74364f-d34e-4954-bfbe-8144635e3349] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:19.955083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:19.960831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:19.960831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:19.965549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:19.973198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:19.974350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:20.011106 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] HTTP exception thrown: Instance 8b74364f-d34e-4954-bfbe-8144635e3349 could not be found. Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Request method failure captured: Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 HTTP/1.1 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuZV4M9qYAJ__Ol8g9DHg3tGcOcrs2Yd8Bb6b9US5_vuuvT47RA7fBsh1oo5DzNS6KVbhlHsi6KT18ovg72te6bAeusApzKryqM517aT19il-313t0tpfk1CpFgCk2ArI68ULf3RzX3tuJO05EE_-wvMy92U5e3OFsOPBIn_W0pRrCU Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 5f4e9d83fc7d45d581f167e2cc6a6705 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerRescueTestJSON-962506298 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/5f4e9d83fc7d45d581f167e2cc6a6705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerRescueTestJSON-962506298 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 5f4e9d83fc7d45d581f167e2cc6a6705 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerRescueTestJSON-962506298 Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerRescueTestJSON-962506298-project Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 7b5b0e068d2f4dadbf174537649474ea Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerRescueTestJSON-962506298-project Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 8b74364f-d34e-4954-bfbe-8144635e3349 could not be found. Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '8b74364f-d34e-4954-bfbe-8144635e3349'} Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b74364f-d34e-4954-bfbe-8144635e3349 could not be found. Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b74364f-d34e-4954-bfbe-8144635e3349 could not be found. Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:20.013654 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:20.022806 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:20.022806 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:20.022806 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:20.022806 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:20.022806 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:20.022806 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b74364f-d34e-4954-bfbe-8144635e3349 could not be found. Nov 02 21:53:20.022806 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:20.023908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] Returning 404 to user: Instance 8b74364f-d34e-4954-bfbe-8144635e3349 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:20.027296 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41547330-9605-47f5-9b65-062cf6032701 tempest-ServerRescueTestJSON-962506298 tempest-ServerRescueTestJSON-962506298-project] 10.222.0.25 "GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349" status: 404 len: 111 microversion: 2.1 time: 0.095492 Nov 02 21:53:20.029175 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2963/5804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:19 2022] GET /compute/v2.1/servers/8b74364f-d34e-4954-bfbe-8144635e3349 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:53:20.173290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:20.187614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:20.220177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:20.225274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:20.229850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:20.231355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:20.232121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:20.252360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:20.304073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:20.366149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc9b5318-941e-42cf-bc0d-25f574e5105e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.957711 Nov 02 21:53:20.367185 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2842/5805] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:19 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:20.792972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:20.867315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:20.891369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:20.901376 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b1ee05b-e489-4e10-97f0-e55fc4754d16 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1340 microversion: 2.20 time: 0.731796 Nov 02 21:53:20.952363 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2964/5806] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:20 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1340 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:21.393623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:21.394723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:21.458884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:21.463930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:21.463930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:21.472508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:21.475908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:21.476789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:21.964406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:21.974748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:22.004060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:22.005549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:22.006645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:22.011765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:22.011765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:22.011765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:23.535754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:23.553989 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8469f97-203d-4143-844f-47b947ca64be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 2.167424 Nov 02 21:53:23.558727 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2843/5807] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:21 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:23.687386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:23.696126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:23.699815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:23.701377 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-505ca157-f07a-4fe1-8dea-16f82b6b080a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1408 microversion: 2.20 time: 1.745826 Nov 02 21:53:23.703124 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2965/5808] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:21 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1408 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:23.771752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-239479e8-c470-4c78-91a5-ec31bb7ebb4e req-f524b7cf-81f6-4848-a837-18672ef3efd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901804ba-1e60-4a26-828f-41666168e0c1", "tag": "17761c3c-21bf-4f5d-98bf-bf7e88907cc4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:23.802605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-239479e8-c470-4c78-91a5-ec31bb7ebb4e req-f524b7cf-81f6-4848-a837-18672ef3efd9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:23.803101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-239479e8-c470-4c78-91a5-ec31bb7ebb4e req-f524b7cf-81f6-4848-a837-18672ef3efd9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:23.803545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-239479e8-c470-4c78-91a5-ec31bb7ebb4e req-f524b7cf-81f6-4848-a837-18672ef3efd9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:23.846319 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-239479e8-c470-4c78-91a5-ec31bb7ebb4e req-f524b7cf-81f6-4848-a837-18672ef3efd9 service nova] Creating event network-changed:17761c3c-21bf-4f5d-98bf-bf7e88907cc4 for instance 901804ba-1e60-4a26-828f-41666168e0c1 on n-h1-860863-4 Nov 02 21:53:23.864853 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-239479e8-c470-4c78-91a5-ec31bb7ebb4e req-f524b7cf-81f6-4848-a837-18672ef3efd9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097488 Nov 02 21:53:23.867675 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2844/5809] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:53:24.586893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:24.601588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:24.609607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:24.610376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:24.612527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:24.613865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:24.614960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:24.615455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:24.656660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:24.737083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:24.744044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:24.750146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:24.750873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:24.751631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:24.752561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:24.753374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:24.754085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.094455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:25.119903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:25.124469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:25.131345 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5cb90ad-1533-46cf-bc78-646db292e96d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.552244 Nov 02 21:53:25.132865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:25.135331 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2966/5810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:24 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:25.137833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b70c08a6-374e-4159-a35d-17cd39c60883 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1408 microversion: 2.20 time: 0.407050 Nov 02 21:53:25.139094 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2845/5811] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:24 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:25.160962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:25.160962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:25.162740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.167754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.168349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.169662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.170656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.171248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.196166 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 HTTP/1.1 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '63309760-3556-4d65-9f7e-1e8a7323c102'} Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:25.199221 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.204142 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.206462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:25.207522 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95e5495f-abb3-41be-af13-e5f17ede4442 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "DELETE /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 404 len: 111 microversion: 2.1 time: 0.057251 Nov 02 21:53:25.220422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:25.222013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: 63309760-3556-4d65-9f7e-1e8a7323c102] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:25.228385 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2967/5812] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:53:25 2022] DELETE /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:53:25.233130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:25.234994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.236254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.236872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.237959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.238573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.239155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.261911 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 HTTP/1.1 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '63309760-3556-4d65-9f7e-1e8a7323c102'} Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:25.265622 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.271673 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:25.271673 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:25.271673 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:25.271673 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:25.271673 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:25.271673 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. Nov 02 21:53:25.271673 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:25.274425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance 63309760-3556-4d65-9f7e-1e8a7323c102 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:25.276302 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b050e74-b644-4530-99ed-8edcca3a6260 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102" status: 404 len: 111 microversion: 2.1 time: 0.062968 Nov 02 21:53:25.277586 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2846/5813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:25 2022] GET /compute/v2.1/servers/63309760-3556-4d65-9f7e-1e8a7323c102 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:53:25.288379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:25.288891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:25.298725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.299648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.299648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.300964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.300964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.310709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.331799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:53:25.462979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:25.714972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd76fc52-2bcc-4d1d-8acc-31b4c801c6d2 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 204 len: 0 microversion: 2.1 time: 0.430234 Nov 02 21:53:25.715882 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2968/5814] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:53:25 2022] DELETE /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:53:25.725913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:25.727825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:25.747855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.748552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.748783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:25.749701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:25.757296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:25.758940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:26.160398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:26.161176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:26.195677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:26.195677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:26.195677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:26.195677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:26.195677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:26.195677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:26.333525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:26.576017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:26.590491 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd79e478-afb7-4f88-8cb9-7cabb5f1bf9f tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 0.870057 Nov 02 21:53:26.595944 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2847/5815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:25 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:26.602814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:26.603428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:26.634804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:26.635623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:26.636071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:26.637480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:26.640744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:26.641429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:27.252407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:27.266187 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b3232f6-aa74-43c8-9cb4-e8d2bbe4bf53 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 1.110661 Nov 02 21:53:27.268787 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2969/5816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:26 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:53:27.278136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:27.291836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:27.296209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:27.317795 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b32a36b-c83b-4e6c-bf09-993a19ce375e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1408 microversion: 2.20 time: 0.700460 Nov 02 21:53:27.320482 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2848/5817] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:26 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1408 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:27.614463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:27.615604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:27.641246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:27.644803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:27.646838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:27.648246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:27.651330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:27.655079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:28.320500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:28.329221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:28.419963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:28.419963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:28.419963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:28.419963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:28.419963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:28.419963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:29.274431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:29.297749 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ee078587-9999-4ae7-9713-48169b2b7cff tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 1.003498 Nov 02 21:53:29.301889 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2849/5818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:28 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:29.326420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:29.329290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:29.341158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:29.342857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:29.342857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:29.343858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:29.348085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:29.348769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:29.638241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:29.647464 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-456c818b-9da3-4760-a09e-825461d05ffc tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1511 microversion: 2.1 time: 2.036814 Nov 02 21:53:29.652059 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2970/5819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:27 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1511 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:29.657040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-029fde8d-51c0-4fb1-94df-058216080347 req-8dea205a-a396-4430-972b-2997d12e680a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901804ba-1e60-4a26-828f-41666168e0c1", "name": "network-vif-plugged", "status": "completed", "tag": "17761c3c-21bf-4f5d-98bf-bf7e88907cc4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:29.697923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-029fde8d-51c0-4fb1-94df-058216080347 req-8dea205a-a396-4430-972b-2997d12e680a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:29.698572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-029fde8d-51c0-4fb1-94df-058216080347 req-8dea205a-a396-4430-972b-2997d12e680a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:29.699023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-029fde8d-51c0-4fb1-94df-058216080347 req-8dea205a-a396-4430-972b-2997d12e680a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:29.715353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-029fde8d-51c0-4fb1-94df-058216080347 req-8dea205a-a396-4430-972b-2997d12e680a service nova] Creating event network-vif-plugged:17761c3c-21bf-4f5d-98bf-bf7e88907cc4 for instance 901804ba-1e60-4a26-828f-41666168e0c1 on n-h1-860863-4 Nov 02 21:53:29.729347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-029fde8d-51c0-4fb1-94df-058216080347 req-8dea205a-a396-4430-972b-2997d12e680a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075517 Nov 02 21:53:29.730358 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2971/5820] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:53:29.903919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:29.913825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:29.923259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:29.924482 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-49b2888c-e0ca-4710-b90e-d04ea7482b31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1408 microversion: 2.20 time: 0.621582 Nov 02 21:53:29.936953 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2850/5821] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:29 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1408 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:30.330238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:30.334935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:30.352094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:30.354022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:30.355549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:30.356669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:30.357476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:30.358154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:30.409208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-99575444-094f-4565-bf53-3c3c5afe95d5 req-dec206c2-3719-43e9-92f0-ea2bb4be953a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40ad45b-ca57-4f29-bc34-1b46511dab23", "name": "network-vif-deleted", "tag": "9890a9b2-b6e7-4c1d-b480-c80d93a563a2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:30.431489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-99575444-094f-4565-bf53-3c3c5afe95d5 req-dec206c2-3719-43e9-92f0-ea2bb4be953a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:30.434008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-99575444-094f-4565-bf53-3c3c5afe95d5 req-dec206c2-3719-43e9-92f0-ea2bb4be953a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:30.435510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-99575444-094f-4565-bf53-3c3c5afe95d5 req-dec206c2-3719-43e9-92f0-ea2bb4be953a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:30.483441 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-99575444-094f-4565-bf53-3c3c5afe95d5 req-dec206c2-3719-43e9-92f0-ea2bb4be953a service nova] Creating event network-vif-deleted:9890a9b2-b6e7-4c1d-b480-c80d93a563a2 for instance d40ad45b-ca57-4f29-bc34-1b46511dab23 on n-h1-860863-4 Nov 02 21:53:30.507036 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-99575444-094f-4565-bf53-3c3c5afe95d5 req-dec206c2-3719-43e9-92f0-ea2bb4be953a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258046 Nov 02 21:53:30.513431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2972/5822] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:53:30.678441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:30.680022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:30.691226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:30.693378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:30.694228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:30.695693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:30.699150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:30.699932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:30.855224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d53ccbfaf4c9b8d03ffb44f8e3660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5da1bc0056403987c4a5d596e2e3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:30.870191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:30.895272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3af82e5-9241-439b-b47b-637e22e4b245 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.573087 Nov 02 21:53:30.898095 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d0a3d648-72d0-4a2f-a2e4-9fac72e153e7 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 200 len: 1301 microversion: 2.1 time: 0.224226 Nov 02 21:53:30.899318 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2973/5823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:30 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 1301 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:30.905474 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2851/5824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:30 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:30.959346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:30.960603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:30.968550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:30.969345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:30.969981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:30.970894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:30.971539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:30.972177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:31.253146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:31.257820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:31.259304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:31.261108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-611b86c3-d664-4ac0-ba48-211e7cc49678 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1408 microversion: 2.20 time: 0.306407 Nov 02 21:53:31.276974 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2852/5825] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:30 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:53:31.928061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:31.928807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:31.931425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:31.937704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] [instance: d40ad45b-ca57-4f29-bc34-1b46511dab23] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:31.972437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:31.978732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:31.982119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:31.984334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:31.985214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:31.985922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:31.989783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:31.999066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:31.999229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:31.999330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:31.999330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:32.001044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:32.008225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:32.057299 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] HTTP exception thrown: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 could not be found. Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Request method failure captured: Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 HTTP/1.1 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuX5TmDkErDfS7dChZhhfpYbrHu9e5wy7E3AAY6drrtN-4jpicw35O3BtjU7QzykvXmKLsAA19LGC_8BcLpX3QLoVuRR0Z4FGA2RMZUxNKTEvMOuwFbUThDSZjFWpzgNAIhSUkDlh44_I0b0oCc9Z9-cvavQPB4KS1O29UivMBNLttM Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/af5da1bc0056403987c4a5d596e2e3fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: af5da1bc0056403987c4a5d596e2e3fb Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-394858086 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4e3d53ccbfaf4c9b8d03ffb44f8e3660 Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-394858086-project Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 could not be found. Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd40ad45b-ca57-4f29-bc34-1b46511dab23'} Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 could not be found. Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 could not be found. Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:32.061133 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 could not be found. Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] Returning 404 to user: Instance d40ad45b-ca57-4f29-bc34-1b46511dab23 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:32.066332 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff65daf1-43d1-4a61-85f0-3a08f9c0d164 tempest-ServersNegativeTestJSON-394858086 tempest-ServersNegativeTestJSON-394858086-project] 10.222.0.25 "GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23" status: 404 len: 111 microversion: 2.1 time: 0.144685 Nov 02 21:53:32.067375 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2974/5826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:31 2022] GET /compute/v2.1/servers/d40ad45b-ca57-4f29-bc34-1b46511dab23 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:53:32.288475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:32.289354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:32.314876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:32.315306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:32.315759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:32.316665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:32.317156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:32.317597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:32.937009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:32.956254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:32.958184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:32.959426 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1025809-ab5c-425c-9487-bdc16fa53438 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1601 microversion: 2.20 time: 0.674965 Nov 02 21:53:32.959992 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2975/5827] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:53:32 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1601 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:53:32.985183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:32.987779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:33.008979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:33.009818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:33.010472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:33.012715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:33.014008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:33.016637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:33.054929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:33.068526 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-429f738a-e4c0-447c-baa3-a4e305730da6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 1.142639 Nov 02 21:53:33.076199 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2853/5828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:31 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:33.206455 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-083d5a3e-4eb7-4c43-9210-10b26e02cc22 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.224268 Nov 02 21:53:33.208122 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2976/5829] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Nov 2 21:53:32 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:53:34.108073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:34.113034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:34.137591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:34.138390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:34.138596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:34.144648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:34.157448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:34.157929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:35.138253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:35.160638 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e53663b-4b1c-4376-bae1-40a773309261 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 1.062987 Nov 02 21:53:35.161435 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2854/5830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:34 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:36.189926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:36.190592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:36.199885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:36.200390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:36.200845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:36.201615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:36.216223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:36.216750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:36.554792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:36.570091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bb44349-c676-40ec-82d1-9c8accfb11a9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.385074 Nov 02 21:53:36.591132 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2977/5831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:36 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:36.805486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2bb0562e-dfb6-43e9-b18a-2bddfcf8dce3 req-0e1bb714-6453-4b20-abc7-812b5bc1b1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901804ba-1e60-4a26-828f-41666168e0c1", "tag": "17761c3c-21bf-4f5d-98bf-bf7e88907cc4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:36.827030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2bb0562e-dfb6-43e9-b18a-2bddfcf8dce3 req-0e1bb714-6453-4b20-abc7-812b5bc1b1e6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:36.827764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2bb0562e-dfb6-43e9-b18a-2bddfcf8dce3 req-0e1bb714-6453-4b20-abc7-812b5bc1b1e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:36.828364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2bb0562e-dfb6-43e9-b18a-2bddfcf8dce3 req-0e1bb714-6453-4b20-abc7-812b5bc1b1e6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:36.842592 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2bb0562e-dfb6-43e9-b18a-2bddfcf8dce3 req-0e1bb714-6453-4b20-abc7-812b5bc1b1e6 service nova] Creating event network-changed:17761c3c-21bf-4f5d-98bf-bf7e88907cc4 for instance 901804ba-1e60-4a26-828f-41666168e0c1 on n-h1-860863-4 Nov 02 21:53:36.853353 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2bb0562e-dfb6-43e9-b18a-2bddfcf8dce3 req-0e1bb714-6453-4b20-abc7-812b5bc1b1e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051413 Nov 02 21:53:36.857816 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2855/5832] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:53:36.901671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:36.902561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:36.926682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:36.927290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:36.927749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:36.928491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:36.951154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:36.953090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:37.183292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lazy-loading 'services' on Instance uuid a02ee7ab-62a7-4c97-b717-4770f68661dc {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:37.585799 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0514f54d-7c00-4741-b7d9-cdab630d88f1 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc/os-volume_attachments/47b5effc-8a0f-4197-b9e2-7c4589965721" status: 202 len: 0 microversion: 2.1 time: 0.688515 Nov 02 21:53:37.595932 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2978/5833] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:53:36 2022] DELETE /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc/os-volume_attachments/47b5effc-8a0f-4197-b9e2-7c4589965721 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:53:37.604551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:37.618163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:37.641236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:37.645196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:37.649239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:37.649239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:37.649239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:37.649239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:37.827955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd1546ea-20f5-4dbb-8873-aa0769be8098 tempest-ExtensionsTest-1899392279 tempest-ExtensionsTest-1899392279-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:37.829998 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd1546ea-20f5-4dbb-8873-aa0769be8098 tempest-ExtensionsTest-1899392279 tempest-ExtensionsTest-1899392279-project] 10.222.0.25 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.384611 Nov 02 21:53:37.830948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2856/5834] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Nov 2 21:53:37 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:53:37.847707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30305be8-1ed1-4141-975d-ca0b0fbad036 tempest-ExtensionsTest-1899392279 tempest-ExtensionsTest-1899392279-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:37.859274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30305be8-1ed1-4141-975d-ca0b0fbad036 tempest-ExtensionsTest-1899392279 tempest-ExtensionsTest-1899392279-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.018642 Nov 02 21:53:37.860973 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2857/5835] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Nov 2 21:53:37 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:53:38.298441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:38.309061 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7b703af-8b7c-416e-9b77-f1d68a277596 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.709567 Nov 02 21:53:38.318294 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2979/5836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:37 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:39.352037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:39.354567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:39.387448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:39.388448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:39.389368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:39.390350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:39.391135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:39.391809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:39.788922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:39.805427 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd06faee-5998-46df-80d5-acef93cc78d8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.454188 Nov 02 21:53:39.806107 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2858/5837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:39 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:40.830059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:40.831547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:40.846602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:40.847445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:40.852629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:40.852629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:40.852629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:40.852629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:41.322648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:41.340620 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31d95b7c-ba66-4243-ba7e-6dae61226941 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1723 microversion: 2.1 time: 0.514686 Nov 02 21:53:41.352159 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2980/5838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:40 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:42.372225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:42.379365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:42.411298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:42.414076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:42.414076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:42.414076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:42.418525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:42.420500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:43.211529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:43.228915 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bad8b275-9ba4-4311-bde1-6f5b25f20e95 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1700 microversion: 2.1 time: 0.864362 Nov 02 21:53:43.237117 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2859/5839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:42 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1700 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:43.265994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45c03c9d-c702-4e51-a934-8137cff44ebd tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:43.289377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c03c9d-c702-4e51-a934-8137cff44ebd tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:43.290240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c03c9d-c702-4e51-a934-8137cff44ebd tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:43.292562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45c03c9d-c702-4e51-a934-8137cff44ebd tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:43.355585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-45c03c9d-c702-4e51-a934-8137cff44ebd tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Going to try to start instance {{(pid=121040) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 21:53:43.632669 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-45c03c9d-c702-4e51-a934-8137cff44ebd tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action" status: 202 len: 0 microversion: 2.1 time: 0.371656 Nov 02 21:53:43.634084 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2981/5840] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:53:43 2022] POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:53:43.642856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:43.644176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:43.659693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:43.660742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:43.661289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:43.662117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:43.664777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:43.665566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:44.201702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:44.213841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1464b1c6-c030-4af4-99a8-ae62514cba5d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1709 microversion: 2.1 time: 0.572442 Nov 02 21:53:44.217169 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2860/5841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:43 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1709 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:45.241608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:45.244920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:45.252445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:45.253190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:45.253885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:45.254791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:45.255455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:45.255897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:46.250493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:46.277310 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4efe2616-13ee-4326-ad50-3cc9b0be7981 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1709 microversion: 2.1 time: 1.029161 Nov 02 21:53:46.281135 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2982/5842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:45 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1709 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:47.307746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:47.308379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:47.321916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:47.324327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:47.326452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:47.330141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:47.331466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:47.333121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:47.394187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:47.626794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:47.644565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91616428-b3d2-48bd-8c78-c8ce149fd07f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1713 microversion: 2.1 time: 0.334304 Nov 02 21:53:47.645611 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2861/5843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:47 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1713 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:49.326250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:49.327541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:49.336523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:49.338707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:49.338956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:49.340108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:49.340899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:49.341622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:49.380080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:53:49.782693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4172faa-0c29-47ed-9530-51e7688051fe tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 204 len: 0 microversion: 2.1 time: 0.463400 Nov 02 21:53:49.786846 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2983/5844] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:53:49 2022] DELETE /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:53:49.793259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:49.796066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:49.806689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=43 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:49.814812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:49.814812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:49.814812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:49.814812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:49.814812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:49.814812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:50.212530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:50.222841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb911047-7298-4a48-aacb-3a41fc8218ac tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1513 microversion: 2.1 time: 0.434483 Nov 02 21:53:50.226980 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2862/5845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:49 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1513 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:51.256229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:51.257740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:51.271393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:51.276621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:51.277175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:51.278160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:51.279170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:51.279528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:51.322455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:53:51.601882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:51.611803 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f50c8a5-c79b-44dd-805b-d98e803d2435 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1513 microversion: 2.1 time: 0.363253 Nov 02 21:53:51.612873 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2984/5846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:51 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:52.268889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-420dba67-6737-4291-9ad7-64f68be9209f req-0824ab6e-301d-4dd5-aeb4-64474bffcedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02ee7ab-62a7-4c97-b717-4770f68661dc", "name": "network-vif-deleted", "tag": "6d4b8438-4134-4153-9711-28a24d99a70d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:53:52.291868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-420dba67-6737-4291-9ad7-64f68be9209f req-0824ab6e-301d-4dd5-aeb4-64474bffcedb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:52.292352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-420dba67-6737-4291-9ad7-64f68be9209f req-0824ab6e-301d-4dd5-aeb4-64474bffcedb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:52.292993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-420dba67-6737-4291-9ad7-64f68be9209f req-0824ab6e-301d-4dd5-aeb4-64474bffcedb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:52.306457 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-420dba67-6737-4291-9ad7-64f68be9209f req-0824ab6e-301d-4dd5-aeb4-64474bffcedb service nova] Creating event network-vif-deleted:6d4b8438-4134-4153-9711-28a24d99a70d for instance a02ee7ab-62a7-4c97-b717-4770f68661dc on n-h2-860863-4 Nov 02 21:53:52.312729 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-420dba67-6737-4291-9ad7-64f68be9209f req-0824ab6e-301d-4dd5-aeb4-64474bffcedb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047548 Nov 02 21:53:52.313870 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2863/5847] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:53:52.639345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:52.640294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:52.661005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:52.661924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:52.662637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:52.665388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:52.669338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:52.674837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:52.761787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:52.763823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:52.765476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:52.772175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lazy-loading 'fault' on Instance uuid a02ee7ab-62a7-4c97-b717-4770f68661dc {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:53:52.874207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e549ae9b7c4a74a0a68a20806ffa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cff0fbcbb24d1a804e9a0b2f5e2e13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:53:52.886635 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 200 len: 1308 microversion: 2.1 time: 0.252144 Nov 02 21:53:52.888987 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2985/5848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:52 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:53:53.922009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:53:53.923818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] [instance: a02ee7ab-62a7-4c97-b717-4770f68661dc] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:53:53.933058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:53.933058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:53.933471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:53.934378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:53:53.934842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:53:53.935278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:53:53.951957 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] HTTP exception thrown: Instance a02ee7ab-62a7-4c97-b717-4770f68661dc could not be found. Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Request method failure captured: Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc HTTP/1.1 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuWaMY0w9DQ4xcxVJ4ByD8WP51dh-M6OPb5hQ2qf4rBI2jZI8jDMJOjWivOsBIS1ZBu3jP6kS6uA9du42t9sROcBCgP6UYdzwsSkwdmh1GnPr9vGe1QO7pTuxKulG7sGO8FlCtG_15akEDq2Bug_-7acBkwD73R4JeMMCa95Gp1zo58 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: a0cff0fbcbb24d1a804e9a0b2f5e2e13 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesSnapshotTestJSON-626344921 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a0cff0fbcbb24d1a804e9a0b2f5e2e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesSnapshotTestJSON-626344921 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: a0cff0fbcbb24d1a804e9a0b2f5e2e13 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-626344921 Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesSnapshotTestJSON-626344921-project Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 94e549ae9b7c4a74a0a68a20806ffa9e Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesSnapshotTestJSON-626344921-project Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance a02ee7ab-62a7-4c97-b717-4770f68661dc could not be found. Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'a02ee7ab-62a7-4c97-b717-4770f68661dc'} Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02ee7ab-62a7-4c97-b717-4770f68661dc could not be found. Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02ee7ab-62a7-4c97-b717-4770f68661dc could not be found. Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:53:53.953813 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02ee7ab-62a7-4c97-b717-4770f68661dc could not be found. Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Returning 404 to user: Instance a02ee7ab-62a7-4c97-b717-4770f68661dc could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a3287b88-f03b-43a8-bcd5-921d813a9290 tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc" status: 404 len: 111 microversion: 2.1 time: 0.041212 Nov 02 21:53:53.966319 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2864/5849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:53:53 2022] GET /compute/v2.1/servers/a02ee7ab-62a7-4c97-b717-4770f68661dc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:54:01.487956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:01.491488 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d74e6b21-b77d-48e5-86cd-ca39b29ed19c tempest-VolumesSnapshotTestJSON-626344921 tempest-VolumesSnapshotTestJSON-626344921-project] 10.222.0.25 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004636 Nov 02 21:54:01.491852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2986/5850] 10.222.0.25 () {56 vars in 886 bytes} [Wed Nov 2 21:54:01 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 21:54:09.593729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:09.594284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:09.599921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=5 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:54:09.601324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=14 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:54:09.608697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:09.610189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:09.610846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:09.612625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:09.614051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:09.614658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:09.656732 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-37e51c6b-f081-4c0d-bdf5-dbc9b4a0a3f2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/ips" status: 200 len: 153 microversion: 2.20 time: 0.070842 Nov 02 21:54:09.657894 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2865/5851] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Nov 2 21:54:09 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/ips => generated 153 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:54:11.113178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:54:11.264578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-647cbc8c-6f98-40a7-9940-c650dd2f3915 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Action: 'create', calling method: .version_select at 0x7f9b6882f790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-194877996", "metadata": {"Type": "work"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-647cbc8c-6f98-40a7-9940-c650dd2f3915 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Request method failure captured: Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 121 Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYucDEJys7hv__cPiaoihtGLWQrSQymVp0FYuSqUK72mv_Ls0hesLGABcx0dlnrNTlGJFFH1tN5D5TkcdBJX9BFN867-TVhD7PtS0dRHua-y9bnysTWKCJ_ftPaespn-82ThsUycKvQXLHfMjTf_vBFCU0EHrsOm8TKPPeBJtL9QyUHA Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: faf64e07a6da44c09059f4c984d8915f Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-194877996", "metadata": {"Type": "work"}}} Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-194877996', 'metadata': {'Type': 'work'}}}} Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:54:11.268842 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 21:54:11.274809 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.277548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-647cbc8c-6f98-40a7-9940-c650dd2f3915 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:54:11.278478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-647cbc8c-6f98-40a7-9940-c650dd2f3915 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.175119 Nov 02 21:54:11.279283 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2987/5852] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 21:54:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:54:11.288769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf53f84c-772f-476b-9728-f94c770be6f2 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Action: 'create', calling method: .version_select at 0x7f9b63a889d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1802496146", "metadata": {"Type": "work"}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf53f84c-772f-476b-9728-f94c770be6f2 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Request method failure captured: Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 120 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYucDEJys7hv__cPiaoihtGLWQrSQymVp0FYuSqUK72mv_Ls0hesLGABcx0dlnrNTlGJFFH1tN5D5TkcdBJX9BFN867-TVhD7PtS0dRHua-y9bnysTWKCJ_ftPaespn-82ThsUycKvQXLHfMjTf_vBFCU0EHrsOm8TKPPeBJtL9QyUHA Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: faf64e07a6da44c09059f4c984d8915f Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1802496146", "metadata": {"Type": "work"}}} Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802496146', 'metadata': {'Type': 'work'}}}} Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi '0' Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:54:11.295941 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 21:54:11.300819 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.309439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf53f84c-772f-476b-9728-f94c770be6f2 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:54:11.316961 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf53f84c-772f-476b-9728-f94c770be6f2 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025739 Nov 02 21:54:11.316961 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2866/5853] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 21:54:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:54:11.322867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd6fd37a-af8c-4a38-a23c-2f0a1023a160 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Action: 'create', calling method: .version_select at 0x7f9b688144c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1336748414", "metadata": {"Type": "work"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd6fd37a-af8c-4a38-a23c-2f0a1023a160 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Request method failure captured: Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 119 Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYucDEJys7hv__cPiaoihtGLWQrSQymVp0FYuSqUK72mv_Ls0hesLGABcx0dlnrNTlGJFFH1tN5D5TkcdBJX9BFN867-TVhD7PtS0dRHua-y9bnysTWKCJ_ftPaespn-82ThsUycKvQXLHfMjTf_vBFCU0EHrsOm8TKPPeBJtL9QyUHA Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: faf64e07a6da44c09059f4c984d8915f Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1336748414", "metadata": {"Type": "work"}}} Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1336748414', 'metadata': {'Type': 'work'}}}} Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '' Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 21:54:11.327768 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd6fd37a-af8c-4a38-a23c-2f0a1023a160 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd6fd37a-af8c-4a38-a23c-2f0a1023a160 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011101 Nov 02 21:54:11.345921 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2988/5854] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Nov 2 21:54:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:54:11.348892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b7fe6b3-5c2b-4e81-b806-c37e302c4e03 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Calling method '.version_select at 0x7f9b63ac0280>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:11.410356 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9b7fe6b3-5c2b-4e81-b806-c37e302c4e03 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] HTTP exception thrown: Volume tempest-invalid-351339898 could not be found. Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b7fe6b3-5c2b-4e81-b806-c37e302c4e03 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Request method failure captured: Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-351339898 HTTP/1.1 Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYucDEJys7hv__cPiaoihtGLWQrSQymVp0FYuSqUK72mv_Ls0hesLGABcx0dlnrNTlGJFFH1tN5D5TkcdBJX9BFN867-TVhD7PtS0dRHua-y9bnysTWKCJ_ftPaespn-82ThsUycKvQXLHfMjTf_vBFCU0EHrsOm8TKPPeBJtL9QyUHA Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: faf64e07a6da44c09059f4c984d8915f Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: exception: Volume tempest-invalid-351339898 could not be found. Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'tempest-invalid-351339898'} Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-351339898 could not be found. (HTTP 404) (Request-ID: req-1d319934-2486-4e02-bcdd-c2ff6fa1ba2b) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:54:11.412899 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-351339898 could not be found. Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-351339898 could not be found. Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-351339898 could not be found. Nov 02 21:54:11.417987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.424629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b7fe6b3-5c2b-4e81-b806-c37e302c4e03 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Returning 404 to user: Volume tempest-invalid-351339898 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:54:11.425760 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b7fe6b3-5c2b-4e81-b806-c37e302c4e03 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-351339898" status: 404 len: 98 microversion: 2.1 time: 0.090744 Nov 02 21:54:11.426562 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2867/5855] 10.222.0.25 () {58 vars in 1215 bytes} [Wed Nov 2 21:54:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-351339898 => generated 98 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 21:54:11.436193 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4db183e4-aa19-42a0-b7f8-43ea55453023 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003810 Nov 02 21:54:11.439407 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2989/5856] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Nov 2 21:54:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 21:54:11.453225 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f892d736-ed1e-4d8c-b14f-94ef9ece3aac tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004344 Nov 02 21:54:11.464431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b0ab305-6987-41b5-895c-658ba32ffc61 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Calling method '.version_select at 0x7f9b6d13b310>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:11.469569 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2868/5857] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Nov 2 21:54:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 21:54:11.516573 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7b0ab305-6987-41b5-895c-658ba32ffc61 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] HTTP exception thrown: Volume a98841e1-09d6-4491-a187-31e99327a6e3 could not be found. Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b0ab305-6987-41b5-895c-658ba32ffc61 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Request method failure captured: Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-volumes/a98841e1-09d6-4491-a187-31e99327a6e3 HTTP/1.1 Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYucDEJys7hv__cPiaoihtGLWQrSQymVp0FYuSqUK72mv_Ls0hesLGABcx0dlnrNTlGJFFH1tN5D5TkcdBJX9BFN867-TVhD7PtS0dRHua-y9bnysTWKCJ_ftPaespn-82ThsUycKvQXLHfMjTf_vBFCU0EHrsOm8TKPPeBJtL9QyUHA Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: faf64e07a6da44c09059f4c984d8915f Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: method: Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: exception: Volume a98841e1-09d6-4491-a187-31e99327a6e3 could not be found. Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'a98841e1-09d6-4491-a187-31e99327a6e3'} Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a98841e1-09d6-4491-a187-31e99327a6e3 could not be found. (HTTP 404) (Request-ID: req-02dc7010-6c3a-402e-9bae-3229be44f0f6) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:54:11.520206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a98841e1-09d6-4491-a187-31e99327a6e3 could not be found. Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a98841e1-09d6-4491-a187-31e99327a6e3 could not be found. Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a98841e1-09d6-4491-a187-31e99327a6e3 could not be found. Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b0ab305-6987-41b5-895c-658ba32ffc61 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Returning 404 to user: Volume a98841e1-09d6-4491-a187-31e99327a6e3 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b0ab305-6987-41b5-895c-658ba32ffc61 tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a98841e1-09d6-4491-a187-31e99327a6e3" status: 404 len: 109 microversion: 2.1 time: 0.062916 Nov 02 21:54:11.524658 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2990/5858] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:54:11 2022] DELETE /compute/v2.1/os-volumes/a98841e1-09d6-4491-a187-31e99327a6e3 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:54:11.538361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de8b0dc9-a9af-43a9-956f-da27f63f1edc tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Calling method '.version_select at 0x7f9b63ae5ee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:11.590068 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-de8b0dc9-a9af-43a9-956f-da27f63f1edc tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] HTTP exception thrown: Volume 0b0a05f9-5572-40ed-a825-08fdfdbf22bb could not be found. Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de8b0dc9-a9af-43a9-956f-da27f63f1edc tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Request method failure captured: Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/os-volumes/0b0a05f9-5572-40ed-a825-08fdfdbf22bb HTTP/1.1 Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYucDEJys7hv__cPiaoihtGLWQrSQymVp0FYuSqUK72mv_Ls0hesLGABcx0dlnrNTlGJFFH1tN5D5TkcdBJX9BFN867-TVhD7PtS0dRHua-y9bnysTWKCJ_ftPaespn-82ThsUycKvQXLHfMjTf_vBFCU0EHrsOm8TKPPeBJtL9QyUHA Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ae0ae03c80424bd1a58f752a91386e0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: ae0ae03c80424bd1a58f752a91386e0c Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesNegativeTest-205140332 Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: faf64e07a6da44c09059f4c984d8915f Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesNegativeTest-205140332-project Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: method: Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: exception: Volume 0b0a05f9-5572-40ed-a825-08fdfdbf22bb could not be found. Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0b0a05f9-5572-40ed-a825-08fdfdbf22bb'} Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b0a05f9-5572-40ed-a825-08fdfdbf22bb could not be found. (HTTP 404) (Request-ID: req-e048b2d5-202a-41ab-8805-75d884c8fadc) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 21:54:11.593000 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b0a05f9-5572-40ed-a825-08fdfdbf22bb could not be found. Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b0a05f9-5572-40ed-a825-08fdfdbf22bb could not be found. Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b0a05f9-5572-40ed-a825-08fdfdbf22bb could not be found. Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de8b0dc9-a9af-43a9-956f-da27f63f1edc tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] Returning 404 to user: Volume 0b0a05f9-5572-40ed-a825-08fdfdbf22bb could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:54:11.599800 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de8b0dc9-a9af-43a9-956f-da27f63f1edc tempest-VolumesNegativeTest-205140332 tempest-VolumesNegativeTest-205140332-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0b0a05f9-5572-40ed-a825-08fdfdbf22bb" status: 404 len: 109 microversion: 2.1 time: 0.064713 Nov 02 21:54:11.605701 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2869/5859] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Nov 2 21:54:11 2022] GET /compute/v2.1/os-volumes/0b0a05f9-5572-40ed-a825-08fdfdbf22bb => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:54:13.461871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:54:13.463904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:13.481214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:13.482775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:13.487882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:13.489548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:13.494429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:13.496205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:13.545110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lazy-loading 'flavor' on Instance uuid 901804ba-1e60-4a26-828f-41666168e0c1 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:54:14.213159 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-609a70e8-2ac8-4c6c-b417-bd05cb420a67 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/action" status: 202 len: 0 microversion: 2.20 time: 0.760340 Nov 02 21:54:14.216402 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2991/5860] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:54:13 2022] POST /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/action => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:54:14.226449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:14.227223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:14.255334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:14.261444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:14.263127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:14.266354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:14.267088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:14.267767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:14.506552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:14.519130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:14.527456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:14.528566 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2029e08a-9b62-4a8e-aee0-de0696aef10d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.307941 Nov 02 21:54:14.530297 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2870/5861] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:14 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:15.556538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:15.557301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:15.572565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:15.577336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:15.577336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:15.577336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:15.577336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:15.577336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:15.994561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:16.004869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:16.006241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:16.007626 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5d48530-4033-4a70-adc3-a5e56cb51827 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.456766 Nov 02 21:54:16.012259 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2992/5862] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:15 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:17.039102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:17.042374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:17.066628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:17.067135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:17.067599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:17.068297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:17.068749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:17.069213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:17.261710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:17.279398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:17.283566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:17.298445 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2dce4c3-165d-4c05-8a22-bafc9595281b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.251836 Nov 02 21:54:17.298445 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2871/5863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:17 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:18.329668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:18.331689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:18.347885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:18.348583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:18.349220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:18.350201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:18.351216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:18.352431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:18.720523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:18.734354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:18.739063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:18.742675 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff2d9d08-2168-42c7-abf6-ad8211a62a13 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.419862 Nov 02 21:54:18.743914 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2993/5864] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:18 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:19.670039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:19.671136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:19.683459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:19.686369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:19.686889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:19.687621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:19.688085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:19.688518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:19.923125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lazy-loading 'services' on Instance uuid 329bf1b5-31f6-4107-a823-5a0c6bbbc201 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:54:20.248484 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-790bf90f-84f2-4d1a-918f-da67f484a188 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-volume_attachments/0a14a59b-fa47-4628-a86f-2e6658ff1ab6" status: 202 len: 0 microversion: 2.1 time: 0.583169 Nov 02 21:54:20.254615 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2872/5865] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:54:19 2022] DELETE /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-volume_attachments/0a14a59b-fa47-4628-a86f-2e6658ff1ab6 => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:54:20.588063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:20.588063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:20.597515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:20.598013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:20.599240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:20.602451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:20.603695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:20.606089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:20.979368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:21.002910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:21.018606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:21.020413 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-291a09e8-23ec-4327-8cfa-6c309c3f1819 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 1.250927 Nov 02 21:54:21.056952 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2994/5866] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:19 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:54:22.057001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:22.060025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:22.083975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:22.084472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:22.084909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:22.085639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:22.086088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:22.086513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:22.663215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:22.671214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:22.672679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:22.690819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-544a44c0-cb9d-4903-b995-c4cd0f053ee2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.638741 Nov 02 21:54:22.715265 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2873/5867] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:22 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:23.726872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:23.733591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:23.762461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:23.765446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:23.773883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:23.779307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:23.783210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:23.786538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:24.248207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:24.270257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:24.276562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:24.277955 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61c78d58-9046-4c22-974f-2ae1e5986534 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.559195 Nov 02 21:54:24.280376 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2995/5868] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:23 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:25.317102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:25.317893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:25.343697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:25.346750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:25.348371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:25.353550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:25.354975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:25.355788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:25.922814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:25.935776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:25.942357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:25.945695 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9c703e3-c81d-49a9-84de-9fc96ec62738 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.638826 Nov 02 21:54:25.946625 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2874/5869] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:25 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:26.981632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:26.981632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:27.005607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:27.020343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:27.021100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:27.022369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:27.023319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:27.026094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:27.418456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:27.434557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:27.439148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:27.439148 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-feae3d9a-a1e6-48e1-9b3a-3c208242ce34 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.464084 Nov 02 21:54:27.439480 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2996/5870] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:26 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:28.472781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:28.474635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:28.505232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:28.505232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:28.505232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:28.505651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:28.506857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:28.506857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:29.134670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4be1513-aefe-4a5b-8612-47b4921b68e8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:54:29.148283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4be1513-aefe-4a5b-8612-47b4921b68e8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:29.150780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4be1513-aefe-4a5b-8612-47b4921b68e8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:29.151374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4be1513-aefe-4a5b-8612-47b4921b68e8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:29.214156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a4be1513-aefe-4a5b-8612-47b4921b68e8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 21:54:29.405495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:29.423681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:29.430119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:29.440058 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a3b933fb-cb40-4a50-a32d-0cb48eafec10 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.976032 Nov 02 21:54:29.450054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2875/5871] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:28 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:29.470355 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a4be1513-aefe-4a5b-8612-47b4921b68e8 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action" status: 202 len: 0 microversion: 2.1 time: 0.341786 Nov 02 21:54:29.471814 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2997/5872] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:54:29 2022] POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 21:54:29.486843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:29.490570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:29.514979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:29.515853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:29.518635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:29.519905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:29.523418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:29.524229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:29.981985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:29.997676 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb9a7787-de3d-4218-89b9-cea04cb8e7be tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1677 microversion: 2.1 time: 0.518752 Nov 02 21:54:29.998317 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2876/5873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:29 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1677 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:30.491953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:30.491953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:30.515268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:30.516233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:30.516996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:30.518505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:30.522461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:30.525506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:30.959100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:30.969592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:30.971052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:30.998480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a78d4b9-2ce1-4637-ad21-10db8f54c181 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1747 microversion: 2.20 time: 0.528439 Nov 02 21:54:30.999742 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2998/5874] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:30 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1747 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:31.041702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:31.043563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:31.062155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:31.069067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:31.071926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:31.072767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:31.074226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:31.074948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:31.286075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:31.304770 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d72f063-9217-4dc0-ae24-cce98fbbf7e0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1677 microversion: 2.1 time: 0.283744 Nov 02 21:54:31.309188 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2877/5875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:31 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1677 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:32.036126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:32.037687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:32.057025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:32.057025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:32.057532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:32.058679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:32.061596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:32.062886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:32.330812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:32.331638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:32.345910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:32.349255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:32.349730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:32.350483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:32.353443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:32.357066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:32.409711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:32.421008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:32.423209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:32.424445 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a569467-ad33-471c-8070-7c513209d251 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1747 microversion: 2.20 time: 0.394257 Nov 02 21:54:32.436203 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2999/5876] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:32 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1747 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:32.947829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:32.982799 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d59a311-f3fd-48cf-b8bb-d68253329853 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1677 microversion: 2.1 time: 0.656692 Nov 02 21:54:32.983102 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2878/5877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:32 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1677 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:33.469392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:33.470617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:33.483193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:33.488276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:33.488276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:33.491212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:33.491843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:33.492305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:33.695493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7b880bce-6fa5-4701-a564-32132b2657e7 req-672d2201-e9de-4414-8380-0f00b32e50d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901804ba-1e60-4a26-828f-41666168e0c1", "name": "network-vif-plugged", "status": "completed", "tag": "17761c3c-21bf-4f5d-98bf-bf7e88907cc4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:54:33.735770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b880bce-6fa5-4701-a564-32132b2657e7 req-672d2201-e9de-4414-8380-0f00b32e50d8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:33.736262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b880bce-6fa5-4701-a564-32132b2657e7 req-672d2201-e9de-4414-8380-0f00b32e50d8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:33.736699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7b880bce-6fa5-4701-a564-32132b2657e7 req-672d2201-e9de-4414-8380-0f00b32e50d8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:33.777303 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7b880bce-6fa5-4701-a564-32132b2657e7 req-672d2201-e9de-4414-8380-0f00b32e50d8 service nova] Creating event network-vif-plugged:17761c3c-21bf-4f5d-98bf-bf7e88907cc4 for instance 901804ba-1e60-4a26-828f-41666168e0c1 on n-h1-860863-4 Nov 02 21:54:33.784562 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7b880bce-6fa5-4701-a564-32132b2657e7 req-672d2201-e9de-4414-8380-0f00b32e50d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093340 Nov 02 21:54:33.785193 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2879/5878] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:54:34.007690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:34.009172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:34.031141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:34.031641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:34.037371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:34.044902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:34.045885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:34.053000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:34.143496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:34.155461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:34.163872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:34.174480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29bf9638-927a-472b-a320-478d5c40ac78 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.709220 Nov 02 21:54:34.175283 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3000/5879] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:33 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:34.370778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:34.381129 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e340ded8-05b2-4f9d-a0b9-de71d0d4ae27 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1677 microversion: 2.1 time: 0.376889 Nov 02 21:54:34.397594 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2880/5880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:34 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1677 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:54:35.209170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:35.209912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:35.231608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:35.233540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:35.235642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:35.238681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:35.242063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:35.244099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:35.410365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:35.412329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:35.450411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:35.453276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:35.460199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:35.463457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:35.466382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:35.467225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:35.768551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:35.790993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:35.802955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:35.804198 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b35821a-2c49-44ca-8312-73b2cfbac27e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.600489 Nov 02 21:54:35.825815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3001/5881] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:35 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:36.030071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:36.064557 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9867cac-a9c8-4730-9121-0843c4499da9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1677 microversion: 2.1 time: 0.661605 Nov 02 21:54:36.066473 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2881/5882] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:35 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1677 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:36.838235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:36.839705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:36.865572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:36.867366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:36.871353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:36.872112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:36.872591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:36.873075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:37.091074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:37.099161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:37.118431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:37.119781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:37.125187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:37.127450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:37.127961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:37.128558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:37.148305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:37.153624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:54:37.167438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:37.169345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:37.171179 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-941f52df-0fa1-44ed-adc4-0439719c09e7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.339640 Nov 02 21:54:37.173603 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3002/5883] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:36 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:37.416908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:37.429354 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-94485cb3-c755-457b-a273-c3713e9cefca tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1677 microversion: 2.1 time: 0.343679 Nov 02 21:54:37.440882 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2882/5884] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:37 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1677 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:38.203973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:38.204749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:38.218456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:38.219159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:38.224368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:38.225219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:38.225700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:38.226183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:38.453360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Calling method '.version_select at 0x7f9b6882fa60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:38.460983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:38.460983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:38.460983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:38.564692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:38.565549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:38.567797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:38.604725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:38.606715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:38.608742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:38.634598 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d1c1e91-71e6-4dd9-8cf3-8ce942adf323 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021 tempest-PortsAdminExtendedAttrsIpV6TestJSON-91992021-project-admin] 10.222.0.25 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.934317 Nov 02 21:54:38.635175 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3003/5885] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 21:54:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:54:38.645928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:38.646809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:38.662807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:38.663589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:38.665999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:38.665999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:38.665999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:38.665999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:38.810051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:38.826756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:38.832613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:38.833067 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e21c2a47-211a-4c2d-a2b5-3c373e5e3ec1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.633230 Nov 02 21:54:38.841974 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2883/5886] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:38 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:54:39.071949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:39.091186 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53bdb374-9cd0-406b-a68e-53942d9b6a08 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1677 microversion: 2.1 time: 0.454958 Nov 02 21:54:39.093835 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3004/5887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:38 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1677 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:39.871076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:39.871695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:39.886805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:39.887589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:39.894136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:39.895132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:39.895797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:39.901532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:40.123782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:40.125155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:40.140211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:40.144730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:40.145556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:40.147498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:40.149799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:40.152825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:40.530166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:40.552218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:40.556655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:40.560750 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d202fada-d776-4960-b7b9-eb02c42d7b33 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.693185 Nov 02 21:54:40.565342 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2884/5888] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:39 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:40.574496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:40.591517 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-871f31fa-c2a2-4353-9ad1-2eb8cac88a72 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1654 microversion: 2.1 time: 0.473459 Nov 02 21:54:40.649616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24668efb-c2c2-4cb8-ab93-34d28dcad0d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:54:40.654833 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3005/5889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:40 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1654 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:40.675034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24668efb-c2c2-4cb8-ab93-34d28dcad0d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:40.675833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24668efb-c2c2-4cb8-ab93-34d28dcad0d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:40.677070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24668efb-c2c2-4cb8-ab93-34d28dcad0d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:40.714290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24668efb-c2c2-4cb8-ab93-34d28dcad0d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Going to try to start instance {{(pid=121039) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 21:54:40.800705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:54:41.036702 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24668efb-c2c2-4cb8-ab93-34d28dcad0d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action" status: 202 len: 0 microversion: 2.1 time: 0.410854 Nov 02 21:54:41.047277 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2885/5890] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:54:40 2022] POST /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:54:41.059808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:41.060460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:41.083832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:41.085785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:41.086440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:41.088050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:41.088693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:41.089351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:41.597151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:41.597865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:41.600176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=35 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:54:41.616484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:41.617024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:41.620179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:41.626965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:41.630234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:41.630739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:41.631189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:41.637481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f258d202-52ec-4dae-9561-7ff25f69a7c1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1663 microversion: 2.1 time: 0.592124 Nov 02 21:54:41.643792 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3006/5891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:41 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1663 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:54:42.095955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:42.111493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:42.113606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:42.115107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31b2a1f3-5f3c-441f-933b-4c3ca65e8a31 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.523243 Nov 02 21:54:42.115662 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2886/5892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:41 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:54:42.673652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:42.674275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:42.700416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:42.703820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:42.705459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:42.710978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:42.711799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:42.712609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:43.142575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:43.149399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:43.166951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:43.193788 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3cf7028-b6b7-47ff-9335-2556b4375333 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1663 microversion: 2.1 time: 0.525434 Nov 02 21:54:43.197451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:43.198324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:43.199031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:43.199564 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3007/5893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:42 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1663 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:43.200722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:43.201461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:43.202120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:43.402638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:43.430541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:43.436560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:43.446385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-708da982-9154-490e-a4b1-226edb4621b2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.307796 Nov 02 21:54:43.471687 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2887/5894] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:43 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:54:44.223207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:44.223919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:44.225958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=37 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:54:44.242217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:44.243219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:44.243686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:44.244410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:44.244879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:44.245382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:44.486030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:44.487295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:44.504068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:44.505089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:44.512686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:44.516409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:44.517171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:44.524879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:44.861428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:44.875122 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-80d52a12-1c72-44b4-8e81-da022c803f1f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1667 microversion: 2.1 time: 0.655752 Nov 02 21:54:44.894785 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3008/5895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:54:44 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1667 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:54:45.015208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:45.034258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:45.041521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:45.045689 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d6a4632e-32e8-4772-8840-58a9a82a5256 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.562531 Nov 02 21:54:45.051204 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2888/5896] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:44 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:46.077437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:46.079459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:46.099894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:46.100809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:46.101606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:46.102967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:46.103631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:46.105510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:46.492983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:46.505112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:46.509786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:46.518113 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e6fea00-47a8-44cc-8a14-931da2fa1a45 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.448479 Nov 02 21:54:46.521762 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3009/5897] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:46 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:47.566187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:47.566829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:47.582929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:47.583452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:47.583876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:47.590492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:47.591081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:47.591650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:48.124213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:48.142862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:48.157973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:48.157973 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-85a87744-0a2b-4bef-950e-47619c7626f7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.588823 Nov 02 21:54:48.157973 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2889/5898] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:47 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:49.181734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:49.182361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:49.202823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:49.203351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:49.204006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:49.205033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:49.205717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:49.206330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:49.876793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:49.886147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:49.887671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:49.888870 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-285dce2f-e14e-4f16-9824-506c249c2bb9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.712675 Nov 02 21:54:49.889496 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3010/5899] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:49 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:50.923803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:50.925350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:50.968140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:50.974781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:50.977483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:50.984553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:50.986451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:50.992475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:51.269312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:51.283836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:51.285636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:51.287066 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4df49330-1546-40ff-b2de-7d4f978abc0d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.368371 Nov 02 21:54:51.287973 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2890/5900] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:50 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:52.339289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:52.340820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:52.350488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:52.351169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:52.351979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:52.353401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:52.354011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:52.354760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:52.576184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:52.585235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:52.594557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:52.595933 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb5b9f47-a1d4-4936-898a-13d308736ee8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.271691 Nov 02 21:54:52.597045 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3011/5901] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:52 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:53.624123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:53.625368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:53.643037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:53.646468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:53.647126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:53.653871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:53.654405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:53.656955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:53.930451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:53.941144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:53.942901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:53.944407 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd4fc7db-d32a-4308-9cdb-c0862135b8e2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.324799 Nov 02 21:54:53.946170 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2891/5902] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:53 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:54.976681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:54.978052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:54.985342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:54.985850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:54.986309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:54.987009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:54.987503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:54.987958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:55.170583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:55.186617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:55.188112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:55.189993 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1192b1c4-0340-4084-a64c-9b979bff0988 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.217909 Nov 02 21:54:55.190634 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3012/5903] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:54 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:54:56.229083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:56.229784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:56.257335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:56.257335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:56.257335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:56.259779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:56.260668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:56.261150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:56.690422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:56.740958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:56.746722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:56.751747 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a5ebbee-2893-4338-ba46-e83599d4eba8 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.530367 Nov 02 21:54:56.813056 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2892/5904] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:56 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:54:57.840909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:57.841634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:57.849855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:57.850549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:57.850549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:57.851603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:57.871614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:57.871614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:58.271902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:58.282205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:58.283797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:58.285091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7d8e4def-d750-45d3-9c37-01667d7c62e1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1742 microversion: 2.20 time: 0.449165 Nov 02 21:54:58.285721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3013/5905] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:57 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1742 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:54:59.316069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:54:59.316683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:54:59.324408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:59.325097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:59.325545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:59.326341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:54:59.326799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:54:59.327232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:54:59.543799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:59.574627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:59.576169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:54:59.577666 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-717cf116-68e2-4647-bfb6-9e33a6b745f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1724 microversion: 2.20 time: 0.265637 Nov 02 21:54:59.578234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2893/5906] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:54:59 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:00.606453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:00.607629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:00.620387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:00.622660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:00.623619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:00.624590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:00.625740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:00.626799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:00.895056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:00.907271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:00.910918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:00.912437 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3611efa5-3e20-4e9c-9b22-8373c11ab5de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1724 microversion: 2.20 time: 0.311544 Nov 02 21:55:00.913735 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3014/5907] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:00 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:55:01.012682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c8820be3-bf16-4dba-99f4-c29b2ec4832e req-19079890-ce0b-4032-b78a-ab3075e19858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901804ba-1e60-4a26-828f-41666168e0c1", "name": "network-vif-unplugged", "status": "completed", "tag": "17761c3c-21bf-4f5d-98bf-bf7e88907cc4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:01.028626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c8820be3-bf16-4dba-99f4-c29b2ec4832e req-19079890-ce0b-4032-b78a-ab3075e19858 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:01.029383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c8820be3-bf16-4dba-99f4-c29b2ec4832e req-19079890-ce0b-4032-b78a-ab3075e19858 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:01.030008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c8820be3-bf16-4dba-99f4-c29b2ec4832e req-19079890-ce0b-4032-b78a-ab3075e19858 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:01.048824 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c8820be3-bf16-4dba-99f4-c29b2ec4832e req-19079890-ce0b-4032-b78a-ab3075e19858 service nova] Creating event network-vif-unplugged:17761c3c-21bf-4f5d-98bf-bf7e88907cc4 for instance 901804ba-1e60-4a26-828f-41666168e0c1 on n-h1-860863-4 Nov 02 21:55:01.058719 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c8820be3-bf16-4dba-99f4-c29b2ec4832e req-19079890-ce0b-4032-b78a-ab3075e19858 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049879 Nov 02 21:55:01.059576 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2894/5908] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:55:01.946838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:01.948575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:01.959322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:01.959823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:01.960275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:01.961771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:01.962703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:01.963141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:02.199460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:02.214293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:02.215719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:02.216912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a9841e1-e3da-4dbf-a6a6-b0119c1aa4a7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1667 microversion: 2.20 time: 0.277761 Nov 02 21:55:02.218842 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3015/5909] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:01 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1667 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:02.247980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89fbba76-51f9-4e3c-9ab8-515cbb492214"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:02.250505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:02.263615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:02.264364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:02.265100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:02.266023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:02.267330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:02.268261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:03.683389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1aeeea1c-f2a0-400b-9b81-5457396c84c4 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.440024 Nov 02 21:55:03.684100 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2895/5910] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Nov 2 21:55:02 2022] POST /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-volume_attachments => generated 188 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 21:55:03.923018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:03.924113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:03.938275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:03.940047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:03.941350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:03.942813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:03.944177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:03.947053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:04.751779 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90cdad56-72de-49ac-b094-16d37064c583 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-volume_attachments/89fbba76-51f9-4e3c-9ab8-515cbb492214" status: 202 len: 0 microversion: 2.20 time: 0.832230 Nov 02 21:55:04.752763 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3016/5911] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Nov 2 21:55:03 2022] DELETE /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-volume_attachments/89fbba76-51f9-4e3c-9ab8-515cbb492214 => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:55:04.843554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:04.844909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:04.852323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:04.852846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:04.853311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:04.854236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:04.854828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:04.855263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:04.887742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121039) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 21:55:05.285257 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71a679b2-b4d2-4431-be6e-7c7be66d80d6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "POST /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/action" status: 202 len: 0 microversion: 2.20 time: 0.445881 Nov 02 21:55:05.287710 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2896/5912] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Nov 2 21:55:04 2022] POST /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:55:05.296020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:05.296782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:05.304069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:05.307288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:05.307288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:05.307944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:05.308633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:05.309503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:05.335423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:05.564841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:05.583284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:05.585888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:05.587884 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-57e917f8-8642-40c5-b843-34bbdbd8d1f3 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1675 microversion: 2.20 time: 0.295842 Nov 02 21:55:05.588460 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3017/5913] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:05 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:06.616708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:06.618948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:06.629448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:06.635330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:06.636077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:06.637189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:06.638345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:06.644761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:06.970834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:06.986556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:06.999013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:07.017842 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-288b13bd-8b5f-4e1b-a414-701b854a1eb6 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1675 microversion: 2.20 time: 0.405928 Nov 02 21:55:07.034777 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2897/5914] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:06 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1675 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:08.046953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:08.050292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:08.056157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:08.056712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:08.057216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:08.058199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:08.058876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:08.059345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:08.440271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:08.458800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:08.478213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:08.479800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a68c3753-4867-405e-bde8-5c81d648372e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.437256 Nov 02 21:55:08.483310 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3018/5915] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:08 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:09.524540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:09.529752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:09.556148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:09.559281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:09.561626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:09.562558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:09.568151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:09.568809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:09.626216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:10.113250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:10.125385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:10.139523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:10.142366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d960337a-18fd-4216-9712-4fc3640f5c52 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.624368 Nov 02 21:55:10.161219 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2898/5916] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:09 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:11.175013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:11.176356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:11.195814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:11.196439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:11.197376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:11.199615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:11.203187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:11.203842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:11.872622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:11.928394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:11.936171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:11.942421 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5704e5a4-68f5-408a-b7b9-e3e830ba3df2 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.773046 Nov 02 21:55:11.943158 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3019/5917] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:11 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:12.971575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:12.972759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:12.991109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:13.002249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:13.016152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:13.016152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:13.016152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:13.016152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:13.016152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:13.461130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:13.478908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:13.482379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:13.483644 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42ae3bf7-5d0b-4f97-8b30-d4259f0b871b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.516444 Nov 02 21:55:13.484234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2899/5918] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:12 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:14.525001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:14.526241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:14.543372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=24 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:14.545648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:14.555896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:14.555896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:14.555896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:14.555896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:14.556588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:15.050160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:15.075001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:15.093441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:15.096629 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6a766e5-6099-4aa0-9eb7-82936b422bda tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.584337 Nov 02 21:55:15.108841 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3020/5919] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:14 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:16.143799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:16.144874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:16.166521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:16.166521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:16.166521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:16.166521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:16.166521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:16.166521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:16.556424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:16.569691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:16.573928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:16.586697 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-630c8c5a-9b64-4fe5-b763-9d11ed2e30f9 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.446777 Nov 02 21:55:16.615962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2900/5920] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:16 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:16.955448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:16.967267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:16.982511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:16.983540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:16.984292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:16.985391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:16.986104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:16.986825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:17.036235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7f3e310-0a36-463d-ba5e-4b7511b3fc10 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100387 Nov 02 21:55:17.036943 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3021/5921] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:55:16 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:17.701193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:17.703393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:17.891752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:17.905611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:17.907766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:17.909568 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04dd0ac0-757c-4e23-9af0-023e912dfa1c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.290662 Nov 02 21:55:17.912982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3022/5922] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:17 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 21:55:18.021980 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d4e8b859-1f84-47cf-8795-8ff6f0e84c1d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 204 len: 0 microversion: 2.1 time: 0.801222 Nov 02 21:55:18.026747 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2901/5923] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:55:17 2022] DELETE /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:55:18.035119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:18.035755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:18.067113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:18.067113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:18.067381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:18.067993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:18.068790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:18.069656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:18.489237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:18.508768 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ab3124d-356e-45c2-9add-30b46bf1352e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1673 microversion: 2.1 time: 0.478083 Nov 02 21:55:18.509795 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3023/5924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:18 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1673 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:18.944813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:18.949729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:18.967738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:18.968435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:18.969530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:18.970647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:18.971429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:18.972326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:19.192574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:19.204970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:19.207460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:19.209505 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5091076a-4795-49a3-a839-12f042f9c593 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.275662 Nov 02 21:55:19.211603 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2902/5925] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:18 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:19.534738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:19.536313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:19.547622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:19.549156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:19.552093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:19.552990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:19.554185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:19.554923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:19.739814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:19.749243 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d9d6948-e673-47c9-b135-84e470a9db99 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1673 microversion: 2.1 time: 0.218495 Nov 02 21:55:19.750002 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3024/5926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:19 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:20.244497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:20.246181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:20.270036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:20.271259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:20.273236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:20.275437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:20.276520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:20.277315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:20.525367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:20.565242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:20.565242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:20.566833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c021bfe-117f-4c3c-9313-c163d1d006da tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.328397 Nov 02 21:55:20.569353 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2903/5927] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:20 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:20.776823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:20.777571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:20.807012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:20.807012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:20.807012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:20.807012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:20.807012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:20.807012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:21.086319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:21.098782 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-21e25afc-23db-4212-95bb-03b5f489975a tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1673 microversion: 2.1 time: 0.327650 Nov 02 21:55:21.112959 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3025/5928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:20 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1673 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:21.605460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:21.606754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:21.624987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:21.625742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:21.626338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:21.628638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:21.629711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:21.631718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:21.995021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:22.038528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:22.046235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:22.059521 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c6b16b0-94f9-48cb-81d6-396d49f7132d tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.462879 Nov 02 21:55:22.063402 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2904/5929] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:21 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:22.128334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:22.129724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:22.151728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:22.152300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:22.152840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:22.153644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:22.154115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:22.154694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:22.360013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:22.402840 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd836947-0124-439c-af1a-4a8e238fc06e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1606 microversion: 2.1 time: 0.277943 Nov 02 21:55:22.423786 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3026/5930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:22 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1606 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:55:22.510223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d2457887-b6ac-4624-b622-22ecb28c25b8 req-91d92c52-f298-4ea1-9830-a586385ba48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329bf1b5-31f6-4107-a823-5a0c6bbbc201", "name": "network-vif-deleted", "tag": "12dc2634-311e-477f-bf15-98f0b4ae6435"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:22.526521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d2457887-b6ac-4624-b622-22ecb28c25b8 req-91d92c52-f298-4ea1-9830-a586385ba48c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:22.527303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d2457887-b6ac-4624-b622-22ecb28c25b8 req-91d92c52-f298-4ea1-9830-a586385ba48c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:22.527923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d2457887-b6ac-4624-b622-22ecb28c25b8 req-91d92c52-f298-4ea1-9830-a586385ba48c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:22.548021 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d2457887-b6ac-4624-b622-22ecb28c25b8 req-91d92c52-f298-4ea1-9830-a586385ba48c service nova] Creating event network-vif-deleted:12dc2634-311e-477f-bf15-98f0b4ae6435 for instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 on n-h2-860863-4 Nov 02 21:55:22.554813 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d2457887-b6ac-4624-b622-22ecb28c25b8 req-91d92c52-f298-4ea1-9830-a586385ba48c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052705 Nov 02 21:55:22.558435 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2905/5931] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:55:23.093174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:23.093976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:23.107633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:23.113888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:23.114630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:23.115622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:23.116305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:23.117580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:23.377966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:23.396822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:23.403494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:23.406121 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d07966d9-0c0f-4fe9-8702-d2791ace9718 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.316679 Nov 02 21:55:23.408493 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3027/5932] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:23 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:23.433076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:23.434412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:23.444293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:23.446414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:23.447083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:23.448678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:23.449453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:23.450066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:23.491556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:23.493002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:23.493608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:23.494225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lazy-loading 'fault' on Instance uuid 329bf1b5-31f6-4107-a823-5a0c6bbbc201 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:55:23.544248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:23.556224 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-489001c4-2acd-4dbf-8c35-621fb564522e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 200 len: 1326 microversion: 2.1 time: 0.128989 Nov 02 21:55:23.560550 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2906/5933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:23 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:24.447411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:24.448901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:24.468454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:24.474797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:24.480568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:24.480568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:24.480568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:24.480568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:24.591881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:24.603460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:24.605329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:24.605831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:24.606276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:24.614743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:24.615292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:24.615735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:24.668800 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] HTTP exception thrown: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Request method failure captured: Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 HTTP/1.1 Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuZ4fXKVsF6-L14ecEpbxtAoEVOTQ5m3zpb4epDzCvFxzSoRbsLHWcBUahu1OCA1y3xLBfMwllMHxx04wMftEwBAQa858RLNO58H_O8SJeOva6BlpT5Rv-k5cETZy4uV0egMtDN_e7JZM7ix6w-9EyoC_FAxwlwC3RamgL66yilRD0w Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1fc99ef958a4434ca4f43354d45ade7d Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '329bf1b5-31f6-4107-a823-5a0c6bbbc201'} Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:55:24.670540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Returning 404 to user: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:55:24.676094 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c10668af-8631-4111-adb3-2002f31034b5 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 404 len: 111 microversion: 2.1 time: 0.084382 Nov 02 21:55:24.697342 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2907/5934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:24 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:55:24.707682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5696086d-4dc8-4ee3-8f44-46a4861481f1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '.version_select at 0x7f9b63aeedc0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:24.822979 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5696086d-4dc8-4ee3-8f44-46a4861481f1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-617689661" status: 202 len: 0 microversion: 2.1 time: 0.124417 Nov 02 21:55:24.823832 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2908/5935] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Nov 2 21:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-617689661 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:55:24.874560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:24.887315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:24.889211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:24.895043 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da742e9c-0db5-443d-807c-cc83b2c5f246 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.452699 Nov 02 21:55:24.896300 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3028/5936] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:24 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:25.928489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:25.931456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:25.948579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:25.952815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:25.953554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:25.954517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:25.955259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:25.956427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:26.208707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:26.218172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:26.229910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:26.231145 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-562beaaa-a6a8-43a0-9c97-a6d75e0adf55 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.308502 Nov 02 21:55:26.232082 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2909/5937] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:25 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:27.088949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2f9f9271-0c2d-498f-be7d-0466c971c4e1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'create', calling method: .version_select at 0x7f9b6d2171f0>, body: {"keypair": {"name": "tempest-keypair-2049992006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDSQupUEXZZDr9f9x3ptPkKG1O067rXEavQCS3TDD4bF8VhhfIc6BpQWb70OiCOnkaTPzIpm582vfjHFA0sWOpY3tCTJwLVHiPwZyxNj42krVhoe8Em55PGuv12wJXwxw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:27.111796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-2f9f9271-0c2d-498f-be7d-0466c971c4e1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:55:27.122331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-2f9f9271-0c2d-498f-be7d-0466c971c4e1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for user 1fc99ef958a4434ca4f43354d45ade7d and project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:55:27.222125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2f9f9271-0c2d-498f-be7d-0466c971c4e1 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139019 Nov 02 21:55:27.234894 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3029/5938] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:55:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:55:27.259809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:27.260465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:27.293435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:27.293951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:27.294402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:27.295122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:27.295586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:27.296010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:27.512759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:27.530483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:27.533874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:27.539498 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6076cc5f-548a-48b0-a1ca-b93f26032b1b tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.284643 Nov 02 21:55:27.542457 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2910/5939] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:27 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:28.578076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:28.578770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:28.605467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:28.610054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:28.610054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:28.610054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:28.610054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:28.610054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:28.880472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:28.892874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:28.924117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:28.924117 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-59bb5d1c-5b76-4f86-a65a-3faacb0490fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.354656 Nov 02 21:55:28.924117 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3030/5940] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:28 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:29.948133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:29.950118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:29.959635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:29.961458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:29.962168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:29.963132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:29.963813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:29.964605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:30.223361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:30.237111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:30.238970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:30.247962 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9678b044-c499-49be-8182-d00b5a9868de tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.304726 Nov 02 21:55:30.248728 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2911/5941] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:29 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:31.235396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-301024401", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b18a2238-2c90-4855-b50c-1faaa9d3b3ed"}], "security_groups": [{"name": "tempest-securitygroup--220803512"}], "key_name": "tempest-keypair-2049992006", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:31.282395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:31.283019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:31.300237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:31.300844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:31.301328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:31.302066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:31.302530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:31.302971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:31.490212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] validate_networks() for [('b18a2238-2c90-4855-b50c-1faaa9d3b3ed', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:55:32.704678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:32.720535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:32.728578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:32.736275 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8d561fe7-5261-4dfe-b60b-6bc670647658 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 1.457720 Nov 02 21:55:32.740499 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2912/5942] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:31 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:32.769958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ced6e19f-7dbb-4410-bd71-70cdf64d412e req-c862531b-7b91-4804-bc92-598cea202a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901804ba-1e60-4a26-828f-41666168e0c1", "name": "network-vif-plugged", "status": "completed", "tag": "17761c3c-21bf-4f5d-98bf-bf7e88907cc4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:32.801930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ced6e19f-7dbb-4410-bd71-70cdf64d412e req-c862531b-7b91-4804-bc92-598cea202a12 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:32.811034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ced6e19f-7dbb-4410-bd71-70cdf64d412e req-c862531b-7b91-4804-bc92-598cea202a12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:32.819743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ced6e19f-7dbb-4410-bd71-70cdf64d412e req-c862531b-7b91-4804-bc92-598cea202a12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:32.857746 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ced6e19f-7dbb-4410-bd71-70cdf64d412e req-c862531b-7b91-4804-bc92-598cea202a12 service nova] Creating event network-vif-plugged:17761c3c-21bf-4f5d-98bf-bf7e88907cc4 for instance 901804ba-1e60-4a26-828f-41666168e0c1 on n-h1-860863-4 Nov 02 21:55:32.868646 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ced6e19f-7dbb-4410-bd71-70cdf64d412e req-c862531b-7b91-4804-bc92-598cea202a12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127416 Nov 02 21:55:32.872058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2913/5943] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:55:33.561085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:55:33.562589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:55:33.563356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:55:33.564321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:55:33.565192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:55:33.577922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:33.578911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:33.579555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:33.580488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:33.581199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:33.581808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:33.611709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:55:33.621093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Getting quotas for user 1fc99ef958a4434ca4f43354d45ade7d and project 0f3955ce6d9a430e803fc845a4e6cb1f. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:55:33.636005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:55:33.646883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:55:33.770670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:33.771815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:33.787588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:33.791200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:33.793518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:33.796070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:33.799408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:33.801490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:33.803909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b00fb6f4-4fb9-411c-8a0f-9e9246badcfa tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.569825 Nov 02 21:55:33.815113 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3031/5944] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:55:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:55:33.830289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-063716e1-b40a-43da-8d30-7bccdbe21ac7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:33.830289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-063716e1-b40a-43da-8d30-7bccdbe21ac7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:34.080502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-063716e1-b40a-43da-8d30-7bccdbe21ac7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:34.127653 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-063716e1-b40a-43da-8d30-7bccdbe21ac7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1237 microversion: 2.1 time: 0.311028 Nov 02 21:55:34.128283 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3032/5945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:33 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1237 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:34.444602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:34.465470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:34.482291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:34.486291 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f04788eb-f4db-48cd-b4a6-517d0d002e5f tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.721888 Nov 02 21:55:34.486896 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2914/5946] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:33 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:35.154006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-478ce9b8-f836-4203-8faa-a31095c1cfab tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:35.160702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-478ce9b8-f836-4203-8faa-a31095c1cfab tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:35.524460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:35.525088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:35.544854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:35.546207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:35.547930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:35.552237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:35.554297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:35.554947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:35.608874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-478ce9b8-f836-4203-8faa-a31095c1cfab tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:35.619822 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-478ce9b8-f836-4203-8faa-a31095c1cfab tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1237 microversion: 2.1 time: 0.469600 Nov 02 21:55:35.623843 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3033/5947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:35 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1237 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:36.304494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:36.321149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:36.359487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:36.359487 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-51f1f837-8f44-43a7-a193-45b3b5e0826e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.836257 Nov 02 21:55:36.361715 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2915/5948] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:35 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:36.646315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:36.648504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:36.697905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:36.700674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:36.701358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:36.702133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:36.715617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:36.725341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:36.958974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:36.968408 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-776fa02e-ce01-43e1-86e5-5e68f0a7757e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1289 microversion: 2.1 time: 0.326203 Nov 02 21:55:36.973083 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3034/5949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:36 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1289 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:37.395869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:37.396479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:37.412055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:37.412826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:37.413964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:37.416202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:37.419521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:37.420379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:37.434413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:37.811534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:37.829940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:37.835053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:37.840324 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f56a73a-fe0d-41e3-a5dd-c408fa25bdd1 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1733 microversion: 2.20 time: 0.448491 Nov 02 21:55:37.854986 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2916/5950] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:37 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1733 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:37.998297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:37.998984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:38.008302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:38.008848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:38.009322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:38.010227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:38.010687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:38.011136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:38.114916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:38.124717 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28055868-e0bd-4ea3-b089-409d8d661e5e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1297 microversion: 2.1 time: 0.132761 Nov 02 21:55:38.128068 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3035/5951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:37 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:38.872799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:38.874598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:38.884320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:38.885291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:38.886046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:38.886989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:38.887625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:38.888063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:39.160411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:39.161183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:39.185269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:39.186676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:39.187139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:39.191060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:39.195072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:39.195967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:39.800855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:39.810335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:39.811804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:39.825739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:39.828436 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-73a28ba9-6193-4810-9eea-85719c78d878 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1720 microversion: 2.20 time: 0.961274 Nov 02 21:55:39.831985 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2917/5952] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:55:38 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1720 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:55:39.838101 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ed05184-a6ad-4c02-8e6f-4c266693b495 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.679935 Nov 02 21:55:39.839358 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3036/5953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:39 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:40.865149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:40.874848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:40.940672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:40.942607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:40.944275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:40.948636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:40.949353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:40.949963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:41.198935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:41.210082 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7ba00d4-3546-43a9-95a7-118d18ef8c7f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.349776 Nov 02 21:55:41.217588 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2918/5954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:40 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:42.236576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:42.236576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:42.246488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:42.246994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:42.247439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:42.258189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:42.258926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:42.259383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:42.279636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:42.318666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8c361c38-2763-44aa-8dd9-e74e2ce10178 req-c696c2c4-3f6d-4d2e-8db6-bcd72bf4d0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e692d6c9-60b9-4d8d-8034-831b90a21987", "tag": "9f5949aa-546a-4990-b8ab-e42633b23e68"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:42.341006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8c361c38-2763-44aa-8dd9-e74e2ce10178 req-c696c2c4-3f6d-4d2e-8db6-bcd72bf4d0e9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:42.341992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8c361c38-2763-44aa-8dd9-e74e2ce10178 req-c696c2c4-3f6d-4d2e-8db6-bcd72bf4d0e9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:42.342696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8c361c38-2763-44aa-8dd9-e74e2ce10178 req-c696c2c4-3f6d-4d2e-8db6-bcd72bf4d0e9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:42.381664 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8c361c38-2763-44aa-8dd9-e74e2ce10178 req-c696c2c4-3f6d-4d2e-8db6-bcd72bf4d0e9 service nova] Creating event network-changed:9f5949aa-546a-4990-b8ab-e42633b23e68 for instance e692d6c9-60b9-4d8d-8034-831b90a21987 on n-h2-860863-4 Nov 02 21:55:42.396178 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8c361c38-2763-44aa-8dd9-e74e2ce10178 req-c696c2c4-3f6d-4d2e-8db6-bcd72bf4d0e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081182 Nov 02 21:55:42.397815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2919/5955] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:55:42.423007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:42.435164 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38c8734f-4cf0-4b6e-85e5-c888fb62746d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.202905 Nov 02 21:55:42.452623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3037/5956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:42 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:43.465522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:43.466240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:43.485815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:43.485815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:43.485815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:43.485815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:43.485815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:43.486319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:43.486579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:43.782327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:43.792122 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb23d992-5286-4c2c-82c5-8318352ad85b tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.332134 Nov 02 21:55:43.792734 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2920/5957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:43 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:44.816001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:44.816631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:44.829947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:44.830741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:44.832196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:44.832675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:44.847402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:44.848554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:44.851319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:44.853384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:45.295430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:45.304552 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90b17d57-90a6-4212-98de-4db7b7e174d0 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.493409 Nov 02 21:55:45.305654 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3038/5958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:44 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:46.332156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:46.333552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:46.348445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:46.352242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:46.353870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:46.355979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:46.356719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:46.357278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:46.514307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:46.540533 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e69b4c75-759e-4557-afe2-c592e5926e2d tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.209439 Nov 02 21:55:46.542416 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2921/5959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:46 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:47.571225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:47.573051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:47.590686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:55:47.597701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:47.598232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:47.598683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:47.599963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:47.600435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:47.602018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:48.082755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:48.096429 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea67db01-fe18-4b9e-8658-ed9a5978ce30 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.535914 Nov 02 21:55:48.099804 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3039/5960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:47 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:49.120486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:49.121916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:49.129757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:49.130770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:49.131226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:49.132757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:49.133293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:49.133735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:49.389263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1a1f3129-fb84-4b5a-b236-0aa5b8bfc44d req-17ac5b97-6325-47ae-bed9-b759c3be6b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e692d6c9-60b9-4d8d-8034-831b90a21987", "name": "network-vif-plugged", "status": "completed", "tag": "9f5949aa-546a-4990-b8ab-e42633b23e68"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:49.403081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1a1f3129-fb84-4b5a-b236-0aa5b8bfc44d req-17ac5b97-6325-47ae-bed9-b759c3be6b37 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:49.403578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1a1f3129-fb84-4b5a-b236-0aa5b8bfc44d req-17ac5b97-6325-47ae-bed9-b759c3be6b37 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:49.404022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1a1f3129-fb84-4b5a-b236-0aa5b8bfc44d req-17ac5b97-6325-47ae-bed9-b759c3be6b37 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:49.427412 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1a1f3129-fb84-4b5a-b236-0aa5b8bfc44d req-17ac5b97-6325-47ae-bed9-b759c3be6b37 service nova] Creating event network-vif-plugged:9f5949aa-546a-4990-b8ab-e42633b23e68 for instance e692d6c9-60b9-4d8d-8034-831b90a21987 on n-h2-860863-4 Nov 02 21:55:49.438343 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1a1f3129-fb84-4b5a-b236-0aa5b8bfc44d req-17ac5b97-6325-47ae-bed9-b759c3be6b37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052669 Nov 02 21:55:49.439130 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3040/5961] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:55:49.556622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:49.567863 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f51994e7-414b-402b-8faf-7a133d4bfc70 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.451826 Nov 02 21:55:49.568845 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2922/5962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:49 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:50.595388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:50.596361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:50.603402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:50.603986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:50.604694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:50.605498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:50.606041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:50.606545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:50.900303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:50.909566 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24e905b2-e770-4708-990e-d14288ee32ae tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1362 microversion: 2.1 time: 0.320423 Nov 02 21:55:50.910737 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3041/5963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:50 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:51.934557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:51.935171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:51.946654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:51.949805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:51.949805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:51.949805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:51.949805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:51.949805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:52.193199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:55:52.202845 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10919ffe-7bc5-4045-9a9b-fe3fbbf60d94 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1548 microversion: 2.1 time: 0.272242 Nov 02 21:55:52.204044 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2923/5964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:55:51 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1548 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:55:52.233218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:55:52.233218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:55:52.242437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:52.242938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:52.243380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:52.244094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:52.244551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:52.245011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:52.384619 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-789d49a9-8451-4448-b262-9e930dc15cd7 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148021 Nov 02 21:55:52.384619 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3042/5965] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 21:55:52 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:55:54.883480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e8e48616-8284-4e4c-ad54-0979273722e6 req-f5bfef0b-1a62-42f3-b735-d15265465371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e692d6c9-60b9-4d8d-8034-831b90a21987", "tag": "9f5949aa-546a-4990-b8ab-e42633b23e68"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:55:54.918789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e8e48616-8284-4e4c-ad54-0979273722e6 req-f5bfef0b-1a62-42f3-b735-d15265465371 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:55:54.922011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e8e48616-8284-4e4c-ad54-0979273722e6 req-f5bfef0b-1a62-42f3-b735-d15265465371 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:55:54.922655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e8e48616-8284-4e4c-ad54-0979273722e6 req-f5bfef0b-1a62-42f3-b735-d15265465371 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:55:54.969435 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e8e48616-8284-4e4c-ad54-0979273722e6 req-f5bfef0b-1a62-42f3-b735-d15265465371 service nova] Creating event network-changed:9f5949aa-546a-4990-b8ab-e42633b23e68 for instance e692d6c9-60b9-4d8d-8034-831b90a21987 on n-h2-860863-4 Nov 02 21:55:54.977915 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e8e48616-8284-4e4c-ad54-0979273722e6 req-f5bfef0b-1a62-42f3-b735-d15265465371 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098827 Nov 02 21:55:54.985401 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2924/5966] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:56:10.602243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=9 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:10.602243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=29 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:10.605777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:10.609098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:10.619839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:10.620770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:10.621422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:10.622306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:10.622932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:10.623533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:10.673656 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-667f30c1-67bc-4ae8-a452-cd625d052d65 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075996 Nov 02 21:56:10.674248 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3043/5967] 10.222.0.25 () {60 vars in 1343 bytes} [Wed Nov 2 21:56:10 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:56:10.787044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=9 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:10.788698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=44 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:10.794711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:10.797052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:10.806283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:10.809202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:10.809202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:10.809202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:10.809202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:10.809808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:10.854054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:56:11.295311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e37669bc-817c-4c0c-8ecd-cf0fac5c1634 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 204 len: 0 microversion: 2.20 time: 0.510938 Nov 02 21:56:11.296235 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2925/5968] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:56:10 2022] DELETE /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:56:11.310628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:11.311259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:11.333953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:11.334464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:11.335465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:11.336343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:11.336815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:11.343697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:12.185923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:12.229052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:12.235927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:12.240078 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d48be21-df76-4f48-a716-4872e4a13ce7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.935596 Nov 02 21:56:12.243746 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3044/5969] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:56:11 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:56:13.275632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:13.277012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:13.330216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:13.336265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:13.337859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:13.339139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:13.343244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:13.346480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:13.636367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:13.650358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:13.651826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:13.659246 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3620db0-45b5-4562-81dc-5d3d62d734fd tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1726 microversion: 2.20 time: 0.383403 Nov 02 21:56:13.659959 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2926/5970] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:56:13 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1726 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:56:14.177134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9409cb64-d30b-4818-bbdf-04d2d3f9c796 req-6bf927a4-a2c9-40a9-aa0a-e41ad9ac85d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901804ba-1e60-4a26-828f-41666168e0c1", "name": "network-vif-deleted", "tag": "17761c3c-21bf-4f5d-98bf-bf7e88907cc4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:56:14.195206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9409cb64-d30b-4818-bbdf-04d2d3f9c796 req-6bf927a4-a2c9-40a9-aa0a-e41ad9ac85d4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:14.196247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9409cb64-d30b-4818-bbdf-04d2d3f9c796 req-6bf927a4-a2c9-40a9-aa0a-e41ad9ac85d4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:14.197171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9409cb64-d30b-4818-bbdf-04d2d3f9c796 req-6bf927a4-a2c9-40a9-aa0a-e41ad9ac85d4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:14.212795 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9409cb64-d30b-4818-bbdf-04d2d3f9c796 req-6bf927a4-a2c9-40a9-aa0a-e41ad9ac85d4 service nova] Creating event network-vif-deleted:17761c3c-21bf-4f5d-98bf-bf7e88907cc4 for instance 901804ba-1e60-4a26-828f-41666168e0c1 on n-h1-860863-4 Nov 02 21:56:14.218939 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9409cb64-d30b-4818-bbdf-04d2d3f9c796 req-6bf927a4-a2c9-40a9-aa0a-e41ad9ac85d4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045786 Nov 02 21:56:14.223180 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3045/5971] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:56:14.702820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:14.703422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:14.720225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:14.721104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:14.721771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:14.724094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:14.724791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:14.726363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:14.775864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:14.776566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:14.777202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:14.777864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lazy-loading 'fault' on Instance uuid 901804ba-1e60-4a26-828f-41666168e0c1 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:56:14.915898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:14.924777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:14.926572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98b623fd3cf64948af31caa837455fbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679e722432214ed6a1217d618c2c4887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:14.928014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e15d4363-cdba-43f7-9d72-5f02556cd07e tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 200 len: 1372 microversion: 2.20 time: 0.229308 Nov 02 21:56:14.929466 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2927/5972] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:56:14 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 21:56:15.959050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:15.961465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:15.976155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:15.977007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:15.977973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:15.978862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:15.979482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:15.980271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:16.013922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] HTTP exception thrown: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Request method failure captured: Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 HTTP/1.1 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuXgJMAZqrV7R4qhQsIzbv1Gl1T7wBoCH7AN7T0pvhtQpTGC-XLqm2SX54AVJTQA7v7SAp-QitUkOYKYBuueYORIYqMDJjH9sx0a8H5Xbx_afvhhfgvxerH3uF4Pg8EE8Fqq8UlWH2FTHDM1Zelk93DWPAsvhcwcDT2SU88K-aJ6gDk Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_679e722432214ed6a1217d618c2c4887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/679e722432214ed6a1217d618c2c4887"}]}, {"type": "tempest-type-1586008170", "name": "tempest-service-1411791147", "endpoints": [{"region": "tempest-region-1993421445", "publicURL": "https://url-1538139527.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "tempest-type-830241382", "name": "tempest-service-1953062676", "endpoints": [{"region": "tempest-region-1889309656", "internalURL": "https://url-690146511.com"}]}] Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 98b623fd3cf64948af31caa837455fbe Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '901804ba-1e60-4a26-828f-41666168e0c1'} Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:56:16.023988 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Returning 404 to user: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-793fd2e1-cd79-4497-8880-e8719ce70dce tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 404 len: 111 microversion: 2.20 time: 0.077225 Nov 02 21:56:16.036212 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3046/5973] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:56:15 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:56:16.042852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-75ca9d4d-eebf-434f-a3ff-b14bc6662a14 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '.version_select at 0x7f9b682ecaf0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:16.193340 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-75ca9d4d-eebf-434f-a3ff-b14bc6662a14 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071730979" status: 204 len: 0 microversion: 2.20 time: 0.156399 Nov 02 21:56:16.194204 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2928/5974] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Nov 2 21:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071730979 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 21:56:21.566060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:21.567209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:21.583007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:21.583788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:21.588054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:21.588823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:21.589384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:21.591074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:21.627689 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] HTTP exception thrown: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Request method failure captured: Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 HTTP/1.1 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuXgJMAZqrV7R4qhQsIzbv1Gl1T7wBoCH7AN7T0pvhtQpTGC-XLqm2SX54AVJTQA7v7SAp-QitUkOYKYBuueYORIYqMDJjH9sx0a8H5Xbx_afvhhfgvxerH3uF4Pg8EE8Fqq8UlWH2FTHDM1Zelk93DWPAsvhcwcDT2SU88K-aJ6gDk Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_679e722432214ed6a1217d618c2c4887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/679e722432214ed6a1217d618c2c4887"}]}, {"type": "tempest-type-1586008170", "name": "tempest-service-1411791147", "endpoints": [{"region": "tempest-region-1993421445", "publicURL": "https://url-1538139527.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "tempest-type-830241382", "name": "tempest-service-1953062676", "endpoints": [{"region": "tempest-region-1889309656", "internalURL": "https://url-690146511.com"}]}] Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 98b623fd3cf64948af31caa837455fbe Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '901804ba-1e60-4a26-828f-41666168e0c1'} Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:56:21.629915 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.635980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Returning 404 to user: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:56:21.638116 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-015349e9-c8d4-4893-b8d0-55c3673fc3d7 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 404 len: 111 microversion: 2.20 time: 0.076385 Nov 02 21:56:21.641409 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3047/5975] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:56:21 2022] DELETE /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:56:21.647773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:21.648819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 901804ba-1e60-4a26-828f-41666168e0c1] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:21.657611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:21.658236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:21.658784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:21.659595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:21.660154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:21.660704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:21.676376 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] HTTP exception thrown: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Request method failure captured: Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 HTTP/1.1 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuXgJMAZqrV7R4qhQsIzbv1Gl1T7wBoCH7AN7T0pvhtQpTGC-XLqm2SX54AVJTQA7v7SAp-QitUkOYKYBuueYORIYqMDJjH9sx0a8H5Xbx_afvhhfgvxerH3uF4Pg8EE8Fqq8UlWH2FTHDM1Zelk93DWPAsvhcwcDT2SU88K-aJ6gDk Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_679e722432214ed6a1217d618c2c4887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/679e722432214ed6a1217d618c2c4887"}]}, {"type": "tempest-type-1586008170", "name": "tempest-service-1411791147", "endpoints": [{"region": "tempest-region-1993421445", "publicURL": "https://url-1538139527.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "tempest-type-830241382", "name": "tempest-service-1953062676", "endpoints": [{"region": "tempest-region-1889309656", "internalURL": "https://url-690146511.com"}]}] Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 98b623fd3cf64948af31caa837455fbe Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '901804ba-1e60-4a26-828f-41666168e0c1'} Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:56:21.682150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Returning 404 to user: Instance 901804ba-1e60-4a26-828f-41666168e0c1 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:56:21.689415 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f874276-c4f0-4993-8871-eca0f0d9852c tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1" status: 404 len: 111 microversion: 2.20 time: 0.040850 Nov 02 21:56:21.698494 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2929/5976] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:56:21 2022] GET /compute/v2.1/servers/901804ba-1e60-4a26-828f-41666168e0c1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:56:27.325861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:27.326451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:27.348904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:27.353450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:27.353450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:27.353450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:27.353450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:27.353450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:27.429295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:27.429878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:27.432974 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc708426-0fc3-4c41-8e37-3bd3d232bd4f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/ips" status: 200 len: 146 microversion: 2.1 time: 0.115919 Nov 02 21:56:27.434285 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3048/5977] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Nov 2 21:56:27 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/ips => generated 146 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:56:27.442700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:27.453681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:27.454321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:27.455234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:27.456340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:27.465834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:27.485131 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] HTTP exception thrown: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Request method failure captured: Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d HTTP/1.1 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuXgJMAZqrV7R4qhQsIzbv1Gl1T7wBoCH7AN7T0pvhtQpTGC-XLqm2SX54AVJTQA7v7SAp-QitUkOYKYBuueYORIYqMDJjH9sx0a8H5Xbx_afvhhfgvxerH3uF4Pg8EE8Fqq8UlWH2FTHDM1Zelk93DWPAsvhcwcDT2SU88K-aJ6gDk Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_679e722432214ed6a1217d618c2c4887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/679e722432214ed6a1217d618c2c4887"}]}, {"type": "tempest-type-1586008170", "name": "tempest-service-1411791147", "endpoints": [{"region": "tempest-region-1993421445", "publicURL": "https://url-1538139527.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "tempest-type-830241382", "name": "tempest-service-1953062676", "endpoints": [{"region": "tempest-region-1889309656", "internalURL": "https://url-690146511.com"}]}] Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 98b623fd3cf64948af31caa837455fbe Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '3351f1dc-a844-4ca9-b336-09cb79dbca9d'} Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:56:27.488880 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.501017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Returning 404 to user: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:56:27.503473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e0b9a5db-f697-481c-9458-564f459ae272 tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 404 len: 111 microversion: 2.20 time: 0.072942 Nov 02 21:56:27.507982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2930/5978] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Nov 2 21:56:27 2022] DELETE /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 21:56:27.513466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:27.513997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] [instance: 3351f1dc-a844-4ca9-b336-09cb79dbca9d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:27.539992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:27.540786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:27.541925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:27.558134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:27.564220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:27.569364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:27.603418 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] HTTP exception thrown: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Request method failure captured: Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d HTTP/1.1 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuXgJMAZqrV7R4qhQsIzbv1Gl1T7wBoCH7AN7T0pvhtQpTGC-XLqm2SX54AVJTQA7v7SAp-QitUkOYKYBuueYORIYqMDJjH9sx0a8H5Xbx_afvhhfgvxerH3uF4Pg8EE8Fqq8UlWH2FTHDM1Zelk93DWPAsvhcwcDT2SU88K-aJ6gDk Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_679e722432214ed6a1217d618c2c4887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/679e722432214ed6a1217d618c2c4887"}]}, {"type": "tempest-type-1586008170", "name": "tempest-service-1411791147", "endpoints": [{"region": "tempest-region-1993421445", "publicURL": "https://url-1538139527.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/679e722432214ed6a1217d618c2c4887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "tempest-type-830241382", "name": "tempest-service-1953062676", "endpoints": [{"region": "tempest-region-1889309656", "internalURL": "https://url-690146511.com"}]}] Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 679e722432214ed6a1217d618c2c4887 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937644995 Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 98b623fd3cf64948af31caa837455fbe Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937644995-project Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3351f1dc-a844-4ca9-b336-09cb79dbca9d'} Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:56:27.605926 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. Nov 02 21:56:27.610334 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:56:27.612903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] Returning 404 to user: Instance 3351f1dc-a844-4ca9-b336-09cb79dbca9d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:56:27.616727 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddecfbae-7c11-48d1-b780-21fb0579dc4a tempest-AttachVolumeShelveTestJSON-1937644995 tempest-AttachVolumeShelveTestJSON-1937644995-project] 10.222.0.25 "GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d" status: 404 len: 111 microversion: 2.20 time: 0.107625 Nov 02 21:56:27.622266 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3049/5979] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Nov 2 21:56:27 2022] GET /compute/v2.1/servers/3351f1dc-a844-4ca9-b336-09cb79dbca9d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 21:56:30.824483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79fb7ad9-40f3-4ff1-90ac-911790a81626"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:56:30.828418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:30.844879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:30.845627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:30.848697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:30.849761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:30.850751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:30.851263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:31.855763 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec8f2d07-b34c-4f74-bbb7-1d50f8c74ec9 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035188 Nov 02 21:56:31.856512 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2931/5980] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:56:30 2022] POST /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:56:46.932313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:46.934750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:46.946925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:46.950004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=24 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:46.954992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:46.955769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:46.957019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:46.957148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:46.957620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:46.958107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:47.043012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-704f7422-75dd-4baf-b568-2ca19ee56642 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115217 Nov 02 21:56:47.052635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:47.054093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:56:47.059105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:47.059706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:47.063745 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3050/5981] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:56:46 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:56:47.077928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:47.081079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:47.081537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:47.082282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:47.082801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:47.083170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:47.220659 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b04981cb-7aad-4f7f-93d0-aab7a6020240 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/79fb7ad9-40f3-4ff1-90ac-911790a81626" status: 200 len: 194 microversion: 2.1 time: 0.169948 Nov 02 21:56:47.231815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2932/5982] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Nov 2 21:56:47 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/79fb7ad9-40f3-4ff1-90ac-911790a81626 => generated 194 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:56:50.317436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fb40dd-e4a6-4262-9e95-3af166e1e060"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:56:50.320172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:50.329002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:50.329473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:50.330109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:50.330948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:50.331585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:50.332207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:52.228727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-374635285", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3602996b-fc5d-4df0-b27d-742897f0b5b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:56:52.651481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:56:52.678356 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ac12685-0de6-4b53-8b7c-0b73454e2943 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "POST /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.365067 Nov 02 21:56:52.679434 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3051/5983] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 21:56:50 2022] POST /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments => generated 194 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:56:53.655342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:56:53.655956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:56:53.656868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:56:53.657500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:56:53.658205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:56:53.676824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:53.677707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:53.678558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:53.679568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:53.680945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:53.681584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:53.711162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:56:53.717326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:56:53.919626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:56:53.921969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3602996b-fc5d-4df0-b27d-742897f0b5b8',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:56:54.955262 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-620ef22f-cba3-4738-82dc-37f954979803 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.731752 Nov 02 21:56:54.961294 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2933/5984] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:56:54.971103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c687b9cf-1be1-40b6-85c2-08e0bcfb85a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:54.972391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c687b9cf-1be1-40b6-85c2-08e0bcfb85a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:55.174627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c687b9cf-1be1-40b6-85c2-08e0bcfb85a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:55.190877 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c687b9cf-1be1-40b6-85c2-08e0bcfb85a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1056 microversion: 2.1 time: 0.226737 Nov 02 21:56:55.191485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3052/5985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:56:54 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1056 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:56:56.231950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc390203-952c-45bc-a504-1436ad18ed81 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:56.232740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc390203-952c-45bc-a504-1436ad18ed81 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:56.336861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc390203-952c-45bc-a504-1436ad18ed81 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:56.344313 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc390203-952c-45bc-a504-1436ad18ed81 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1056 microversion: 2.1 time: 0.129838 Nov 02 21:56:56.347586 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2934/5986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:56:56 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1056 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:56:57.368912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:57.370271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:57.381129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:57.387356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:57.388065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:57.389991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:57.390724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:57.393550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:58.213834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:58.230707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fe74453-2f40-4b3a-80a6-8c751a6f161c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1098 microversion: 2.1 time: 0.866416 Nov 02 21:56:58.232612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3053/5987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:56:57 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1098 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:56:59.262083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:56:59.262862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:56:59.289183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:59.292634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:59.293474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:59.297837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:56:59.300543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:56:59.302628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:56:59.525866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:56:59.537955 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-02974f16-3bbf-4363-8ad6-12876810d362 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1172 microversion: 2.1 time: 0.280313 Nov 02 21:56:59.544683 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2935/5988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:56:59 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1172 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:00.581636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:00.582575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:00.598882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:00.599740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:00.601035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:00.603581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:00.607353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:00.608385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:00.774142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:00.799062 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-523ca3b9-4b28-44d2-8d21-bcd253d6f752 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1172 microversion: 2.1 time: 0.222035 Nov 02 21:57:00.802600 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3054/5989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:00 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1172 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:01.827484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:01.827484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:01.843756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:01.844252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:01.844699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:01.845685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:01.846149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:01.846578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:02.327416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:02.350367 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48d85ff6-0b1e-4b74-b16e-2910faf2f0da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1214 microversion: 2.1 time: 0.527200 Nov 02 21:57:02.371306 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2936/5990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:01 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1214 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:03.247513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-da071e68-302a-4e8e-9b66-90b10a18b346 req-cff346b1-4628-49e9-88b5-d1aee2fa104a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4deb2f3a-7e1b-422c-abff-ff5c7d28e761", "tag": "c9ec9028-65f4-455f-aa1a-eb2f74030d5a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:57:03.273460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-da071e68-302a-4e8e-9b66-90b10a18b346 req-cff346b1-4628-49e9-88b5-d1aee2fa104a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:03.285871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-da071e68-302a-4e8e-9b66-90b10a18b346 req-cff346b1-4628-49e9-88b5-d1aee2fa104a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:03.286325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-da071e68-302a-4e8e-9b66-90b10a18b346 req-cff346b1-4628-49e9-88b5-d1aee2fa104a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:03.298885 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-da071e68-302a-4e8e-9b66-90b10a18b346 req-cff346b1-4628-49e9-88b5-d1aee2fa104a service nova] Creating event network-changed:c9ec9028-65f4-455f-aa1a-eb2f74030d5a for instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 on n-h1-860863-4 Nov 02 21:57:03.328272 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-da071e68-302a-4e8e-9b66-90b10a18b346 req-cff346b1-4628-49e9-88b5-d1aee2fa104a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084297 Nov 02 21:57:03.328891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3055/5991] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:57:03.375217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:03.380703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:03.400114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:03.401798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:03.402567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:03.405711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:03.406329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:03.407183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:03.698199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:04.308298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:04.322308 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a6bc156-d1b9-44cb-8951-c5441c8ca92f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1214 microversion: 2.1 time: 0.951805 Nov 02 21:57:04.329260 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2937/5992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:03 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1214 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:05.347384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:05.348063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:05.350871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:05.356244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:05.356740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:05.357218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:05.357928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:05.358383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:05.358811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:05.503729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:05.512647 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d98e630-2929-43b0-8d29-9f1a9a1a01c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1214 microversion: 2.1 time: 0.169631 Nov 02 21:57:05.513278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3056/5993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:05 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:06.536041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:06.536679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:06.540727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:06.550814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:06.551315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:06.551970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:06.552872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:06.553541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:06.554023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:06.745861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:06.758157 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c40009c-4aad-42fb-b4c5-0381ffaede22 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1214 microversion: 2.1 time: 0.225823 Nov 02 21:57:06.761323 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2938/5994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:06 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:07.786222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:07.787082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:07.802282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:07.802282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:07.802282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:07.802282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:07.802282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:07.802282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:08.024156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:08.034269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-269c711b-2369-42ad-b950-1aa0daa04af4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1214 microversion: 2.1 time: 0.253758 Nov 02 21:57:08.036130 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3057/5995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:07 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:57:09.045746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:09.049128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:09.063112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:09.065682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:09.076423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.081890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.082978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.086111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.086111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.086111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.086111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.087144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.088297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.092420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.093127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.094022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.173818 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2adabdb9-b6f5-4e43-852f-5e79c6fe8fe4 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.133676 Nov 02 21:57:09.174427 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2939/5996] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:57:09 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:57:09.303617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:09.323266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bbcab3fa-590f-4df9-a44e-81b7897eb917 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1214 microversion: 2.1 time: 0.265654 Nov 02 21:57:09.323405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:09.323405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:09.335270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.336131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.337197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.339271 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3058/5997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:09 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:09.339441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.339758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.342150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.399193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5db12ead-49d7-4f3d-bc82-0c49739598cc tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/79fb7ad9-40f3-4ff1-90ac-911790a81626" status: 200 len: 194 microversion: 2.1 time: 0.083862 Nov 02 21:57:09.400723 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2940/5998] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Nov 2 21:57:09 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/79fb7ad9-40f3-4ff1-90ac-911790a81626 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:57:09.411671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:09.415638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:09.419935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.420442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.420883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.421895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:09.422626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:09.423504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:09.524826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lazy-loading 'services' on Instance uuid e692d6c9-60b9-4d8d-8034-831b90a21987 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:57:09.806269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0423d0f-fea8-4b4f-b834-d4f838a2f064 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/79fb7ad9-40f3-4ff1-90ac-911790a81626" status: 202 len: 0 microversion: 2.1 time: 0.394665 Nov 02 21:57:09.806269 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3059/5999] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:57:09 2022] DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/79fb7ad9-40f3-4ff1-90ac-911790a81626 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:57:10.346614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:10.347331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:10.356555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:10.357105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:10.361627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:10.361627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:10.361627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:10.361627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:10.622252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:10.634384 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f172b33-bab0-4334-be65-5243d093580b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.294468 Nov 02 21:57:10.636376 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2941/6000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:10 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:11.670891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:11.674064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:11.699589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:11.700090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:11.700546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:11.701303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:11.714038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:11.714038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:11.940768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:11.952948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ac63cdc6-c018-4b98-bd6f-998ce09d36ab tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.289507 Nov 02 21:57:11.956489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3060/6001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:11 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:12.979079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:12.979812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:12.988499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:12.990286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:12.992564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:12.994489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:12.995899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:12.996777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:13.276126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:13.290929 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fecbf196-69dc-442b-bfbd-c804bf4e6140 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.314839 Nov 02 21:57:13.306649 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2942/6002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:12 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:14.320138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:14.320880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:14.328707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:14.337367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:14.338082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:14.339080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:14.340634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:14.342173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:14.514506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:14.529227 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-305dce24-80f4-42dc-a933-662f7b7bd318 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.216543 Nov 02 21:57:14.530240 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3061/6003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:14 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:15.553451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:15.557220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:15.567890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:15.568712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:15.568821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:15.570041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:15.570515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:15.570958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:15.818351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:15.826944 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e7bf48ae-7bf8-4fb2-acd5-07e955b0b5e5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.277417 Nov 02 21:57:15.827536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2943/6004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:15 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:16.100350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:16.106409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:16.111586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:16.112406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:16.113881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:16.117751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:16.118668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:16.119239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:16.155768 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ca4e315-9787-4ac7-99e4-baab9513a9d6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/e9fb40dd-e4a6-4262-9e95-3af166e1e060" status: 200 len: 194 microversion: 2.1 time: 0.064659 Nov 02 21:57:16.165456 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3062/6005] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Nov 2 21:57:16 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/e9fb40dd-e4a6-4262-9e95-3af166e1e060 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:57:16.174495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:16.175002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:16.182052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:16.182672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:16.185788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:16.186743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:16.187224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:16.187841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:16.276563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lazy-loading 'services' on Instance uuid e692d6c9-60b9-4d8d-8034-831b90a21987 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:57:16.575128 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b79e58a9-e826-4886-ac73-e0e21963eb25 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/e9fb40dd-e4a6-4262-9e95-3af166e1e060" status: 202 len: 0 microversion: 2.1 time: 0.403522 Nov 02 21:57:16.577420 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2944/6006] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 21:57:16 2022] DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments/e9fb40dd-e4a6-4262-9e95-3af166e1e060 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:57:16.850243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:16.857618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:16.869847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:16.873785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:16.874885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:16.876018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:16.876890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:16.878641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:17.068588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:17.078737 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5a72021-4872-4d11-a0b7-885c5f8d8529 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.231582 Nov 02 21:57:17.081221 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3063/6007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:16 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:18.103834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:18.105225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:18.123031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:18.125308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:18.125877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:18.128041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:18.128606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:18.129310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:18.456846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:18.465084 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1cb6f89d-9bad-44e7-97ab-7f5114e69575 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.365807 Nov 02 21:57:18.469233 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2945/6008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:18 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:19.492410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:19.493838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:19.502148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:19.512571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:19.513335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:19.514321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:19.514952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:19.515562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:19.922792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:19.945887 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e1126c1-125a-4f4c-864c-425a0d1f1ca8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.453391 Nov 02 21:57:19.965444 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3064/6009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:19 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:20.355302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ed4d3aee-123e-4e23-bd5c-0f696e8d5503 req-29514626-99d4-4226-bf8c-523e410bd115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deb2f3a-7e1b-422c-abff-ff5c7d28e761", "name": "network-vif-plugged", "status": "completed", "tag": "c9ec9028-65f4-455f-aa1a-eb2f74030d5a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:57:20.376239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ed4d3aee-123e-4e23-bd5c-0f696e8d5503 req-29514626-99d4-4226-bf8c-523e410bd115 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:20.376239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ed4d3aee-123e-4e23-bd5c-0f696e8d5503 req-29514626-99d4-4226-bf8c-523e410bd115 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:20.376239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ed4d3aee-123e-4e23-bd5c-0f696e8d5503 req-29514626-99d4-4226-bf8c-523e410bd115 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:20.390034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ed4d3aee-123e-4e23-bd5c-0f696e8d5503 req-29514626-99d4-4226-bf8c-523e410bd115 service nova] Creating event network-vif-plugged:c9ec9028-65f4-455f-aa1a-eb2f74030d5a for instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 on n-h1-860863-4 Nov 02 21:57:20.395544 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ed4d3aee-123e-4e23-bd5c-0f696e8d5503 req-29514626-99d4-4226-bf8c-523e410bd115 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044142 Nov 02 21:57:20.396744 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2946/6010] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:57:20.974359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:20.975042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:20.978575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=33 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:20.986316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:20.987729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:20.988413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:20.990143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:20.990895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:20.992867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:20.998889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:21.272360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:21.307654 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0e36a02-f322-4232-81ad-7ec5904b71f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1202 microversion: 2.1 time: 0.337811 Nov 02 21:57:21.313201 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3065/6011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:20 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1202 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:22.346014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:22.346657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:22.379646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:22.380338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:22.380847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:22.381636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:22.382103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:22.382731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:22.586346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:22.594796 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-850c3282-516b-4fda-9ad9-970e3be409af tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1389 microversion: 2.1 time: 0.253278 Nov 02 21:57:22.601129 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2947/6012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:22 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1389 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:22.619025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:22.619798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:22.628448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:22.629084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:22.631033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:22.631033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:22.631033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:22.631510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:22.894677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:22.908659 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7fc3813f-aa76-45c1-bb70-eef2a42c9fee tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1389 microversion: 2.1 time: 0.294690 Nov 02 21:57:22.912368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3066/6013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:22 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1389 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:22.943395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:22.944025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:22.953859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:22.954630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:22.955246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:22.956215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:22.956843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:22.957487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:23.207293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:23.216961 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24b79938-3556-49c4-8779-8f9556ad657a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1389 microversion: 2.1 time: 0.279878 Nov 02 21:57:23.221310 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2948/6014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:22 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1389 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:23.245137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:23.246023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:23.254636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:23.255490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:23.256387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:23.258292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:23.258984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:23.259658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:23.291657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:57:23.592410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9dfb3524-fe1b-41eb-a482-09a9828ba9ba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 204 len: 0 microversion: 2.1 time: 0.351034 Nov 02 21:57:23.593339 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3067/6015] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:57:23 2022] DELETE /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:57:23.602809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:23.603736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:23.612519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:23.613061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:23.613850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:23.614862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:23.615521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:23.616124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:23.803046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:23.813493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2502f924-fce9-4b71-9ce5-ed41d0f25e54 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1395 microversion: 2.1 time: 0.215378 Nov 02 21:57:23.822085 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2949/6016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:23 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1395 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:57:24.308720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:24.312000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:24.324513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.325394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.326022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:24.326910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.327551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.328193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:24.366448 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-871c04b3-7e74-4ed9-bf0b-e198e3b48739 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062298 Nov 02 21:57:24.373014 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3068/6017] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:57:24 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:57:24.504384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:24.509445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:24.513286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:24.519212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.519956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.520786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:24.521698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.522360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.523167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:24.528729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:24.561565 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0cbc5bd0-02b8-4c0d-bdaf-902a13e37088 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060902 Nov 02 21:57:24.565673 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2950/6018] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 21:57:24 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 21:57:24.642419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:24.642933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:24.650933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.651495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.656299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:24.656299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.656299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.656299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:24.698605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:57:24.847407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:24.848693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:24.878113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.878889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.879617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:24.880645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:24.881452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:24.882122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:25.066254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08244447-3e18-4cb6-9469-822c0f69b76f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 204 len: 0 microversion: 2.1 time: 0.427717 Nov 02 21:57:25.067111 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3069/6019] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:57:24 2022] DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:57:25.078462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:25.079306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:25.091958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:25.094121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:25.095490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:25.096461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:25.097311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:25.097975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:25.147209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:25.157776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-094321c3-92ee-44eb-8d84-f37681c2742a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1395 microversion: 2.1 time: 0.315618 Nov 02 21:57:25.174812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2951/6020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:24 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1395 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:25.386013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:25.395415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bc5592c-73e9-4eb1-85ca-2afc2bcc5568 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1673 microversion: 2.1 time: 0.321841 Nov 02 21:57:25.396039 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3070/6021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:25 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1673 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:57:26.093180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f392601f-9f7b-419f-927a-d7f29915c3d8 req-0c404ce0-d9ae-4354-9bbf-1a9d21c62eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deb2f3a-7e1b-422c-abff-ff5c7d28e761", "name": "network-vif-deleted", "tag": "c9ec9028-65f4-455f-aa1a-eb2f74030d5a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:57:26.109684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f392601f-9f7b-419f-927a-d7f29915c3d8 req-0c404ce0-d9ae-4354-9bbf-1a9d21c62eb2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:26.109684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f392601f-9f7b-419f-927a-d7f29915c3d8 req-0c404ce0-d9ae-4354-9bbf-1a9d21c62eb2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:26.109684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f392601f-9f7b-419f-927a-d7f29915c3d8 req-0c404ce0-d9ae-4354-9bbf-1a9d21c62eb2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:26.160743 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f392601f-9f7b-419f-927a-d7f29915c3d8 req-0c404ce0-d9ae-4354-9bbf-1a9d21c62eb2 service nova] Creating event network-vif-deleted:c9ec9028-65f4-455f-aa1a-eb2f74030d5a for instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 on n-h1-860863-4 Nov 02 21:57:26.174626 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f392601f-9f7b-419f-927a-d7f29915c3d8 req-0c404ce0-d9ae-4354-9bbf-1a9d21c62eb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085712 Nov 02 21:57:26.185194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:26.186181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:26.190948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2952/6022] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:57:26.199325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:26.201888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:26.202527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:26.203453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:26.206174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:26.206828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:26.416408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:26.423776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:26.425075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:26.426922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15c8c20e-33af-4cb5-98d1-a33a7f0b2ae0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1353 microversion: 2.1 time: 0.246275 Nov 02 21:57:26.443608 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3071/6023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:26 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1353 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:26.446457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:26.446976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:26.447428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:26.451943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:26.467362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:26.467838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:26.779919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:26.798506 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-42d07413-5cf1-4979-8472-4f1fdfb01d6e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1673 microversion: 2.1 time: 0.372686 Nov 02 21:57:26.799997 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2953/6024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:26 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1673 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:27.468181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:27.469788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:27.487397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:27.488779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:27.496281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:27.496281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:27.496281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:27.496281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:27.670647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:27.695441 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-320b3c58-a305-4743-ab9a-373df5ffae48 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1187 microversion: 2.1 time: 0.231309 Nov 02 21:57:27.697706 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3072/6025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:27 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1187 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:27.828286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:27.829020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:27.851773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:27.852812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:27.853542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:27.854433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:27.855257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:27.855869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:28.176792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:28.193879 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1d4700ad-7435-40ad-860e-ad1992f0a8c6 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1673 microversion: 2.1 time: 0.370256 Nov 02 21:57:28.195707 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2954/6026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:27 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1673 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:28.728510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:28.730909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:28.748805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:28.749476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:28.750155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:28.751071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:28.758706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:28.759481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:28.941095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:28.953239 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41769ee8-f2ab-4d17-b35c-bc1a342a969f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1187 microversion: 2.1 time: 0.233307 Nov 02 21:57:28.956694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3073/6027] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:28 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1187 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:57:29.224119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:29.226938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:29.235490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:29.236865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:29.237774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:29.238661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:29.240352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:29.241129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:29.332918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:29.346968 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8abb9857-d5bf-44f6-b137-2bdad2b3799c tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1606 microversion: 2.1 time: 0.128630 Nov 02 21:57:29.348129 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2955/6028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:29 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1606 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:29.510120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-abf2d0f0-dddd-4c0b-8e87-5be7f92f8f1d req-c160d352-1353-48d3-bec6-82478c96ab8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e692d6c9-60b9-4d8d-8034-831b90a21987", "name": "network-vif-deleted", "tag": "9f5949aa-546a-4990-b8ab-e42633b23e68"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:57:29.531418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-abf2d0f0-dddd-4c0b-8e87-5be7f92f8f1d req-c160d352-1353-48d3-bec6-82478c96ab8c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:29.531754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-abf2d0f0-dddd-4c0b-8e87-5be7f92f8f1d req-c160d352-1353-48d3-bec6-82478c96ab8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:29.549380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-abf2d0f0-dddd-4c0b-8e87-5be7f92f8f1d req-c160d352-1353-48d3-bec6-82478c96ab8c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:29.591987 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-abf2d0f0-dddd-4c0b-8e87-5be7f92f8f1d req-c160d352-1353-48d3-bec6-82478c96ab8c service nova] Creating event network-vif-deleted:9f5949aa-546a-4990-b8ab-e42633b23e68 for instance e692d6c9-60b9-4d8d-8034-831b90a21987 on n-h2-860863-4 Nov 02 21:57:29.605547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-abf2d0f0-dddd-4c0b-8e87-5be7f92f8f1d req-c160d352-1353-48d3-bec6-82478c96ab8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101403 Nov 02 21:57:29.641653 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3074/6029] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:57:29.988392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:29.993936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:30.012954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:30.014079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:30.017874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:30.020275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:30.025451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:30.029052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:30.240074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:30.268868 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a053033-797b-4370-9a07-0af8e23d2841 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1187 microversion: 2.1 time: 0.284862 Nov 02 21:57:30.273135 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2956/6030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:29 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1187 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:30.376245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:30.377849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:30.390529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:30.393989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:30.395564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:30.397334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:30.399210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:30.399946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:30.484784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:30.485302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:30.485745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:30.486200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lazy-loading 'fault' on Instance uuid e692d6c9-60b9-4d8d-8034-831b90a21987 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:57:30.560911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc99ef958a4434ca4f43354d45ade7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3955ce6d9a430e803fc845a4e6cb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:30.602248 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4bdaa9db-3ed9-4e40-9451-e513c8e6f754 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 200 len: 1327 microversion: 2.1 time: 0.229582 Nov 02 21:57:30.617836 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3075/6031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:30 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 1327 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:31.301552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:31.302182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:31.315975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:31.321144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:31.322392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:31.327664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:31.328490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:31.329157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:31.482995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:31.493112 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0481e8d1-da3a-469e-aa48-e022da2f66f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1187 microversion: 2.1 time: 0.197866 Nov 02 21:57:31.516258 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2957/6032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:31 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1187 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:31.641712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:31.642350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:31.656885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:31.657410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:31.657860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:31.669874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:31.669874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:31.669874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:31.727217 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] HTTP exception thrown: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Request method failure captured: Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 HTTP/1.1 Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuZ4fXKVsF6-L14ecEpbxtAoEVOTQ5m3zpb4epDzCvFxzSoRbsLHWcBUahu1OCA1y3xLBfMwllMHxx04wMftEwBAQa858RLNO58H_O8SJeOva6BlpT5Rv-k5cETZy4uV0egMtDN_e7JZM7ix6w-9EyoC_FAxwlwC3RamgL66yilRD0w Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1fc99ef958a4434ca4f43354d45ade7d Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e692d6c9-60b9-4d8d-8034-831b90a21987'} Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:31.736969 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:31.742930 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:31.742930 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:31.742930 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:31.742930 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:57:31.742930 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:57:31.742930 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:31.742930 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:31.748755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Returning 404 to user: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:57:31.749751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f180567-a38d-474d-b16e-954979a69048 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 404 len: 111 microversion: 2.1 time: 0.120453 Nov 02 21:57:31.754715 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3076/6033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:31 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:57:31.760056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-750f6a5d-4b27-4d70-b4c4-298aab55a25f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '.version_select at 0x7f9b6837a9d0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:31.884745 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-750f6a5d-4b27-4d70-b4c4-298aab55a25f tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049992006" status: 202 len: 0 microversion: 2.1 time: 0.129409 Nov 02 21:57:31.885640 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2958/6034] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 21:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049992006 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:57:32.524724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:32.525817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:32.539954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:32.540473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:32.541033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:32.541656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:32.542117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:32.542553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:32.745458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:32.754735 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-728acd22-1d9c-4a1d-ba93-05d250a113c7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1187 microversion: 2.1 time: 0.234482 Nov 02 21:57:32.755333 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3077/6035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:32 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1187 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:33.787420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:33.788267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:33.813247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:33.814209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:33.816663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:33.818407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:33.822071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:33.825002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:33.974016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:33.988366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f6afdfe-3f71-43a9-b65f-b6cfff4e8002 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1187 microversion: 2.1 time: 0.205869 Nov 02 21:57:33.989604 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2959/6036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:33 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1187 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:35.021476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:35.023743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:35.033424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:35.034599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:35.035231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:35.036504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:35.037203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:35.038220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:35.094386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:35.095343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:35.106100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:35.106921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lazy-loading 'fault' on Instance uuid 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:57:35.160264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:35.169797 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f29ca731-adef-4ad4-a2cc-6153f1c9d76e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 200 len: 1192 microversion: 2.1 time: 0.152454 Nov 02 21:57:35.171020 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3078/6037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:35 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 1192 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:36.199305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:36.199994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4deb2f3a-7e1b-422c-abff-ff5c7d28e761] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:36.218023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:36.220637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:36.220637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:36.220637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:36.220637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:36.221835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:36.258725 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 could not be found. Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 HTTP/1.1 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "tempest-type-1134707163", "name": "tempest-service-324089359", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 could not be found. Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4deb2f3a-7e1b-422c-abff-ff5c7d28e761'} Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 could not be found. Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 could not be found. Nov 02 21:57:36.260578 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 could not be found. Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 4deb2f3a-7e1b-422c-abff-ff5c7d28e761 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:57:36.266360 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e09ebfd8-d7f2-4c34-847e-ccdd27f073cd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761" status: 404 len: 111 microversion: 2.1 time: 0.071909 Nov 02 21:57:36.268630 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2960/6038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:36 2022] GET /compute/v2.1/servers/4deb2f3a-7e1b-422c-abff-ff5c7d28e761 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:57:36.675081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad61a5e2-382c-4eff-978a-8a402039d9ba tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: .version_select at 0x7f9b68f7c8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-795845922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDclRlzLushcSisaJczKfQ1PMmuwkc7mrDYIQKxe9u9Lw8rZ/vuzPqhsZ3b8b5huWprBQtbDhP65Hb5E9UKM+n3+xEJXo9LldGgoYEGJBxbVLTdgP9dRsxCVj5uIcIuGQQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:57:36.733749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ad61a5e2-382c-4eff-978a-8a402039d9ba tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:57:36.738878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ad61a5e2-382c-4eff-978a-8a402039d9ba tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:57:36.870922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad61a5e2-382c-4eff-978a-8a402039d9ba tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.488575 Nov 02 21:57:36.876295 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3079/6039] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:57:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:57:45.227092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:45.227631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:45.243775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:45.244280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:45.244727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:45.266519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:45.271481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:45.271481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:45.301378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] HTTP exception thrown: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Request method failure captured: Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 HTTP/1.1 Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuZ4fXKVsF6-L14ecEpbxtAoEVOTQ5m3zpb4epDzCvFxzSoRbsLHWcBUahu1OCA1y3xLBfMwllMHxx04wMftEwBAQa858RLNO58H_O8SJeOva6BlpT5Rv-k5cETZy4uV0egMtDN_e7JZM7ix6w-9EyoC_FAxwlwC3RamgL66yilRD0w Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1fc99ef958a4434ca4f43354d45ade7d Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e692d6c9-60b9-4d8d-8034-831b90a21987'} Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:57:45.302980 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Returning 404 to user: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e735c6c-9fe6-48b8-9b8b-59d3117bd829 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 404 len: 111 microversion: 2.1 time: 0.083100 Nov 02 21:57:45.312674 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2961/6040] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:57:45 2022] DELETE /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:57:45.315147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:45.315147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: e692d6c9-60b9-4d8d-8034-831b90a21987] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:45.318406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:45.328570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:45.329623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:45.330358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:45.331760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:45.332666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:45.333387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:45.357959 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] HTTP exception thrown: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Request method failure captured: Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 HTTP/1.1 Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuZ4fXKVsF6-L14ecEpbxtAoEVOTQ5m3zpb4epDzCvFxzSoRbsLHWcBUahu1OCA1y3xLBfMwllMHxx04wMftEwBAQa858RLNO58H_O8SJeOva6BlpT5Rv-k5cETZy4uV0egMtDN_e7JZM7ix6w-9EyoC_FAxwlwC3RamgL66yilRD0w Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1fc99ef958a4434ca4f43354d45ade7d Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e692d6c9-60b9-4d8d-8034-831b90a21987'} Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:45.359542 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Returning 404 to user: Instance e692d6c9-60b9-4d8d-8034-831b90a21987 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c05cdd74-3595-4bc9-83e8-a1d83316afdf tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987" status: 404 len: 111 microversion: 2.1 time: 0.051189 Nov 02 21:57:45.364582 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3080/6041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:45 2022] GET /compute/v2.1/servers/e692d6c9-60b9-4d8d-8034-831b90a21987 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 21:57:45.592821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1649968770", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8a032b59-67b9-4fd3-903a-cc8f0c1aa327", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:57:45.823304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:57:47.177436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:57:47.177436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:57:47.177436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:57:47.177436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:57:47.177436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:57:47.191942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:47.193489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:47.194331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:47.198001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:47.198782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:47.199490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:47.265826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:57:47.299648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:57:47.452808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:57:47.455048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a032b59-67b9-4fd3-903a-cc8f0c1aa327',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:57:48.357993 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b4c5f71-75b7-4a47-a42c-e30b73eacfbb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.495502 Nov 02 21:57:48.357993 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2962/6042] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 21:57:48.361077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90c3f293-4f21-4ea2-85ec-ae3f8fd94f5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:48.361077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90c3f293-4f21-4ea2-85ec-ae3f8fd94f5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:48.361077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:48.361077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90c3f293-4f21-4ea2-85ec-ae3f8fd94f5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:48.361077 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90c3f293-4f21-4ea2-85ec-ae3f8fd94f5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1057 microversion: 2.1 time: 0.222102 Nov 02 21:57:48.361077 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3081/6043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:48 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1057 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:57:49.345400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c411887f-0b07-47f4-8337-5843fb227365 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:49.346102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c411887f-0b07-47f4-8337-5843fb227365 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:49.595782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c411887f-0b07-47f4-8337-5843fb227365 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:49.624479 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c411887f-0b07-47f4-8337-5843fb227365 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1057 microversion: 2.1 time: 0.287114 Nov 02 21:57:49.631387 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2963/6044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:49 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1057 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:50.656049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:50.657950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:50.675713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:50.678296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:50.696535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:50.699003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:50.704807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:50.705428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:50.810385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:50.823514 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f529891-5ac8-4548-8079-bdeb6a1ee946 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1099 microversion: 2.1 time: 0.171332 Nov 02 21:57:50.824581 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3082/6045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:50 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1099 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:51.853531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:51.853531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:51.868979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:51.869614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:51.870252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:51.871080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:51.874412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:51.874989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:52.048747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:52.063456 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e9f6ec3-704f-47d3-9df2-72225767282c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1163 microversion: 2.1 time: 0.218405 Nov 02 21:57:52.067611 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2964/6046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:51 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1163 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:52.687838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:52.688287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:52.695604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:52.697444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:52.698080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:52.699233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:52.700103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:52.700798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:52.701390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:52.722987 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] HTTP exception thrown: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Request method failure captured: Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 HTTP/1.1 Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuZ4fXKVsF6-L14ecEpbxtAoEVOTQ5m3zpb4epDzCvFxzSoRbsLHWcBUahu1OCA1y3xLBfMwllMHxx04wMftEwBAQa858RLNO58H_O8SJeOva6BlpT5Rv-k5cETZy4uV0egMtDN_e7JZM7ix6w-9EyoC_FAxwlwC3RamgL66yilRD0w Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1fc99ef958a4434ca4f43354d45ade7d Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '329bf1b5-31f6-4107-a823-5a0c6bbbc201'} Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:57:52.741256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.745096 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.747743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Returning 404 to user: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:57:52.748824 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e29d00a-29ee-404e-a22d-c609905e3933 tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "DELETE /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 404 len: 111 microversion: 2.1 time: 0.066010 Nov 02 21:57:52.761343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3083/6047] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:57:52 2022] DELETE /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:57:52.778045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:52.778812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] [instance: 329bf1b5-31f6-4107-a823-5a0c6bbbc201] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:52.789572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:52.790014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:52.790564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:52.791281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:52.791739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:52.792169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:52.824802 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] HTTP exception thrown: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Request method failure captured: Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 HTTP/1.1 Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuZ4fXKVsF6-L14ecEpbxtAoEVOTQ5m3zpb4epDzCvFxzSoRbsLHWcBUahu1OCA1y3xLBfMwllMHxx04wMftEwBAQa858RLNO58H_O8SJeOva6BlpT5Rv-k5cETZy4uV0egMtDN_e7JZM7ix6w-9EyoC_FAxwlwC3RamgL66yilRD0w Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0f3955ce6d9a430e803fc845a4e6cb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0f3955ce6d9a430e803fc845a4e6cb1f Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888845393 Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1fc99ef958a4434ca4f43354d45ade7d Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-AttachVolumeTestJSON-888845393-project Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '329bf1b5-31f6-4107-a823-5a0c6bbbc201'} Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:57:52.826401 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.830398 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:57:52.830398 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:57:52.830398 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:57:52.830398 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:57:52.830398 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:57:52.830398 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. Nov 02 21:57:52.830398 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 21:57:52.845776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] Returning 404 to user: Instance 329bf1b5-31f6-4107-a823-5a0c6bbbc201 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:57:52.855406 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-13d88574-aadf-4208-98c1-344f24be6c2e tempest-AttachVolumeTestJSON-888845393 tempest-AttachVolumeTestJSON-888845393-project] 10.222.0.25 "GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201" status: 404 len: 111 microversion: 2.1 time: 0.082798 Nov 02 21:57:52.855406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2965/6048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:52 2022] GET /compute/v2.1/servers/329bf1b5-31f6-4107-a823-5a0c6bbbc201 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:57:53.095681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:53.096321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:53.118623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:53.119407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:53.121581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:53.122519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:53.126839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:53.129003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:53.321289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:53.342468 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb5f8dac-82f3-4376-b7af-68435b2fc84b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1173 microversion: 2.1 time: 0.250811 Nov 02 21:57:53.343849 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3084/6049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:53 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1173 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:54.370242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:54.370851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:54.378379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:54.380624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:54.384715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:54.389995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:54.390650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:54.391249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:54.638566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:54.658047 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4489ed5-2520-41c3-aa7d-b33d1783889f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1173 microversion: 2.1 time: 0.287902 Nov 02 21:57:54.658877 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2966/6050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:54 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1173 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:55.718573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:55.720645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:55.744846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:55.751767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:55.755295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:55.759429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:55.763277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:55.764606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:56.484473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:56.497926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0fabbbab-b279-458d-bb5b-25aeede9b7d5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1215 microversion: 2.1 time: 0.812696 Nov 02 21:57:56.500826 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3085/6051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:55 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1215 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:56.836117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2086126224", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b1836632-bb1b-4ab0-9f01-49cecca73306"}], "key_name": "tempest-TestNetworkAdvancedServerOps-795845922", "security_groups": [{"name": "tempest-secgroup-smoke-1855541569"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:57:56.869453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:57.140017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] validate_networks() for [('b1836632-bb1b-4ab0-9f01-49cecca73306', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:57:57.228921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:57:57.529098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:57:57.530336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:57:57.558748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:57.559258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:57.559716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:57.577315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:57:57.577825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:57:57.578279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:57:59.495781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:57:59.523091 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b1ac8f9-5cf7-4708-b3e5-cd55042cf39f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1215 microversion: 2.1 time: 1.998763 Nov 02 21:57:59.541005 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3086/6052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:57:57 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1215 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:57:59.601776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:00.276371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fd725415-05f2-4a1f-a9de-dea3de8c3d14 req-1d2e977e-a3f1-4a7c-914a-ae762819a701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25bcee6d-a0aa-4f43-b140-e42d967a83eb", "tag": "9e1e8398-e33a-4370-8982-836302929b4e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:00.296407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd725415-05f2-4a1f-a9de-dea3de8c3d14 req-1d2e977e-a3f1-4a7c-914a-ae762819a701 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:00.300771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd725415-05f2-4a1f-a9de-dea3de8c3d14 req-1d2e977e-a3f1-4a7c-914a-ae762819a701 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:00.301586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd725415-05f2-4a1f-a9de-dea3de8c3d14 req-1d2e977e-a3f1-4a7c-914a-ae762819a701 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:00.331228 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fd725415-05f2-4a1f-a9de-dea3de8c3d14 req-1d2e977e-a3f1-4a7c-914a-ae762819a701 service nova] Creating event network-changed:9e1e8398-e33a-4370-8982-836302929b4e for instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb on n-h2-860863-4 Nov 02 21:58:00.338572 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fd725415-05f2-4a1f-a9de-dea3de8c3d14 req-1d2e977e-a3f1-4a7c-914a-ae762819a701 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.805449 Nov 02 21:58:00.343252 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3087/6053] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:58:00.412033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:58:00.412847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:58:00.414263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:58:00.414991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:58:00.415598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:58:00.446248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:00.447363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:00.448740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:00.450609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:00.452051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:00.452418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:00.485094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=70 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:00.506965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:58:00.522757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:58:00.556573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:00.557253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:00.559755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:58:00.567945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:58:00.572831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:00.573436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:00.573899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:00.578029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:00.582647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:00.583403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:00.675885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:00.765385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-179de1d6-db18-48ce-8bfd-4e16ea34f78a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.933445 Nov 02 21:58:00.767995 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2967/6054] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:57:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 3937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:58:00.781312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0296156c-f33b-4ca3-84ed-da465234ba5b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:00.783975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0296156c-f33b-4ca3-84ed-da465234ba5b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:00.994892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0296156c-f33b-4ca3-84ed-da465234ba5b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:01.002716 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0296156c-f33b-4ca3-84ed-da465234ba5b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1266 microversion: 2.1 time: 0.227150 Nov 02 21:58:01.029338 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2968/6055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:00 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:01.055828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:01.070868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-779c36ea-e79a-468b-a757-db6e047fe15f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1215 microversion: 2.1 time: 0.518616 Nov 02 21:58:01.088799 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3088/6056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:00 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1215 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:02.025530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89210571-0487-49c6-8543-04c2858b2887 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:02.026372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-89210571-0487-49c6-8543-04c2858b2887 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:02.120182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:02.121121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:02.130882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89210571-0487-49c6-8543-04c2858b2887 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:02.138350 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89210571-0487-49c6-8543-04c2858b2887 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1266 microversion: 2.1 time: 0.116779 Nov 02 21:58:02.138940 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2969/6057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:02 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:02.142488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:02.142488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:02.145024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:02.145912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:02.148132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:02.150293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:02.836042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:02.854979 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c58fc32b-6a6d-4603-8e80-6877758b2385 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1215 microversion: 2.1 time: 0.738945 Nov 02 21:58:02.855952 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3089/6058] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:02 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1215 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:03.164574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:03.166148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:03.179773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:03.182278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:03.191146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:03.197352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:03.202852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:03.203504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:03.392049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:03.401673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69be0387-f552-4faf-9db4-07c4d5ff299b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1262 microversion: 2.1 time: 0.241667 Nov 02 21:58:03.420359 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2970/6059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:03 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1262 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:03.887155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:03.888759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:03.900127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:03.901812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:03.902678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:03.903963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:03.904697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:03.905384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:04.298656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:04.313335 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-306d9fed-c8c3-47ba-b7e7-def4d3c356e3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1215 microversion: 2.1 time: 0.431387 Nov 02 21:58:04.314489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3090/6060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:03 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:04.427955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:04.428467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:04.436668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:04.437184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:04.437622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:04.438332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:04.438785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:04.439214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:04.542850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:04.551607 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fff6b26-2c0b-4f1c-b021-031c80c2e018 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1326 microversion: 2.1 time: 0.127558 Nov 02 21:58:04.552239 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2971/6061] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:04 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1326 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:05.343958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:05.346435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:05.364442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:05.364966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:05.368283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:05.370111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:05.370602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:05.371052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:05.576604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:05.578606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:05.586787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:05.587480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:05.588120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:05.589033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:05.589647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:05.597536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:05.631598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:05.650259 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-472e1ef1-5083-4713-863a-6646ab3d7d8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.315758 Nov 02 21:58:05.651337 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3091/6062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:05 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:05.816305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:05.825404 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0deb833-ea96-4efa-b836-7eb46ca81f0d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.252892 Nov 02 21:58:05.826022 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2972/6063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:05 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:06.674984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:06.675902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:06.692438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:06.692438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:06.692438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:06.692438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:06.692438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:06.692438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:06.855153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:06.855781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:06.862817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:06.863315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:06.863764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:06.864486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:06.864964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:06.865402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:07.039346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:07.052534 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df92563e-3d75-4b6c-873b-5e531ed9103b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.381671 Nov 02 21:58:07.054650 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3092/6064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:06 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:07.187435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:07.197975 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24275008-c6ae-42cc-8006-59eede7754fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.346124 Nov 02 21:58:07.199623 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2973/6065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:06 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:07.507566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a090868e-fb53-435f-8dc5-08e175cca437 req-2e229842-243c-40c8-afdd-1679e631f830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:07.550530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a090868e-fb53-435f-8dc5-08e175cca437 req-2e229842-243c-40c8-afdd-1679e631f830 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:07.550530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a090868e-fb53-435f-8dc5-08e175cca437 req-2e229842-243c-40c8-afdd-1679e631f830 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:07.550530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a090868e-fb53-435f-8dc5-08e175cca437 req-2e229842-243c-40c8-afdd-1679e631f830 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:07.598476 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a090868e-fb53-435f-8dc5-08e175cca437 req-2e229842-243c-40c8-afdd-1679e631f830 service nova] Creating event network-changed:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h1-860863-4 Nov 02 21:58:07.610810 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a090868e-fb53-435f-8dc5-08e175cca437 req-2e229842-243c-40c8-afdd-1679e631f830 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105446 Nov 02 21:58:07.611996 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3093/6066] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:58:08.077287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:08.078086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:08.093251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:08.093825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:08.094287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:08.097689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:08.098226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:08.102592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:08.225704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:08.227502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:08.235296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:08.236141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:08.237016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:08.248842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:08.249590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:08.250248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:09.325177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:09.337141 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-230596b6-1aac-48c2-831d-6d6a1f2c5ae3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 1.264119 Nov 02 21:58:09.338657 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2974/6067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:08 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:09.360030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:09.377756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-632a9aff-465f-4c4d-ba92-49d122386d38 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 1.156323 Nov 02 21:58:09.378349 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3094/6068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:08 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:10.373934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:10.388252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:10.405581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:10.406204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:10.414894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:10.417012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:10.419241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:10.421950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:10.422675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:10.422863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:10.425546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:10.426051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:10.432231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:10.432231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:10.432813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:10.436154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:10.488085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:10.900696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:10.908186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:10.912255 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab04d0de-66c5-4897-bf99-3146a153ecbe tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.512344 Nov 02 21:58:10.914167 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3095/6069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:10 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:10.935500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fc7aac5a-36b8-40b6-a724-4ee4ead23d6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.566755 Nov 02 21:58:10.936514 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2975/6070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:10 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:11.935872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:11.936463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:11.951792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:11.952353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:11.952855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:11.960123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:11.961417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:11.965871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:11.968448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:11.968923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:11.975915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:11.976748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:11.977239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:11.982065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:11.982065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:11.982065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:12.142644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:12.251825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:12.285208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:12.291744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c871d3d-d2b9-4c00-a0bf-6b60226023c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.359740 Nov 02 21:58:12.292424 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3096/6071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:11 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:12.300285 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ac88779-6eb1-4e44-8a3d-badeedf5a6ae tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.344884 Nov 02 21:58:12.313305 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2976/6072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:11 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:13.327634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:13.330001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:13.331138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:13.332101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:13.346894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:13.348895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:13.349330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:13.350325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:13.351370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:13.351883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:13.352610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:13.353202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:13.353747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:13.354261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:13.354919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:13.359456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:13.588141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:13.596608 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae1dbafc-d4e4-45a4-9819-0515ba06be91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.276587 Nov 02 21:58:13.597224 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3097/6073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:13 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:13.599139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:13.608586 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b96c387-0465-458e-98f9-ed89d56136c5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.287704 Nov 02 21:58:13.609300 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2977/6074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:13 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:14.619338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:14.619956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:14.636208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:14.636999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:14.637720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:14.638223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:14.638662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:14.639381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:14.643866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:14.644359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:14.656867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:14.658862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:14.660609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:14.661401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:14.664255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:14.665542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:14.932767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:14.944952 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2bdedb9-f0da-43e6-afaa-9077edef8053 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.328122 Nov 02 21:58:14.957103 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3098/6075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:14 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:14.970848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:14.980789 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10a79be4-47b4-42ed-accf-d21375036e10 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.350332 Nov 02 21:58:14.981413 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2978/6076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:14 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:15.969385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:15.970083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:15.977224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:15.977796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:15.978445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:15.979162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:15.979620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:15.980458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:16.007760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:16.008566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:16.020628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:16.021167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:16.021617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:16.022360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:16.023031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:16.025197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:16.356390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:16.370029 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79289487-2e55-4bc3-952a-bb59904c9baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.402159 Nov 02 21:58:16.373197 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3099/6077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:15 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:16.381448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:16.391015 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e62c8c40-b268-48da-8946-75c40d413358 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.389796 Nov 02 21:58:16.393887 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2979/6078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:15 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:16.723102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-806546b6-dbfb-4c22-ab6f-c13f5710e3d0 req-ef590fa1-999d-49bf-8162-b94294357955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "name": "network-vif-plugged", "status": "completed", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:16.733540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-806546b6-dbfb-4c22-ab6f-c13f5710e3d0 req-ef590fa1-999d-49bf-8162-b94294357955 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:16.734017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-806546b6-dbfb-4c22-ab6f-c13f5710e3d0 req-ef590fa1-999d-49bf-8162-b94294357955 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:16.734653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-806546b6-dbfb-4c22-ab6f-c13f5710e3d0 req-ef590fa1-999d-49bf-8162-b94294357955 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:16.738804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:16.747358 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-806546b6-dbfb-4c22-ab6f-c13f5710e3d0 req-ef590fa1-999d-49bf-8162-b94294357955 service nova] Creating event network-vif-plugged:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h1-860863-4 Nov 02 21:58:16.752752 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-806546b6-dbfb-4c22-ab6f-c13f5710e3d0 req-ef590fa1-999d-49bf-8162-b94294357955 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326149 Nov 02 21:58:16.753587 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3100/6079] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:58:17.393546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:17.394184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:17.403221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:17.403653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:17.404102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:17.404815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:17.405310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:17.405772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:17.423365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:17.425830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:17.438278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:17.439059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:17.439707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:17.441125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:17.441983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:17.443225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:17.781969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:17.789118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:17.790734 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9b9e6f2-7cda-45ef-9721-a943d1f1bdfa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.401284 Nov 02 21:58:17.793014 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2980/6080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:17 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:17.799447 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05f315a2-3078-46f9-900b-c643b9c7ac0b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1392 microversion: 2.1 time: 0.383780 Nov 02 21:58:17.800554 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3101/6081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:17 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1392 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:18.774390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a209dd74-76ae-46f4-898f-c3ef66d94f0a req-2569f275-699a-466c-ade8-19df57dd515e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25bcee6d-a0aa-4f43-b140-e42d967a83eb", "name": "network-vif-plugged", "status": "completed", "tag": "9e1e8398-e33a-4370-8982-836302929b4e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:18.786123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a209dd74-76ae-46f4-898f-c3ef66d94f0a req-2569f275-699a-466c-ade8-19df57dd515e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:18.786834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a209dd74-76ae-46f4-898f-c3ef66d94f0a req-2569f275-699a-466c-ade8-19df57dd515e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:18.787421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a209dd74-76ae-46f4-898f-c3ef66d94f0a req-2569f275-699a-466c-ade8-19df57dd515e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:18.800052 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a209dd74-76ae-46f4-898f-c3ef66d94f0a req-2569f275-699a-466c-ade8-19df57dd515e service nova] Creating event network-vif-plugged:9e1e8398-e33a-4370-8982-836302929b4e for instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb on n-h2-860863-4 Nov 02 21:58:18.806387 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a209dd74-76ae-46f4-898f-c3ef66d94f0a req-2569f275-699a-466c-ade8-19df57dd515e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036348 Nov 02 21:58:18.807012 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2981/6082] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:58:18.818451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:18.818451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:18.827775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:18.828683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:18.829421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:18.829994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:18.831058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:18.833645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:18.836406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:18.837192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:18.837458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:18.837952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:18.838348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:18.839074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:18.839608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:18.840489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:19.225041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:19.241234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-afe57dde-f49f-4161-85cd-75a13e7a9803 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1563 microversion: 2.1 time: 0.417526 Nov 02 21:58:19.241234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2982/6083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:18 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1563 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:19.244504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:19.263351 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89852624-f2c9-411d-8bc1-dc1463ee3e17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1203 microversion: 2.1 time: 0.452983 Nov 02 21:58:19.264004 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3102/6084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:18 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1203 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:19.265514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:19.266485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:19.273523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:19.274009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:19.274648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:19.275424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:19.275878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:19.276574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:19.484462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:19.492608 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-375e9cb7-46d7-4870-8934-2d4005c56169 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1563 microversion: 2.1 time: 0.231795 Nov 02 21:58:19.493212 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2983/6085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:19 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:20.286706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:20.287967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:20.302977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:20.304412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:20.306653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:20.309816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:20.310641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:20.311285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:20.512378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:20.526781 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eeb76738-9e79-4276-bda4-4958f203ddc4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1390 microversion: 2.1 time: 0.243744 Nov 02 21:58:20.528404 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3103/6086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:20 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1390 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:20.556126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:20.561184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:20.575329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:20.578580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:20.582230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:20.583625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:20.584109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:20.586150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:20.762639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:20.770971 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a8ab3c4-ac79-47cb-90fe-72cbce92d9d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1390 microversion: 2.1 time: 0.222264 Nov 02 21:58:20.771833 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2984/6087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:20 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:20.794657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:20.795779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:20.804598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:20.805548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:20.806198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:20.806952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:20.807605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:20.808168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:21.036514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:21.048953 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11c99824-af44-43cf-b399-bdc8bc6a143f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1390 microversion: 2.1 time: 0.254927 Nov 02 21:58:21.050262 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3104/6088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:20 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1390 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:21.074546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:21.075395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:21.093112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:21.096420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:21.098361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:21.106637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:21.109335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:21.111672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:21.172609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:58:21.321621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:21.537068 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-822d80cc-c83b-4c3f-8075-346102298f60 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 204 len: 0 microversion: 2.1 time: 0.468190 Nov 02 21:58:21.538543 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2985/6089] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:58:21 2022] DELETE /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:58:21.547217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:21.547920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:21.556304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:21.558107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:21.558107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:21.558107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:21.558357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:21.558890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:21.705331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:21.714256 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-331d3b3f-56d2-4fef-97ef-76b7e0c33c11 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1396 microversion: 2.1 time: 0.170809 Nov 02 21:58:21.714982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3105/6090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:21 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1396 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:22.464350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:22.465095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:22.467673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4a3d50d9-e8bb-4c05-a98c-4975989a1c7b req-60f077cd-f259-495a-b87b-51d20785a097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:22.473735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:22.474245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:22.474831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:22.476160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:22.477000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:22.477118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:22.478822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4a3d50d9-e8bb-4c05-a98c-4975989a1c7b req-60f077cd-f259-495a-b87b-51d20785a097 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:22.479453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4a3d50d9-e8bb-4c05-a98c-4975989a1c7b req-60f077cd-f259-495a-b87b-51d20785a097 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:22.479967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4a3d50d9-e8bb-4c05-a98c-4975989a1c7b req-60f077cd-f259-495a-b87b-51d20785a097 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:22.491721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4a3d50d9-e8bb-4c05-a98c-4975989a1c7b req-60f077cd-f259-495a-b87b-51d20785a097 service nova] Creating event network-changed:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h1-860863-4 Nov 02 21:58:22.497170 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4a3d50d9-e8bb-4c05-a98c-4975989a1c7b req-60f077cd-f259-495a-b87b-51d20785a097 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033623 Nov 02 21:58:22.498229 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3106/6091] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:58:22.747801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:22.747801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:22.753786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:22.754813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:22.755483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:22.756309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:22.757535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:22.758063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:22.828620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:22.828620 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ab6f5d6-c17e-496c-ab6e-a1341e653b31 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1563 microversion: 2.1 time: 0.357103 Nov 02 21:58:22.828620 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2986/6092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:22 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1563 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:23.104907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:23.122901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-10e1bff4-2c90-4c16-a26d-bc74f22b6baf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1396 microversion: 2.1 time: 0.382004 Nov 02 21:58:23.126609 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3107/6093] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:22 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1396 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:58:24.149332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:24.149956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:24.172607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:24.173140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:24.173764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:24.174635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:24.175234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:24.175805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:24.274017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:24.283827 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0d12ff0d-3999-4069-a467-60a30d21f2f4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1188 microversion: 2.1 time: 0.139832 Nov 02 21:58:24.288438 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2987/6094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:24 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1188 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:24.548221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-734bf31c-d4a5-4a4d-b861-ca40fb4e07c8 req-f0d4c611-4901-40b1-b21b-3d831b4318fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25bcee6d-a0aa-4f43-b140-e42d967a83eb", "name": "network-vif-deleted", "tag": "9e1e8398-e33a-4370-8982-836302929b4e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:24.571152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-734bf31c-d4a5-4a4d-b861-ca40fb4e07c8 req-f0d4c611-4901-40b1-b21b-3d831b4318fb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:24.571635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-734bf31c-d4a5-4a4d-b861-ca40fb4e07c8 req-f0d4c611-4901-40b1-b21b-3d831b4318fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:24.572066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-734bf31c-d4a5-4a4d-b861-ca40fb4e07c8 req-f0d4c611-4901-40b1-b21b-3d831b4318fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:24.608082 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-734bf31c-d4a5-4a4d-b861-ca40fb4e07c8 req-f0d4c611-4901-40b1-b21b-3d831b4318fb service nova] Creating event network-vif-deleted:9e1e8398-e33a-4370-8982-836302929b4e for instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb on n-h2-860863-4 Nov 02 21:58:24.626182 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-734bf31c-d4a5-4a4d-b861-ca40fb4e07c8 req-f0d4c611-4901-40b1-b21b-3d831b4318fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088795 Nov 02 21:58:24.637160 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3108/6095] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:58:25.308399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:25.310119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:25.324312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:25.325005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:25.326378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:25.331277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:25.331277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:25.331277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:25.475484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:25.483734 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d8b9be5-4b20-43eb-93ea-1c574208be6b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1188 microversion: 2.1 time: 0.179573 Nov 02 21:58:25.485943 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2988/6096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:25 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1188 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:26.509145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:26.509962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:26.511974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=52 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:26.517206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:26.517783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:26.518291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:26.519082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:26.519614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:26.520114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:26.587806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:26.597232 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-669f8b18-fb4b-4924-9068-602b69753011 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1188 microversion: 2.1 time: 0.093227 Nov 02 21:58:26.597778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3109/6097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:26 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:27.623999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:27.624888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:27.635428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:27.637212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:27.637820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:27.638746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:27.639378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:27.639968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:27.746077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:27.759748 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4e311127-f721-4d5c-8fa4-739dec8e93f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1188 microversion: 2.1 time: 0.140237 Nov 02 21:58:27.763104 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2989/6098] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:27 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1188 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:28.786622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:28.787244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:28.795278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:28.797539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:28.797539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:28.797539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:28.797539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:28.797889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:28.861722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:28.870576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ced7999-127c-4a0b-ba21-c61b1dda9c4d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1188 microversion: 2.1 time: 0.087886 Nov 02 21:58:28.871149 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3110/6099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:28 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:29.912527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:29.913727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:29.918083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:29.925973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:29.926712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:29.927713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:29.929252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:29.930767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:29.931482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:29.970854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:29.972004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:29.973215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:29.973215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lazy-loading 'fault' on Instance uuid 25bcee6d-a0aa-4f43-b140-e42d967a83eb {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 21:58:30.034376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:30.046710 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c0d0be3b-b577-48d9-afe6-5df3727d19cc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 200 len: 1193 microversion: 2.1 time: 0.156567 Nov 02 21:58:30.060432 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2990/6100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:29 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 1193 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:31.072172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:31.072722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 25bcee6d-a0aa-4f43-b140-e42d967a83eb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:31.079686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:31.080124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:31.080574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:31.081317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:31.081777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:31.082213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:31.100090 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb could not be found. Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb HTTP/1.1 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "tempest-type-1134707163", "name": "tempest-service-324089359", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb could not be found. Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '25bcee6d-a0aa-4f43-b140-e42d967a83eb'} Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb could not be found. Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb could not be found. Nov 02 21:58:31.102660 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb could not be found. Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 25bcee6d-a0aa-4f43-b140-e42d967a83eb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16ed3178-6f9f-45c1-ab43-145eb40df758 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb" status: 404 len: 111 microversion: 2.1 time: 0.036829 Nov 02 21:58:31.106132 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3111/6101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:31 2022] GET /compute/v2.1/servers/25bcee6d-a0aa-4f43-b140-e42d967a83eb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 21:58:47.297543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:47.299855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:47.305210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:47.311343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:47.312308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:47.312950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:47.313968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:47.314601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:47.315347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:47.381396 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-00cd680d-5fbf-49fb-9f4d-2fbfb8824287 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action" status: 200 len: 24570 microversion: 2.1 time: 0.089042 Nov 02 21:58:47.392205 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2991/6102] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:58:47 2022] POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action => generated 24570 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:58:58.517884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:58.518641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:58.530577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:58.535622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=54 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:58:58.542629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:58.549169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:58.554918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:58.555665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:58.556377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:58.557459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:59.194485 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0325626-be9c-4678-96dc-83aa786ea1d8 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1833 microversion: 2.1 time: 0.676502 Nov 02 21:58:59.194485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3112/6103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:58 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1833 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:59.220325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:58:59.220325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:59.235802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:59.236108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:59.242477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:59.246760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:59.246760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:59.246760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:59.632514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:58:59.646510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cfb83a30-9d71-46bd-b30a-2c3520490cd9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1682 microversion: 2.1 time: 0.432417 Nov 02 21:58:59.647863 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2992/6104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:58:59 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1682 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:58:59.923138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:58:59.925429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:58:59.933627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:59.934383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:59.935029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:58:59.935927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:58:59.936546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:58:59.937246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:00.008104 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edcb32a4-6096-4e3f-8955-38d52bd8e0eb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action" status: 200 len: 32644 microversion: 2.1 time: 0.088474 Nov 02 21:59:00.009009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3113/6105] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:58:59 2022] POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action => generated 32644 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:59:00.170377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:00.170878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:00.185992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:00.186834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:00.187455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:00.188373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:00.189260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:00.189700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:00.246540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc86be9b6b43469894152a5afc613d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19816276b1244e8c919901dbf46ea96a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:00.247233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] flavor_id is None. Assuming migration. {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 21:59:00.247958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 21:59:01.044264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f87ab83-53e0-4840-a279-e57b542fd029 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action" status: 202 len: 0 microversion: 2.1 time: 0.878483 Nov 02 21:59:01.048632 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2993/6106] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:59:00 2022] POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action => generated 0 bytes in 881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 21:59:01.055090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:01.056633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:01.065941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:01.066592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:01.067036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:01.067787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:01.068274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:01.068702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:01.230167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:01.239365 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9afe23b-4a32-4578-bb18-04be2dc31d6c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1691 microversion: 2.1 time: 0.188812 Nov 02 21:59:01.239961 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3114/6107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:01 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:02.269621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:02.269621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:02.275607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:02.276099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:02.276812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:02.277893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:02.278430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:02.278940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:02.746883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:02.763654 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aa681c74-11aa-47ed-9aeb-5ea6e24782f1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1691 microversion: 2.1 time: 0.502302 Nov 02 21:59:02.765135 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2994/6108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:02 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1691 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:03.789627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:03.791194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:03.799043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:03.799825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:03.800373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:03.801319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:03.801893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:03.802424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:04.024015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:04.039985 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4e0b2be1-3dd1-4a47-a0e1-e3b125df8e68 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1691 microversion: 2.1 time: 0.254795 Nov 02 21:59:04.057725 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3115/6109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:03 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1691 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:05.067866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:05.071645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:05.134298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:05.140456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:05.142713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:05.152737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:05.155968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:05.164077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:06.120121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:06.140679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2fc718f8-35b6-43de-8b49-917e8e66f357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1691 microversion: 2.1 time: 1.075069 Nov 02 21:59:06.145013 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2995/6110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:05 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1691 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:07.173882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:07.176213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:07.187121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:07.187848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:07.188559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:07.189484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:07.190128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:07.191289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:07.550084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:07.573290 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce3f69ca-6741-48c7-8278-bc050a0a7b36 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1691 microversion: 2.1 time: 0.409260 Nov 02 21:59:07.575774 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3116/6111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:07 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1691 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:08.604720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:08.605669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:08.621816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:08.622322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:08.622770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:08.623492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:08.630317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:08.630317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:09.043924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:09.061839 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-18359cf4-b3ce-43b0-877c-3129a45bae71 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 0.461937 Nov 02 21:59:09.062442 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2996/6112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:08 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:10.094536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:10.095801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:10.113469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:10.114190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:10.115433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:10.118652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:10.119335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:10.120489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:11.172091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:11.189901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ed9e012-313a-4ce0-9862-354b8d334fe0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 1.099741 Nov 02 21:59:11.190529 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3117/6113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:10 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:11.813997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1638842203", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6e880976-fead-4f80-a239-597a40cd2f94", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:12.008680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:59:12.193725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dae4fd6c-7f61-4923-8328-e260820cf76d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'create', calling method: .version_select at 0x7f9b685d20d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-829192132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKQd+9dSMJym76EBohQvKsPrVnv2iAL6PI7uYTrWNRvLd3Ymd6dJI9RaNHoM/Su7uKNcuYuuFh0qDArjZ34N1Z3lNfbXTSS1tcJ+wImfp2v5s/AkjURHvgT4MT3xz6Avw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:12.221254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dae4fd6c-7f61-4923-8328-e260820cf76d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for project b4108462f6954f26868cf2f1b1819046. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:59:12.253148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-dae4fd6c-7f61-4923-8328-e260820cf76d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for user ed2d57d2fe094d6890ddf1888c11b0fd and project b4108462f6954f26868cf2f1b1819046. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:59:12.392433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dae4fd6c-7f61-4923-8328-e260820cf76d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.203806 Nov 02 21:59:12.393108 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3118/6114] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 21:59:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:12.412079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:12.413273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:12.436608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:12.444824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:12.445698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:12.448751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:12.449346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:12.455010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:12.915084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:12.929835 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b4b31cf-0075-4c76-9ccd-80e4a248885f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 0.529428 Nov 02 21:59:12.930498 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3119/6115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:12 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:13.530731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:59:13.531197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:59:13.531591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:59:13.531998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:59:13.532407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:59:13.552550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:13.552550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:13.553794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:13.555818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:13.556476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:13.557067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:13.605374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:59:13.613245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:59:13.630554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:59:13.633197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6e880976-fead-4f80-a239-597a40cd2f94',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:59:13.822507 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f749369e-d2a1-415f-837c-223b20141b1e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012632 Nov 02 21:59:13.828851 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2997/6116] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:59:13.834770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fcb5505-553c-4a30-b6f1-f223d673dc59 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:13.835393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fcb5505-553c-4a30-b6f1-f223d673dc59 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:13.956900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:13.958391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:13.977791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:13.978980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:13.980373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:13.982349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:13.985116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:13.985961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:14.074614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fcb5505-553c-4a30-b6f1-f223d673dc59 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:14.083653 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fcb5505-553c-4a30-b6f1-f223d673dc59 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1057 microversion: 2.1 time: 0.253004 Nov 02 21:59:14.094794 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3120/6117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:13 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1057 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:14.306178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:14.323033 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-21e3472e-3d3c-4358-8f2f-5e2a30f3d7d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 0.365635 Nov 02 21:59:14.327546 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2998/6118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:13 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:15.117080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:15.118410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:15.153613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:15.154117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:15.154593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:15.155352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:15.155813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:15.156250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:15.364648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:15.370685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:15.410644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:15.411152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:15.411599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:15.415196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:15.419873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:15.420659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:15.428350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:15.442347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e6c251a9-09a3-4dae-80cd-13542c2abe32 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1061 microversion: 2.1 time: 0.335759 Nov 02 21:59:15.442964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3121/6119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:15 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1061 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:15.741966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:15.771146 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-065530c7-ff43-4db5-bda2-21037297d05f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 0.416837 Nov 02 21:59:15.786552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 2999/6120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:15 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:16.470530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:16.471489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:16.486039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:16.486039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:16.486039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:16.486548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:16.486955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:16.488375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:16.591563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:16.615087 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af2a3b8a-b826-4507-8881-890f2be5d8d6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1109 microversion: 2.1 time: 0.149360 Nov 02 21:59:16.621341 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3122/6121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:16 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1109 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:16.797582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:16.798204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:16.806755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:16.807269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:16.807702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:16.808417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:16.808876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:16.809340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:17.150932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1100505519", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "6bf1c257-5957-4713-951b-4cd9df3322f9"}], "key_name": "tempest-TestNetworkBasicOps-829192132", "security_groups": [{"name": "tempest-secgroup-smoke-1361201015"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:17.154280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:17.182270 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63eec262-24f4-4b35-9172-a2d7b8ed123c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 0.374231 Nov 02 21:59:17.182270 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3000/6122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:16 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:17.443321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] validate_networks() for [('6bf1c257-5957-4713-951b-4cd9df3322f9', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:59:17.647108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:17.648313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:17.655757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:17.656606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:17.657838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:17.658672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:17.659237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:17.659898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:17.852708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:17.875357 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f7ff991d-d1a1-4d07-b5e3-cceb00d974b2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1127 microversion: 2.1 time: 0.229291 Nov 02 21:59:17.894265 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3001/6123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:17 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1127 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:18.204186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:18.205362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:18.217615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:18.220213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:18.221674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:18.228815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:18.231313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:18.232030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:18.665036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:18.677534 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ffa4d7bf-27b2-492c-a409-6e0ac6760473 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 0.476994 Nov 02 21:59:18.681339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3002/6124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:18 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:18.917827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:18.924538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:18.938663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:18.938663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:18.938663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:18.938663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:18.938663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:18.938663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:18.954677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:59:18.955097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:59:18.955513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:59:18.955930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:59:18.956350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:59:18.984562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:18.985178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:18.985647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:18.990188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:18.991580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:18.999052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:19.034418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for project b4108462f6954f26868cf2f1b1819046. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:59:19.041639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for user ed2d57d2fe094d6890ddf1888c11b0fd and project b4108462f6954f26868cf2f1b1819046. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:59:19.058797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:59:19.061833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:59:19.219374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0f4d0341-1fea-496c-a4e8-e625f603755b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.072954 Nov 02 21:59:19.223959 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3123/6125] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:59:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:59:19.237660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93f6f0b9-fc98-465e-bded-7c6453b27545 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:19.238648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93f6f0b9-fc98-465e-bded-7c6453b27545 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:19.561539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93f6f0b9-fc98-465e-bded-7c6453b27545 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:19.571584 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93f6f0b9-fc98-465e-bded-7c6453b27545 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1248 microversion: 2.1 time: 0.340855 Nov 02 21:59:19.584075 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3124/6126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:19 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1248 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:19.697973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:19.704293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:19.705443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:19.710006 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-94dda1ec-17ea-4617-abf5-4c12d5560f94 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.802850 Nov 02 21:59:19.711213 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3003/6127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:18 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:19.714782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:19.715715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:19.716393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:19.721511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:19.721511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:19.722190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:20.045882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:20.054640 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e6c6baf-5baf-4814-bc70-e1c45368bf7e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1696 microversion: 2.1 time: 0.354371 Nov 02 21:59:20.055245 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3125/6128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:19 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1696 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:20.596698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-441d5172-c498-443e-85d3-d159ce1a4555 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:20.597489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-441d5172-c498-443e-85d3-d159ce1a4555 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:20.676913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-441d5172-c498-443e-85d3-d159ce1a4555 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:20.685677 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-441d5172-c498-443e-85d3-d159ce1a4555 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1248 microversion: 2.1 time: 0.093434 Nov 02 21:59:20.686882 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3004/6129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:20 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1248 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:20.735748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:20.736692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:20.748856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:20.749784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:20.750247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:20.750984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:20.751550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:20.751881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:20.999578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:21.012759 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0520e559-affb-498c-9e9c-7a59d69fbe45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.279718 Nov 02 21:59:21.026211 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3126/6130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:20 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:21.089691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:21.090345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:21.121550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:21.123153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:21.128644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:21.132116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:21.133534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:21.134762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:21.562511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:21.574678 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88574525-124b-4eed-9ed2-08715ff849e5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1695 microversion: 2.1 time: 0.494460 Nov 02 21:59:21.576415 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3005/6131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:21 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1695 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:21.581822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7818efc3-c8d6-4576-b98f-bbbf5f7c27b2 req-629f5069-3b96-4792-860c-d4e35b7c9c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "name": "network-vif-unplugged", "status": "completed", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:21.614024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7818efc3-c8d6-4576-b98f-bbbf5f7c27b2 req-629f5069-3b96-4792-860c-d4e35b7c9c07 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:21.615491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7818efc3-c8d6-4576-b98f-bbbf5f7c27b2 req-629f5069-3b96-4792-860c-d4e35b7c9c07 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:21.616459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7818efc3-c8d6-4576-b98f-bbbf5f7c27b2 req-629f5069-3b96-4792-860c-d4e35b7c9c07 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:21.630002 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7818efc3-c8d6-4576-b98f-bbbf5f7c27b2 req-629f5069-3b96-4792-860c-d4e35b7c9c07 service nova] Creating event network-vif-unplugged:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h2-860863-4 Nov 02 21:59:21.637897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-7818efc3-c8d6-4576-b98f-bbbf5f7c27b2 req-629f5069-3b96-4792-860c-d4e35b7c9c07 service nova] Instance 6924a2df-f4af-490f-9277-4eabd819853e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:59:21.653636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7818efc3-c8d6-4576-b98f-bbbf5f7c27b2 req-629f5069-3b96-4792-860c-d4e35b7c9c07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078341 Nov 02 21:59:21.655691 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3127/6132] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:21.713219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:21.713946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:21.724032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:21.729589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:21.732130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:21.734130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:21.735854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:21.736313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:21.849551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:21.858854 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-54798cc1-1d34-4279-bb03-681e22ba392b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1244 microversion: 2.1 time: 0.150743 Nov 02 21:59:21.859959 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3006/6133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:21 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1244 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:22.044689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:22.045435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:22.068120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:22.071202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:22.071735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:22.073598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:22.074270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:22.075457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:22.352470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:22.374071 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dfd6db32-a946-416c-8393-746b72f6b2c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.332863 Nov 02 21:59:22.375791 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3128/6134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:22 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:22.608169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:22.609119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:22.625894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:22.628898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:22.630362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:22.632201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:22.633841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:22.634514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:22.888762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:22.891456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:22.909330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:22.915044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:22.917173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:22.918134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:22.919777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:22.921604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:23.052604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:23.065037 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8822c45-d5c6-4a1c-9f22-307e2cf8afb2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1308 microversion: 2.1 time: 0.179742 Nov 02 21:59:23.066171 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3129/6135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:22 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:23.200636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:23.205231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:23.218652 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bef0d863-42bc-4ba0-ba27-69a0211f6192 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1695 microversion: 2.1 time: 0.615093 Nov 02 21:59:23.219544 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3007/6136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:22 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1695 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:23.399114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:23.399967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:23.407829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:23.408462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:23.408940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:23.409651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:23.410437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:23.410879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:23.635535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:23.650087 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7af63b29-3390-44d5-913d-2f1764ece9df tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.255363 Nov 02 21:59:23.650936 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3130/6137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:23 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:23.710944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4a2f8c-0347-4bf7-81ac-6aa56395672e", "tag": "f16c14cf-95c9-4e4b-9071-ae92441d6e34"}, {"name": "network-changed", "server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:23.719088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:23.728460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:23.730866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:23.731592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:23.751369 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] Creating event network-changed:f16c14cf-95c9-4e4b-9071-ae92441d6e34 for instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e on n-h2-860863-4 Nov 02 21:59:23.752001 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] Creating event network-changed:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h2-860863-4 Nov 02 21:59:23.763497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] Instance 6924a2df-f4af-490f-9277-4eabd819853e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 21:59:23.782901 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dbe68142-8454-4515-97b4-707626aa0bae req-3768b445-a7b1-43f7-81e2-10748483bae1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093996 Nov 02 21:59:23.784196 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3008/6138] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:24.096027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:24.097239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:24.119855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:24.120353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:24.124233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:24.125197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:24.132484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:24.133609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:24.253388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:24.254120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:24.268895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:24.271950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:24.272440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:24.276472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:24.276605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:24.277278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:24.481609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:24.491684 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ae9cbb9-ff41-43e3-836f-27835cdffe89 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.399277 Nov 02 21:59:24.496350 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3131/6139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:24 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:24.566764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:24.578201 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-94a1c99a-70c4-4872-b74a-91f92fe35957 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1695 microversion: 2.1 time: 0.331489 Nov 02 21:59:24.597957 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3009/6140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:24 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1695 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:24.677049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:24.677677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:24.685089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:24.685583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:24.686026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:24.686726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:24.687177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:24.687671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:24.940549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:24.947081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:24.953002 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dca3eb9f-65b2-414f-b2a2-c53d399a8d37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.281192 Nov 02 21:59:24.953832 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3132/6141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:24 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:25.522206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:25.522909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:25.541751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:25.542580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:25.543112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:25.543894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:25.544356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:25.545635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:25.608471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:25.610104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:25.625550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:25.626308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:25.626922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:25.627810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:25.628426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:25.629216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:26.237280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:26.246410 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9ec8493-c238-4923-aa7f-612b451fac4a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.730484 Nov 02 21:59:26.247020 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3010/6142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:25 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:26.264917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:26.265571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:26.280764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:26.281561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:26.282179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:26.282899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:26.283364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:26.289587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:26.393833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:26.404497 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d51ad131-4d17-4121-ada0-1007a83b1dde tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1695 microversion: 2.1 time: 0.800450 Nov 02 21:59:26.419093 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3133/6143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:25 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1695 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:26.616182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:26.620816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9cbbd392-443d-441d-a32d-6ca11f13f540 req-94ea4eef-ed39-489e-907e-5f0fe5bc75c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba65780f-947b-4884-9836-dd5c6cda5701", "tag": "3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:26.636049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9cbbd392-443d-441d-a32d-6ca11f13f540 req-94ea4eef-ed39-489e-907e-5f0fe5bc75c5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:26.636528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9cbbd392-443d-441d-a32d-6ca11f13f540 req-94ea4eef-ed39-489e-907e-5f0fe5bc75c5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:26.636993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9cbbd392-443d-441d-a32d-6ca11f13f540 req-94ea4eef-ed39-489e-907e-5f0fe5bc75c5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:26.639040 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed874d73-f351-43e9-8231-d28bbdd1fb36 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.380544 Nov 02 21:59:26.640604 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3011/6144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:26 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:26.649626 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9cbbd392-443d-441d-a32d-6ca11f13f540 req-94ea4eef-ed39-489e-907e-5f0fe5bc75c5 service nova] Creating event network-changed:3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730 for instance ba65780f-947b-4884-9836-dd5c6cda5701 on n-h1-860863-4 Nov 02 21:59:26.660811 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9cbbd392-443d-441d-a32d-6ca11f13f540 req-94ea4eef-ed39-489e-907e-5f0fe5bc75c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240293 Nov 02 21:59:26.663854 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3134/6145] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:27.290659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:27.291380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:27.299321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:27.300140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:27.300585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:27.301488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:27.302351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:27.302928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:27.435493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:27.436204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:27.453583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:27.454298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:27.455484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:27.456377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:27.457353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:27.457943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:27.624610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:27.660486 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3e2efff1-a711-421c-bafe-827c6902daae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.387861 Nov 02 21:59:27.685429 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3012/6146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:27 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:27.695247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:27.695891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:27.710615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:27.711123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:27.711661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:27.716168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:27.716656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:27.717129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:27.844461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:27.856045 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27c918de-3870-42c2-9869-33865f033cb2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1693 microversion: 2.1 time: 0.425466 Nov 02 21:59:27.856652 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3135/6147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:27 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1693 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:28.063370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:28.075218 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-38932dda-42d8-4ac6-92ae-b967ee57d90e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.394504 Nov 02 21:59:28.076436 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3013/6148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:27 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:28.691038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:28.691857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:28.699299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:28.709973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:28.712124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:28.712124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:28.712124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:28.713402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:28.714005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:28.890949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:28.900561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:28.912188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:28.912188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:28.912188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:28.914219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:28.914860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:28.915455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:29.024050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:29.217278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:29.232244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c042038-7cd7-4bfc-a357-568023254ad7 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.545019 Nov 02 21:59:29.233738 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3136/6149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:28 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:29.240866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:29.241469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:29.248596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:29.253211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:29.253211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:29.253211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:29.262338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:29.262810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:29.292359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:29.309470 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc6e9148-103b-4af1-8449-9282298b110b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1690 microversion: 2.1 time: 0.423574 Nov 02 21:59:29.310455 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3014/6150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:28 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1690 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:29.341733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:29.342225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:29.356725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:29.358338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:29.363327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:29.363327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:29.363327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:29.363327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:29.363327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:29.494920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:29.503935 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a806c09e-27a8-41ac-b234-8a2e2d9ff2c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.268806 Nov 02 21:59:29.504521 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3137/6151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:29 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:29.666761 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-185a2ca0-9396-4f08-b38a-a5326a02fac0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action" status: 204 len: 0 microversion: 2.1 time: 0.335596 Nov 02 21:59:29.672553 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3015/6152] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:59:29 2022] POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 21:59:29.688048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:29.688693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:29.698519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:29.702100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:29.705064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:29.705064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:29.708817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:29.709918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:29.710582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:30.206633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:30.219342 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-384253e2-737d-4cda-b783-7515633da193 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1690 microversion: 2.1 time: 0.544672 Nov 02 21:59:30.220577 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3138/6153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:29 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1690 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:30.263545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:30.265287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:30.303412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:30.305166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:30.306215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:30.308137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:30.309463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:30.310315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:30.532085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:30.532882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:30.540799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:30.541831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:30.543129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:30.544100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:30.544800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:30.545865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:30.682054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:31.331918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:31.351082 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1324cf98-9e38-4cb2-838c-669b76e71ff5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 1.097462 Nov 02 21:59:31.352831 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3016/6154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:30 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:31.402361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:31.405295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:31.421759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:31.424452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:31.425007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:31.426086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:31.427044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:31.427781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:31.474447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:31.483650 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa3c9e24-d809-4ca9-a29c-c95aa4472eac tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.957236 Nov 02 21:59:31.489172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3139/6155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:30 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:32.035121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:32.064679 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-78b466c4-fad9-48a2-842e-c14ee6c3a0f6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1690 microversion: 2.1 time: 0.710183 Nov 02 21:59:32.065931 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3017/6156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:31 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1690 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:32.385555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:32.387594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:32.422388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:32.422388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:32.422388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:32.422388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:32.422388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:32.422388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:32.522525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:32.523784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:32.540506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:32.541136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:32.541597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:32.542349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:32.548452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:32.557751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:32.855886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:32.869429 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d0ae709-1f79-4d77-9330-385c44872de6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.491810 Nov 02 21:59:32.872137 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3140/6157] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:32 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:32.981902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:32.996580 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eeebccc4-d5fa-4e13-b1c3-ed1d03cc959b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.479268 Nov 02 21:59:32.997865 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3018/6158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:32 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:33.095822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:33.096984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:33.109837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:33.110349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:33.113582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:33.113582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:33.113582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:33.113582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:33.598066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:33.610262 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4710e1cd-2be7-4e3b-a70d-4ac5cbcf129c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1690 microversion: 2.1 time: 0.525641 Nov 02 21:59:33.611411 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3141/6159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:33 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1690 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:33.897801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:33.899001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:33.923001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:33.923758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:33.924306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:33.925076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:33.925546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:33.926041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:34.020051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:34.020727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:34.042950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:34.048500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:34.049166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:34.050022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:34.052160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:34.053881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:34.482737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:34.496087 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-781abf7e-4721-4dd3-8974-a42797851872 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.603474 Nov 02 21:59:34.496087 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3019/6160] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:33 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:34.638198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:34.638825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:34.645166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:34.645673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:34.646129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:34.646929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:34.655554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:34.656244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:35.042482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:35.056247 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-73af3f94-54d0-4a68-aae6-48dd8109cf37 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 1.040051 Nov 02 21:59:35.061812 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3142/6161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:34 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:35.113696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4ebea94a-94cf-4006-b5e5-9c43452da5a3 req-1278aa35-893b-4e59-bbdf-e1057f60f328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "name": "network-vif-plugged", "status": "completed", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:35.127754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4ebea94a-94cf-4006-b5e5-9c43452da5a3 req-1278aa35-893b-4e59-bbdf-e1057f60f328 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:35.128239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4ebea94a-94cf-4006-b5e5-9c43452da5a3 req-1278aa35-893b-4e59-bbdf-e1057f60f328 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:35.128765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4ebea94a-94cf-4006-b5e5-9c43452da5a3 req-1278aa35-893b-4e59-bbdf-e1057f60f328 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:35.147356 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4ebea94a-94cf-4006-b5e5-9c43452da5a3 req-1278aa35-893b-4e59-bbdf-e1057f60f328 service nova] Creating event network-vif-plugged:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h2-860863-4 Nov 02 21:59:35.159981 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4ebea94a-94cf-4006-b5e5-9c43452da5a3 req-1278aa35-893b-4e59-bbdf-e1057f60f328 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052901 Nov 02 21:59:35.159981 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3143/6162] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 21:59:35.217446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:35.244480 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9daf22b-7ed7-4d95-939b-441550947a2a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1682 microversion: 2.1 time: 0.610553 Nov 02 21:59:35.245410 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3020/6163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:34 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1682 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:35.528213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:35.529260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:35.547720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:35.549420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:35.549893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:35.550663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:35.551088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:35.551576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:35.815716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:35.825202 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7a0d816c-1ab3-493d-a0d4-69bcc678ddcc tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.301428 Nov 02 21:59:35.826693 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3144/6164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:35 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:36.093310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:36.094121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:36.119421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:36.120431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:36.120890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:36.121820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:36.122287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:36.123380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:36.336762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:36.345816 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a724b30-257a-44c1-9b4b-0ca9d478773e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.259435 Nov 02 21:59:36.346417 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3021/6165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:36 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:36.851403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:36.855415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:36.859027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:36.859629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:36.860316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:36.863040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:36.863795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:36.864278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:37.046086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:37.055808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8a0ea05-69e9-4411-97b3-f337de99901f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.209280 Nov 02 21:59:37.056415 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3145/6166] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:36 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:37.170691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b566bdb8-d797-4054-b982-2e078aa4bfe9 req-3fc20aa4-1066-4560-80e0-aa84dbcdafe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba65780f-947b-4884-9836-dd5c6cda5701", "name": "network-vif-plugged", "status": "completed", "tag": "3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:37.182321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b566bdb8-d797-4054-b982-2e078aa4bfe9 req-3fc20aa4-1066-4560-80e0-aa84dbcdafe5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:37.186227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b566bdb8-d797-4054-b982-2e078aa4bfe9 req-3fc20aa4-1066-4560-80e0-aa84dbcdafe5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:37.186227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b566bdb8-d797-4054-b982-2e078aa4bfe9 req-3fc20aa4-1066-4560-80e0-aa84dbcdafe5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:37.198480 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b566bdb8-d797-4054-b982-2e078aa4bfe9 req-3fc20aa4-1066-4560-80e0-aa84dbcdafe5 service nova] Creating event network-vif-plugged:3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730 for instance ba65780f-947b-4884-9836-dd5c6cda5701 on n-h1-860863-4 Nov 02 21:59:37.207594 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b566bdb8-d797-4054-b982-2e078aa4bfe9 req-3fc20aa4-1066-4560-80e0-aa84dbcdafe5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038330 Nov 02 21:59:37.214967 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3022/6167] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:37.375411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:37.376402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:37.384584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:37.388260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:37.389097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:37.390054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:37.390886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:37.391677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:37.590202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:37.600710 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b74878fe-953d-4882-9e6d-8691d657d458 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.229251 Nov 02 21:59:37.601417 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3146/6168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:37 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:38.008763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1044308931", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "f409b96e-a407-406d-8559-e2e1a906bddb"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:38.086433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:38.086433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:38.087234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:38.087354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:38.087777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:38.088478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:38.088956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:38.089379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:38.101248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] validate_networks() for [('f409b96e-a407-406d-8559-e2e1a906bddb', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 21:59:38.359376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:38.368905 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f5811fd-b056-4c4e-b7dc-c2c279c3a1d3 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1374 microversion: 2.1 time: 0.293588 Nov 02 21:59:38.369842 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3147/6169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:38 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1374 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:38.625633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:38.626264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:38.630165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 21:59:38.630596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 21:59:38.631647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 21:59:38.632764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 21:59:38.633233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 21:59:38.634121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:38.634897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:38.635561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:38.636585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:38.637311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:38.637971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:38.643292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:38.643795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:38.644241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:38.644996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:38.645489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:38.645926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:38.688556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Getting quotas for project 7f1bb33307af47bfb0d3386342404fc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 21:59:38.697227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Getting quotas for user 3249ed7f9f274b1b8aca777c10445e54 and project 7f1bb33307af47bfb0d3386342404fc0. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 21:59:38.718506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 21:59:38.721076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 21:59:38.873375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:38.878754 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-811e81bc-4285-47ea-a9e5-9059cbeb47e4 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040866 Nov 02 21:59:38.887354 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3023/6170] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 21:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 21:59:38.890228 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-320ccf4c-b177-481e-9946-92f75743aaf8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.270340 Nov 02 21:59:38.891561 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3148/6171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:38 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:38.894013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8138ef53-cfd4-4eb5-b5f0-65c4240c984e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:38.915561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8138ef53-cfd4-4eb5-b5f0-65c4240c984e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:38.987516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8138ef53-cfd4-4eb5-b5f0-65c4240c984e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:38.997772 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8138ef53-cfd4-4eb5-b5f0-65c4240c984e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1214 microversion: 2.1 time: 0.108783 Nov 02 21:59:38.998371 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3024/6172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:38 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:39.393556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:39.394648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:39.404021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:39.404791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:39.405295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:39.406017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:39.406692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:39.407291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:39.615090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:39.624741 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a782080-9525-4315-ae84-ed2578c35354 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1546 microversion: 2.1 time: 0.236624 Nov 02 21:59:39.630296 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3149/6173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:39 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:39.656574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:39.657310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:39.665309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:39.665806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:39.666247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:39.666945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:39.667400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:39.667856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:39.853937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:39.863315 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a50aefc1-e39a-4f53-8c89-bbbe90faac45 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1546 microversion: 2.1 time: 0.210645 Nov 02 21:59:39.863918 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3025/6174] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:39 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1546 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:39.917147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:39.918312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:39.925020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:39.925706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:39.926307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:39.927285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:39.928195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:39.930878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:40.026060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a12719c0-8cac-4b81-a340-db6c888d6a0b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:40.033043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a12719c0-8cac-4b81-a340-db6c888d6a0b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:40.154669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:40.156031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:40.160815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e20324c-beae-41d7-ad31-fa6ee0ceb472 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.248481 Nov 02 21:59:40.161436 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3150/6175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:39 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:40.213464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a12719c0-8cac-4b81-a340-db6c888d6a0b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:40.235307 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a12719c0-8cac-4b81-a340-db6c888d6a0b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1214 microversion: 2.1 time: 0.216202 Nov 02 21:59:40.236432 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3026/6176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:40 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:41.190501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:41.191187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:41.199162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:41.207995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:41.208689 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:41.219763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:41.219763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:41.219763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:41.269095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:41.269095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:41.306871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:41.308361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:41.310142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:41.310866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:41.312358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:41.313546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:41.320420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:41.559558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:41.584073 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ac04df5-b96f-4673-b926-3b553d777160 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1210 microversion: 2.1 time: 0.327266 Nov 02 21:59:41.600484 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3027/6177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:41 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1210 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:42.301667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:42.313738 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-950036a9-bc77-469c-86f1-e26de90fb0ce tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 1.128047 Nov 02 21:59:42.338827 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3151/6178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:41 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:42.618038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:42.619270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:42.628106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:42.628840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:42.629607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:42.630526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:42.631826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:42.632417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:42.740074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:42.748631 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d48fded0-3643-4196-a695-da305cff5643 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1274 microversion: 2.1 time: 0.144447 Nov 02 21:59:42.749246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3028/6179] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:42 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1274 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:43.343384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:43.343994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:43.385731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:43.387061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:43.394115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:43.411765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:43.420057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:43.429870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:43.776786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:43.778474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:43.795460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:43.799086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:43.799754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:43.801774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:43.803970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:43.804581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:44.189104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:44.207036 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86c0e167-af46-4e96-b077-f939d93ab744 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1272 microversion: 2.1 time: 0.435671 Nov 02 21:59:44.207036 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3029/6180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:43 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:44.271309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:44.286398 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1815b1f-8d8c-4ec4-a4eb-e229a5939e12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.947315 Nov 02 21:59:44.287448 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3152/6181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:43 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:45.030016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-59694afe-c3b7-439f-ab8d-2c1f28ac144a req-4b171c14-658d-4d2f-91af-ee4b7f8f0b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba65780f-947b-4884-9836-dd5c6cda5701", "tag": "3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:45.050082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-59694afe-c3b7-439f-ab8d-2c1f28ac144a req-4b171c14-658d-4d2f-91af-ee4b7f8f0b4f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:45.054790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-59694afe-c3b7-439f-ab8d-2c1f28ac144a req-4b171c14-658d-4d2f-91af-ee4b7f8f0b4f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:45.059732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-59694afe-c3b7-439f-ab8d-2c1f28ac144a req-4b171c14-658d-4d2f-91af-ee4b7f8f0b4f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:45.086272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-59694afe-c3b7-439f-ab8d-2c1f28ac144a req-4b171c14-658d-4d2f-91af-ee4b7f8f0b4f service nova] Creating event network-changed:3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730 for instance ba65780f-947b-4884-9836-dd5c6cda5701 on n-h1-860863-4 Nov 02 21:59:45.104874 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-59694afe-c3b7-439f-ab8d-2c1f28ac144a req-4b171c14-658d-4d2f-91af-ee4b7f8f0b4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079286 Nov 02 21:59:45.106280 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3030/6182] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:45.231111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:45.232344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:45.248606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:45.250528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:45.251309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:45.253368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:45.254559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:45.257238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:45.310396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:45.311136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:45.330754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:45.331494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:45.332088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:45.332968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:45.333594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:45.334435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:46.272457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:46.282326 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4cdf356b-8dda-4946-a80a-e454921a8ef7 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 1.054905 Nov 02 21:59:46.282864 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3153/6183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:45 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:46.415199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:46.429120 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a4e22c90-aeb0-4a0a-949c-5f92e9317a6e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 1.122223 Nov 02 21:59:46.431225 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3031/6184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:45 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:47.310467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:47.311085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:47.339638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:47.340203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:47.340591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:47.341353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:47.341803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:47.342229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:47.374561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-855fb313-1457-4d10-81da-543d56f536ab req-e8103112-b8c5-4df6-9e07-33946b04e928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88008ed8-cc0b-4825-bfa8-2ab487043920", "tag": "d10b7b19-ed4c-48c5-80f1-75eb2177b213"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:47.387868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-855fb313-1457-4d10-81da-543d56f536ab req-e8103112-b8c5-4df6-9e07-33946b04e928 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:47.388574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-855fb313-1457-4d10-81da-543d56f536ab req-e8103112-b8c5-4df6-9e07-33946b04e928 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:47.389385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-855fb313-1457-4d10-81da-543d56f536ab req-e8103112-b8c5-4df6-9e07-33946b04e928 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:47.406204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-855fb313-1457-4d10-81da-543d56f536ab req-e8103112-b8c5-4df6-9e07-33946b04e928 service nova] Creating event network-changed:d10b7b19-ed4c-48c5-80f1-75eb2177b213 for instance 88008ed8-cc0b-4825-bfa8-2ab487043920 on n-h1-860863-4 Nov 02 21:59:47.419048 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-855fb313-1457-4d10-81da-543d56f536ab req-e8103112-b8c5-4df6-9e07-33946b04e928 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044200 Nov 02 21:59:47.421978 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3032/6185] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:47.453547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:47.454645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:47.464103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:47.465005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:47.465668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:47.466614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:47.467253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:47.467852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:47.980251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:47.999968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:48.000167 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6212c2f8-ceef-439e-88f8-94829002d83a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.551501 Nov 02 21:59:48.002656 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3033/6186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:47 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:48.015459 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-083f5e78-aff6-41b4-bd97-ed413ebc371f tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 0.708897 Nov 02 21:59:48.018058 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3154/6187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:47 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:49.027047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:49.028673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:49.035467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:49.037784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:49.038509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:49.039174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:49.040127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:49.040652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:49.041602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:49.047642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:49.048914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:49.061720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:49.062496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:49.063220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:49.065545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:49.066306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:49.071496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:49.389250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:49.401865 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-423c5db1-842c-4cdb-ac86-e2f921d1f638 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.379946 Nov 02 21:59:49.417475 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3034/6188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:49 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:49.443364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:49.464617 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-acf566a1-c1cf-479e-880b-c403957287aa tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 0.420722 Nov 02 21:59:49.467963 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3155/6189] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:49 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:50.429744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:50.431736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:50.442374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=10 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 21:59:50.446349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:50.446616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:50.446894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:50.447777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:50.448250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:50.448895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:50.491435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:50.492831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:50.506708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:50.506708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:50.506708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:50.511097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:50.511615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:50.512179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:50.708906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:50.723181 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4faf8a6d-27d8-4767-9911-57af4fea16d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.298749 Nov 02 21:59:50.723181 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3035/6190] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:50 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:50.767602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:50.779675 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89bd1a80-12e0-4edb-968a-40dd3c79ad4d tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 0.293271 Nov 02 21:59:50.783036 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3156/6191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:50 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:51.567829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:51.571718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:51.578949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:51.579801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:51.580410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:51.581310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:51.581957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:51.582540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:51.642224 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a7951b2-f1e9-4c9d-85fa-30cfcd24ccc6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action" status: 200 len: 24577 microversion: 2.1 time: 0.078338 Nov 02 21:59:51.643038 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3036/6192] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 21:59:51 2022] POST /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e/action => generated 24577 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 21:59:51.744581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:51.746094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:51.753782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:51.754451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:51.755171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:51.756262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:51.756813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:51.757401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:51.811608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:51.812558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:51.821811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:51.822306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:51.822749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:51.823627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:51.824081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:51.824514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:52.067758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:52.082187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a7e79e6-f322-4f8e-976d-33652158e55b tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 0.280048 Nov 02 21:59:52.085770 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3037/6193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:51 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:52.092528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:52.101396 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1432921-a929-499b-b6f5-13187a4827d8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.361361 Nov 02 21:59:52.121139 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3157/6194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:51 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:53.113427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:53.114328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:53.126596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:53.127141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:53.130334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:53.132175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:53.132909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:53.135246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:53.140655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:53.141483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:53.144999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:53.145500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:53.145940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:53.147257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:53.147715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:53.148299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:53.755530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:53.764399 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2a7d672-0710-4e73-8abc-cf393acd2dc9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.641674 Nov 02 21:59:53.765007 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3158/6195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:53 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:53.784971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:53.794070 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c845e5d1-5699-4550-9ea1-16f8b3575f7e tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 0.686165 Nov 02 21:59:53.795236 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3038/6196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:53 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:54.727028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-58b72d1a-09c5-430b-989d-37b3cf886b27 req-35044336-dfd5-4735-b73c-630fb308b999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88008ed8-cc0b-4825-bfa8-2ab487043920", "name": "network-vif-plugged", "status": "completed", "tag": "d10b7b19-ed4c-48c5-80f1-75eb2177b213"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:54.739150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-58b72d1a-09c5-430b-989d-37b3cf886b27 req-35044336-dfd5-4735-b73c-630fb308b999 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:54.739624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-58b72d1a-09c5-430b-989d-37b3cf886b27 req-35044336-dfd5-4735-b73c-630fb308b999 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:54.740090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-58b72d1a-09c5-430b-989d-37b3cf886b27 req-35044336-dfd5-4735-b73c-630fb308b999 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:54.752617 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-58b72d1a-09c5-430b-989d-37b3cf886b27 req-35044336-dfd5-4735-b73c-630fb308b999 service nova] Creating event network-vif-plugged:d10b7b19-ed4c-48c5-80f1-75eb2177b213 for instance 88008ed8-cc0b-4825-bfa8-2ab487043920 on n-h1-860863-4 Nov 02 21:59:54.758268 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-58b72d1a-09c5-430b-989d-37b3cf886b27 req-35044336-dfd5-4735-b73c-630fb308b999 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035060 Nov 02 21:59:54.759049 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3159/6197] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 21:59:54.788869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:54.790127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:54.798785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:54.799281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:54.799894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:54.800895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:54.801530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:54.802113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:54.819903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:54.820536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:54.839151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:54.839892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:54.841047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:54.841935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:54.842573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:54.843160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:55.363119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:55.366294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:55.378620 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3c616770-dd76-4b19-9986-10cbb54d70b1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1169 microversion: 2.1 time: 0.594553 Nov 02 21:59:55.379398 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3039/6198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:54 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1169 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:55.394518 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d81944a-a42b-4079-a9de-cb036ce8994a tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 0.566011 Nov 02 21:59:55.397669 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3160/6199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:54 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:56.402012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:56.403737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:56.412294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:56.413239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:56.413875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:56.415315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:56.415937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:56.416526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:56.419769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:56.420397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:56.429600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:56.430107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:56.430601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:56.431574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:56.432240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:56.432990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:56.765048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:56.773507 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f47b22e-d659-4f08-a1dd-679cb6b99bc3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.375418 Nov 02 21:59:56.774192 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3040/6200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:56 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:56.839491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:56.848793 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-710f9f5d-0860-4c0c-b8ad-625cacabf6cc tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1314 microversion: 2.1 time: 0.432496 Nov 02 21:59:56.861371 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3161/6201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:56 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:57.799512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:57.801634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:57.814338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:57.814846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:57.816043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:57.816775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:57.817326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:57.818442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:57.873659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:57.876618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:57.892300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:57.893215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:57.897158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:57.899657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:57.901481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:57.902142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:58.125595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:58.144360 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-685ffdd4-3d12-42ea-8d90-0b1292716b49 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.349757 Nov 02 21:59:58.150232 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3041/6202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:57 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:58.164576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:58.166828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:58.175209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:58.176692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:58.178357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:58.179925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:58.181948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:58.182641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:58.183357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:58.206367 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c64568da-dc34-4bd5-b0f6-6dc8ce14a783 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1498 microversion: 2.1 time: 0.337931 Nov 02 21:59:58.230194 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3162/6203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:57 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1498 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:58.488144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9860820f-7561-419f-9fc1-1e630a7ccc80 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1833 microversion: 2.1 time: 0.336074 Nov 02 21:59:58.500178 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3042/6204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:58 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1833 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 21:59:59.178113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:59.178732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:59.189913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:59.190110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:59.190498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:59.192409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:59.194044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:59.194817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:59.489722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 21:59:59.507831 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f31cef3-c1d2-48b0-a955-df12bc3372f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.333494 Nov 02 21:59:59.508896 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3163/6205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 21:59:59 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 21:59:59.821038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 21:59:59.821583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 21:59:59.833635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:59.835946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:59.836412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:59.837346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:59.837985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:59.838571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:59.838782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c892cd6e-219d-4f4a-9e64-875bcaf89b6c req-391f9641-f2d3-43bc-bd03-297f4828385b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 21:59:59.861924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c892cd6e-219d-4f4a-9e64-875bcaf89b6c req-391f9641-f2d3-43bc-bd03-297f4828385b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 21:59:59.862417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c892cd6e-219d-4f4a-9e64-875bcaf89b6c req-391f9641-f2d3-43bc-bd03-297f4828385b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 21:59:59.863594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c892cd6e-219d-4f4a-9e64-875bcaf89b6c req-391f9641-f2d3-43bc-bd03-297f4828385b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 21:59:59.882292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 21:59:59.894469 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c892cd6e-219d-4f4a-9e64-875bcaf89b6c req-391f9641-f2d3-43bc-bd03-297f4828385b service nova] Creating event network-changed:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h2-860863-4 Nov 02 21:59:59.907917 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c892cd6e-219d-4f4a-9e64-875bcaf89b6c req-391f9641-f2d3-43bc-bd03-297f4828385b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071612 Nov 02 21:59:59.910911 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3164/6206] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 21:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:00:00.042846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:00.204076 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de5feac0-524c-4d2e-9ee5-220ba39ecf4d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 204 len: 0 microversion: 2.1 time: 0.387547 Nov 02 22:00:00.206583 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3043/6207] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 21:59:59 2022] DELETE /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:00:00.219321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:00.220031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:00.230880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:00.231390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:00.231850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:00.232549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:00.236595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:00.247987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:00.436437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:00.446125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9914bb64-4ebc-44e9-8d99-dae95ec91d60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1688 microversion: 2.1 time: 0.231893 Nov 02 22:00:00.447595 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3165/6208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:00 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1688 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:00.534391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:00.535454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:00.541957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:00.542526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:00.543196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:00.544077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:00.544698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:00.545169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:00.712336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:00.740351 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c7c5167-42bf-43da-a379-c1bf27ba4fe0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.203831 Nov 02 22:00:00.741401 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3044/6209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:00 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:01.492467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:01.495191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:01.528951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=60 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:01.530831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:01.531473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:01.532250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:01.533179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:01.533844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:01.535881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:01.768521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:01.769761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:01.773151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:01.784667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:01.785363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:01.787754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:01.792701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:01.793444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:01.794055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:02.129233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:02.152734 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-42d4b941-a595-4f11-9e4f-29f4ce498999 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1688 microversion: 2.1 time: 0.675124 Nov 02 22:00:02.152734 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3166/6210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:01 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1688 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:02.227758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:02.241802 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e7bc630-57e6-4656-923d-2bb3fc1ee801 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.477136 Nov 02 22:00:02.253420 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3045/6211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:01 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:02.410602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1eb06410-bed1-4ff7-84f6-7563f41c8589 req-cac1557a-6606-40fb-b16d-e2306095f4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6924a2df-f4af-490f-9277-4eabd819853e", "name": "network-vif-deleted", "tag": "7c9ace4f-d5e6-401e-8b63-5413da997a5b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:02.421804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1eb06410-bed1-4ff7-84f6-7563f41c8589 req-cac1557a-6606-40fb-b16d-e2306095f4c0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:02.423079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1eb06410-bed1-4ff7-84f6-7563f41c8589 req-cac1557a-6606-40fb-b16d-e2306095f4c0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:02.423325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1eb06410-bed1-4ff7-84f6-7563f41c8589 req-cac1557a-6606-40fb-b16d-e2306095f4c0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:02.448565 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1eb06410-bed1-4ff7-84f6-7563f41c8589 req-cac1557a-6606-40fb-b16d-e2306095f4c0 service nova] Creating event network-vif-deleted:7c9ace4f-d5e6-401e-8b63-5413da997a5b for instance 6924a2df-f4af-490f-9277-4eabd819853e on n-h2-860863-4 Nov 02 22:00:02.456453 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1eb06410-bed1-4ff7-84f6-7563f41c8589 req-cac1557a-6606-40fb-b16d-e2306095f4c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049832 Nov 02 22:00:02.457846 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3167/6212] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:03.177485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:03.183865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:03.188169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.189091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.189713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.190612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.191240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.191834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.261556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:03.262903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:03.284150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.284666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.285773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.286515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.287656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.288674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.304990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.304990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.304990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.304990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lazy-loading 'fault' on Instance uuid 6924a2df-f4af-490f-9277-4eabd819853e {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:00:03.344570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:00:03.456304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:03.456778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:03.469754 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-354b3426-715e-4148-8665-6897b69a851a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 200 len: 1356 microversion: 2.1 time: 0.297369 Nov 02 22:00:03.472115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3046/6213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:03 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 1356 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:03.485158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:03.490447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:03.510858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.511832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.525575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.529028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.529772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.532535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.860238 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd4607ab-5d03-4646-b221-5b9cf9b7a689 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "DELETE /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 204 len: 0 microversion: 2.1 time: 0.604938 Nov 02 22:00:03.865043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3168/6214] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:00:03 2022] DELETE /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:00:03.871669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:03.874758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:03.882587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.883413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.884148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:03.885579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:03.887249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:03.887895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:04.351158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:04.356763 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8f113769-aa96-42dd-899d-69047e5c9c0f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.883352 Nov 02 22:00:04.357378 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3047/6215] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:03 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:04.377110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:04.385613 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd616dd4-cdb0-4b84-88f0-83ffc0abad5c tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1504 microversion: 2.1 time: 0.518182 Nov 02 22:00:04.386191 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3169/6216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:03 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:04.501981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:04.502757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 6924a2df-f4af-490f-9277-4eabd819853e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:04.513557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:04.514621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:04.516196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:04.517621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:04.518362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:04.519227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:04.540647 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] HTTP exception thrown: Instance 6924a2df-f4af-490f-9277-4eabd819853e could not be found. Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Request method failure captured: Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e HTTP/1.1 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYufPX6Rr5nr0yUdeWlboFRhiIRbfN70FaGXR5l42VL99ff4QwXSASZ8gH2G8kcngmWHBOUnKDxEHG5udsXaLab0zA1qmKd0pxn2TvmKN1vh_EQYUFTlFaM3t9QlaSUDMe-Q91CN2uqH3mfhXQC5X0nf71_hjip1qxhzqvXD3EIeuvz4 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f3d5fb3af3fe44d3a742f5e902b32f4d Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 6924a2df-f4af-490f-9277-4eabd819853e could not be found. Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '6924a2df-f4af-490f-9277-4eabd819853e'} Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6924a2df-f4af-490f-9277-4eabd819853e could not be found. Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6924a2df-f4af-490f-9277-4eabd819853e could not be found. Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:04.542228 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6924a2df-f4af-490f-9277-4eabd819853e could not be found. Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Returning 404 to user: Instance 6924a2df-f4af-490f-9277-4eabd819853e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:00:04.549111 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-562123b0-987f-4435-a525-029d2ead204f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e" status: 404 len: 111 microversion: 2.1 time: 0.047708 Nov 02 22:00:04.559620 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3048/6217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:04 2022] GET /compute/v2.1/servers/6924a2df-f4af-490f-9277-4eabd819853e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:00:05.380799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:05.382536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:05.401734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:05.410182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:05.411674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:05.423576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:05.430073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:05.430932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:05.432968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:05.433549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:05.434235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:05.434507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:05.434694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:05.435618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:05.436314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:05.437055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:05.912013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:05.925685 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d5725388-5cec-41e7-8f57-1d283d46673b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.548774 Nov 02 22:00:05.928729 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3170/6218] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:05 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:05.953722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:05.963993 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3a41bc2-cfba-4aee-9c82-af750c3f4326 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1504 microversion: 2.1 time: 0.557908 Nov 02 22:00:05.966489 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3049/6219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:05 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:06.650265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0650413b-1072-4e89-bd8a-b03b38a29384 req-a4b7edd6-860e-400f-9d9f-4fb9b162c63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88008ed8-cc0b-4825-bfa8-2ab487043920", "name": "network-vif-deleted", "tag": "d10b7b19-ed4c-48c5-80f1-75eb2177b213"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:06.670935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0650413b-1072-4e89-bd8a-b03b38a29384 req-a4b7edd6-860e-400f-9d9f-4fb9b162c63a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:06.672015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0650413b-1072-4e89-bd8a-b03b38a29384 req-a4b7edd6-860e-400f-9d9f-4fb9b162c63a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:06.672762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0650413b-1072-4e89-bd8a-b03b38a29384 req-a4b7edd6-860e-400f-9d9f-4fb9b162c63a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:06.720177 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0650413b-1072-4e89-bd8a-b03b38a29384 req-a4b7edd6-860e-400f-9d9f-4fb9b162c63a service nova] Creating event network-vif-deleted:d10b7b19-ed4c-48c5-80f1-75eb2177b213 for instance 88008ed8-cc0b-4825-bfa8-2ab487043920 on n-h1-860863-4 Nov 02 22:00:06.733386 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0650413b-1072-4e89-bd8a-b03b38a29384 req-a4b7edd6-860e-400f-9d9f-4fb9b162c63a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092853 Nov 02 22:00:06.734595 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3171/6220] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:06.758030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:06.767115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:06.785514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-664261f7-bfa8-4cc6-afbe-ee10569547a2 req-378b06f8-0f80-4525-968b-bcd2895cea16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4a2f8c-0347-4bf7-81ac-6aa56395672e", "name": "network-vif-plugged", "status": "completed", "tag": "f16c14cf-95c9-4e4b-9071-ae92441d6e34"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:06.801000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:06.802136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:06.803596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:06.806627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:06.807263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:06.808918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:06.815228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-664261f7-bfa8-4cc6-afbe-ee10569547a2 req-378b06f8-0f80-4525-968b-bcd2895cea16 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:06.815941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-664261f7-bfa8-4cc6-afbe-ee10569547a2 req-378b06f8-0f80-4525-968b-bcd2895cea16 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:06.816557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-664261f7-bfa8-4cc6-afbe-ee10569547a2 req-378b06f8-0f80-4525-968b-bcd2895cea16 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:06.852313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-664261f7-bfa8-4cc6-afbe-ee10569547a2 req-378b06f8-0f80-4525-968b-bcd2895cea16 service nova] Creating event network-vif-plugged:f16c14cf-95c9-4e4b-9071-ae92441d6e34 for instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e on n-h2-860863-4 Nov 02 22:00:06.865543 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-664261f7-bfa8-4cc6-afbe-ee10569547a2 req-378b06f8-0f80-4525-968b-bcd2895cea16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086957 Nov 02 22:00:06.866166 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3172/6221] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:00:06.944820 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ee50a22-7e84-4120-9f8f-9bd40e437346 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701/action" status: 200 len: 24574 microversion: 2.1 time: 0.206136 Nov 02 22:00:06.946433 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3050/6222] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:00:06 2022] POST /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701/action => generated 24574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 22:00:06.954080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:06.957325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:06.972236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:06.973179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:06.973842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:06.975526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:06.976355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:06.977296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:06.994662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:06.995533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:07.012737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:07.015553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:07.017338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:07.018794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:07.020046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:07.023078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:07.159432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3249ed7f9f274b1b8aca777c10445e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1bb33307af47bfb0d3386342404fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:07.180678 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-35aa8c2e-ed24-4308-aeb4-d600cce16fdb tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 200 len: 1299 microversion: 2.1 time: 0.192529 Nov 02 22:00:07.183523 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3051/6223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:06 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:07.379300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:07.398522 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f54bedce-a9e5-4c4b-85e5-56340a12f533 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.448337 Nov 02 22:00:07.399150 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3173/6224] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:06 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:08.211532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:08.213447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] [instance: 88008ed8-cc0b-4825-bfa8-2ab487043920] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:08.226623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:08.227931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:08.228734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:08.230047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:08.230838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:08.231514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:08.286224 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] HTTP exception thrown: Instance 88008ed8-cc0b-4825-bfa8-2ab487043920 could not be found. Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Request method failure captured: Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 HTTP/1.1 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuhFbfqSLk4gkkM9e7Mp33soZGehhYoFwF04ETN4k_BTDNUK-b9coqy30SZ144Grg7DzmOH-7Wf0-8R_Ot72a14VAvC4KXAcYucXTHoQdjzzMEJwVD6NcTTroH2-Rpi5_dIlRtblnQKsS101d32YnWZcJptXnAhWuOBsElYS77ntH84 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7f1bb33307af47bfb0d3386342404fc0 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-VolumesActionsTest-1833291178 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7f1bb33307af47bfb0d3386342404fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f1bb33307af47bfb0d3386342404fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7f1bb33307af47bfb0d3386342404fc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7f1bb33307af47bfb0d3386342404fc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-VolumesActionsTest-1833291178 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7f1bb33307af47bfb0d3386342404fc0 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-VolumesActionsTest-1833291178 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-VolumesActionsTest-1833291178-project Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 3249ed7f9f274b1b8aca777c10445e54 Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-VolumesActionsTest-1833291178-project Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 88008ed8-cc0b-4825-bfa8-2ab487043920 could not be found. Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '88008ed8-cc0b-4825-bfa8-2ab487043920'} Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88008ed8-cc0b-4825-bfa8-2ab487043920 could not be found. Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88008ed8-cc0b-4825-bfa8-2ab487043920 could not be found. Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:08.294325 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:08.298768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:08.298768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:08.298768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:08.298768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:00:08.298768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:00:08.298768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88008ed8-cc0b-4825-bfa8-2ab487043920 could not be found. Nov 02 22:00:08.298768 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:08.311414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] Returning 404 to user: Instance 88008ed8-cc0b-4825-bfa8-2ab487043920 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:00:08.312693 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ba392fae-7f77-4c33-adcb-5ddd2a700d24 tempest-VolumesActionsTest-1833291178 tempest-VolumesActionsTest-1833291178-project] 10.222.0.25 "GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920" status: 404 len: 111 microversion: 2.1 time: 0.106563 Nov 02 22:00:08.317285 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3052/6225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:08 2022] GET /compute/v2.1/servers/88008ed8-cc0b-4825-bfa8-2ab487043920 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:00:08.436795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:08.441722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:08.451412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:08.452314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:08.453048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:08.454140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:08.455109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:08.456175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:08.820824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:08.833446 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc5ebd22-8297-4e5d-9ab6-29beb65baa0e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1203 microversion: 2.1 time: 0.410728 Nov 02 22:00:08.835053 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3174/6226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:08 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1203 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:09.862512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:09.864041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:09.897900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:09.898675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:09.899898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:09.904477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:09.905206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:09.908008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:10.628567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:10.638993 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ee19e4e-5b2f-4369-a9f5-e2a7045b5010 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1390 microversion: 2.1 time: 0.783065 Nov 02 22:00:10.640986 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3053/6227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:09 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1390 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:10.663404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:10.664571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:10.671858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:10.672355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:10.672992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:10.673707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:10.674171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:10.674612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:10.764431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cb2da85-294f-4172-9625-bfe69ab54af3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '.version_select at 0x7f9b6d23d040>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:10.883946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:10.891707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ee9e0cb-3d99-4e92-8291-4c100da2b820 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1390 microversion: 2.1 time: 0.233274 Nov 02 22:00:10.892457 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3175/6228] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:10 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:10.915763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:10.916451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:10.922740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:10.923258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:10.923707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:10.924410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:10.924870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:10.925348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:10.933755 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cb2da85-294f-4172-9625-bfe69ab54af3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-795845922" status: 202 len: 0 microversion: 2.1 time: 0.174830 Nov 02 22:00:10.936594 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3054/6229] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 22:00:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-795845922 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:00:10.973761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6d75d0c8-12b2-4ab8-88f5-9f76044fa9e7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: .version_select at 0x7f9b6d2fce50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1841212613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrp+S5YgVz/5alxlcgyFRNXGOw2bF7uyGo1sIyHEm2r1Znoe+IigHTtnich91K4R5Y9yXq+V9menXEhZ6wHyvOvkzzXHTg+2CiKxhsRgA0ukR6YB0Pebt1Q7ke8QwieAQ=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:10.991702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6d75d0c8-12b2-4ab8-88f5-9f76044fa9e7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:00:10.997409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-6d75d0c8-12b2-4ab8-88f5-9f76044fa9e7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:00:11.108720 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6d75d0c8-12b2-4ab8-88f5-9f76044fa9e7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.139251 Nov 02 22:00:11.109400 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3055/6230] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:00:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:11.185309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:11.193363 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-75426e6b-57ed-4534-9b0a-59a15dc16410 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1390 microversion: 2.1 time: 0.282380 Nov 02 22:00:11.194113 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3176/6231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:10 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1390 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:11.299062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:11.299062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:11.304187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:11.304902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:11.305585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:11.306291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:11.306893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:11.307556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:11.368053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:00:11.842830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a375d220-3e0b-42ff-a8cb-caf4a67035aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 204 len: 0 microversion: 2.1 time: 0.560151 Nov 02 22:00:11.845912 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3056/6232] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:00:11 2022] DELETE /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:00:11.851656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:11.852312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:11.859392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:11.859885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:11.860330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:11.861063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:11.861524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:11.861959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:12.117206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:12.125652 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a284bfbd-948f-4faf-bc30-799209abb059 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1396 microversion: 2.1 time: 0.278007 Nov 02 22:00:12.126246 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3177/6233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:11 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1396 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:13.161124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:13.163287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:13.182192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:13.185405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:13.185922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:13.189970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:13.190486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:13.194457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:13.368636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:13.379680 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f7b68da-19fa-49e1-b51a-aaef400e20fe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1396 microversion: 2.1 time: 0.229676 Nov 02 22:00:13.380919 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3057/6234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:13 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1396 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:14.353060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7adbb940-cdd1-4cb5-85f1-7c934ac4bddd req-735250ee-c383-48d6-8904-380e7b67911d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4a2f8c-0347-4bf7-81ac-6aa56395672e", "name": "network-vif-deleted", "tag": "f16c14cf-95c9-4e4b-9071-ae92441d6e34"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:14.382628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7adbb940-cdd1-4cb5-85f1-7c934ac4bddd req-735250ee-c383-48d6-8904-380e7b67911d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:14.383392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7adbb940-cdd1-4cb5-85f1-7c934ac4bddd req-735250ee-c383-48d6-8904-380e7b67911d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:14.383989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7adbb940-cdd1-4cb5-85f1-7c934ac4bddd req-735250ee-c383-48d6-8904-380e7b67911d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:14.401048 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7adbb940-cdd1-4cb5-85f1-7c934ac4bddd req-735250ee-c383-48d6-8904-380e7b67911d service nova] Creating event network-vif-deleted:f16c14cf-95c9-4e4b-9071-ae92441d6e34 for instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e on n-h2-860863-4 Nov 02 22:00:14.403771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:14.405469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:14.422437 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7adbb940-cdd1-4cb5-85f1-7c934ac4bddd req-735250ee-c383-48d6-8904-380e7b67911d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072733 Nov 02 22:00:14.423898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:14.427363 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3178/6235] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:14.429597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:14.430398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:14.431318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:14.431975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:14.432624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:14.547789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:14.557184 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a29ba9e5-f701-49d2-834a-d799d324de4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1354 microversion: 2.1 time: 0.157803 Nov 02 22:00:14.557774 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3058/6236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:14 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:15.581176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:15.581888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:15.600888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:15.603617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:15.604106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:15.604896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:15.609136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:15.609590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:15.766105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:15.781272 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6fe3cace-2a5f-4b4c-8d31-e9d814ca68f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1188 microversion: 2.1 time: 0.201785 Nov 02 22:00:15.781922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3179/6237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:15 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1188 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:16.804016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:16.805199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:16.812203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:16.812920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:16.819231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:16.819231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:16.819231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:16.819231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:16.893849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:16.906332 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a19ae65c-76b6-47ff-aace-c5614b86c963 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1188 microversion: 2.1 time: 0.106390 Nov 02 22:00:16.910561 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3059/6238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:16 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1188 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:17.939391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:17.941018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:17.949638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:17.950651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:17.955656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:17.955656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:17.955656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:17.955656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:18.159529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:18.171373 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd97f0e1-f36c-49a6-97b5-be09d054f36e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1188 microversion: 2.1 time: 0.241493 Nov 02 22:00:18.197560 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3180/6239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:17 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1188 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:19.197162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:19.197791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:19.216788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:19.217765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:19.218422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:19.219355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:19.219980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:19.225993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:19.515406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:19.527062 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-352ea83a-6e74-4fa4-b919-b439ae6a46ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1188 microversion: 2.1 time: 0.334714 Nov 02 22:00:19.536597 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3060/6240] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:19 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1188 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:20.553033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:20.553899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:20.568567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:20.569284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:20.570023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:20.570972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:20.572860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:20.578634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:21.691117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:21.760012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-524398b3-d3a7-4dfe-8053-fd5802e9da9e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1188 microversion: 2.1 time: 1.210978 Nov 02 22:00:21.767943 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3181/6241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:20 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1188 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:22.795121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:22.795745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:22.799780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:22.816988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:22.817515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:22.823582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:22.827497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:22.827497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:22.829669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:22.976342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:22.976843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:22.977321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:22.983137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lazy-loading 'fault' on Instance uuid 4e4a2f8c-0347-4bf7-81ac-6aa56395672e {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:00:23.135708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:23.138836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:23.154970 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41061b56-31bb-4261-abc4-141c1113b950 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 200 len: 1147 microversion: 2.1 time: 0.364059 Nov 02 22:00:23.155482 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3061/6242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:22 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 1147 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:24.179701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:24.180343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:24.209695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:24.211333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:24.214027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:24.214998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:24.215463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:24.215910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:24.284029 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e HTTP/1.1 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "tempest-type-1134707163", "name": "tempest-service-324089359", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4e4a2f8c-0347-4bf7-81ac-6aa56395672e'} Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:24.285785 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c3fe025-5119-4dc8-a90d-8b619ab1c29e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 404 len: 111 microversion: 2.1 time: 0.112997 Nov 02 22:00:24.294848 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3182/6243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:24 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:00:27.569778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f41dba73-e5ee-42b9-acce-e4c8e2c761e0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'create', calling method: .version_select at 0x7f9b63aeedc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-28687776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnpi8OevmpKcpKW0MkuQ/GYxWiu3IeC9YGqT4sZ/8Z+2FU7O48We08PkXsaYgAT0MFMHTdcjzmHHQtgnWIpLq/hSVp2NbeXUiWyYAij3+4bZJjDVoiwAVq+o7yPx91mhQ=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:27.596738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f41dba73-e5ee-42b9-acce-e4c8e2c761e0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for project b4108462f6954f26868cf2f1b1819046. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:00:27.630874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-f41dba73-e5ee-42b9-acce-e4c8e2c761e0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for user ed2d57d2fe094d6890ddf1888c11b0fd and project b4108462f6954f26868cf2f1b1819046. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:00:27.749436 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f41dba73-e5ee-42b9-acce-e4c8e2c761e0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.184957 Nov 02 22:00:27.750901 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3062/6244] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:00:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:28.807918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-706119817", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "dd124bce-413e-4a5e-8a24-2e76a6c09898"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1841212613", "security_groups": [{"name": "tempest-secgroup-smoke-297815088"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:28.987477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:28.987983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:29.015520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:29.015979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:29.016427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:29.017177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:29.017634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:29.019540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:29.063132 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e HTTP/1.1 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "tempest-type-1134707163", "name": "tempest-service-324089359", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4e4a2f8c-0347-4bf7-81ac-6aa56395672e'} Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:00:29.067162 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.072195 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.083397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:00:29.085294 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf4b90d2-f96c-4820-9aef-8a2d82cf6619 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 404 len: 111 microversion: 2.1 time: 0.103568 Nov 02 22:00:29.086048 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3063/6245] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:00:28 2022] DELETE /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:00:29.095024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:29.095906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 4e4a2f8c-0347-4bf7-81ac-6aa56395672e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:29.106829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:29.113774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:29.114520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:29.115976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:29.116600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:29.117216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:29.147815 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e HTTP/1.1 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "tempest-type-1134707163", "name": "tempest-service-324089359", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4e4a2f8c-0347-4bf7-81ac-6aa56395672e'} Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.151145 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. Nov 02 22:00:29.155646 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:00:29.166465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 4e4a2f8c-0347-4bf7-81ac-6aa56395672e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:00:29.172738 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9dd97d61-804c-467e-ad10-1c2a62bcaa6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e" status: 404 len: 111 microversion: 2.1 time: 0.076375 Nov 02 22:00:29.172738 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3064/6246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:29 2022] GET /compute/v2.1/servers/4e4a2f8c-0347-4bf7-81ac-6aa56395672e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:00:29.324216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] validate_networks() for [('dd124bce-413e-4a5e-8a24-2e76a6c09898', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:00:31.743527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:00:31.744182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:00:31.744807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:00:31.745348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:00:31.745889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:00:31.754192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:31.778812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:31.782225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:31.782932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:31.783943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:31.787632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:31.790956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:31.871453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:00:31.915426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:00:31.950212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:00:31.961972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:00:32.267067 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3a6c8f5-e369-4cd2-847e-d8f9fb43d8a2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.463435 Nov 02 22:00:32.268515 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3183/6247] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:00:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 3466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:00:32.284662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2d4c885f-1c25-41e4-8fd8-21e6e4bd6a37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:32.286012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2d4c885f-1c25-41e4-8fd8-21e6e4bd6a37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:32.569362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2d4c885f-1c25-41e4-8fd8-21e6e4bd6a37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:32.594830 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2d4c885f-1c25-41e4-8fd8-21e6e4bd6a37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1266 microversion: 2.1 time: 0.318228 Nov 02 22:00:32.595433 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3065/6248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:32 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:33.621850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a324d13b-1e2e-4734-a8de-26e79d196a23 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:33.624654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a324d13b-1e2e-4734-a8de-26e79d196a23 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:33.639393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1072932447", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "f968ed3b-b816-444a-a40f-a507b9ee594e"}], "key_name": "tempest-TestNetworkBasicOps-28687776", "security_groups": [{"name": "tempest-secgroup-smoke-1392935060"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:33.753194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:33.876350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a324d13b-1e2e-4734-a8de-26e79d196a23 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:33.918162 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a324d13b-1e2e-4734-a8de-26e79d196a23 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1266 microversion: 2.1 time: 0.298667 Nov 02 22:00:33.919649 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3184/6249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:33 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:33.942085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] validate_networks() for [('f968ed3b-b816-444a-a40f-a507b9ee594e', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:00:34.948451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:34.951299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:34.972882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:34.975197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:34.976332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:34.977812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:34.982262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:34.984398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:35.023903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:00:35.025184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:00:35.025828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:00:35.026809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:00:35.027383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:00:35.055726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:35.058757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:35.059752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:35.063915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:35.064604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:35.065192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:35.065805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:35.121740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for project b4108462f6954f26868cf2f1b1819046. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:00:35.138906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for user ed2d57d2fe094d6890ddf1888c11b0fd and project b4108462f6954f26868cf2f1b1819046. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:00:35.192595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:00:35.194359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:35.203150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:00:35.211221 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e8c8a96-0bb6-4c24-bd3b-fd8541cd1c04 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1318 microversion: 2.1 time: 0.263567 Nov 02 22:00:35.212369 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3185/6250] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:34 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:35.454691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31b184b3-0332-414d-978c-a2ded612d20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.821017 Nov 02 22:00:35.455913 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3066/6251] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:00:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:00:35.468488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84fe5db5-a201-4355-b0e7-82a0772688e1 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:35.469633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84fe5db5-a201-4355-b0e7-82a0772688e1 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:35.548781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-84fe5db5-a201-4355-b0e7-82a0772688e1 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:35.562199 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84fe5db5-a201-4355-b0e7-82a0772688e1 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1247 microversion: 2.1 time: 0.098745 Nov 02 22:00:35.564368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3186/6252] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:35 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1247 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:36.238982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:36.240808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:36.267152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:36.269710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:36.270644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:36.280673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:36.280673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:36.280673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:36.590889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b434025-88e0-40ef-8845-59085efbffca tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:36.592231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4b434025-88e0-40ef-8845-59085efbffca tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:36.847395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:36.859029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-87b2d7f2-d568-4674-a707-6b709d05ed26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1324 microversion: 2.1 time: 0.624772 Nov 02 22:00:36.861868 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3067/6253] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:36 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:36.916386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4b434025-88e0-40ef-8845-59085efbffca tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:36.925160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b434025-88e0-40ef-8845-59085efbffca tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1247 microversion: 2.1 time: 0.339247 Nov 02 22:00:36.936657 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3187/6254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:36 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1247 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:37.884911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:37.885613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:37.896156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:37.896643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:37.898908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:37.898908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:37.898908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:37.898908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:37.963170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:37.964504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:37.977511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:37.978018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:37.978467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:37.991222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:37.992535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:37.993174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:38.128397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:38.142663 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-49562cb4-ba38-47b7-8e6d-574586ebb6c4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1299 microversion: 2.1 time: 0.195137 Nov 02 22:00:38.143461 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3188/6255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:37 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1299 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:38.188399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:38.197572 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9643039f-d0f5-4698-a0d0-f910a58a732b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.317607 Nov 02 22:00:38.201836 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3068/6256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:37 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:39.169186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:39.169786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:39.184188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:39.191674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:39.193011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:39.195149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:39.199525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:39.199995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:39.221861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:39.222528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:39.243757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:39.247759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:39.247759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:39.247759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:39.247759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:39.253536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:39.532327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:39.548772 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d4c496a-3b82-4f92-a78a-099b85418132 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1307 microversion: 2.1 time: 0.383483 Nov 02 22:00:39.549436 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3189/6257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:39 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1307 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:39.699823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:39.717874 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-13341a6e-ee64-4053-bd6c-ca4e27b87e60 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.499779 Nov 02 22:00:39.739186 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3069/6258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:39 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:40.593114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:40.594570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:40.624473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:40.627134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:40.627134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:40.630849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:40.632662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:40.638483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:40.749392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:40.749996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:40.763000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:40.763498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:40.763941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:40.764652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:40.765134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:40.765566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:40.798269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:40.810055 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6da3a13a-fb71-44be-99c8-a5480b50af23 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1305 microversion: 2.1 time: 0.227865 Nov 02 22:00:40.813298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3190/6259] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:40 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1305 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:40.941893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-169b8d8f-9d73-4cb7-858a-6e9c7e86ea21 req-d4f06f16-01dd-40aa-8f9f-b4a6fe894f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:40.954280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-169b8d8f-9d73-4cb7-858a-6e9c7e86ea21 req-d4f06f16-01dd-40aa-8f9f-b4a6fe894f2d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:40.955242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-169b8d8f-9d73-4cb7-858a-6e9c7e86ea21 req-d4f06f16-01dd-40aa-8f9f-b4a6fe894f2d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:40.956070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-169b8d8f-9d73-4cb7-858a-6e9c7e86ea21 req-d4f06f16-01dd-40aa-8f9f-b4a6fe894f2d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:40.977430 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-169b8d8f-9d73-4cb7-858a-6e9c7e86ea21 req-d4f06f16-01dd-40aa-8f9f-b4a6fe894f2d service nova] Creating event network-changed:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:00:40.987311 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-169b8d8f-9d73-4cb7-858a-6e9c7e86ea21 req-d4f06f16-01dd-40aa-8f9f-b4a6fe894f2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052622 Nov 02 22:00:40.993465 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3191/6260] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:41.393894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:41.410862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15ff5ba1-53be-4ac7-b848-006055e0c03d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.668255 Nov 02 22:00:41.413694 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3070/6261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:40 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:41.847491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:41.850904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:41.888597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:41.888597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:41.888597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:41.888597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:41.892063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:41.897411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:41.900362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:42.441956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:42.443455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:42.460807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:42.461346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:42.463362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:42.465141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:42.471367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:42.476394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:42.481270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:42.495643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09cd2abf-60b9-4e44-90bc-0be72f729d7e tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 0.657761 Nov 02 22:00:42.511088 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3192/6262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:41 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:42.836103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:42.858102 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5255b7c7-493c-489a-98b7-b577da6069d0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.420897 Nov 02 22:00:42.859637 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3071/6263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:42 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:43.525653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:43.526332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:43.542444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:43.542954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:43.543406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:43.544133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:43.547666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:43.550070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:43.767682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:43.768172 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a7a8953-49d8-4926-8074-d6b66fb48dae tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 0.248577 Nov 02 22:00:43.769167 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3193/6264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:43 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:43.888907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:43.890550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:43.910744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:43.913662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:43.914878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:43.915820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:43.916292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:43.916889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:44.134036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:44.147175 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2a9c8b1-af5e-4f43-a8a1-425c64bc71b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.262114 Nov 02 22:00:44.153001 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3072/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:43 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:44.207299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d5b895fb-c3cd-426c-b98c-1fffe709f875 req-c9b341c7-bb27-46cc-864c-fb6a0e2ae898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15cde50d-627a-44cd-a7f0-8e230e23267a", "tag": "4eef3ea8-110f-41e2-b38f-6ce753f25726"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:44.253525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d5b895fb-c3cd-426c-b98c-1fffe709f875 req-c9b341c7-bb27-46cc-864c-fb6a0e2ae898 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:44.256606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d5b895fb-c3cd-426c-b98c-1fffe709f875 req-c9b341c7-bb27-46cc-864c-fb6a0e2ae898 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:44.261356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d5b895fb-c3cd-426c-b98c-1fffe709f875 req-c9b341c7-bb27-46cc-864c-fb6a0e2ae898 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:44.316557 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d5b895fb-c3cd-426c-b98c-1fffe709f875 req-c9b341c7-bb27-46cc-864c-fb6a0e2ae898 service nova] Creating event network-changed:4eef3ea8-110f-41e2-b38f-6ce753f25726 for instance 15cde50d-627a-44cd-a7f0-8e230e23267a on n-h1-860863-4 Nov 02 22:00:44.338800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d5b895fb-c3cd-426c-b98c-1fffe709f875 req-c9b341c7-bb27-46cc-864c-fb6a0e2ae898 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135948 Nov 02 22:00:44.339996 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3194/6266] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:44.793484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:44.794358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:44.814949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:44.821625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:44.826889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:44.831889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:44.835182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:44.835967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:45.084423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:45.179189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:45.180586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:45.181662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:45.192048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:45.193190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:45.194196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:45.195253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:45.195920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:45.196990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:45.867547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:45.884519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-303e7065-4278-4528-aae9-bb95d0bf52c0 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 1.091824 Nov 02 22:00:45.890960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:45.899949 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3073/6267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:44 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:45.920024 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08995e1e-3f57-46ce-99ab-652159ad4f34 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.740901 Nov 02 22:00:45.922197 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3195/6268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:45 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:46.916529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:46.918620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:46.937591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:46.949994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:46.951293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:46.959163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:46.960825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:46.964880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:46.970282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:46.970725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:00:46.986677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:46.991080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:47.002742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:47.006974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:47.010326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:47.011864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:47.018601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:47.765893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:47.773883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:47.790991 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34017a52-ecc3-4fb7-89a4-c44c81287d40 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 0.883784 Nov 02 22:00:47.792138 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16fd491d-46da-4532-b396-66b5e4c93aac tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.846129 Nov 02 22:00:47.803863 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3074/6269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:46 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:47.815528 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3196/6270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:46 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:48.819171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:48.820393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:48.823195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:48.824114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:48.834833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:48.836485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:48.837012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:48.841830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:48.841830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:48.842038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:48.842137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:48.842137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:48.842290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:48.842368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:48.842449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:48.842449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:49.141025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:49.147716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:49.149937 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c44b3032-0c51-46ad-9825-94caeb150c79 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 0.335111 Nov 02 22:00:49.151332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3075/6271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:48 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:49.160854 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-656723d9-9a4e-4a15-b492-c725008936e3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.341364 Nov 02 22:00:49.163692 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3197/6272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:48 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:50.175982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:50.176688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:50.194120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:50.194120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:50.194120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:50.194120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:50.194120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:50.194120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:50.197922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:50.201318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:50.229776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:50.232688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:50.235760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:50.239096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:50.244217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:50.244217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:50.764500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:50.766217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:50.776076 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-965a1d74-4d92-41dd-a1ca-4138b4e58285 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.590158 Nov 02 22:00:50.776698 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3198/6273] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:50 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:50.777541 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47039d0e-4b19-46a5-ab48-aad60a16033a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 0.604715 Nov 02 22:00:50.778658 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3076/6274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:50 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:50.997735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-49a0c4d8-c1d9-4d38-b050-4b2ad1332e98 req-84949ff7-2d9c-45eb-8220-a6874f31bf97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "name": "network-vif-plugged", "status": "completed", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:51.032133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49a0c4d8-c1d9-4d38-b050-4b2ad1332e98 req-84949ff7-2d9c-45eb-8220-a6874f31bf97 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:51.033643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49a0c4d8-c1d9-4d38-b050-4b2ad1332e98 req-84949ff7-2d9c-45eb-8220-a6874f31bf97 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:51.034530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49a0c4d8-c1d9-4d38-b050-4b2ad1332e98 req-84949ff7-2d9c-45eb-8220-a6874f31bf97 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:51.063010 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-49a0c4d8-c1d9-4d38-b050-4b2ad1332e98 req-84949ff7-2d9c-45eb-8220-a6874f31bf97 service nova] Creating event network-vif-plugged:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:00:51.074022 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-49a0c4d8-c1d9-4d38-b050-4b2ad1332e98 req-84949ff7-2d9c-45eb-8220-a6874f31bf97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088707 Nov 02 22:00:51.075457 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3199/6275] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:00:51.810047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:51.812545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:51.813445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:51.816817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:51.850730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:51.851507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:51.851729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:51.852202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:51.857671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:51.858593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:51.860319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:51.861646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:51.862636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:51.866286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:51.866776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:51.868673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:52.355391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:52.365760 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e62649c3-5076-46bd-8ba1-5e50997da66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1391 microversion: 2.1 time: 0.569067 Nov 02 22:00:52.390886 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3077/6276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:51 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1391 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:53.016018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:53.041169 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-54379006-1835-4976-a720-8eaf01862d56 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 1.236762 Nov 02 22:00:53.042196 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3200/6277] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:51 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:53.395175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:53.396375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:53.406907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:53.407398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:53.407841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:53.408547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:53.409639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9cb5db4d-40d1-4f2d-8d31-ee9e4a2b4f9a req-00231748-262e-40ad-9ad5-ae2906442b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15cde50d-627a-44cd-a7f0-8e230e23267a", "name": "network-vif-plugged", "status": "completed", "tag": "4eef3ea8-110f-41e2-b38f-6ce753f25726"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:00:53.418756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:53.419477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:53.430381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9cb5db4d-40d1-4f2d-8d31-ee9e4a2b4f9a req-00231748-262e-40ad-9ad5-ae2906442b5b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:53.430864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9cb5db4d-40d1-4f2d-8d31-ee9e4a2b4f9a req-00231748-262e-40ad-9ad5-ae2906442b5b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:53.431762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9cb5db4d-40d1-4f2d-8d31-ee9e4a2b4f9a req-00231748-262e-40ad-9ad5-ae2906442b5b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:53.448516 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9cb5db4d-40d1-4f2d-8d31-ee9e4a2b4f9a req-00231748-262e-40ad-9ad5-ae2906442b5b service nova] Creating event network-vif-plugged:4eef3ea8-110f-41e2-b38f-6ce753f25726 for instance 15cde50d-627a-44cd-a7f0-8e230e23267a on n-h1-860863-4 Nov 02 22:00:53.461691 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9cb5db4d-40d1-4f2d-8d31-ee9e4a2b4f9a req-00231748-262e-40ad-9ad5-ae2906442b5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057258 Nov 02 22:00:53.462718 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3201/6278] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:00:53.743046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:53.758330 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-416c77cb-b7ab-401c-aaf9-f1ff30ae9762 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1563 microversion: 2.1 time: 0.367067 Nov 02 22:00:53.773712 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3078/6279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:53 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1563 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:53.791341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:53.792752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:53.822281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:53.826074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:53.829279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:53.830961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:53.833857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:53.834456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:54.065942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:54.066587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:54.078370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:54.078866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:54.079318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:54.080023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:54.080484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:54.084494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:54.174203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:54.192045 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6880b951-7c82-4e73-ac62-f58d0a6e0c41 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1563 microversion: 2.1 time: 0.405656 Nov 02 22:00:54.194384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3202/6280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:53 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1563 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:54.445403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:54.453797 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-af6f3aed-8973-47ad-99bb-b11421dd4896 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1373 microversion: 2.1 time: 0.391669 Nov 02 22:00:54.454659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3079/6281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:54 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1373 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:00:55.483719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:55.491197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:55.521678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:55.522254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:55.522742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:55.531623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:55.531623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:55.531623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:56.175105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:56.190322 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7daccac1-ef13-48a3-84c6-747022fafbff tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1545 microversion: 2.1 time: 0.714542 Nov 02 22:00:56.193078 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3203/6282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:55 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1545 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:00:56.218178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:00:56.219432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:00:56.229777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:56.235932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:56.236610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:56.237540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:00:56.238162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:00:56.238746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:00:56.790749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:00:56.805416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3c57ddd-e828-45cb-bb5e-9307ca6a6f74 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1545 microversion: 2.1 time: 0.588820 Nov 02 22:00:56.806366 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3080/6283] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:00:56 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1545 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:00.137000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:00.140386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:00.156721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-469169d9-72be-4c98-96d6-5f3e9903ba91 req-447070d1-fdf9-496f-ac40-69a96e0b4fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:00.170215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:00.182761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:00.183530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:00.185663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:00.194687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:00.195257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:00.211709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-469169d9-72be-4c98-96d6-5f3e9903ba91 req-447070d1-fdf9-496f-ac40-69a96e0b4fa9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:00.212339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-469169d9-72be-4c98-96d6-5f3e9903ba91 req-447070d1-fdf9-496f-ac40-69a96e0b4fa9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:00.215068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-469169d9-72be-4c98-96d6-5f3e9903ba91 req-447070d1-fdf9-496f-ac40-69a96e0b4fa9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:00.273790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=92 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:00.288467 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-469169d9-72be-4c98-96d6-5f3e9903ba91 req-447070d1-fdf9-496f-ac40-69a96e0b4fa9 service nova] Creating event network-changed:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:01:00.308048 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-469169d9-72be-4c98-96d6-5f3e9903ba91 req-447070d1-fdf9-496f-ac40-69a96e0b4fa9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152832 Nov 02 22:01:00.309512 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3081/6284] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 22:01:00.645610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:00.655474 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce8c4236-067d-4fde-9442-f7c4b0ad5df4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1563 microversion: 2.1 time: 0.522277 Nov 02 22:01:00.663914 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3204/6285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:00 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1563 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:18.190863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:18.190863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:18.209130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:18.218933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:18.220791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:18.221683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:18.222707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:18.224577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:18.225663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:18.312313 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca6226ef-019b-4632-9eda-14a50b965a0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action" status: 200 len: 24560 microversion: 2.1 time: 0.130449 Nov 02 22:01:18.317137 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3082/6286] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:01:18 2022] POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action => generated 24560 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:01:20.173381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1292458934", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fb44fb60-635e-46f7-b855-521e4fe23c35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:20.190558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:20.191427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=91 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:20.260471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:01:21.071210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:01:21.071818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:01:21.072363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:01:21.073257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:01:21.073900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:01:21.088035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:21.088731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:21.089435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:21.090359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:21.090983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:21.091598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:21.112846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:01:21.120880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:01:21.227177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:01:21.231664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb44fb60-635e-46f7-b855-521e4fe23c35',volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:01:21.765601 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-711a10a0-099d-4797-a701-73545c7425fd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605600 Nov 02 22:01:21.766845 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3205/6287] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:01:21.778863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19dd4fb4-fbd8-4629-846f-4bfb4494faed tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:21.783232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19dd4fb4-fbd8-4629-846f-4bfb4494faed tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:21.965610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19dd4fb4-fbd8-4629-846f-4bfb4494faed tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:21.986537 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19dd4fb4-fbd8-4629-846f-4bfb4494faed tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1071 microversion: 2.1 time: 0.211806 Nov 02 22:01:21.987154 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3083/6288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:21 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1071 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:23.019126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f2602bd-f2ae-450f-ab41-c09730912030 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:23.022853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f2602bd-f2ae-450f-ab41-c09730912030 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:23.132351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f2602bd-f2ae-450f-ab41-c09730912030 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:23.139965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f2602bd-f2ae-450f-ab41-c09730912030 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1071 microversion: 2.1 time: 0.126125 Nov 02 22:01:23.141445 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3206/6289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:23 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1071 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:24.165543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:24.166106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:24.187842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:24.188636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:24.189351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:24.191115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:24.192703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:24.194883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:24.401169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:24.412857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ea0702f-a73a-45d5-a106-853946467ddc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1169 microversion: 2.1 time: 0.251091 Nov 02 22:01:24.415650 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3084/6290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:24 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1169 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:24.763045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:24.763045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:24.763649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:24.763649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:24.772867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:24.773920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:24.774624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:24.775825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:24.776541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:24.777209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:24.791269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:24.791829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:24.792291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:24.793057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:24.793524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:24.793967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:24.860288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:01:25.179689 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72f33f75-5868-4c45-b56e-a79cf32a9da1 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1833 microversion: 2.1 time: 0.417140 Nov 02 22:01:25.215265 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3085/6291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:24 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1833 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:25.235276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:25.235920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:25.251189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:25.251707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:25.252157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:25.252880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:25.253378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:25.253817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:25.286509 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ae05a40-97d6-46b3-9f31-35eb0362a4bf tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 204 len: 0 microversion: 2.1 time: 0.531244 Nov 02 22:01:25.287434 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3207/6292] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:01:24 2022] DELETE /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:01:25.307115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:25.323211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:25.351964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:25.351964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:25.351964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:25.351964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:25.356355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:25.362302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:25.775136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:25.788359 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81ed33c6-8f6c-496d-bc97-41d146d1d004 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1682 microversion: 2.1 time: 0.569665 Nov 02 22:01:25.790326 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3086/6293] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:25 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1682 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:25.798413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:25.799122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:25.815704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:25.827205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:25.828863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:25.832777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:25.834743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:25.837408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:25.889896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:25.901314 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f99ab5bf-aa16-4a44-abed-5d2687ee642f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1551 microversion: 2.1 time: 0.605648 Nov 02 22:01:25.909917 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3208/6294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:25 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1551 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:26.066764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:26.089062 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7070f8ff-8009-42fc-a8bb-37089829e6c3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1187 microversion: 2.1 time: 0.297518 Nov 02 22:01:26.109579 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3087/6295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:25 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1187 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:26.112840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:26.116672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:26.148253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:26.150100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:26.150762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:26.164535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:26.164535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:26.164535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:26.286011 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3470ffc6-eaa4-407b-b65d-f94d026598d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action" status: 200 len: 32629 microversion: 2.1 time: 0.183729 Nov 02 22:01:26.290217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3209/6296] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:01:26 2022] POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action => generated 32629 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:01:26.500072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:26.504337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:26.514111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:26.514852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:26.515458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:26.516332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:26.516981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:26.525765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:26.627047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc86be9b6b43469894152a5afc613d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19816276b1244e8c919901dbf46ea96a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:26.634264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 860026f0-896b-4371-9434-b880d1ef1573] flavor_id is None. Assuming migration. {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 02 22:01:26.636533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:01:26.941823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:26.943833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:26.972458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:26.975739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:26.976288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:26.977093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:26.980685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:26.983042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:27.079619 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c5e1360-635b-4eb6-81c4-662eb81e271b tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action" status: 202 len: 0 microversion: 2.1 time: 0.581277 Nov 02 22:01:27.080248 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3088/6297] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:01:26 2022] POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:01:27.096584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:27.100002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:27.141557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:27.146507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:27.152245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:27.154185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:27.159251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:27.161705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:27.647037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:27.655984 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48c0c317-6e9a-46ab-a458-c06cc46da565 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1551 microversion: 2.1 time: 0.719392 Nov 02 22:01:27.682849 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3210/6298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:26 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1551 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:27.690845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:27.691602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:27.730261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:27.732477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:27.734033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:27.740279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:27.740858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:27.741340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:27.994750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:28.032393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:28.035271 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-de027ad6-c09f-452e-94fb-21b413a9b05e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1691 microversion: 2.1 time: 0.924661 Nov 02 22:01:28.038293 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3089/6299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:27 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1691 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:28.047647 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-faac134c-b5ee-49f8-a34d-d96bdc211cc2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1187 microversion: 2.1 time: 0.360519 Nov 02 22:01:28.048247 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3211/6300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:27 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1187 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:28.682342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:28.683509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:28.697876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:28.698381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:28.698836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:28.699568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:28.700033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:28.700459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:28.867987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-455142c3-e6e0-4dbd-9128-89ae516f97a9 req-e5087812-406b-4d90-9c6f-f03a94ca69b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15cde50d-627a-44cd-a7f0-8e230e23267a", "name": "network-vif-deleted", "tag": "4eef3ea8-110f-41e2-b38f-6ce753f25726"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:28.893165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:28.910236 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-954756dc-e0db-417d-a54d-3afe5fd7bd47 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1483 microversion: 2.1 time: 0.232412 Nov 02 22:01:28.917564 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3090/6301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:28 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1483 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:28.950346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-455142c3-e6e0-4dbd-9128-89ae516f97a9 req-e5087812-406b-4d90-9c6f-f03a94ca69b3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:28.954366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-455142c3-e6e0-4dbd-9128-89ae516f97a9 req-e5087812-406b-4d90-9c6f-f03a94ca69b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:28.958491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-455142c3-e6e0-4dbd-9128-89ae516f97a9 req-e5087812-406b-4d90-9c6f-f03a94ca69b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:29.048503 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-455142c3-e6e0-4dbd-9128-89ae516f97a9 req-e5087812-406b-4d90-9c6f-f03a94ca69b3 service nova] Creating event network-vif-deleted:4eef3ea8-110f-41e2-b38f-6ce753f25726 for instance 15cde50d-627a-44cd-a7f0-8e230e23267a on n-h1-860863-4 Nov 02 22:01:29.079014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:29.080438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:29.106379 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-455142c3-e6e0-4dbd-9128-89ae516f97a9 req-e5087812-406b-4d90-9c6f-f03a94ca69b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236099 Nov 02 22:01:29.116506 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3212/6302] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:01:29.120084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:29.127459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:29.129160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:29.139215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:29.145294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:29.156067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:29.175288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:29.179111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:29.211821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:29.212513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:29.213726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:29.226512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:29.227916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:29.228555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:29.907147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:29.919514 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ae370897-20b8-4535-8cb1-cb57e0c35bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1229 microversion: 2.1 time: 0.796275 Nov 02 22:01:29.920121 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3213/6303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:29 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1229 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:29.944559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:29.945521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:29.961136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:29.961896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:29.962723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:29.963639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:29.964267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:29.964860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:29.992659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:30.007657 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e5d6f3d-3603-46e9-8b6e-606fa6401efd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1691 microversion: 2.1 time: 0.932852 Nov 02 22:01:30.010449 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3091/6304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:29 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1691 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:30.040241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:30.041041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:30.041645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:30.042261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lazy-loading 'fault' on Instance uuid 15cde50d-627a-44cd-a7f0-8e230e23267a {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:01:30.130121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:30.144144 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-288db35b-bbea-48ee-88b9-d8489f8b8fb4 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 200 len: 1337 microversion: 2.1 time: 0.203930 Nov 02 22:01:30.153095 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3214/6305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:29 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 1337 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:30.945961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:30.946673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:30.971581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:30.972540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:30.973336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:30.974826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:30.975820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:30.976606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:31.049066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:31.051468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:31.070023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:31.078542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:31.079173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:31.080040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:31.080749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:31.081429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:31.123476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:31.506593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:31.523747 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5cfd788f-3506-44b0-8df8-3c824a50209c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1229 microversion: 2.1 time: 0.582418 Nov 02 22:01:31.536987 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3092/6306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:30 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1229 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:31.538393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:31.538957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: 15cde50d-627a-44cd-a7f0-8e230e23267a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:31.573741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:31.573741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:31.573741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:31.573741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:31.573741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:31.573741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:31.588541 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] HTTP exception thrown: Instance 15cde50d-627a-44cd-a7f0-8e230e23267a could not be found. Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Request method failure captured: Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a HTTP/1.1 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuggNoGcRU_63V01mbd6hqyjt_dyATQXmaFQ47Wlnqvcs2gf4s8TDWL3v9VauiGLO9gHDkWIuyUpLIG3Ha7NSDkuOdWm7C0tn_nTnMb-LEsRSGKQuocD0C2ho8j3gkshZt2FzYVOeNaWbbX3c99xXJPheHprR0Y0Pag8c4biRMrBtQE Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b4108462f6954f26868cf2f1b1819046 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4108462f6954f26868cf2f1b1819046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b4108462f6954f26868cf2f1b1819046 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestNetworkBasicOps-1659074523-project Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: ed2d57d2fe094d6890ddf1888c11b0fd Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestNetworkBasicOps-1659074523-project Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 15cde50d-627a-44cd-a7f0-8e230e23267a could not be found. Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '15cde50d-627a-44cd-a7f0-8e230e23267a'} Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15cde50d-627a-44cd-a7f0-8e230e23267a could not be found. Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15cde50d-627a-44cd-a7f0-8e230e23267a could not be found. Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:01:31.596062 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15cde50d-627a-44cd-a7f0-8e230e23267a could not be found. Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Returning 404 to user: Instance 15cde50d-627a-44cd-a7f0-8e230e23267a could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-34280e00-9fd7-417d-af4e-2195901df12b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a" status: 404 len: 111 microversion: 2.1 time: 0.067063 Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3093/6307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:31 2022] GET /compute/v2.1/servers/15cde50d-627a-44cd-a7f0-8e230e23267a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:01:31.601771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-60a826f5-642b-4f75-9cae-c5621b442dd9 req-4d63f298-bc07-4bf9-ab12-185418629a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b998f3-2b02-4a29-b08a-92cb0f176e2b", "tag": "6660e040-aa02-4acd-8ee1-a34e4768e15c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:31.610908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-60a826f5-642b-4f75-9cae-c5621b442dd9 req-4d63f298-bc07-4bf9-ab12-185418629a4e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:31.611401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-60a826f5-642b-4f75-9cae-c5621b442dd9 req-4d63f298-bc07-4bf9-ab12-185418629a4e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:31.611841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-60a826f5-642b-4f75-9cae-c5621b442dd9 req-4d63f298-bc07-4bf9-ab12-185418629a4e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:31.626152 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-60a826f5-642b-4f75-9cae-c5621b442dd9 req-4d63f298-bc07-4bf9-ab12-185418629a4e service nova] Creating event network-changed:6660e040-aa02-4acd-8ee1-a34e4768e15c for instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b on n-h2-860863-4 Nov 02 22:01:31.630003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:31.631828 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-60a826f5-642b-4f75-9cae-c5621b442dd9 req-4d63f298-bc07-4bf9-ab12-185418629a4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037049 Nov 02 22:01:31.632820 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3094/6308] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:01:31.642317 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e865606-f38c-4181-8015-1d84dae1a3b9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1691 microversion: 2.1 time: 0.608797 Nov 02 22:01:31.642317 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3215/6309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:31 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1691 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:32.236857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:32.242323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c94d8d79-c89b-4133-bc89-d8d9bd5bb3e6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '.version_select at 0x7f9b69175a60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:32.389556 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c94d8d79-c89b-4133-bc89-d8d9bd5bb3e6 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-28687776" status: 202 len: 0 microversion: 2.1 time: 0.142258 Nov 02 22:01:32.389556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3095/6310] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 22:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-28687776 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:01:32.551981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:32.552828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:32.562877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:32.568035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:32.568627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:32.577300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:32.578179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:32.580286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:32.667478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:32.672135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:32.693886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:32.694585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:32.695359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:32.696295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:32.696973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:32.697600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:33.054282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:33.079491 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-68d8b696-b548-4c74-be82-107aadbacfea tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1229 microversion: 2.1 time: 0.533088 Nov 02 22:01:33.088196 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3216/6311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:32 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1229 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:33.143745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:33.167048 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fc817c7b-9d16-4a7e-a1f1-136001e12088 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1691 microversion: 2.1 time: 0.504587 Nov 02 22:01:33.185866 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3096/6312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:32 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1691 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:34.111008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:34.112992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:34.119692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:34.124148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:34.124902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:34.125586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:34.126948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:34.127597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:34.128218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:34.200141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:34.202184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:34.213127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:34.213887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:34.214641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:34.216241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:34.217132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:34.218065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:34.583662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:34.605121 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c479ac6c-bdac-4854-b035-9186f9ce7004 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1229 microversion: 2.1 time: 0.501913 Nov 02 22:01:34.606155 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3217/6313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:34 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1229 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:34.785758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:34.797366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30b68416-63b9-44fc-bfd4-3dd0b6cf125d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1691 microversion: 2.1 time: 0.602543 Nov 02 22:01:34.803099 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3097/6314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:34 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1691 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:35.646504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:35.647288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:35.665568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:35.666322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:35.667157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:35.668103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:35.668977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:35.670362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:35.838848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:35.845179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:35.868283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:35.868283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:35.868283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:35.869443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:35.870063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:35.870657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:36.287692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:36.297069 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d0be99bc-a147-4b56-969f-2dd3534f46db tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1229 microversion: 2.1 time: 0.655450 Nov 02 22:01:36.325203 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3218/6315] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:35 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1229 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:36.361563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:36.372801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89a8d633-89e9-41de-baaa-5b847be18fbd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.539573 Nov 02 22:01:36.385823 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3098/6316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:35 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:37.038618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:37.039189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:37.061789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.065076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.065661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.066811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.071312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.072146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.087999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1add2018-1be0-481f-9287-9a79bb08d5b0 req-a263e2e5-42b2-4f81-b3e3-635627f0f5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba65780f-947b-4884-9836-dd5c6cda5701", "tag": "3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:37.120738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1add2018-1be0-481f-9287-9a79bb08d5b0 req-a263e2e5-42b2-4f81-b3e3-635627f0f5e9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.124870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1add2018-1be0-481f-9287-9a79bb08d5b0 req-a263e2e5-42b2-4f81-b3e3-635627f0f5e9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.126016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1add2018-1be0-481f-9287-9a79bb08d5b0 req-a263e2e5-42b2-4f81-b3e3-635627f0f5e9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.171127 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1add2018-1be0-481f-9287-9a79bb08d5b0 req-a263e2e5-42b2-4f81-b3e3-635627f0f5e9 service nova] Creating event network-changed:3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730 for instance ba65780f-947b-4884-9836-dd5c6cda5701 on n-h1-860863-4 Nov 02 22:01:37.188251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:01:37.190543 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1add2018-1be0-481f-9287-9a79bb08d5b0 req-a263e2e5-42b2-4f81-b3e3-635627f0f5e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115989 Nov 02 22:01:37.191159 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3099/6317] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:01:37.328468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:37.329220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:37.352256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.352796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.356361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.356361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.356361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.356361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.637995 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d235626c-a12b-4de2-843e-c0d1eade8aec tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 204 len: 0 microversion: 2.1 time: 0.610282 Nov 02 22:01:37.641758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3219/6318] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:01:37 2022] DELETE /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:01:37.645925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:37.650457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:37.659895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:37.666588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.668735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.668735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.669204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.669749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.670258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.685919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a270e0f-648f-4721-bb3c-e5654e78cf23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1229 microversion: 2.1 time: 0.362477 Nov 02 22:01:37.704604 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3100/6319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:37 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1229 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:37.704604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:37.704604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:37.711898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:37.735656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.747233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.747740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.753928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:37.754432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:37.757471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:37.768761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:38.036578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:38.048204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-881d9b9a-62bb-4817-8540-e0d437e25906 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1671 microversion: 2.1 time: 0.356455 Nov 02 22:01:38.050330 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3101/6320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:37 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1671 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:38.087582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:38.101364 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15e6e845-5ee8-4c27-8dbe-1c6ff89dd55a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.460881 Nov 02 22:01:38.102655 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3220/6321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:37 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:38.722132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:38.722757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:38.729932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:38.730435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:38.731056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:38.731993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:38.732611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:38.733237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:38.896359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:38.904862 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d6909bfe-6621-4bd0-a2e8-bd52196d5a0d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.196796 Nov 02 22:01:38.912993 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3102/6322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:38 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:39.075680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:39.076299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:39.096507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:39.097230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:39.102009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:39.102857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:39.103348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:39.103796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:39.130912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:39.131535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:39.140468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:39.141011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:39.143468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:39.146988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:39.147458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:39.151829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:39.578975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:39.586315 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a92d98b-5d52-4c17-a67f-cda1f72b64cb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1671 microversion: 2.1 time: 0.514460 Nov 02 22:01:39.586918 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3221/6323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:39 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1671 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:39.596716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:39.612061 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d7e11f9a-7e91-49d9-86cd-9bfa1d0e0ee4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.485195 Nov 02 22:01:39.628972 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3103/6324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:39 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:39.935680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:39.937512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:39.948286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:39.948795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:39.950573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:39.951304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:39.951773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:39.952215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:40.184164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-11a622b5-4da9-43b0-b4e6-62708b6ba8e2 req-210359e5-d868-4dc2-af84-f5440f335d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba65780f-947b-4884-9836-dd5c6cda5701", "name": "network-vif-deleted", "tag": "3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:40.208887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-11a622b5-4da9-43b0-b4e6-62708b6ba8e2 req-210359e5-d868-4dc2-af84-f5440f335d38 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:40.209445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-11a622b5-4da9-43b0-b4e6-62708b6ba8e2 req-210359e5-d868-4dc2-af84-f5440f335d38 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:40.209902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-11a622b5-4da9-43b0-b4e6-62708b6ba8e2 req-210359e5-d868-4dc2-af84-f5440f335d38 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:40.242838 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-11a622b5-4da9-43b0-b4e6-62708b6ba8e2 req-210359e5-d868-4dc2-af84-f5440f335d38 service nova] Creating event network-vif-deleted:3e63e37a-e4f2-46e4-a09b-3bc7c6ed2730 for instance ba65780f-947b-4884-9836-dd5c6cda5701 on n-h1-860863-4 Nov 02 22:01:40.251771 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-11a622b5-4da9-43b0-b4e6-62708b6ba8e2 req-210359e5-d868-4dc2-af84-f5440f335d38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071040 Nov 02 22:01:40.252377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3104/6325] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:01:40.297439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:40.314241 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29a08ad4-fce9-4a0a-8343-233e540ed457 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.384009 Nov 02 22:01:40.325117 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3222/6326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:39 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:40.616199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:40.617367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:40.624422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:40.625279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:40.625955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:40.627370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:40.628185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:40.628861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:40.642172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:40.642873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:40.656344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:40.657438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:40.660171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:40.663222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:40.663924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:40.664556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:40.725202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:40.726506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:40.727041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:40.727573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lazy-loading 'fault' on Instance uuid ba65780f-947b-4884-9836-dd5c6cda5701 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:01:40.847442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:40.858959 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44cab8d3-e8bb-4a84-9ddc-15abf8df2c63 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 200 len: 1338 microversion: 2.1 time: 0.249285 Nov 02 22:01:40.859728 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3105/6327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:40 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 1338 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:40.945645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:40.956147 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da3ad850-e663-4ad9-b5a5-7211642074c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.317741 Nov 02 22:01:40.965727 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3223/6328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:40 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:41.339696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:41.340424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:41.347587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:41.348076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:41.350162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:41.350891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:41.351351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:41.351787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:41.535062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:41.549029 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a8c111ff-0c29-4d22-be52-0708ff574a5b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.213337 Nov 02 22:01:41.549634 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3106/6329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:41 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:41.884531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:41.885237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ba65780f-947b-4884-9836-dd5c6cda5701] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:41.892632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:41.892860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:41.893341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:41.894051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:41.894513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:41.894954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:41.910430 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] HTTP exception thrown: Instance ba65780f-947b-4884-9836-dd5c6cda5701 could not be found. Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Request method failure captured: Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 HTTP/1.1 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuggNoGcRU_63V01mbd6hqyjt_dyATQXmaFQ47Wlnqvcs2gf4s8TDWL3v9VauiGLO9gHDkWIuyUpLIG3Ha7NSDkuOdWm7C0tn_nTnMb-LEsRSGKQuocD0C2ho8j3gkshZt2FzYVOeNaWbbX3c99xXJPheHprR0Y0Pag8c4biRMrBtQE Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: b4108462f6954f26868cf2f1b1819046 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4108462f6954f26868cf2f1b1819046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: b4108462f6954f26868cf2f1b1819046 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestNetworkBasicOps-1659074523-project Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: ed2d57d2fe094d6890ddf1888c11b0fd Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestNetworkBasicOps-1659074523-project Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance ba65780f-947b-4884-9836-dd5c6cda5701 could not be found. Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'ba65780f-947b-4884-9836-dd5c6cda5701'} Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba65780f-947b-4884-9836-dd5c6cda5701 could not be found. Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba65780f-947b-4884-9836-dd5c6cda5701 could not be found. Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:01:41.913523 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba65780f-947b-4884-9836-dd5c6cda5701 could not be found. Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Returning 404 to user: Instance ba65780f-947b-4884-9836-dd5c6cda5701 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddb20d04-8909-4859-addd-e13c016e4f7b tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701" status: 404 len: 111 microversion: 2.1 time: 0.035257 Nov 02 22:01:41.918332 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3224/6330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:41 2022] GET /compute/v2.1/servers/ba65780f-947b-4884-9836-dd5c6cda5701 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:01:41.981578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:41.982861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:41.995596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:41.997977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:41.998726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:42.002055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:42.002563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:42.003718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:42.219458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:42.231440 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ed5f6e85-7943-4197-8231-1bb288bcd832 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.252839 Nov 02 22:01:42.232088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3107/6331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:41 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:42.321491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-635f307f-67b0-47a9-8c85-01889c25a20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '.version_select at 0x7f9b68dfb430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:42.467820 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-635f307f-67b0-47a9-8c85-01889c25a20c tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-829192132" status: 202 len: 0 microversion: 2.1 time: 0.151743 Nov 02 22:01:42.468506 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3225/6332] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 22:01:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-829192132 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:01:42.577950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:42.578717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:42.587937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:42.588590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:42.589662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:42.590535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:42.591231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:42.591807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:42.768665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:42.778484 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0593921f-19c6-4c0e-a6be-2d535032e8a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.206084 Nov 02 22:01:42.779063 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3108/6333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:42 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:43.261900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:43.263027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:43.275841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:43.276357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:43.277579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:43.278495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:43.279132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:43.280047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:43.802347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:43.803251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:43.823754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:43.823754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:43.823754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:43.823754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:43.823754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:43.824732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:43.877835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:43.894057 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-87b561fe-8d0d-4d97-ae40-aa67cedd1996 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.640318 Nov 02 22:01:43.895462 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3226/6334] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:43 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:44.050741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:44.062342 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bfd7111d-fbb1-4e64-adb1-8cca67e9f7d4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.264580 Nov 02 22:01:44.063581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3109/6335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:43 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:44.927073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:44.927874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:44.943982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:44.952711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:44.953317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:44.956169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:44.958625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:44.960220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:45.089667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:45.089667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:45.098553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:45.099105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:45.099737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:45.100511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:45.101172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:45.101759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:45.539580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:45.549919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf65bd0d-808b-4959-83be-da564d1532a5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.465759 Nov 02 22:01:45.550901 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3110/6336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:45 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:45.570141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:45.578307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96da3d90-94be-49ee-b2a3-ccd8ce881543 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.658136 Nov 02 22:01:45.578893 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3227/6337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:44 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:46.603722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:46.605100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:46.614393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:46.614897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:46.615551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:46.616280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:46.616741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:46.617239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:46.903993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:46.922306 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8cd4b8c3-4263-4eaa-855d-f57c6d171575 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1696 microversion: 2.1 time: 0.322373 Nov 02 22:01:46.943197 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3228/6338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:46 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1696 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:47.050647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:47.051994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:47.061696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:47.062787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:47.063518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:47.064540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:47.065426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:47.066042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:47.338825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:47.349696 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-acda1195-7e51-421c-96ab-131f92f23901 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.780596 Nov 02 22:01:47.356091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3111/6339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:46 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:47.949839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:47.951000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:47.966224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:47.969647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:47.969647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:47.969647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:47.969647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:47.969647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:48.372975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:48.374235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:48.384516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:48.389602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:48.390282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:48.392053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:48.392544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:48.393009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:48.517841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:48.529645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b779434d-8b7a-4201-81c0-2d2ec503a072 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1695 microversion: 2.1 time: 0.583782 Nov 02 22:01:48.532525 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3229/6340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:47 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1695 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:48.807231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:48.817829 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-393d961d-f318-4258-a5df-b75c042b6e62 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.447923 Nov 02 22:01:48.818942 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3112/6341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:48 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:49.034530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5d0bbf50-a993-4693-af3d-8568892c6ba6 req-e8b46c78-1b7b-4aac-8287-305332f0324b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "name": "network-vif-unplugged", "status": "completed", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:49.055479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7ac15cc2-f040-430c-8ebf-d43ba2789fd2 req-82069697-bf50-4609-9111-61df3ccecca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b998f3-2b02-4a29-b08a-92cb0f176e2b", "name": "network-vif-plugged", "status": "completed", "tag": "6660e040-aa02-4acd-8ee1-a34e4768e15c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:49.060882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5d0bbf50-a993-4693-af3d-8568892c6ba6 req-e8b46c78-1b7b-4aac-8287-305332f0324b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:49.061406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5d0bbf50-a993-4693-af3d-8568892c6ba6 req-e8b46c78-1b7b-4aac-8287-305332f0324b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:49.064626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5d0bbf50-a993-4693-af3d-8568892c6ba6 req-e8b46c78-1b7b-4aac-8287-305332f0324b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:49.073244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ac15cc2-f040-430c-8ebf-d43ba2789fd2 req-82069697-bf50-4609-9111-61df3ccecca9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:49.075891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ac15cc2-f040-430c-8ebf-d43ba2789fd2 req-82069697-bf50-4609-9111-61df3ccecca9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:49.076337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ac15cc2-f040-430c-8ebf-d43ba2789fd2 req-82069697-bf50-4609-9111-61df3ccecca9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:49.082433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5d0bbf50-a993-4693-af3d-8568892c6ba6 req-e8b46c78-1b7b-4aac-8287-305332f0324b service nova] Creating event network-vif-unplugged:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h1-860863-4 Nov 02 22:01:49.088973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-5d0bbf50-a993-4693-af3d-8568892c6ba6 req-e8b46c78-1b7b-4aac-8287-305332f0324b service nova] Instance 860026f0-896b-4371-9434-b880d1ef1573 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:01:49.107957 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7ac15cc2-f040-430c-8ebf-d43ba2789fd2 req-82069697-bf50-4609-9111-61df3ccecca9 service nova] Creating event network-vif-plugged:6660e040-aa02-4acd-8ee1-a34e4768e15c for instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b on n-h2-860863-4 Nov 02 22:01:49.111565 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5d0bbf50-a993-4693-af3d-8568892c6ba6 req-e8b46c78-1b7b-4aac-8287-305332f0324b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072853 Nov 02 22:01:49.115281 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3230/6342] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:01:49.117442 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7ac15cc2-f040-430c-8ebf-d43ba2789fd2 req-82069697-bf50-4609-9111-61df3ccecca9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068925 Nov 02 22:01:49.119500 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3113/6343] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:01:49.555776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:49.556491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:49.563557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:49.564050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:49.564487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:49.565283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:49.566616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:49.567622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:49.844402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:49.845054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:49.869544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:49.870115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:49.870561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:49.871287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:49.871742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:49.872172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:50.478533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:50.490029 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-07c6bda7-df4d-4637-a5bf-f563b31716ea tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1695 microversion: 2.1 time: 0.937778 Nov 02 22:01:50.491185 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3231/6344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:49 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1695 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:50.563931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:50.573389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b522ef9-8169-4de3-840b-6bcdffb92f67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1217 microversion: 2.1 time: 0.734395 Nov 02 22:01:50.585193 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3114/6345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:49 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1217 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:51.222725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b94f8f92-8b81-4d0d-bf8b-fa948708335b req-0312ebdf-440e-4d6b-935f-6a56e5ffefc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:51.248482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:51.253201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b94f8f92-8b81-4d0d-bf8b-fa948708335b req-0312ebdf-440e-4d6b-935f-6a56e5ffefc7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:51.255530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b94f8f92-8b81-4d0d-bf8b-fa948708335b req-0312ebdf-440e-4d6b-935f-6a56e5ffefc7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:51.255982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b94f8f92-8b81-4d0d-bf8b-fa948708335b req-0312ebdf-440e-4d6b-935f-6a56e5ffefc7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:51.282644 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b94f8f92-8b81-4d0d-bf8b-fa948708335b req-0312ebdf-440e-4d6b-935f-6a56e5ffefc7 service nova] Creating event network-changed:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h1-860863-4 Nov 02 22:01:51.324680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-b94f8f92-8b81-4d0d-bf8b-fa948708335b req-0312ebdf-440e-4d6b-935f-6a56e5ffefc7 service nova] Instance 860026f0-896b-4371-9434-b880d1ef1573 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:01:51.340212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b94f8f92-8b81-4d0d-bf8b-fa948708335b req-0312ebdf-440e-4d6b-935f-6a56e5ffefc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121250 Nov 02 22:01:51.344577 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3232/6346] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:01:51.514493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:51.515802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:51.531665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:51.533654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:51.533654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:51.534139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:51.534787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:51.535410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:51.598590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:51.600400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:51.610511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:51.611378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:51.612235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:51.613200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:51.614522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:51.615117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:52.286406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:52.296274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:52.298706 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cb834c50-37ed-4cb5-b492-471afa612782 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1695 microversion: 2.1 time: 0.788446 Nov 02 22:01:52.300468 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3115/6347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:51 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1695 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:52.309932 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c624c999-8d47-4063-b865-9da28bcdad5c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1404 microversion: 2.1 time: 0.713677 Nov 02 22:01:52.309932 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3233/6348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:51 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:52.340708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:52.342587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:52.349291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:52.350926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:52.351479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:52.352557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:52.353403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:52.353924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:52.354426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:53.108661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:53.133013 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1b1b32b-d2ba-4689-86ad-07adfff729a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1404 microversion: 2.1 time: 0.795478 Nov 02 22:01:53.134387 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3116/6349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:52 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1404 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:53.159763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2122119027"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:53.162637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:53.185503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:53.185997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:53.186439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:53.187403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:53.187877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:53.188291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:53.328713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:53.329559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:53.344317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:53.344967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:53.345603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:53.347142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:53.347885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:53.349157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:53.353124 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.api [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Attempting to quiesce instance before volume snapshot. Nov 02 22:01:53.436466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.api [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 02 22:01:53.554491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:53.570726 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d1329dd0-4613-4d08-9f0b-464c0f0ca4c4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1695 microversion: 2.1 time: 0.248158 Nov 02 22:01:53.571605 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3117/6350] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:53 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1695 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:53.844580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Creating snapshot from volume fb44fb60-635e-46f7-b855-521e4fe23c35. {{(pid=121040) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Nov 02 22:01:54.598038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:54.599977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:54.615919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:54.616421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:54.616866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:54.621766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:54.625255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:54.625827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:55.062248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:55.075276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:55.078883 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f7462862-a8e1-44de-a4bc-f0fa5c226651 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1693 microversion: 2.1 time: 0.485771 Nov 02 22:01:55.080634 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3118/6351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:54 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1693 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:56.106661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:56.107950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:56.133990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:56.134690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:56.137545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:56.145760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:56.145760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:56.145760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:56.486641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d62e313a-422a-42b4-b645-d283b5719b87 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b/action" status: 202 len: 0 microversion: 2.1 time: 3.330969 Nov 02 22:01:56.494264 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3234/6352] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:01:53 2022] POST /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b/action => generated 0 bytes in 3333 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 22:01:56.546869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:56.575133 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c754a90e-5902-4860-bcb7-63ad0832e981 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1690 microversion: 2.1 time: 0.468858 Nov 02 22:01:56.575133 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3119/6353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:56 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1690 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:01:56.605638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:56.607671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:56.614938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:56.615855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:56.620057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:56.621282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:56.622417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:56.623032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:56.913128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:01:57.108355 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8874064-d8d4-41a9-89a2-35a030bdea9a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action" status: 202 len: 0 microversion: 2.1 time: 0.513594 Nov 02 22:01:57.109398 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3235/6354] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:01:56 2022] POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 22:01:57.118829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:57.119445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:57.152258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:57.172515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:57.174441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:57.175564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:57.179924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:57.180384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:57.818605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:01:57.845735 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6d847c2f-5e0a-4d34-8442-5053da2d8659 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 0.714340 Nov 02 22:01:57.845735 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3120/6355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:57 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:01:58.861577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:01:58.862398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:01:58.885775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:58.890688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:58.891765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:58.899079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:01:58.899906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:01:58.901833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:01:59.032030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-784626467", "imageRef": "fec178b6-6df9-4a26-80e9-cdcc4bec5147", "flavorRef": "452", "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:01:59.156360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:02:00.523064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:00.535083 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e1e1a17-c915-465f-be78-cd66003cda69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 1.679065 Nov 02 22:02:00.543485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3236/6356] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:01:58 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:00.947247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:02:00.948869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:02:00.951082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:02:00.951082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:02:00.951082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:02:00.962138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:00.962633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:00.963079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:00.963811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:00.964268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:00.964754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:00.996765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:02:01.007737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:02:01.046894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:02:01.049766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b0ad29a1-0d37-4ef7-b050-846192af083c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:02:01.287034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-afffb223-f087-47f6-949c-52a84183b862 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.259683 Nov 02 22:02:01.294590 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3121/6357] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:02:01.299897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-73a94a09-1c40-4302-8d51-5f19a195fd7d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:01.301181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-73a94a09-1c40-4302-8d51-5f19a195fd7d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:01.440439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-73a94a09-1c40-4302-8d51-5f19a195fd7d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:01.454757 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-73a94a09-1c40-4302-8d51-5f19a195fd7d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1229 microversion: 2.1 time: 0.154605 Nov 02 22:02:01.454757 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3237/6358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:01 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:01.569722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:01.571236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:01.591819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:01.592510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:01.593584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:01.596116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:01.599752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:01.604153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:01.910323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-01b0ab5c-3ae8-4edf-8808-cf756847775e req-f4863a95-97a1-4230-a001-c042719fc47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "name": "network-vif-plugged", "status": "completed", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:01.947960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-01b0ab5c-3ae8-4edf-8808-cf756847775e req-f4863a95-97a1-4230-a001-c042719fc47e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:01.949026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-01b0ab5c-3ae8-4edf-8808-cf756847775e req-f4863a95-97a1-4230-a001-c042719fc47e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:01.949898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-01b0ab5c-3ae8-4edf-8808-cf756847775e req-f4863a95-97a1-4230-a001-c042719fc47e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:01.969837 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-01b0ab5c-3ae8-4edf-8808-cf756847775e req-f4863a95-97a1-4230-a001-c042719fc47e service nova] Creating event network-vif-plugged:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h1-860863-4 Nov 02 22:02:01.983592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-01b0ab5c-3ae8-4edf-8808-cf756847775e req-f4863a95-97a1-4230-a001-c042719fc47e service nova] Instance 860026f0-896b-4371-9434-b880d1ef1573 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:02:02.058620 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-01b0ab5c-3ae8-4edf-8808-cf756847775e req-f4863a95-97a1-4230-a001-c042719fc47e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120112 Nov 02 22:02:02.058620 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3238/6359] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:02.071730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:02.085171 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-73589cf5-e989-4f39-86e9-04f77ddfc290 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 0.523632 Nov 02 22:02:02.086116 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3122/6360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:01 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:02.476987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9d6ee34b-f11e-4cb9-acab-f73c924a4236 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:02.478157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9d6ee34b-f11e-4cb9-acab-f73c924a4236 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:02.575952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9d6ee34b-f11e-4cb9-acab-f73c924a4236 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:02.586894 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9d6ee34b-f11e-4cb9-acab-f73c924a4236 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1229 microversion: 2.1 time: 0.114733 Nov 02 22:02:02.588563 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3239/6361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:02 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1229 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:03.110960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:03.111594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:03.123967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:03.124868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:03.125047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:03.126013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:03.126710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:03.127151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:03.470301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:03.483652 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9e18dd9d-b76d-42f8-bc97-a4282b2aebab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 0.377450 Nov 02 22:02:03.501075 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3123/6362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:03 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:03.614349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:03.615707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:03.624490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:03.625254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:03.638099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:03.639251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:03.639858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:03.640380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:03.801646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:03.812729 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2c25109-e0ab-4de8-8bd3-de0063953f46 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1281 microversion: 2.1 time: 0.202530 Nov 02 22:02:03.830086 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3240/6363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:03 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1281 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:04.513785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:04.515138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:04.528599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:04.529353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:04.530628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:04.541357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:04.542713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:04.548344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:04.559751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-571cf2a9-99f7-4771-b48c-dd1dfac17bb6 req-aafb9d1b-076e-44ca-8f29-550f869ca1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "name": "network-vif-unplugged", "status": "completed", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:04.586178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-571cf2a9-99f7-4771-b48c-dd1dfac17bb6 req-aafb9d1b-076e-44ca-8f29-550f869ca1fb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:04.587062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-571cf2a9-99f7-4771-b48c-dd1dfac17bb6 req-aafb9d1b-076e-44ca-8f29-550f869ca1fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:04.587981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-571cf2a9-99f7-4771-b48c-dd1dfac17bb6 req-aafb9d1b-076e-44ca-8f29-550f869ca1fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:04.607620 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-571cf2a9-99f7-4771-b48c-dd1dfac17bb6 req-aafb9d1b-076e-44ca-8f29-550f869ca1fb service nova] Creating event network-vif-unplugged:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:02:04.624107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-571cf2a9-99f7-4771-b48c-dd1dfac17bb6 req-aafb9d1b-076e-44ca-8f29-550f869ca1fb service nova] Instance 860026f0-896b-4371-9434-b880d1ef1573 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:02:04.682791 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-571cf2a9-99f7-4771-b48c-dd1dfac17bb6 req-aafb9d1b-076e-44ca-8f29-550f869ca1fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131666 Nov 02 22:02:04.685861 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3241/6364] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:04.838876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:04.840201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:04.851798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:04.861934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:04.862412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:04.864383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:04.864863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:04.866188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:05.117409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:05.132351 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94643d11-10cc-42ee-b258-331dea30cd6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1299 microversion: 2.1 time: 0.296726 Nov 02 22:02:05.150547 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3242/6365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:04 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1299 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:05.389372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:05.414892 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-68bca322-53ae-4b22-8002-825008ae37b4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 0.894784 Nov 02 22:02:05.419557 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3124/6366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:04 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:05.556145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bddc0a03-b41f-4e1d-beb2-109749cb96ac tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'create', calling method: .version_select at 0x7f9b683f49d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1191199711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJH5D4TODekV2OezXxkwaZOc99aF1LdrM/D/RBfaRJjhE3UlIev16oOyc2AicU4tgwRkeS6rfhDOuQduVHQAXZl0gj/u/Kjw9v2SQMm5Ea+BaqMbW697eF7RPpVFFKC4g=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:05.597957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-bddc0a03-b41f-4e1d-beb2-109749cb96ac tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for project b4108462f6954f26868cf2f1b1819046. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:02:05.617240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-bddc0a03-b41f-4e1d-beb2-109749cb96ac tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for user ed2d57d2fe094d6890ddf1888c11b0fd and project b4108462f6954f26868cf2f1b1819046. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:02:05.733753 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bddc0a03-b41f-4e1d-beb2-109749cb96ac tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.178086 Nov 02 22:02:05.733753 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3243/6367] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:02:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:06.166654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:06.169220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:06.189981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:06.192062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:06.194352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:06.197666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:06.198910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:06.201713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:06.362736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:06.378489 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-606a5c0a-7284-452b-b268-904de69630d0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1299 microversion: 2.1 time: 0.214180 Nov 02 22:02:06.379984 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3125/6368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:06 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1299 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:06.450134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:06.451199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:06.472576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:06.475001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:06.477609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:06.478788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:06.480779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:06.481295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:06.794815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-03233ef9-3ecd-438b-af2f-0c047438b794 req-e6ddaa34-46b4-46e4-8a06-d21a90c4aaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:06.847059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-03233ef9-3ecd-438b-af2f-0c047438b794 req-e6ddaa34-46b4-46e4-8a06-d21a90c4aaf0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:06.849625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-03233ef9-3ecd-438b-af2f-0c047438b794 req-e6ddaa34-46b4-46e4-8a06-d21a90c4aaf0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:06.852375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-03233ef9-3ecd-438b-af2f-0c047438b794 req-e6ddaa34-46b4-46e4-8a06-d21a90c4aaf0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:06.899921 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-03233ef9-3ecd-438b-af2f-0c047438b794 req-e6ddaa34-46b4-46e4-8a06-d21a90c4aaf0 service nova] Creating event network-changed:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:02:06.918156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-03233ef9-3ecd-438b-af2f-0c047438b794 req-e6ddaa34-46b4-46e4-8a06-d21a90c4aaf0 service nova] Instance 860026f0-896b-4371-9434-b880d1ef1573 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:02:06.977637 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-03233ef9-3ecd-438b-af2f-0c047438b794 req-e6ddaa34-46b4-46e4-8a06-d21a90c4aaf0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182326 Nov 02 22:02:06.981900 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3126/6369] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:07.091419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:07.112416 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-abd6be56-47ed-4a4c-b3a0-e615fe27ca2b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 0.666353 Nov 02 22:02:07.115069 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3244/6370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:06 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:07.410170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:07.411176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:07.429026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:07.429545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:07.432073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:07.434062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:07.436103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:07.436563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:08.137768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:08.139033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:08.162561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:08.163426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:08.165609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:08.166549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:08.169194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:08.169916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:08.282481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:08.293742 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a8691cf-4c79-4063-afaf-dd004501dab6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.890014 Nov 02 22:02:08.296177 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3127/6371] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:07 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:08.741566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:08.765154 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-220cea4c-ae74-46d1-a1b5-7c64a7150ee7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 0.630161 Nov 02 22:02:08.766469 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3245/6372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:08 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:09.330291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bae7decf-e370-4114-aaa8-23e0c1e2daaf req-5a7c4871-d085-44f0-83df-bbf743b669e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21297773-fa06-420c-b893-e4e79a6c9ad7", "tag": "c1b54115-5891-4981-a965-5efcb232dd92"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:09.339748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:09.340364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:09.391142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:09.391645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:09.392094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:09.392810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:09.393296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:09.406701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:09.429156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bae7decf-e370-4114-aaa8-23e0c1e2daaf req-5a7c4871-d085-44f0-83df-bbf743b669e2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:09.437269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bae7decf-e370-4114-aaa8-23e0c1e2daaf req-5a7c4871-d085-44f0-83df-bbf743b669e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:09.444536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bae7decf-e370-4114-aaa8-23e0c1e2daaf req-5a7c4871-d085-44f0-83df-bbf743b669e2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:09.565100 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bae7decf-e370-4114-aaa8-23e0c1e2daaf req-5a7c4871-d085-44f0-83df-bbf743b669e2 service nova] Creating event network-changed:c1b54115-5891-4981-a965-5efcb232dd92 for instance 21297773-fa06-420c-b893-e4e79a6c9ad7 on n-h1-860863-4 Nov 02 22:02:09.597118 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bae7decf-e370-4114-aaa8-23e0c1e2daaf req-5a7c4871-d085-44f0-83df-bbf743b669e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270631 Nov 02 22:02:09.618612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3246/6373] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 22:02:09.799108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:09.800362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:09.830632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:09.834272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:09.834272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:09.834272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:09.834272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:09.840438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:10.621574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:10.633187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-93b91ebb-bd0c-4062-8729-f5f1666516a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 1.312009 Nov 02 22:02:10.637584 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3128/6374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:09 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:10.791828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:10.817926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd7ac155-48ae-4208-ba4c-84e7968336ed tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1689 microversion: 2.1 time: 1.023753 Nov 02 22:02:10.824080 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3247/6375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:09 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1689 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:11.660247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:11.662313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:11.673219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:11.676276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:11.683948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:11.684714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:11.686468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:11.688822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:11.692774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:11.693510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:11.847399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:11.853832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:11.875844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:11.876599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:11.877262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:11.878190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:11.878886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:11.879664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:12.237747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:12.246776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6cff654f-6152-404d-a957-a773962fd10d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.590947 Nov 02 22:02:12.251353 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3129/6376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:11 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:12.267299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1220214902", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "d421d1ed-89ed-4485-bb5a-5e81de2e134e"}], "key_name": "tempest-TestNetworkBasicOps-1191199711", "security_groups": [{"name": "tempest-secgroup-smoke-88425210"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:12.519076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:12.532821 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb72c42a-f04a-47bb-b54c-ba157637eab5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1682 microversion: 2.1 time: 0.687575 Nov 02 22:02:12.533789 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3248/6377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:11 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1682 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:12.623884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] validate_networks() for [('d421d1ed-89ed-4485-bb5a-5e81de2e134e', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:02:13.232467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:02:13.233110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:02:13.233400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:02:13.233892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:02:13.237114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:02:13.253081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:13.253997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:13.255362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:13.257014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:13.259086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:13.259759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:13.276146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:13.278205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:13.295712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:13.296239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:13.296707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:13.318925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:13.319458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:13.320010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:13.331756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for project b4108462f6954f26868cf2f1b1819046. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:02:13.340231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Getting quotas for user ed2d57d2fe094d6890ddf1888c11b0fd and project b4108462f6954f26868cf2f1b1819046. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:02:13.395573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:02:13.398607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:02:13.589117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:13.597997 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7cf77893-0fe0-4f62-9766-064ba24495f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.326149 Nov 02 22:02:13.601214 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3249/6378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:13 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:13.606032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bdc102e9-cfa1-4d24-beb6-c13e9f64eb12 req-74a2ca86-b47e-42c7-9210-bd860d21d4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "name": "network-vif-plugged", "status": "completed", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:13.624692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bdc102e9-cfa1-4d24-beb6-c13e9f64eb12 req-74a2ca86-b47e-42c7-9210-bd860d21d4e0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:13.628096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bdc102e9-cfa1-4d24-beb6-c13e9f64eb12 req-74a2ca86-b47e-42c7-9210-bd860d21d4e0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:13.628096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bdc102e9-cfa1-4d24-beb6-c13e9f64eb12 req-74a2ca86-b47e-42c7-9210-bd860d21d4e0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:13.644692 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bdc102e9-cfa1-4d24-beb6-c13e9f64eb12 req-74a2ca86-b47e-42c7-9210-bd860d21d4e0 service nova] Creating event network-vif-plugged:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:02:13.651274 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2ce5ff5-bbcd-4e44-986b-d205baabed17 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.391856 Nov 02 22:02:13.651274 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3130/6379] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:02:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:02:13.663233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc092a95-a1ef-427c-bcb1-f588a69b585f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:13.663795 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bdc102e9-cfa1-4d24-beb6-c13e9f64eb12 req-74a2ca86-b47e-42c7-9210-bd860d21d4e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063601 Nov 02 22:02:13.663923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc092a95-a1ef-427c-bcb1-f588a69b585f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:13.664532 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3250/6380] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:13.760921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc092a95-a1ef-427c-bcb1-f588a69b585f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:13.779219 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc092a95-a1ef-427c-bcb1-f588a69b585f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1249 microversion: 2.1 time: 0.110865 Nov 02 22:02:13.790635 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3131/6381] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:13 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:14.630526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:14.631260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:14.637727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:14.638233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:14.638693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:14.639409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:14.639893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:14.640575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:14.798241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:14.798962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:14.810844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:14.811339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:14.811775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:14.812685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:14.813245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:14.813839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:14.868813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:14.877990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-26ee1fd0-b0ba-4916-8c3f-34216136a90f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.253691 Nov 02 22:02:14.878601 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3251/6382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:14 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:14.896578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:14.906764 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-32771ceb-e838-4543-92c6-aae482240bb5 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1253 microversion: 2.1 time: 0.112389 Nov 02 22:02:14.907247 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3132/6383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:14 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1253 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:15.904977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:15.909496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:15.919106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:15.940455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:15.941401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:15.942250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:15.943567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:15.944474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:15.945429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:15.946068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:15.946782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:15.958709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:15.958709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:15.958709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:15.958709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:15.958709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:15.958709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:16.075177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:16.083995 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1f1414e8-2254-4ab5-a794-85891ca9ec46 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1301 microversion: 2.1 time: 0.152743 Nov 02 22:02:16.095493 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3133/6384] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:15 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1301 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:16.163943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:16.173613 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fcc647db-bd08-4c3f-bda7-42ad43e82eeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.272429 Nov 02 22:02:16.176962 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3252/6385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:15 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:17.117914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:17.119166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:17.127488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:17.128194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:17.128847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:17.130469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:17.131109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:17.131811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:17.199043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:17.200677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:17.207700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:17.212362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:17.212362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:17.212362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:17.212362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:17.212362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:17.216202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:17.225735 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63c5382b-fa5c-4552-8430-6f6c57d45d70 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1307 microversion: 2.1 time: 0.113702 Nov 02 22:02:17.226505 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3134/6386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:17 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:17.371212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:17.379320 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6920da28-50e2-4ba0-9b38-da9a1b2bc4f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.184224 Nov 02 22:02:17.379908 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3253/6387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:17 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:18.250473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:18.251443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:18.260396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:18.261235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:18.262064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:18.263219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:18.263910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:18.264548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:18.405142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:18.407698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:18.421443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:18.429289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:18.430113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:18.432611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:18.434198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:18.435384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:18.554526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:18.564468 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d2848e2-1f55-4b4a-833f-928ea175d0cd tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1373 microversion: 2.1 time: 0.318368 Nov 02 22:02:18.572586 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3135/6388] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:18 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1373 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:18.826778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:18.837879 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36b31560-605f-44ad-a8a7-364e31257077 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.438273 Nov 02 22:02:18.873051 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3254/6389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:18 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:19.178072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-97c7eed5-db3e-47c2-899d-8d04b9ead2d5 req-896afcd2-33f3-4975-a501-f23c6238f9af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee092334-e35d-4a25-89b1-644e5af9f175", "tag": "9770f3bc-34b0-4126-af27-c5ea20c5f400"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:19.189862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-97c7eed5-db3e-47c2-899d-8d04b9ead2d5 req-896afcd2-33f3-4975-a501-f23c6238f9af service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:19.190638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-97c7eed5-db3e-47c2-899d-8d04b9ead2d5 req-896afcd2-33f3-4975-a501-f23c6238f9af service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:19.191136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-97c7eed5-db3e-47c2-899d-8d04b9ead2d5 req-896afcd2-33f3-4975-a501-f23c6238f9af service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:19.205218 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-97c7eed5-db3e-47c2-899d-8d04b9ead2d5 req-896afcd2-33f3-4975-a501-f23c6238f9af service nova] Creating event network-changed:9770f3bc-34b0-4126-af27-c5ea20c5f400 for instance ee092334-e35d-4a25-89b1-644e5af9f175 on n-h1-860863-4 Nov 02 22:02:19.211135 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-97c7eed5-db3e-47c2-899d-8d04b9ead2d5 req-896afcd2-33f3-4975-a501-f23c6238f9af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039762 Nov 02 22:02:19.211756 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3136/6390] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:19.597444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:19.601838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:19.611660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:19.612476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:19.613218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:19.614268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:19.614937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:19.615405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:19.882755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:19.883470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:19.894403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:19.925179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:19.926499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:19.928242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:19.932613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:19.932613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:19.942849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:19.967530 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-07e74355-efaa-4362-a7ca-5fb43e67b8e2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1373 microversion: 2.1 time: 0.367265 Nov 02 22:02:19.969488 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3255/6391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:19 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1373 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:20.252007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:20.274502 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41e8f572-3d20-4b5c-bf6d-35d198a73b28 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.395348 Nov 02 22:02:20.274502 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3137/6392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:19 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:20.992351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:20.993062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:21.002949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:21.003411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:21.004729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:21.005514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:21.005986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:21.006423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:21.172469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:21.180807 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3107359f-fd97-4dd3-9d25-9208e1a9d54d tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1373 microversion: 2.1 time: 0.192769 Nov 02 22:02:21.193395 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3256/6393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:20 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1373 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:21.296161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:21.297771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:21.306128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:21.306626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:21.307116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:21.307869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:21.308335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:21.308768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:21.464815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:21.467156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:21.475279 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-247209a8-558a-47d7-86d4-2a96beebc725 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.183097 Nov 02 22:02:21.482127 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3138/6394] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:21 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:22.206692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:22.207870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:22.215211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:22.221326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:22.221828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:22.222281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:22.223722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:22.224457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:22.224906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:22.244045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:22.450259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:22.459876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4dffee4-c8ca-44a3-9cd1-246eddfcda54 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1373 microversion: 2.1 time: 0.256959 Nov 02 22:02:22.466321 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3257/6395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:22 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1373 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:22.500229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:22.501560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:22.517847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:22.517847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:22.517847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:22.518206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:22.518378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:22.522263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:22.688317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:22.698356 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-65f49aa4-afaf-43dc-996f-d3395b1aece7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.201977 Nov 02 22:02:22.699176 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3139/6396] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:22 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:23.485629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:23.486268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:23.509957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:23.512543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:23.512872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:23.513630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:23.515808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:23.516270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:23.720794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:23.728550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:23.728797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:23.734927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:23.750784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:23.751308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:23.751743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:23.755086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:23.755578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:23.756028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:23.765508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:23.771034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:23.776278 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b50566e-df77-4559-a31b-d8cff4de2597 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1373 microversion: 2.1 time: 0.294610 Nov 02 22:02:23.776878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3258/6397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:23 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1373 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:23.973400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:23.990231 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e2001738-adf9-49ad-bbb1-0956c41dece0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.270223 Nov 02 22:02:23.990898 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3140/6398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:23 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:24.804328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:24.805123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:24.813123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:24.813634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:24.814095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:24.814819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:24.815295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:24.815747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:24.973877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:24.987571 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b66e4d84-4af5-438c-b3c4-db1a503b1d9a tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1373 microversion: 2.1 time: 0.188919 Nov 02 22:02:24.988852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3259/6399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:24 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:25.014311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:25.015744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:25.027551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:25.028420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:25.029122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:25.029994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:25.030988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:25.031841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:25.185398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:25.190362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-261897b2-9654-465e-b333-4eec21bb4fad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.179885 Nov 02 22:02:25.190950 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3141/6400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:25 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:25.463205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-701b87a9-c287-4836-b317-1d5b767cd048 req-882cae46-4a79-41ad-95e9-8110d7a7b101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee092334-e35d-4a25-89b1-644e5af9f175", "name": "network-vif-plugged", "status": "completed", "tag": "9770f3bc-34b0-4126-af27-c5ea20c5f400"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:25.475098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-701b87a9-c287-4836-b317-1d5b767cd048 req-882cae46-4a79-41ad-95e9-8110d7a7b101 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:25.475930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-701b87a9-c287-4836-b317-1d5b767cd048 req-882cae46-4a79-41ad-95e9-8110d7a7b101 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:25.476591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-701b87a9-c287-4836-b317-1d5b767cd048 req-882cae46-4a79-41ad-95e9-8110d7a7b101 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:25.491694 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-701b87a9-c287-4836-b317-1d5b767cd048 req-882cae46-4a79-41ad-95e9-8110d7a7b101 service nova] Creating event network-vif-plugged:9770f3bc-34b0-4126-af27-c5ea20c5f400 for instance ee092334-e35d-4a25-89b1-644e5af9f175 on n-h1-860863-4 Nov 02 22:02:25.497194 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-701b87a9-c287-4836-b317-1d5b767cd048 req-882cae46-4a79-41ad-95e9-8110d7a7b101 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040241 Nov 02 22:02:25.497955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3260/6401] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:26.011719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:26.012647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:26.018803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:26.019410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:26.019981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:26.020430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:26.021151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:26.021674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:26.198241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:26.209485 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-931e8f51-f9c4-4dcb-a512-8f35e85280ed tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1373 microversion: 2.1 time: 0.201706 Nov 02 22:02:26.216205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:26.216942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:26.220729 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3142/6402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:26 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:26.224951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:26.225781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:26.226461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:26.227272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:26.227817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:26.228340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:26.427098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:26.436176 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-739cd5b3-7107-4e04-a3a7-483865978ef7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.225057 Nov 02 22:02:26.436877 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3261/6403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:26 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:27.244138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:27.245396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:27.252717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:27.253543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:27.254874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:27.255635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:27.256151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:27.256597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:27.443020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:27.453480 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b72063b2-8c0d-455e-aff2-613eb8aa11d2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1545 microversion: 2.1 time: 0.213517 Nov 02 22:02:27.454730 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3143/6404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:27 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1545 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:27.469119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:27.470575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:27.484710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:27.487449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:27.488112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:27.489215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:27.489688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:27.490665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:27.491191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:27.492035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:27.499672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:27.500435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:27.500899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:27.501934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:27.502559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:27.503401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:27.820173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:27.827700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:27.844077 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-839a8455-d62a-4474-a1ae-397dc1dec098 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1545 microversion: 2.1 time: 0.363115 Nov 02 22:02:27.845230 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4147641-efc3-43a6-9e51-46862fa34804 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.384556 Nov 02 22:02:27.846705 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3144/6405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:27 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1545 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:27.847518 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3262/6406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:27 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:28.872065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:28.873432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:28.887371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:28.887881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:28.888341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:28.889104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:28.889582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:28.890031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:29.258935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:29.268808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f52873f5-3b1c-47e9-bfc4-b0274cbc7007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.402060 Nov 02 22:02:29.270702 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3263/6407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:28 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:30.300917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:30.302338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:30.314080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:30.321489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:30.322232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:30.323188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:30.323839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:30.324567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:30.594847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:30.603051 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-899a320a-b55d-4854-9e4e-d23a25298629 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.306687 Nov 02 22:02:30.603640 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3145/6408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:30 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:31.169594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-870d29b1-e6b6-47f3-a5c0-c7422cbfae81 req-d14b09d8-8693-43b4-acfb-23ee2b9630fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee092334-e35d-4a25-89b1-644e5af9f175", "tag": "9770f3bc-34b0-4126-af27-c5ea20c5f400"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:31.215363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-870d29b1-e6b6-47f3-a5c0-c7422cbfae81 req-d14b09d8-8693-43b4-acfb-23ee2b9630fc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:31.216202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-870d29b1-e6b6-47f3-a5c0-c7422cbfae81 req-d14b09d8-8693-43b4-acfb-23ee2b9630fc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:31.216828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-870d29b1-e6b6-47f3-a5c0-c7422cbfae81 req-d14b09d8-8693-43b4-acfb-23ee2b9630fc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:31.256291 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-870d29b1-e6b6-47f3-a5c0-c7422cbfae81 req-d14b09d8-8693-43b4-acfb-23ee2b9630fc service nova] Creating event network-changed:9770f3bc-34b0-4126-af27-c5ea20c5f400 for instance ee092334-e35d-4a25-89b1-644e5af9f175 on n-h1-860863-4 Nov 02 22:02:31.263353 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-870d29b1-e6b6-47f3-a5c0-c7422cbfae81 req-d14b09d8-8693-43b4-acfb-23ee2b9630fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098241 Nov 02 22:02:31.269336 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3264/6409] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:31.631499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:31.632119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:31.652507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:31.652507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:31.652507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:31.652507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:31.652507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:31.652507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:32.050113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:32.077818 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a7b733c-9f58-46d4-a595-c4a44a3cde7c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.452682 Nov 02 22:02:32.087248 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3146/6410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:31 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:33.112753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:33.114429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:33.122041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:33.122835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:33.123514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:33.124457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:33.125771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:33.126431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:33.292097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:33.301252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4574119-3d7a-4812-9055-7f9d01048c89 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.192662 Nov 02 22:02:33.304002 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3265/6411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:33 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:34.328828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:34.329488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:34.336642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:34.337157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:34.337596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:34.338309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:34.338743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:34.339171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:34.483149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:34.501734 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5b2c2e28-259d-470e-a81d-250412b94ada tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.176860 Nov 02 22:02:34.502326 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3147/6412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:34 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:34.811973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:34.814271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:34.821466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:34.821993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:34.822459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:34.823207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:34.823696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:34.824229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:34.887679 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2605145b-1823-41e6-a19c-89ebae70cd26 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action" status: 200 len: 63178 microversion: 2.1 time: 0.076496 Nov 02 22:02:34.887679 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3266/6413] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:02:34 2022] POST /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573/action => generated 63178 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:02:35.525986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:35.531713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:35.541588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:35.541588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:35.541870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:35.543152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:35.543590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:35.544028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:35.717969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:35.735413 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81092639-2310-4a88-abfa-282e5cb0a2bd tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.214023 Nov 02 22:02:35.736465 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3148/6414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:35 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:36.771232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:36.772532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:36.783510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:36.784029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:36.784493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:36.785321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:36.785943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:36.786391 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:36.961552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:36.972184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48785cf0-92b1-4b83-80dd-07604601bb1c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.203956 Nov 02 22:02:36.973484 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3267/6415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:36 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:37.780457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1584835001", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:37.847911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:02:37.995955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:37.998725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:38.006722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:38.007248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:38.007962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:38.009135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:38.009733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:38.010243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:38.216323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:02:38.217344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:02:38.217821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:02:38.218234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:02:38.218644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:02:38.219573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:38.228480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-656492aa-5e2d-49e9-8a83-2729c530de7b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.236491 Nov 02 22:02:38.228673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:38.229198 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3268/6416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:37 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:38.229353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:38.229688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:38.230620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:38.231084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:38.231519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:38.250857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Getting quotas for project 77c0307bf9ac4fd48746fee2c27493f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:02:38.260747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Getting quotas for user 8f0c93784238435f983fa36d59ca222c and project 77c0307bf9ac4fd48746fee2c27493f7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:02:38.270259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:02:38.272571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:02:38.392555 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d0a6cc9d-5f18-48d4-988d-e19e752a4039 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615861 Nov 02 22:02:38.393422 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3149/6417] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 22:02:38.405068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b77b5b6-19cd-4676-8c6d-0288d2512eb7 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:38.406186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4b77b5b6-19cd-4676-8c6d-0288d2512eb7 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:38.474464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4b77b5b6-19cd-4676-8c6d-0288d2512eb7 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:38.481449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b77b5b6-19cd-4676-8c6d-0288d2512eb7 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1214 microversion: 2.1 time: 0.080304 Nov 02 22:02:38.486320 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3269/6418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:38 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:39.253045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:39.253819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:39.267340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:39.267838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:39.268283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:39.269027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:39.269482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:39.269911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:39.450869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:39.459999 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f403f14-0878-499b-a126-a71144af3320 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.212312 Nov 02 22:02:39.460579 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3150/6419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:39 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:39.505104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22f6b873-62cd-4381-9b19-c09a12ac9c63 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:39.506890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22f6b873-62cd-4381-9b19-c09a12ac9c63 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:39.562953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22f6b873-62cd-4381-9b19-c09a12ac9c63 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:39.570673 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22f6b873-62cd-4381-9b19-c09a12ac9c63 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1214 microversion: 2.1 time: 0.070317 Nov 02 22:02:39.571240 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3270/6420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:39 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:40.485462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:40.486095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:40.495071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:40.495621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:40.496251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:40.497161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:40.498151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:40.498151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:40.595974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:40.596687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:40.604077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:40.604861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:40.605963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:40.606885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:40.607530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:40.608145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:40.662452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:40.672555 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eab635de-4463-4377-ba1e-b215d2e4fe67 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.192283 Nov 02 22:02:40.684565 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3151/6421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:40 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:40.694175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:40.700014 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76bc1859-a128-4b9e-91b7-6c0828a9e9fd tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1266 microversion: 2.1 time: 0.108337 Nov 02 22:02:40.700601 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3271/6422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:40 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:41.140716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:41.141942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:41.152769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:41.153301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:41.153764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:41.155605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:41.156618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:41.157538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:41.325265 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e3636c4-4047-494e-bf4e-d97e4fac52a2 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1833 microversion: 2.1 time: 0.188419 Nov 02 22:02:41.326095 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3152/6423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:41 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1833 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:41.702608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:41.708122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:41.727275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:41.729204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:41.729555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:41.730086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:41.730549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:41.731291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:41.731767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:41.732400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:41.741779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:41.742504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:41.743319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:41.744778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:41.745460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:41.746090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:41.874333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:41.883902 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1314fcfb-982f-40b4-9568-5ee0660a096b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1272 microversion: 2.1 time: 0.163305 Nov 02 22:02:41.884496 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3153/6424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:41 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:42.008877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:42.018632 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d9606901-ef43-493f-8346-53d4bd6e0230 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.321672 Nov 02 22:02:42.019794 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3272/6425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:41 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:42.773749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:42.774289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:42.776612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-679325f5-3e6c-47c9-a7d6-a2a8a06400c3 req-0d1728d3-3bb5-4720-8ce5-aa3cb68954cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:42.791443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-679325f5-3e6c-47c9-a7d6-a2a8a06400c3 req-0d1728d3-3bb5-4720-8ce5-aa3cb68954cd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:42.792318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-679325f5-3e6c-47c9-a7d6-a2a8a06400c3 req-0d1728d3-3bb5-4720-8ce5-aa3cb68954cd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:42.793081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-679325f5-3e6c-47c9-a7d6-a2a8a06400c3 req-0d1728d3-3bb5-4720-8ce5-aa3cb68954cd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:42.793607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:42.794107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:42.794601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:42.795320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:42.795777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:42.796207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:42.809085 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-679325f5-3e6c-47c9-a7d6-a2a8a06400c3 req-0d1728d3-3bb5-4720-8ce5-aa3cb68954cd service nova] Creating event network-changed:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:02:42.814721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-679325f5-3e6c-47c9-a7d6-a2a8a06400c3 req-0d1728d3-3bb5-4720-8ce5-aa3cb68954cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042631 Nov 02 22:02:42.816041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3273/6426] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:42.848288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:02:42.914067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:42.915309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:42.922884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:42.923703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:42.924252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:42.925115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:42.925714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:42.926409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:43.007725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:43.159867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:43.178451 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b137697e-deb3-407d-aa85-612511eb85c2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.273268 Nov 02 22:02:43.193428 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3274/6427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:42 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:43.201967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:43.202731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:43.209558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:43.214854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:43.214854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:43.214854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:43.214854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:43.214854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:43.264100 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ace34091-9ead-4f57-ac0d-9c1129e8a8da tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 204 len: 0 microversion: 2.1 time: 0.496419 Nov 02 22:02:43.265992 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3154/6428] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:02:42 2022] DELETE /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:02:43.273936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:43.274653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:43.286412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:43.287341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:43.288130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:43.289133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:43.290112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:43.292271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:43.446987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:43.461254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f2c55cb-fbce-4f9b-9fa0-e8537a45aa0a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.265771 Nov 02 22:02:43.473206 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3275/6429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:43 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:43.497508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:43.507322 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca39dbcd-dd0d-4a71-9afe-a01de039049c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1688 microversion: 2.1 time: 0.237720 Nov 02 22:02:43.508253 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3155/6430] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:43 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1688 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:44.209650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:44.210302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:44.217113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:44.224895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:44.224895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:44.224895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:44.224895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:44.224895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:44.266348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-3bb6c4da-1206-49ab-9a60-bfa469d69a83 req-50b5f217-6a0e-4f36-b463-5cd350ec2356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1268682c-eee2-4c8c-9644-4d4f9b056dac", "tag": "f6626d2f-a508-40d0-9db8-7168787cef18"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:44.284948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3bb6c4da-1206-49ab-9a60-bfa469d69a83 req-50b5f217-6a0e-4f36-b463-5cd350ec2356 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:44.289522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3bb6c4da-1206-49ab-9a60-bfa469d69a83 req-50b5f217-6a0e-4f36-b463-5cd350ec2356 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:44.295566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3bb6c4da-1206-49ab-9a60-bfa469d69a83 req-50b5f217-6a0e-4f36-b463-5cd350ec2356 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:44.318369 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-3bb6c4da-1206-49ab-9a60-bfa469d69a83 req-50b5f217-6a0e-4f36-b463-5cd350ec2356 service nova] Creating event network-changed:f6626d2f-a508-40d0-9db8-7168787cef18 for instance 1268682c-eee2-4c8c-9644-4d4f9b056dac on n-h2-860863-4 Nov 02 22:02:44.326548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-3bb6c4da-1206-49ab-9a60-bfa469d69a83 req-50b5f217-6a0e-4f36-b463-5cd350ec2356 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068223 Nov 02 22:02:44.329086 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3156/6431] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:44.383164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:44.390921 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c86d07bc-8881-4f9c-8cdb-3d2fbae63d11 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.188128 Nov 02 22:02:44.391492 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3276/6432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:44 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:44.489847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:44.491403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:44.498683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:44.499401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:44.499842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:44.500539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:44.501083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:44.501509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:44.539212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:44.540243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:44.548172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:44.551867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:44.551867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:44.551867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:44.551867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:44.552555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:45.161480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:45.170810 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e416049-c2a6-45d6-a627-a358b5c7eff9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1688 microversion: 2.1 time: 0.639636 Nov 02 22:02:45.185342 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3277/6433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:44 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1688 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:45.196396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:45.208096 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6ceecd8b-e3d5-4d55-abc5-307f8fa6a5da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.723502 Nov 02 22:02:45.220958 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3157/6434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:44 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:45.414684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:45.415231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:45.422618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:45.423335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:45.423879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:45.427065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:45.427065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:45.427381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:45.433108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:45.598674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:45.618187 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65c7fefc-2a27-4788-aa7d-cd2272c85202 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.207789 Nov 02 22:02:45.623124 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3278/6435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:45 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:45.666255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c33ea6ac-6e1e-429d-924c-8da426c80876 req-b68d21d9-6279-4a45-8212-0220acd6cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860026f0-896b-4371-9434-b880d1ef1573", "name": "network-vif-deleted", "tag": "c4c10916-1d6f-4561-92b3-9b06eb1c4076"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:45.678933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c33ea6ac-6e1e-429d-924c-8da426c80876 req-b68d21d9-6279-4a45-8212-0220acd6cd21 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:45.679516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c33ea6ac-6e1e-429d-924c-8da426c80876 req-b68d21d9-6279-4a45-8212-0220acd6cd21 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:45.680061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c33ea6ac-6e1e-429d-924c-8da426c80876 req-b68d21d9-6279-4a45-8212-0220acd6cd21 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:45.693430 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c33ea6ac-6e1e-429d-924c-8da426c80876 req-b68d21d9-6279-4a45-8212-0220acd6cd21 service nova] Creating event network-vif-deleted:c4c10916-1d6f-4561-92b3-9b06eb1c4076 for instance 860026f0-896b-4371-9434-b880d1ef1573 on n-h2-860863-4 Nov 02 22:02:45.703472 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c33ea6ac-6e1e-429d-924c-8da426c80876 req-b68d21d9-6279-4a45-8212-0220acd6cd21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035986 Nov 02 22:02:45.703472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3158/6436] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:46.195365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:46.196088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:46.211404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:46.211404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:46.211404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:46.211404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:46.211404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:46.212043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:46.234825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:46.235733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:46.243068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:46.245700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:46.245700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:46.245700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:46.245700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:46.247458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:46.294242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:46.315125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3491c56e-0c93-4d8c-b01f-24ac4f09807c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1502 microversion: 2.1 time: 0.123844 Nov 02 22:02:46.315720 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3279/6437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:46 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1502 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:46.399121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:46.406748 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fabdddaf-05f9-4720-a7a2-44ad5d4e0b5a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.177239 Nov 02 22:02:46.407586 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3159/6438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:46 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:46.643405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:46.644049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:46.651533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:46.652040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:46.652496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:46.653449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:46.653925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:46.654374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:46.888178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:46.911121 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51a7301f-1e02-4bc1-9f21-b43ef7daec62 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.259813 Nov 02 22:02:46.911121 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3280/6439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:46 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:47.339435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:47.340171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:47.347064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:47.348176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:47.348617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:47.354247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:47.354247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:47.354247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:47.382238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:47.382716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:47.383155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:47.383597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lazy-loading 'fault' on Instance uuid 860026f0-896b-4371-9434-b880d1ef1573 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:02:47.431039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:47.431852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:47.433085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:47.439940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:47.440580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:47.441111 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f587e996-53b5-43f8-9499-0d1a323e1dfa tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 200 len: 1356 microversion: 2.1 time: 0.105682 Nov 02 22:02:47.443561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:47.443689 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3160/6440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:47 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:47.443804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:47.443804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:47.443804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:47.580962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:47.590607 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0e0289a-9898-45d3-a0b6-3f0c663e539f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.163779 Nov 02 22:02:47.591319 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3281/6441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:47 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:47.924234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:47.924866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:47.931372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:47.931857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:47.932310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:47.933051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:47.933667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:47.934103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:48.093660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:48.102626 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c66e2f44-0974-4fb4-b09f-cd992ac35764 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.182639 Nov 02 22:02:48.103203 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3161/6442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:47 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:48.466000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:48.466630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 860026f0-896b-4371-9434-b880d1ef1573] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:48.473732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:48.474273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:48.474733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:48.475435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:48.475906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:48.476356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:48.490401 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] HTTP exception thrown: Instance 860026f0-896b-4371-9434-b880d1ef1573 could not be found. Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Request method failure captured: Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 HTTP/1.1 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYufPX6Rr5nr0yUdeWlboFRhiIRbfN70FaGXR5l42VL99ff4QwXSASZ8gH2G8kcngmWHBOUnKDxEHG5udsXaLab0zA1qmKd0pxn2TvmKN1vh_EQYUFTlFaM3t9QlaSUDMe-Q91CN2uqH3mfhXQC5X0nf71_hjip1qxhzqvXD3EIeuvz4 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: f3d5fb3af3fe44d3a742f5e902b32f4d Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 860026f0-896b-4371-9434-b880d1ef1573 could not be found. Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '860026f0-896b-4371-9434-b880d1ef1573'} Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860026f0-896b-4371-9434-b880d1ef1573 could not be found. Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860026f0-896b-4371-9434-b880d1ef1573 could not be found. Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:02:48.492149 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860026f0-896b-4371-9434-b880d1ef1573 could not be found. Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Returning 404 to user: Instance 860026f0-896b-4371-9434-b880d1ef1573 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5cbc7e17-babe-4d82-a437-c2d8d8a4d643 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573" status: 404 len: 111 microversion: 2.1 time: 0.031817 Nov 02 22:02:48.497454 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3282/6443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:48 2022] GET /compute/v2.1/servers/860026f0-896b-4371-9434-b880d1ef1573 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:02:48.615578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:48.616385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:48.618396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:48.619091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:48.626270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:48.626769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:48.627216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:48.627973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:48.628432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:48.629718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:48.919268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:48.928462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-acd3cf25-b899-4cf4-9728-989e1a317d71 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.317299 Nov 02 22:02:48.929153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3162/6444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:48 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:49.135987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:49.138111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:49.145896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:49.146668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:49.147244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:49.148263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:49.148838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:49.149593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:49.509834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:49.520792 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2f603cc2-b94b-4aec-bb3b-3f2a9bc9e343 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.396705 Nov 02 22:02:49.540953 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3283/6445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:49 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:49.958413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:49.959986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:49.967810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:49.968562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:49.969307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:49.970273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:49.971265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:49.971781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:50.133682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:50.143861 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c96ef99-1efb-406d-b2fb-bb66e004e913 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.191030 Nov 02 22:02:50.145598 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3163/6446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:49 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:50.549372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:50.549920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:50.551957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:50.558205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:50.558962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:50.559582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:50.560468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:50.561299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:50.561946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:51.102895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:51.115561 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4623eeec-25ae-48c7-989d-fe2d12fdf82c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.568960 Nov 02 22:02:51.116498 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3284/6447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:50 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:51.168731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:51.169392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:51.182054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:51.182746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:51.183377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:51.184269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:51.184903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:51.185517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:51.512105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:51.529884 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f73dc0ac-2684-4ee1-91fe-9802a11b4ba4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.366709 Nov 02 22:02:51.544972 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3164/6448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:51 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:51.545202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8ba22424-3d67-4cdc-bff1-fc08a045d6c0 req-6129e639-7629-447f-af84-66ccff753205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1268682c-eee2-4c8c-9644-4d4f9b056dac", "name": "network-vif-plugged", "status": "completed", "tag": "f6626d2f-a508-40d0-9db8-7168787cef18"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:51.564958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8ba22424-3d67-4cdc-bff1-fc08a045d6c0 req-6129e639-7629-447f-af84-66ccff753205 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:51.569935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8ba22424-3d67-4cdc-bff1-fc08a045d6c0 req-6129e639-7629-447f-af84-66ccff753205 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:51.569935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8ba22424-3d67-4cdc-bff1-fc08a045d6c0 req-6129e639-7629-447f-af84-66ccff753205 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:51.600818 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8ba22424-3d67-4cdc-bff1-fc08a045d6c0 req-6129e639-7629-447f-af84-66ccff753205 service nova] Creating event network-vif-plugged:f6626d2f-a508-40d0-9db8-7168787cef18 for instance 1268682c-eee2-4c8c-9644-4d4f9b056dac on n-h2-860863-4 Nov 02 22:02:51.614897 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8ba22424-3d67-4cdc-bff1-fc08a045d6c0 req-6129e639-7629-447f-af84-66ccff753205 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083654 Nov 02 22:02:51.616043 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3285/6449] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:52.140652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:52.148332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:52.149406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:52.150077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:52.150736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:52.152345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:52.152983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:52.153613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:52.376872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:52.386204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4a9cddd8-12a5-4320-ac24-f75283d86496 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1314 microversion: 2.1 time: 0.249351 Nov 02 22:02:52.388676 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3165/6450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:52 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:52.575643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:52.576396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:52.587344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:52.588296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:52.589261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:52.590000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:52.590642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:52.591255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:52.770163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:52.781151 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9069681-7c7f-4e9f-a43d-022e0b05b118 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.216672 Nov 02 22:02:52.781946 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3286/6451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:52 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:53.418072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:53.419069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:53.425844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:53.426339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:53.426781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:53.427526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:53.427982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:53.428450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:53.592049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:53.602392 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c846ba71-bb5a-4b98-b9c3-52c838bf93d9 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1463 microversion: 2.1 time: 0.190879 Nov 02 22:02:53.621302 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3166/6452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:53 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1463 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:53.641154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65a0b832-dabf-4214-b3fd-1bce4d5d2707", "device": "/dev/sdb"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:53.643604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:53.671854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:53.672632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:53.673321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:53.674146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:53.674860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:53.675686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:53.808051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:53.809240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:53.822407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:53.824351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:53.824853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:53.832469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:53.832469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:53.832469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:54.108347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:54.118701 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9526a83-591f-4b51-b3fb-3046b8ede52d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.314360 Nov 02 22:02:54.119438 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3167/6453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:53 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:02:54.311644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e6582fc3-b16a-4be7-9aec-19768a63fb0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '.version_select at 0x7f9b6d285160>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:54.392840 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e6582fc3-b16a-4be7-9aec-19768a63fb0f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1841212613" status: 202 len: 0 microversion: 2.1 time: 0.085120 Nov 02 22:02:54.393552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3168/6454] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 22:02:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1841212613 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 22:02:54.438271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da14d15a-c721-4b58-b273-5318da702224 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: .version_select at 0x7f9b63f90e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1536031199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPyJvpDIdoEusMm5ch9+a6gEyKtuy3J8nK8h34zzbwIj/3YF0FfnSNrfFT5c0avrZZ+7ehNWLXMPtHomhggmuhRqeD+6xQ4bST99AUTbeKybQhsquX2/SRrv12iehoSGg=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:54.456677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-da14d15a-c721-4b58-b273-5318da702224 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:02:54.462337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-da14d15a-c721-4b58-b273-5318da702224 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:02:54.569953 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da14d15a-c721-4b58-b273-5318da702224 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.136103 Nov 02 22:02:54.570552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3169/6455] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:02:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:02:54.761419 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df887cb7-048d-4b7b-8f2b-72f5d05af16c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "POST /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124238 Nov 02 22:02:54.762100 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3287/6456] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 22:02:53 2022] POST /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:02:55.150239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:55.151080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:55.153066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:55.160404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:55.161269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:55.162371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:55.163304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:55.163862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:55.164419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:55.359616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:55.369414 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-06ea3b4e-a582-4b51-a0b7-e8f0f20959d7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.223590 Nov 02 22:02:55.370005 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3170/6457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:55 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:55.638086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:02:55.640586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:55.644814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=66 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:02:55.662796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:55.663649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:55.664378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:55.666015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:55.666748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:55.667375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:55.757055 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17b2a807-a2fb-4016-bfae-07d4a7a7507f tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175/action" status: 200 len: 24560 microversion: 2.1 time: 0.123899 Nov 02 22:02:55.758967 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3288/6458] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:02:55 2022] POST /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175/action => generated 24560 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:02:56.394411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:56.395045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:56.403484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:56.404019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:56.404472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:56.405655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:56.406121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:56.406553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:56.592785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:56.617056 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d519b301-dc4e-4bed-8abf-1c2537ea79c6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.227083 Nov 02 22:02:56.617899 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3171/6459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:56 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:57.647086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:57.652699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:57.659415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:57.660393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:57.661174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:57.662905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:57.664131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:57.667996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:57.895045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:57.904212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-38dad788-a2d3-4ff5-bd95-61e214bae807 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.264530 Nov 02 22:02:57.906519 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3289/6460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:57 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:02:58.930193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:02:58.931038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:02:58.942324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:58.943320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:58.943761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:58.944464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:02:58.944918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:02:58.945379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:02:59.112569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:02:59.121325 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f92a991b-b3b2-4d8f-a01d-69f8c6f480de tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.195023 Nov 02 22:02:59.122503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3172/6461] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:02:58 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:00.150408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:00.151244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:00.170368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:00.170944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:00.171545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:00.172643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:00.173323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:00.173917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:00.380480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:00.399882 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9281d6ba-5f67-4e0a-94ee-6afc79e65e9a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.255805 Nov 02 22:03:00.400651 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3290/6462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:00 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:01.426236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:01.429772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:01.441119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:01.445821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:01.445821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:01.445821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:01.445821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:01.445821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:01.613313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:01.630261 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d625bcd0-98bc-4c52-847e-125852644f31 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.203833 Nov 02 22:03:01.630261 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3173/6463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:01 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:02.647855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:02.648527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:02.655362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:02.655860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:02.669750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:02.671955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:02.674254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:02.674830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:02.877039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:02.893216 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-081f0992-2932-47b1-857c-11503965f379 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.248302 Nov 02 22:03:02.933979 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3291/6464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:02 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:03.923992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:03.924653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:03.954059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:03.958510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:03.961664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:03.963396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:03.964090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:03.967984 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:04.037571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:04.366290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:04.381801 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc308d10-b786-40ab-9698-344c26c230a7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.463374 Nov 02 22:03:04.382404 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3174/6465] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:03 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:05.408298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:05.409596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:05.418547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:05.419591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:05.420312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:05.421305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:05.422009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:05.422678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:05.602766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:05.611428 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-345e0cf0-07e1-4663-969c-73cd749cd58c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.207492 Nov 02 22:03:05.613900 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3292/6466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:05 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:05.986158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1372467443", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "a3ae8e07-3233-4784-b414-85149b876527"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1536031199", "security_groups": [{"name": "tempest-secgroup-smoke-1651798106"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:05.996747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:06.218979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] validate_networks() for [('a3ae8e07-3233-4784-b414-85149b876527', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:03:06.641945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:06.642580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:06.657730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:06.661799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:06.662496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:06.663544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:06.670398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:06.671658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:06.857241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:03:06.857668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:03:06.858525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:03:06.858947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:03:06.859409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:03:06.880845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:06.882448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:06.883767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:06.885301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:06.887924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:06.888621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:06.942922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:03:06.976478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:03:07.026581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:03:07.030345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:03:07.207160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:07.244838 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aed67a91-e53b-4fe7-9704-029b157459a6 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.606841 Nov 02 22:03:07.251867 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4027b91b-b042-4e89-bdaa-d2f56cbdeca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.269444 Nov 02 22:03:07.252878 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3175/6467] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:03:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:03:07.260339 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3293/6468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:06 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:07.264117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:07.271240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:07.282995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-432ba598-bd2a-44b7-ad55-e9519ee3fada tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:07.283642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-432ba598-bd2a-44b7-ad55-e9519ee3fada tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:07.287757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:07.288267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:07.288717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:07.289471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:07.289928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:07.290355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:07.378943 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e73a61d-ba07-4d88-b747-d66b3a37f661 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "POST /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175/action" status: 200 len: 32633 microversion: 2.1 time: 0.124544 Nov 02 22:03:07.379868 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3176/6469] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:07 2022] POST /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175/action => generated 32633 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:03:07.418850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-432ba598-bd2a-44b7-ad55-e9519ee3fada tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:07.431972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-432ba598-bd2a-44b7-ad55-e9519ee3fada tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1267 microversion: 2.1 time: 0.163893 Nov 02 22:03:07.432269 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3294/6470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:07 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:08.279235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:08.281312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:08.311621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:08.313200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:08.316548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:08.317982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:08.321439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:08.322166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:08.464755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3e6758a-b196-4267-b332-9c6c8eda7b00 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:08.465417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3e6758a-b196-4267-b332-9c6c8eda7b00 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:08.570323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:08.589770 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8fa01d13-fdad-4d05-b203-02070c66a53f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.314981 Nov 02 22:03:08.590408 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3177/6471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:08 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:08.743975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3e6758a-b196-4267-b332-9c6c8eda7b00 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:08.754129 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3e6758a-b196-4267-b332-9c6c8eda7b00 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1267 microversion: 2.1 time: 0.297097 Nov 02 22:03:08.755733 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3295/6472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:08 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:09.361343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:09.365503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:09.374597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c20e1bae-13db-481d-839e-ccd93240a55c req-a1bc6c48-5c87-4009-b279-4a306c537c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee092334-e35d-4a25-89b1-644e5af9f175", "tag": "9770f3bc-34b0-4126-af27-c5ea20c5f400"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:09.378224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:09.378886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:09.388797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:09.389203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:09.394277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:09.394277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:09.394754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c20e1bae-13db-481d-839e-ccd93240a55c req-a1bc6c48-5c87-4009-b279-4a306c537c0c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:09.394754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c20e1bae-13db-481d-839e-ccd93240a55c req-a1bc6c48-5c87-4009-b279-4a306c537c0c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:09.394754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c20e1bae-13db-481d-839e-ccd93240a55c req-a1bc6c48-5c87-4009-b279-4a306c537c0c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:09.414114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c20e1bae-13db-481d-839e-ccd93240a55c req-a1bc6c48-5c87-4009-b279-4a306c537c0c service nova] Creating event network-changed:9770f3bc-34b0-4126-af27-c5ea20c5f400 for instance ee092334-e35d-4a25-89b1-644e5af9f175 on n-h1-860863-4 Nov 02 22:03:09.436182 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c20e1bae-13db-481d-839e-ccd93240a55c req-a1bc6c48-5c87-4009-b279-4a306c537c0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065747 Nov 02 22:03:09.437454 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3296/6473] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:09.448545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:03:09.625441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:09.626167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:09.644204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:09.644840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:09.645343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:09.647039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:09.647520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:09.647975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:09.973464 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98de70bc-4708-4020-88a0-a18b40966cfb tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 204 len: 0 microversion: 2.1 time: 0.611048 Nov 02 22:03:09.973464 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3178/6474] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:03:09 2022] DELETE /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 22:03:09.978426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:09.979470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:09.998879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:10.000136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:10.001476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:10.008594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:10.009472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:10.010082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:10.280970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:10.300633 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-313314cc-dd5e-4134-b361-adc74af0cca4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1263 microversion: 2.1 time: 0.326448 Nov 02 22:03:10.307278 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3179/6475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:09 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1263 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:10.318147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:10.320141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:10.320141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:10.324784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:10.335461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:10.336345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:10.337243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:10.338361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:10.339003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:10.341181 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-102b1d9d-f277-43f7-a9b7-ebb12434c454 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1341 microversion: 2.1 time: 0.719163 Nov 02 22:03:10.341502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:10.343532 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3297/6476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:09 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1341 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:10.718600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:10.727922 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7763a556-8265-4ef6-874c-91535128b9a2 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1670 microversion: 2.1 time: 0.419347 Nov 02 22:03:10.735036 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3180/6477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:10 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1670 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:11.339672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:11.341048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:11.365789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:11.366740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:11.367363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:11.368365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:11.369843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:11.371220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:11.372032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:11.374198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:11.398292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:11.398801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:11.399250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:11.400074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:11.400523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:11.400975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:11.672347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:11.689732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca28912e-6330-433b-8c7b-12b0346dfcab tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1327 microversion: 2.1 time: 0.361068 Nov 02 22:03:11.690562 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3298/6478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:11 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1327 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:11.750941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:11.751815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:11.762166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:11.766516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:11.767169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:11.770983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:11.770983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:11.770983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:12.080916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:12.089461 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d14e629a-d5f8-41a9-8595-518097d8d007 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1387 microversion: 2.1 time: 0.722277 Nov 02 22:03:12.105611 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3181/6479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:11 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1387 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:12.244114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:12.255895 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8dab4062-3fea-4b6e-8d64-ef0267692e82 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1670 microversion: 2.1 time: 0.508537 Nov 02 22:03:12.271538 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3299/6480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:11 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1670 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:12.532890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7c68b17f-13b9-401a-9f71-67390084e8bf req-1f2ec518-c296-4d0c-8ecc-1af114b0b585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee092334-e35d-4a25-89b1-644e5af9f175", "name": "network-vif-deleted", "tag": "9770f3bc-34b0-4126-af27-c5ea20c5f400"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:12.543641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7c68b17f-13b9-401a-9f71-67390084e8bf req-1f2ec518-c296-4d0c-8ecc-1af114b0b585 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:12.544139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7c68b17f-13b9-401a-9f71-67390084e8bf req-1f2ec518-c296-4d0c-8ecc-1af114b0b585 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:12.544566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7c68b17f-13b9-401a-9f71-67390084e8bf req-1f2ec518-c296-4d0c-8ecc-1af114b0b585 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:12.565424 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7c68b17f-13b9-401a-9f71-67390084e8bf req-1f2ec518-c296-4d0c-8ecc-1af114b0b585 service nova] Creating event network-vif-deleted:9770f3bc-34b0-4126-af27-c5ea20c5f400 for instance ee092334-e35d-4a25-89b1-644e5af9f175 on n-h1-860863-4 Nov 02 22:03:12.570463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7c68b17f-13b9-401a-9f71-67390084e8bf req-1f2ec518-c296-4d0c-8ecc-1af114b0b585 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242753 Nov 02 22:03:12.571063 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3182/6481] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:12.726709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:12.728225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:12.736019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:12.736813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:12.740415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:12.740415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:12.740415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:12.740415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:12.862464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:12.873778 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ccd14b5d-77a1-4c54-9f21-0977c67a18dd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1325 microversion: 2.1 time: 0.156816 Nov 02 22:03:12.878131 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3300/6482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:12 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1325 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:13.115409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:13.116172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:13.123737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:13.124225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:13.124849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:13.126920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:13.127654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:13.128535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:13.294422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:13.295679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:13.307432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:13.308634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:13.309411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:13.310589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:13.311428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:13.312030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:13.391397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:13.393821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:13.399016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:13.400380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lazy-loading 'fault' on Instance uuid ee092334-e35d-4a25-89b1-644e5af9f175 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:03:13.497870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2d57d2fe094d6890ddf1888c11b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4108462f6954f26868cf2f1b1819046', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:13.515821 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b2fda679-1b3c-4b36-bfef-a37b67f9fb19 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 200 len: 1490 microversion: 2.1 time: 0.231328 Nov 02 22:03:13.535837 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3301/6483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:13 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 1490 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:13.540341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:13.555385 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9e330fc-cba4-4c62-ac83-77988d5c8069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.443704 Nov 02 22:03:13.572589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3183/6484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:13 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:13.899610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:13.900326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:13.913895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:13.917656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:13.918331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:13.919498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:13.920082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:13.920676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:14.543403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:14.544623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] [instance: ee092334-e35d-4a25-89b1-644e5af9f175] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:14.552018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:14.552909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:14.553661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:14.554765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:14.555393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:14.555990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:14.564474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:14.572188 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] HTTP exception thrown: Instance ee092334-e35d-4a25-89b1-644e5af9f175 could not be found. Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Request method failure captured: Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 HTTP/1.1 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuggNoGcRU_63V01mbd6hqyjt_dyATQXmaFQ47Wlnqvcs2gf4s8TDWL3v9VauiGLO9gHDkWIuyUpLIG3Ha7NSDkuOdWm7C0tn_nTnMb-LEsRSGKQuocD0C2ho8j3gkshZt2FzYVOeNaWbbX3c99xXJPheHprR0Y0Pag8c4biRMrBtQE Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: b4108462f6954f26868cf2f1b1819046 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b4108462f6954f26868cf2f1b1819046"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b4108462f6954f26868cf2f1b1819046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: b4108462f6954f26868cf2f1b1819046 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestNetworkBasicOps-1659074523 Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestNetworkBasicOps-1659074523-project Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: ed2d57d2fe094d6890ddf1888c11b0fd Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestNetworkBasicOps-1659074523-project Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance ee092334-e35d-4a25-89b1-644e5af9f175 could not be found. Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'ee092334-e35d-4a25-89b1-644e5af9f175'} Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee092334-e35d-4a25-89b1-644e5af9f175 could not be found. Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee092334-e35d-4a25-89b1-644e5af9f175 could not be found. Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:03:14.575098 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:14.581231 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:14.581231 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:03:14.581231 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:03:14.581231 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:03:14.581231 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:03:14.581231 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee092334-e35d-4a25-89b1-644e5af9f175 could not be found. Nov 02 22:03:14.581231 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:14.584781 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ccc31e1c-3825-4341-8e7d-8d522c9d504d tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1393 microversion: 2.1 time: 0.688581 Nov 02 22:03:14.585365 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3302/6485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:13 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1393 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:14.587088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Returning 404 to user: Instance ee092334-e35d-4a25-89b1-644e5af9f175 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:03:14.588190 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98c69a91-714e-4199-a92f-0c62d87a6f97 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175" status: 404 len: 111 microversion: 2.1 time: 0.049026 Nov 02 22:03:14.589702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:14.589869 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3184/6486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:14 2022] GET /compute/v2.1/servers/ee092334-e35d-4a25-89b1-644e5af9f175 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:03:14.590373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:14.596658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:14.597274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:14.597739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:14.598471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:14.599540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:14.600095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:14.875263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:14.888050 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d934f15-043c-4251-9d66-a8e17f5eadeb tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.301844 Nov 02 22:03:14.891109 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3303/6487] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:14 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:14.908352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-938f1193-21b7-4a90-965f-6893c11ae452 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] Calling method '.version_select at 0x7f9b68603ca0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:15.012285 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-938f1193-21b7-4a90-965f-6893c11ae452 tempest-TestNetworkBasicOps-1659074523 tempest-TestNetworkBasicOps-1659074523-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1191199711" status: 202 len: 0 microversion: 2.1 time: 0.119809 Nov 02 22:03:15.013631 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3185/6488] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 22:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1191199711 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:03:15.508244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a000bacf-e0cd-4f1d-89c0-fb6d8161a3a3 req-5415fd54-9359-4969-be57-ecabcd483388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f1373a-47c4-4413-86d2-86d0c939cb97", "tag": "dd8a8740-1190-426b-adac-9eb808bb59ae"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:15.527168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a000bacf-e0cd-4f1d-89c0-fb6d8161a3a3 req-5415fd54-9359-4969-be57-ecabcd483388 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:15.530356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a000bacf-e0cd-4f1d-89c0-fb6d8161a3a3 req-5415fd54-9359-4969-be57-ecabcd483388 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:15.531014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a000bacf-e0cd-4f1d-89c0-fb6d8161a3a3 req-5415fd54-9359-4969-be57-ecabcd483388 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:15.561113 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a000bacf-e0cd-4f1d-89c0-fb6d8161a3a3 req-5415fd54-9359-4969-be57-ecabcd483388 service nova] Creating event network-changed:dd8a8740-1190-426b-adac-9eb808bb59ae for instance 60f1373a-47c4-4413-86d2-86d0c939cb97 on n-h2-860863-4 Nov 02 22:03:15.569804 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a000bacf-e0cd-4f1d-89c0-fb6d8161a3a3 req-5415fd54-9359-4969-be57-ecabcd483388 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066125 Nov 02 22:03:15.571809 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3304/6489] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:15.608295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:15.609734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:15.622675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:15.625985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:15.626453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:15.632410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:15.632915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:15.633404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:15.920319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:15.923293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:15.930766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:15.935295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:15.935295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:15.935295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:15.935295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:15.935295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:15.967647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:15.979314 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6575b73c-9e18-4f85-b63b-801740deeccd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1393 microversion: 2.1 time: 0.374944 Nov 02 22:03:15.983133 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3186/6490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:15 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1393 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:16.215740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:16.225212 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dca33582-29d4-4f3d-9a40-480c130aa9da tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.307773 Nov 02 22:03:16.244204 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3305/6491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:15 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:17.011227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:17.011871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:17.015253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:17.015821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:17.021586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:17.022093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:17.022565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:17.023278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:17.023737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:17.024168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:17.253785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:17.255450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:17.269766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:17.270466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:17.271908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:17.272821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:17.273478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:17.274082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:17.277604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:17.286685 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0b4bcc4-cd40-4cc8-b091-dd019ceaade9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1393 microversion: 2.1 time: 0.279306 Nov 02 22:03:17.292191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3187/6492] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:17 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1393 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:17.546466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:17.558190 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9dbcb44-e1ef-4bf0-8204-b359383cf284 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.310255 Nov 02 22:03:17.573625 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3306/6493] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:17 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:18.316325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:18.316975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:18.340756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:18.341229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:18.341747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:18.342545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:18.343017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:18.343457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:18.584399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:18.585729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:18.593063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:18.609208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:18.610169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:18.611100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:18.611896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:18.612639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:18.685931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:18.696790 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ade48e5-ddcb-4c84-b176-c8ebd34d7da8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1393 microversion: 2.1 time: 0.384725 Nov 02 22:03:18.714913 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3188/6494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:18 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1393 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:18.748863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:18.869068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:18.892257 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc19e5f7-db5d-4a66-9096-798d406f8527 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.312850 Nov 02 22:03:18.902202 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3307/6495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:18 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:19.722090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:19.727623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:19.731162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:19.732090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:19.732631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:19.733510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:19.734048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:19.734505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:19.928449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:19.929164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:19.946189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:19.946720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:19.947183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:19.948107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:19.950171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:19.953113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:20.095785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:20.105059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a5a222f-3f87-4fa2-83a3-c7bc4e79ae13 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1393 microversion: 2.1 time: 0.387643 Nov 02 22:03:20.109399 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3189/6496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:19 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1393 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:20.304879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:20.341822 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-32dcc340-23cd-483f-8259-c13bfabd1293 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.419432 Nov 02 22:03:20.346296 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3308/6497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:19 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:21.137255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:21.138058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:21.147384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:21.147807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:21.148255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:21.148999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:21.149476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:21.149901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:21.334213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:21.345589 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9fcc2f9-7f86-438f-9e05-ddecc2d20f37 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1393 microversion: 2.1 time: 0.213148 Nov 02 22:03:21.350002 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3190/6498] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:21 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:21.369684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:21.370318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:21.377595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:21.378737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:21.379110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:21.380610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:21.381869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:21.382506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:21.591163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:21.603288 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee1df60b-1bff-4f7f-910c-1b9964f1a732 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.237405 Nov 02 22:03:21.604462 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3309/6499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:21 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:21.716889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-895b5984-67e6-42c9-9773-fd9c4d07beec req-8f1af6dd-1a95-49b4-be06-4cf34ee0f983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f1373a-47c4-4413-86d2-86d0c939cb97", "name": "network-vif-plugged", "status": "completed", "tag": "dd8a8740-1190-426b-adac-9eb808bb59ae"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:21.729635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-895b5984-67e6-42c9-9773-fd9c4d07beec req-8f1af6dd-1a95-49b4-be06-4cf34ee0f983 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:21.731281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-895b5984-67e6-42c9-9773-fd9c4d07beec req-8f1af6dd-1a95-49b4-be06-4cf34ee0f983 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:21.731806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-895b5984-67e6-42c9-9773-fd9c4d07beec req-8f1af6dd-1a95-49b4-be06-4cf34ee0f983 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:21.747548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-895b5984-67e6-42c9-9773-fd9c4d07beec req-8f1af6dd-1a95-49b4-be06-4cf34ee0f983 service nova] Creating event network-vif-plugged:dd8a8740-1190-426b-adac-9eb808bb59ae for instance 60f1373a-47c4-4413-86d2-86d0c939cb97 on n-h2-860863-4 Nov 02 22:03:21.755264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-895b5984-67e6-42c9-9773-fd9c4d07beec req-8f1af6dd-1a95-49b4-be06-4cf34ee0f983 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203209 Nov 02 22:03:21.756698 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3191/6500] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:22.371557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:22.373159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:22.381538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:22.382062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:22.382521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:22.386288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:22.386288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:22.386288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:22.587933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:22.596527 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39c96930-5ddd-46bf-b469-a30a6c84a44b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1393 microversion: 2.1 time: 0.228692 Nov 02 22:03:22.600981 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3310/6501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:22 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1393 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:22.629490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:22.633441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:22.644905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:22.646523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:22.647165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:22.648090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:22.648739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:22.649383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:22.872188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:22.881088 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4752bd81-4608-4574-a2f6-77ad5c713ea2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.256673 Nov 02 22:03:22.881808 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3192/6502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:22 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:23.620191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:23.620828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:23.627959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:23.628465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:23.628939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:23.629670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:23.630311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:23.630850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:23.792347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:23.806204 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4aab1e0-b6bf-4fb9-93c0-6bc399f49fa0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1564 microversion: 2.1 time: 0.189748 Nov 02 22:03:23.807832 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3311/6503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:23 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:23.832348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:23.833284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:23.841319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:23.842062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:23.849943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:23.851357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:23.851848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:23.852467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:23.857396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:23.877640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-50ce932b-c3a7-4aea-b3f5-d33470e2dbbb req-6f2ab27c-f09b-4953-9954-8344c2baa91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21297773-fa06-420c-b893-e4e79a6c9ad7", "name": "network-vif-plugged", "status": "completed", "tag": "c1b54115-5891-4981-a965-5efcb232dd92"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:23.912393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-50ce932b-c3a7-4aea-b3f5-d33470e2dbbb req-6f2ab27c-f09b-4953-9954-8344c2baa91f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:23.913058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-50ce932b-c3a7-4aea-b3f5-d33470e2dbbb req-6f2ab27c-f09b-4953-9954-8344c2baa91f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:23.913527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-50ce932b-c3a7-4aea-b3f5-d33470e2dbbb req-6f2ab27c-f09b-4953-9954-8344c2baa91f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:23.932386 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-50ce932b-c3a7-4aea-b3f5-d33470e2dbbb req-6f2ab27c-f09b-4953-9954-8344c2baa91f service nova] Creating event network-vif-plugged:c1b54115-5891-4981-a965-5efcb232dd92 for instance 21297773-fa06-420c-b893-e4e79a6c9ad7 on n-h1-860863-4 Nov 02 22:03:23.938211 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-50ce932b-c3a7-4aea-b3f5-d33470e2dbbb req-6f2ab27c-f09b-4953-9954-8344c2baa91f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064223 Nov 02 22:03:23.939341 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3312/6504] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:23.947555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:23.948287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:23.957122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:23.957892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:23.958559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:23.959463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:23.960136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:23.960817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:24.269983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:24.282022 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-345df032-a970-44cb-a9c5-6bcc31c903f2 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1564 microversion: 2.1 time: 0.455244 Nov 02 22:03:24.283801 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3193/6505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:23 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1564 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:24.334822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:24.355706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58fc0a13-98e2-4dcc-a2ae-22606a4d0b17 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.412406 Nov 02 22:03:24.357287 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3313/6506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:23 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:25.379522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:25.380878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:25.388229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:25.388969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:25.390066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:25.390974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:25.391602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:25.392204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:25.666488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:25.675698 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-706abf07-82e8-4bca-b825-82f1fb0f75cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1375 microversion: 2.1 time: 0.300002 Nov 02 22:03:25.677548 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3194/6507] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:25 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1375 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:26.704084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:26.705305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:26.713108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:26.713615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:26.714073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:26.714837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:26.715473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:26.716068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.304478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:27.313631 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d311cdbe-6d3d-46b2-8bd4-67aec4a76480 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1562 microversion: 2.1 time: 0.613673 Nov 02 22:03:27.325533 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3314/6508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:26 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1562 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:27.342777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:27.344098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:27.354186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:27.362369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:27.362369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.362369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:27.362369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:27.362369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.470927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:27.470927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:27.481735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:27.482596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:27.483176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.484125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:27.484735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:27.485378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.526385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:27.637651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:27.650496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fa1d8966-ebec-4332-bbb6-e26d235b444c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1562 microversion: 2.1 time: 0.311576 Nov 02 22:03:27.651122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3195/6509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:27 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1562 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:27.658781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b9025f3e-d893-4992-ae4c-cd558bdc06cd req-119ebc93-e77d-4aee-a23f-85dc1876951b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f1373a-47c4-4413-86d2-86d0c939cb97", "tag": "dd8a8740-1190-426b-adac-9eb808bb59ae"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:27.689650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9025f3e-d893-4992-ae4c-cd558bdc06cd req-119ebc93-e77d-4aee-a23f-85dc1876951b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:27.689650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9025f3e-d893-4992-ae4c-cd558bdc06cd req-119ebc93-e77d-4aee-a23f-85dc1876951b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:27.689650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9025f3e-d893-4992-ae4c-cd558bdc06cd req-119ebc93-e77d-4aee-a23f-85dc1876951b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.700708 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b9025f3e-d893-4992-ae4c-cd558bdc06cd req-119ebc93-e77d-4aee-a23f-85dc1876951b service nova] Creating event network-changed:dd8a8740-1190-426b-adac-9eb808bb59ae for instance 60f1373a-47c4-4413-86d2-86d0c939cb97 on n-h2-860863-4 Nov 02 22:03:27.706523 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b9025f3e-d893-4992-ae4c-cd558bdc06cd req-119ebc93-e77d-4aee-a23f-85dc1876951b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052670 Nov 02 22:03:27.707623 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3196/6510] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:27.763353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:27.790626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:27.790626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:27.790626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:27.791110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:27.791519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.792299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:27.792749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:27.792868 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5847ff00-0721-4d3f-a9df-74ece1d2c0d8 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1564 microversion: 2.1 time: 0.327129 Nov 02 22:03:27.793194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:27.794632 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3315/6511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:27 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1564 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:27.853371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:03:28.249331 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-398f8537-c2ea-4fdf-a9a0-979bc2921b68 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 204 len: 0 microversion: 2.1 time: 0.471946 Nov 02 22:03:28.251616 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3197/6512] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:03:27 2022] DELETE /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 22:03:28.266005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:28.266725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:28.270264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=62 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:28.285238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:28.286649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:28.299513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:28.299513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:28.299513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:28.301248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:28.599951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:28.612220 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4f68b01-3496-44cb-9781-6a5f00e0881a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1568 microversion: 2.1 time: 0.352536 Nov 02 22:03:28.613751 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3316/6513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:28 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:29.640107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:29.641580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:29.650109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:29.652030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:29.652781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:29.653301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:29.654141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:29.654667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:29.655176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:29.815977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:29.831272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-adbb497c-7f5b-41f7-9f4a-34043df6972c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1568 microversion: 2.1 time: 0.195831 Nov 02 22:03:29.832770 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3198/6514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:29 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:30.607037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c9b25246-8870-442e-8254-ccd60c012746 req-b5d33aa6-4d23-4a59-83e6-a30b1d181845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21297773-fa06-420c-b893-e4e79a6c9ad7", "name": "network-vif-deleted", "tag": "c1b54115-5891-4981-a965-5efcb232dd92"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:30.632193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9b25246-8870-442e-8254-ccd60c012746 req-b5d33aa6-4d23-4a59-83e6-a30b1d181845 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:30.632682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9b25246-8870-442e-8254-ccd60c012746 req-b5d33aa6-4d23-4a59-83e6-a30b1d181845 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:30.633187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9b25246-8870-442e-8254-ccd60c012746 req-b5d33aa6-4d23-4a59-83e6-a30b1d181845 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:30.654922 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c9b25246-8870-442e-8254-ccd60c012746 req-b5d33aa6-4d23-4a59-83e6-a30b1d181845 service nova] Creating event network-vif-deleted:c1b54115-5891-4981-a965-5efcb232dd92 for instance 21297773-fa06-420c-b893-e4e79a6c9ad7 on n-h1-860863-4 Nov 02 22:03:30.662849 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c9b25246-8870-442e-8254-ccd60c012746 req-b5d33aa6-4d23-4a59-83e6-a30b1d181845 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059549 Nov 02 22:03:30.667197 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3317/6515] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:30.865914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:30.866640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:30.875460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:30.875974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:30.876427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:30.877190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:30.878979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:30.879464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:30.893856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2141455664", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "f102d7b2-0c08-4275-8544-52edb2d9bf6d"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:30.987515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:30.999244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6afbdc95-d959-4dcb-b888-8a82d26e5fd0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1360 microversion: 2.1 time: 0.137760 Nov 02 22:03:30.999853 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3318/6516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:30 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1360 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:31.029559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] validate_networks() for [('f102d7b2-0c08-4275-8544-52edb2d9bf6d', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:03:31.476486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:03:31.477315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:03:31.480194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:03:31.480771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:03:31.481637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:03:31.495761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:31.497684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:31.498354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:31.499105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:31.499569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:31.500005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:31.519488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Getting quotas for project 52b6e923b6f34cebbebe6a6759457e00. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:03:31.527461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Getting quotas for user e6d2f1afc4e649638ddc30b57b911ce6 and project 52b6e923b6f34cebbebe6a6759457e00. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:03:31.543188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:03:31.545780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:03:31.685430 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1358e0ba-3c32-433a-8215-4ed108d468d4 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005966 Nov 02 22:03:31.692878 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3199/6517] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:03:31.697911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-abddbda5-4fdb-4159-ae8f-b6b14461c9a1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:31.698551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-abddbda5-4fdb-4159-ae8f-b6b14461c9a1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:31.765247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-abddbda5-4fdb-4159-ae8f-b6b14461c9a1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:31.773199 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-abddbda5-4fdb-4159-ae8f-b6b14461c9a1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1215 microversion: 2.1 time: 0.078849 Nov 02 22:03:31.774476 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3319/6518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:31 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:32.025928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:32.026460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:32.035885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:32.036770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:32.037436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:32.038356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:32.038876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:32.039313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:32.111647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:32.120579 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c2f22b45-9241-4b29-91cb-05f0cd3fbe08 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1360 microversion: 2.1 time: 0.098840 Nov 02 22:03:32.121183 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3200/6519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:32 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1360 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:32.797583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1808ba6b-f64c-42c3-b71b-7020f86ae587 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:32.798238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1808ba6b-f64c-42c3-b71b-7020f86ae587 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:32.866214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1808ba6b-f64c-42c3-b71b-7020f86ae587 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:32.873893 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1808ba6b-f64c-42c3-b71b-7020f86ae587 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1215 microversion: 2.1 time: 0.080128 Nov 02 22:03:32.874964 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3320/6520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:32 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:33.145912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:33.145912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:33.155355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:33.156044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:33.156581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:33.157424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:33.158235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:33.158755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:33.253708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:33.263113 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48e7d98b-08ef-4e62-b784-f59ffa1a02cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1360 microversion: 2.1 time: 0.123189 Nov 02 22:03:33.274591 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3201/6521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:33 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1360 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:33.898895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:33.900471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:33.910165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:33.910912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:33.911571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:33.914648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:33.914648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:33.914648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:33.988617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:33.997073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-537f77e6-6605-48be-88dd-67df950f8f76 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1267 microversion: 2.1 time: 0.102566 Nov 02 22:03:33.997660 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3321/6522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:33 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:34.286761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:34.287342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:34.294398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:34.294891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:34.295310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:34.296135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:34.296585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:34.297041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:34.370960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:34.379144 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ee0c6b51-e23e-4bd4-86e0-a04443cce63f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1360 microversion: 2.1 time: 0.096675 Nov 02 22:03:34.379725 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3202/6523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:34 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:35.036481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:35.111826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:35.120955 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04c7b33d-4f43-4e93-8373-debaeb0e8398 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1275 microversion: 2.1 time: 0.101129 Nov 02 22:03:35.128101 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3322/6524] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:35 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:35.407315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:35.409599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:35.420635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:35.424247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:35.424247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:35.424247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:35.424247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:35.424247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:35.515896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:35.524545 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ab19eaa-c3d5-4f4d-ab4e-68f8247e3a24 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1360 microversion: 2.1 time: 0.124670 Nov 02 22:03:35.525503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3203/6525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:35 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1360 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:36.151685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:36.152513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:36.160045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:36.160626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:36.161743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:36.162671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:36.163204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:36.163714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:36.465577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:36.483054 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-983e2f04-3d9f-4962-a956-4334273453aa tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.336313 Nov 02 22:03:36.484537 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3323/6526] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:36 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:36.550243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:36.551502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:36.561751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:36.573840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:36.574645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:36.575619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:36.576288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:36.577306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:36.663823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:36.669766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:36.669766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:36.669766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lazy-loading 'fault' on Instance uuid 21297773-fa06-420c-b893-e4e79a6c9ad7 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:03:36.751289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:36.762975 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ef8f5e42-5304-4fad-8f59-dab3b5824718 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 200 len: 1365 microversion: 2.1 time: 0.217502 Nov 02 22:03:36.764536 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3204/6527] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:36 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:37.518139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:37.530207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:37.539624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ab8309de-4bf7-4c84-9f70-d02c5ac514f1 req-176ad870-f830-4584-b7c0-0b0e676572ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5052d0e9-7774-496c-a56f-d01ec846e05f", "tag": "7327c423-ed08-4e6b-a41b-ad1e89079528"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:37.572266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:37.572774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:37.588334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:37.588334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:37.588334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:37.588334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:37.591113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ab8309de-4bf7-4c84-9f70-d02c5ac514f1 req-176ad870-f830-4584-b7c0-0b0e676572ae service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:37.594804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ab8309de-4bf7-4c84-9f70-d02c5ac514f1 req-176ad870-f830-4584-b7c0-0b0e676572ae service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:37.595288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ab8309de-4bf7-4c84-9f70-d02c5ac514f1 req-176ad870-f830-4584-b7c0-0b0e676572ae service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:37.624765 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ab8309de-4bf7-4c84-9f70-d02c5ac514f1 req-176ad870-f830-4584-b7c0-0b0e676572ae service nova] Creating event network-changed:7327c423-ed08-4e6b-a41b-ad1e89079528 for instance 5052d0e9-7774-496c-a56f-d01ec846e05f on n-h1-860863-4 Nov 02 22:03:37.634000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ab8309de-4bf7-4c84-9f70-d02c5ac514f1 req-176ad870-f830-4584-b7c0-0b0e676572ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108739 Nov 02 22:03:37.634615 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3205/6528] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:37.793562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:37.795284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:37.811843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:37.812876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:37.819716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:37.820714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:37.821532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:37.822074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:37.858802 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 HTTP/1.1 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '21297773-fa06-420c-b893-e4e79a6c9ad7'} Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:03:37.861187 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:37.865505 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:37.865505 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:03:37.865505 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:03:37.865505 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:03:37.865505 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:03:37.865505 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:03:37.865505 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:37.867476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:03:37.871108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f494b582-e2bd-413c-9cdf-ec285ed8c006 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 404 len: 111 microversion: 2.1 time: 0.082436 Nov 02 22:03:37.889101 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3206/6529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:37 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:03:37.923317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:37.948034 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b81053e0-e645-430a-af9a-df0a266b82a7 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.435249 Nov 02 22:03:37.959368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3324/6530] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:37 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:38.974947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:38.975587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:38.982954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:38.983437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:38.983883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:38.984588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:38.985072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:38.985510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:39.156785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:39.165784 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f39f6dcc-b56f-4a2b-926a-e6ee449f6d17 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.195354 Nov 02 22:03:39.166834 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3207/6531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:38 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:40.195320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:40.197046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:40.209190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:40.210243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:40.219126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:40.221910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:40.221910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:40.223243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:40.429022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:40.436745 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ffed0a0-f7fd-4c0b-a519-05b4e1cc0c49 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.246345 Nov 02 22:03:40.437392 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3325/6532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:40 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:41.460003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:41.461312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:41.468526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:41.469181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:41.469825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:41.470655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:41.471212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:41.471743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:41.523001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:41.542322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:41.728734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:41.736543 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5078dc62-9a18-4ff1-8e4b-d0c4fd202548 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.280661 Nov 02 22:03:41.737788 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3208/6533] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:41 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:42.761944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:42.762715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:42.775434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:42.780502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:42.781007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:42.781760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:42.782231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:42.782682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:42.871031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:42.972868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:42.982470 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc39691c-f097-41be-8729-f9cd36a0be14 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.224711 Nov 02 22:03:42.983210 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3326/6534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:42 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:43.871327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1cc67aa4-5302-4908-be39-5609ed6b60d2 req-89936422-f6ec-45eb-8ca6-09bff4bc19d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5052d0e9-7774-496c-a56f-d01ec846e05f", "name": "network-vif-plugged", "status": "completed", "tag": "7327c423-ed08-4e6b-a41b-ad1e89079528"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:43.883553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1cc67aa4-5302-4908-be39-5609ed6b60d2 req-89936422-f6ec-45eb-8ca6-09bff4bc19d7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:43.883821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1cc67aa4-5302-4908-be39-5609ed6b60d2 req-89936422-f6ec-45eb-8ca6-09bff4bc19d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:43.884446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1cc67aa4-5302-4908-be39-5609ed6b60d2 req-89936422-f6ec-45eb-8ca6-09bff4bc19d7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:43.896887 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1cc67aa4-5302-4908-be39-5609ed6b60d2 req-89936422-f6ec-45eb-8ca6-09bff4bc19d7 service nova] Creating event network-vif-plugged:7327c423-ed08-4e6b-a41b-ad1e89079528 for instance 5052d0e9-7774-496c-a56f-d01ec846e05f on n-h1-860863-4 Nov 02 22:03:43.902074 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1cc67aa4-5302-4908-be39-5609ed6b60d2 req-89936422-f6ec-45eb-8ca6-09bff4bc19d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034458 Nov 02 22:03:43.902990 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3209/6535] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:44.007232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:44.008582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:44.016879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:44.016879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:44.018649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:44.020085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:44.020085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:44.020950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:44.205091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:44.220259 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ccbc64f1-24d9-4ac6-b7fe-f9d2fae79e67 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.217798 Nov 02 22:03:44.227069 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3327/6536] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:44 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:44.483533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:44.484126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:44.491215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:44.496305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:44.496305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:44.496305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:44.496305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:44.496305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:44.521366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:03:44.536420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:44.985791 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f4dd28f-7e06-495d-80c6-5a1e1bb5b278 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 204 len: 0 microversion: 2.1 time: 0.506213 Nov 02 22:03:44.986675 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3210/6537] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:03:44 2022] DELETE /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:03:44.996576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:44.997244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:45.003510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:45.004018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:45.004531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:45.005514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:45.005986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:45.006428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:45.250457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:45.251674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:45.291170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:45.294069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:45.296849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:45.301706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:45.301706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:45.301706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:45.302098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:45.332904 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a478e7dc-e844-4cfc-93a8-5b4166f27b8d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1410 microversion: 2.1 time: 0.339747 Nov 02 22:03:45.334181 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3328/6538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:44 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1410 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:45.534362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:45.547946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bdaf44da-7c14-4475-927e-6f95ca57807d tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1315 microversion: 2.1 time: 0.302325 Nov 02 22:03:45.548805 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3211/6539] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:45 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:46.359782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:46.360344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:46.368513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:46.369053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:46.369698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:46.370369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:46.370828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:46.371294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:46.553561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:46.559900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc86adc8-2807-48bc-bc17-d165f584f77d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1410 microversion: 2.1 time: 0.204089 Nov 02 22:03:46.560641 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3329/6540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:46 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1410 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:46.576035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:46.576035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:46.584410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:46.585112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:46.585683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:46.586504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:46.587137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:46.587632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:46.802320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:46.811200 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f6a9adf-e1f8-45d9-8a27-416b95f9d75c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1502 microversion: 2.1 time: 0.241387 Nov 02 22:03:46.811780 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3212/6541] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:46 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:46.836009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:46.836628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:46.848125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:46.849356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:46.849882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:46.851133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:46.851859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:46.852291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:47.075828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:47.088683 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63411bd7-cb53-4561-b275-e5f6f5aa7e87 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1502 microversion: 2.1 time: 0.256404 Nov 02 22:03:47.099029 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3330/6542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:46 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1502 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:47.123767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:47.124299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:47.130635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:47.131468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:47.132110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:47.133112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:47.133759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:47.134374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:47.163156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lazy-loading 'flavor' on Instance uuid 5052d0e9-7774-496c-a56f-d01ec846e05f {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:03:47.510121 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7c59660-f934-4491-b2e6-e9131e3b96c1 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action" status: 202 len: 0 microversion: 2.1 time: 0.382220 Nov 02 22:03:47.514427 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3213/6543] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:47 2022] POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:03:47.523523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:47.524155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:47.532330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:47.532330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:47.532559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:47.533754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:47.534745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:47.535521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:47.588321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:47.589341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:47.617436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:47.618263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:47.618815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:47.619790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:47.621089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:47.622721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:48.206064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:48.219091 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e7d09565-cd9a-4e32-bde2-455ec1ac3463 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1368 microversion: 2.1 time: 0.638274 Nov 02 22:03:48.219703 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3214/6544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:47 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1368 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:48.236867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b9c37f98-74f7-4a62-af60-b0ddbf6162a9 req-c1dca634-1849-473a-acee-0c7153b4d59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b998f3-2b02-4a29-b08a-92cb0f176e2b", "name": "network-vif-deleted", "tag": "6660e040-aa02-4acd-8ee1-a34e4768e15c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:48.264709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9c37f98-74f7-4a62-af60-b0ddbf6162a9 req-c1dca634-1849-473a-acee-0c7153b4d59a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:48.265131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9c37f98-74f7-4a62-af60-b0ddbf6162a9 req-c1dca634-1849-473a-acee-0c7153b4d59a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:48.275830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b9c37f98-74f7-4a62-af60-b0ddbf6162a9 req-c1dca634-1849-473a-acee-0c7153b4d59a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:48.311781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:48.320426 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b9c37f98-74f7-4a62-af60-b0ddbf6162a9 req-c1dca634-1849-473a-acee-0c7153b4d59a service nova] Creating event network-vif-deleted:6660e040-aa02-4acd-8ee1-a34e4768e15c for instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b on n-h2-860863-4 Nov 02 22:03:48.327119 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b9c37f98-74f7-4a62-af60-b0ddbf6162a9 req-c1dca634-1849-473a-acee-0c7153b4d59a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104036 Nov 02 22:03:48.332184 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3215/6545] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:03:48.332642 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b76eff9-782c-41cf-a5b0-edcf05e72323 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1510 microversion: 2.1 time: 0.813899 Nov 02 22:03:48.334798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3331/6546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:47 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1510 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:49.148162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:49.153783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:49.192626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.193675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.197645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.198567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.199592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.200198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.245372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:49.246587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:49.253376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.254265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.255307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.257644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.258365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.259607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.270491 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-96abe0b5-365f-4718-9c3b-59fc64c36966 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action" status: 200 len: 24574 microversion: 2.1 time: 0.134516 Nov 02 22:03:49.280451 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3216/6547] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:49 2022] POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action => generated 24574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:03:49.360858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:49.361700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:49.370661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.371410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.372071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.372995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.373659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.374161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.410407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:49.422051 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-205b9579-a198-4b53-9a31-b3f72ccf4ffa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1202 microversion: 2.1 time: 0.180601 Nov 02 22:03:49.423278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3332/6548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:49 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:49.653507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:49.663234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7349fe3-634d-4b28-883d-c12ba88ebe9e tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1493 microversion: 2.1 time: 0.307268 Nov 02 22:03:49.663879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3217/6549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:49 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1493 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:49.693122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:49.693666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:49.699948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.700457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.700906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.701637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.702101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.702993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:49.871951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:49.972558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3f15dc4-db41-432c-a9c2-35f499914de3 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action" status: 202 len: 0 microversion: 2.1 time: 0.283462 Nov 02 22:03:49.977654 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3333/6550] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:49 2022] POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:03:49.981716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:49.982566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:49.993232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:49.994024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:49.999280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:50.000679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:50.001339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:50.001787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:50.270605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:50.280442 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ecbde0bf-5272-4498-96b4-55a3e488ac79 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1499 microversion: 2.1 time: 0.302964 Nov 02 22:03:50.281257 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3218/6551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:49 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1499 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:50.447529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:50.448373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:50.462270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:50.462921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:50.463582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:50.464723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:50.465435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:50.466030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:50.564948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:50.575277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d6f7772-8fb3-4008-9847-59119269e542 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1202 microversion: 2.1 time: 0.133022 Nov 02 22:03:50.575858 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3334/6552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:50 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1202 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:51.309949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:51.311202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:51.321210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:51.321936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:51.322379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:51.323250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:51.323858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:51.324466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:51.509993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:51.517956 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-360233eb-90c5-46c3-8e04-b49bb23b8239 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1499 microversion: 2.1 time: 0.213622 Nov 02 22:03:51.518498 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3219/6553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:51 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1499 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:51.598267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:51.599360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:51.606142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:51.606873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:51.607529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:51.608670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:51.609178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:51.609779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:51.680759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:51.689226 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf50b843-56da-4fb6-9d84-dc82567238f8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1202 microversion: 2.1 time: 0.095006 Nov 02 22:03:51.702592 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3335/6554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:51 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:52.542014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:52.542693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:52.553351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:52.553351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:52.553351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:52.553351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:52.554156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:52.554465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:52.703486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:52.714244 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a1bbdbb-1cc3-4825-9d28-2c0f1e4ce03c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1502 microversion: 2.1 time: 0.176050 Nov 02 22:03:52.715475 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3220/6555] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:52 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:52.740314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:52.740968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:52.747868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:52.747868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:52.758125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:52.758643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:52.759108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:52.759836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:52.760312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:52.760763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:52.763757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:52.764785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:52.765477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:52.766432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:52.767095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:52.767675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:52.799391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lazy-loading 'flavor' on Instance uuid 5052d0e9-7774-496c-a56f-d01ec846e05f {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:03:52.886814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:52.896715 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76b5e26e-d37e-4978-ba05-4f3f64f30392 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1202 microversion: 2.1 time: 0.185000 Nov 02 22:03:52.905333 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3336/6556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:52 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1202 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:53.128778 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e825c52-4d63-46b8-aff2-ae27a461d61f tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action" status: 202 len: 0 microversion: 2.1 time: 0.385981 Nov 02 22:03:53.140248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:53.141397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:53.146646 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3221/6557] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:52 2022] POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:03:53.151233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:53.151977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:53.152678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:53.154108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:53.154841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:53.155592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:53.350874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:53.358785 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d953da5d-49ee-41b0-9f80-d7249620c2d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1510 microversion: 2.1 time: 0.223838 Nov 02 22:03:53.359570 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3337/6558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:53 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:53.942950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:53.944380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:53.952235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:53.952906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:53.953534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:53.954477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:53.955189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:53.955780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:54.046761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:54.055781 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a5fb5c9-c077-434d-94d8-f61c0a4d239b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1202 microversion: 2.1 time: 0.126817 Nov 02 22:03:54.056374 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3222/6559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:53 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1202 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:54.385673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:54.386992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:54.397140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:54.397670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:54.398338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:54.399283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:54.399949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:54.400621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:54.695619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:54.705906 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2901565-8697-4f68-bd29-59b8955ee98c tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1493 microversion: 2.1 time: 0.327131 Nov 02 22:03:54.706503 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3338/6560] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:54 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1493 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:54.735378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:54.736207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:54.742840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:54.743629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:54.744233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:54.745327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:54.745953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:54.746414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:54.778244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:03:54.997218 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2646902-5e41-4477-8318-a1a3a7d85334 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action" status: 202 len: 0 microversion: 2.1 time: 0.270818 Nov 02 22:03:54.999023 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3223/6561] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:54 2022] POST /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:03:55.018886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:55.019551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:55.031451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:55.031984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:55.032789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:55.034029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:55.034668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:55.035278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:55.079336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:55.080262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:55.088089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:55.089827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:55.089827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:55.089827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:55.090181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:55.090622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:55.217501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:55.228603 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9299730-04a1-4bee-bc18-4c5b73257069 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1202 microversion: 2.1 time: 0.154078 Nov 02 22:03:55.240962 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3224/6562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:55 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:55.277227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:55.287495 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca695615-75b7-41fa-96fa-18bfab2121d9 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1499 microversion: 2.1 time: 0.284601 Nov 02 22:03:55.288329 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3339/6563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:55 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1499 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:55.689342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:55.690173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:55.705967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:55.706795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:55.707409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:55.708894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:55.709693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:55.710310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:55.996099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:56.010124 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-76b5b653-51c9-40f8-a6a9-57a72491067b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1683 microversion: 2.1 time: 0.324718 Nov 02 22:03:56.010839 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3225/6564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:55 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1683 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:56.190912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:56.193905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:56.202071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.202921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.203673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.204557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.205259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.206021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.254043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:56.258795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:56.265868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.266380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.266826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.267535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.267993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.268532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.284641 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9788d604-ce7a-437f-bffb-64e888d85a30 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action" status: 200 len: 32641 microversion: 2.1 time: 0.098481 Nov 02 22:03:56.286166 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3340/6565] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:56 2022] POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action => generated 32641 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:03:56.312252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:56.313167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:56.314361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.314855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.315297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.315758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lazy-loading 'fault' on Instance uuid f8b998f3-2b02-4a29-b08a-92cb0f176e2b {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:03:56.335954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.335954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.335954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.338469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.339043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.339702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.406728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:56.420156 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc302bcd-0a25-4643-a654-a61ff53ffe93 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 200 len: 1207 microversion: 2.1 time: 0.170244 Nov 02 22:03:56.420942 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3226/6566] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:56 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 1207 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:56.529854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:56.531102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:56.538608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.539323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.539922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.541283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.541713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:56.544681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.544681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.557881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fcf4105-b5ef-444a-b4ff-480018edce38 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1499 microversion: 2.1 time: 0.249949 Nov 02 22:03:56.558475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3341/6567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:56 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:03:56.714626 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c185c171-655b-4628-8c81-76005e6f557a tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1834 microversion: 2.1 time: 0.188368 Nov 02 22:03:56.715399 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3227/6568] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:56 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1834 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:56.751992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:03:56.754989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:56.774287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.774760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.775221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.775960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:56.776438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:56.776886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:56.831959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lazy-loading 'flavor' on Instance uuid 60f1373a-47c4-4413-86d2-86d0c939cb97 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:03:56.855766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Going to try to live migrate instance to another host {{(pid=121040) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 02 22:03:57.446463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:57.447205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:57.456566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:57.471750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:57.472498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:57.476237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:57.476910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:57.480210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:57.507168 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b HTTP/1.1 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'f8b998f3-2b02-4a29-b08a-92cb0f176e2b'} Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:03:57.509018 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:03:57.513227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-84759145-3e50-4641-ae77-1542aafdfb6c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 404 len: 111 microversion: 2.1 time: 0.068772 Nov 02 22:03:57.514113 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3228/6569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:57 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:03:57.595432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:57.596861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:57.603663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:57.604157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:57.604601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:57.607410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:57.607880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:57.608322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:57.821469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:57.828963 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2c7dee25-fb7c-42cf-bbf0-3accc44a0a61 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1502 microversion: 2.1 time: 0.237769 Nov 02 22:03:57.829562 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3229/6570] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:57 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:57.852457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:57.853490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:57.861845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:57.862492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:57.863164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:57.865010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:57.865957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:57.866763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:57.912453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:03:58.320491 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e97d2f5d-fed8-4d5b-9b57-b6052d083186 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 204 len: 0 microversion: 2.1 time: 0.471107 Nov 02 22:03:58.326439 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3230/6571] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:03:57 2022] DELETE /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 22:03:58.342957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:58.345269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:58.369290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:58.370904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:58.372291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:58.375183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:58.375995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:58.377938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:58.695967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:58.705476 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-781f808c-52af-4fae-921a-df0a959c6a50 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1508 microversion: 2.1 time: 0.377703 Nov 02 22:03:58.709767 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3231/6572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:58 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:03:59.738725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:03:59.740116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:03:59.751847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:59.756200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:59.759551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:59.759551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:03:59.759551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:03:59.759551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:03:59.985456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:03:59.995682 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a45c3fb4-cfda-482e-80cf-387b78364637 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1508 microversion: 2.1 time: 0.259630 Nov 02 22:03:59.999727 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3232/6573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:03:59 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:01.030733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:01.047456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:01.080132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:01.084304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:01.089052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:01.089595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:01.095347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:01.095870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:01.099099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:01.339959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:01.349730 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0cbe7c63-737a-4dcf-a824-ea5e242968d5 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1466 microversion: 2.1 time: 0.334349 Nov 02 22:04:01.350926 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3233/6574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:01 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1466 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:04:01.356365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-14edea84-08ea-4c61-821c-399d2dcaa789 req-dbf3dbcb-7bc2-4786-9e07-6c383f1962d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5052d0e9-7774-496c-a56f-d01ec846e05f", "name": "network-vif-deleted", "tag": "7327c423-ed08-4e6b-a41b-ad1e89079528"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:01.367339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-14edea84-08ea-4c61-821c-399d2dcaa789 req-dbf3dbcb-7bc2-4786-9e07-6c383f1962d1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:01.367824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-14edea84-08ea-4c61-821c-399d2dcaa789 req-dbf3dbcb-7bc2-4786-9e07-6c383f1962d1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:01.368261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-14edea84-08ea-4c61-821c-399d2dcaa789 req-dbf3dbcb-7bc2-4786-9e07-6c383f1962d1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:01.381018 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-14edea84-08ea-4c61-821c-399d2dcaa789 req-dbf3dbcb-7bc2-4786-9e07-6c383f1962d1 service nova] Creating event network-vif-deleted:7327c423-ed08-4e6b-a41b-ad1e89079528 for instance 5052d0e9-7774-496c-a56f-d01ec846e05f on n-h1-860863-4 Nov 02 22:04:01.386467 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-14edea84-08ea-4c61-821c-399d2dcaa789 req-dbf3dbcb-7bc2-4786-9e07-6c383f1962d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034105 Nov 02 22:04:01.387317 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3234/6575] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:01.533309 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ca66782-8654-4b5a-b01b-8822e66037b7 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action" status: 202 len: 0 microversion: 2.1 time: 4.784580 Nov 02 22:04:01.535236 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3342/6576] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:03:56 2022] POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action => generated 0 bytes in 4788 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:04:01.546144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:01.547651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:01.556301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:01.559059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:01.559059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:01.559059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:01.559059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:01.560116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:01.763785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:01.773508 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f1175fe-2fb6-42ff-af08-1ff94e7fd026 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.232615 Nov 02 22:04:01.774207 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3235/6577] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:01 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:04:02.378020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:02.381557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:02.390087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=60 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:02.392118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:02.393124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:02.394375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:02.395685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:02.396460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:02.423665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:02.494416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:02.495557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:02.496035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:02.496514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lazy-loading 'fault' on Instance uuid 5052d0e9-7774-496c-a56f-d01ec846e05f {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:04:02.569480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d2f1afc4e649638ddc30b57b911ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b6e923b6f34cebbebe6a6759457e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:02.587697 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-333a226f-ed4b-4360-9e5d-ca93a6db4e84 tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 200 len: 1305 microversion: 2.1 time: 0.213511 Nov 02 22:04:02.588811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3343/6578] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:02 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 1305 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:02.801109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:02.802411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:02.812511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:02.813630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:02.814345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:02.815716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:02.816419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:02.817605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:03.003964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:03.004667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:03.021165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:03.023119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:03.023709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:03.024450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:03.024952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:03.032199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:03.063188 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 HTTP/1.1 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '21297773-fa06-420c-b893-e4e79a6c9ad7'} Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:04:03.066319 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f84c8157-7d40-42ec-875e-9cef776aa981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 404 len: 111 microversion: 2.1 time: 0.069053 Nov 02 22:04:03.070379 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3344/6579] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:04:02 2022] DELETE /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:04:03.077732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:03.078594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 21297773-fa06-420c-b893-e4e79a6c9ad7] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:03.086892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:03.087745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:03.099896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:03.099896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:03.099896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:03.099896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:03.108719 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 HTTP/1.1 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '21297773-fa06-420c-b893-e4e79a6c9ad7'} Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:03.110594 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.117152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 21297773-fa06-420c-b893-e4e79a6c9ad7 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:04:03.118415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2ad0c76-3311-40a5-81f9-386267acef02 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7" status: 404 len: 111 microversion: 2.1 time: 0.043822 Nov 02 22:04:03.118907 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3345/6580] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:03 2022] GET /compute/v2.1/servers/21297773-fa06-420c-b893-e4e79a6c9ad7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:04:03.314460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:03.329900 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ccf429a-7d45-4a4f-be36-ab37f79b40cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.533948 Nov 02 22:04:03.334580 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3236/6581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:02 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:03.614915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:03.616891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] [instance: 5052d0e9-7774-496c-a56f-d01ec846e05f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:03.630413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:03.631275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:03.634287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:03.635373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:03.636866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:03.639410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:03.676965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] HTTP exception thrown: Instance 5052d0e9-7774-496c-a56f-d01ec846e05f could not be found. Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Request method failure captured: Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f HTTP/1.1 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYukvRKDYrQDr3vWhuYQLmdhem__rRP9FTTT9rsivH1vhxlpjdhLgnNXv9jeqTLAreRZeI7zGp6VqBwQkOV-ee32-jEIl6YmeR9S5_B7TZjbeHmik5BCZ97YLh2E-Ecioiy2XCoRFSZeJ7RurvwD0M933S-fB60j1iRrkR7Q0_Zpa5OE Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 52b6e923b6f34cebbebe6a6759457e00 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestServerAdvancedOps-1037189480 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52b6e923b6f34cebbebe6a6759457e00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52b6e923b6f34cebbebe6a6759457e00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52b6e923b6f34cebbebe6a6759457e00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52b6e923b6f34cebbebe6a6759457e00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestServerAdvancedOps-1037189480 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 52b6e923b6f34cebbebe6a6759457e00 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestServerAdvancedOps-1037189480 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestServerAdvancedOps-1037189480-project Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e6d2f1afc4e649638ddc30b57b911ce6 Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestServerAdvancedOps-1037189480-project Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 5052d0e9-7774-496c-a56f-d01ec846e05f could not be found. Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '5052d0e9-7774-496c-a56f-d01ec846e05f'} Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5052d0e9-7774-496c-a56f-d01ec846e05f could not be found. Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5052d0e9-7774-496c-a56f-d01ec846e05f could not be found. Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:03.685204 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5052d0e9-7774-496c-a56f-d01ec846e05f could not be found. Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] Returning 404 to user: Instance 5052d0e9-7774-496c-a56f-d01ec846e05f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-703a5079-90a5-4e6e-9171-c767fd73ceeb tempest-TestServerAdvancedOps-1037189480 tempest-TestServerAdvancedOps-1037189480-project] 10.222.0.25 "GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f" status: 404 len: 111 microversion: 2.1 time: 0.076984 Nov 02 22:04:03.694079 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3346/6582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:03 2022] GET /compute/v2.1/servers/5052d0e9-7774-496c-a56f-d01ec846e05f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:04:04.369795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:04.372046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:04.388574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:04.389103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:04.390975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:04.407607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:04.410974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:04.412270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:04.622242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:04.625111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:04.631853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:04.638958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:04.639824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:04.640607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:04.642183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:04.644429 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:04.671825 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b HTTP/1.1 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f8b998f3-2b02-4a29-b08a-92cb0f176e2b'} Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:04:04.674100 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.678782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.680857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:04:04.687757 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08dfa19a-1e9f-40cf-ac0e-6d7f501f224d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 404 len: 111 microversion: 2.1 time: 0.064178 Nov 02 22:04:04.692951 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3347/6583] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:04:04 2022] DELETE /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:04:04.698438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:04.699424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: f8b998f3-2b02-4a29-b08a-92cb0f176e2b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:04.705949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:04.706811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:04.708224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:04.709153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:04.709801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:04.710409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:04.735930 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b HTTP/1.1 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f8b998f3-2b02-4a29-b08a-92cb0f176e2b'} Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:04.737922 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.742880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:04.742880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:04.742880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:04.742880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:04:04.742880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:04:04.742880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. Nov 02 22:04:04.742880 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:04:04.744682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance f8b998f3-2b02-4a29-b08a-92cb0f176e2b could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:04:04.746659 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af37a24b-07ad-43e6-b5f4-3ce8bcf0f8aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b" status: 404 len: 111 microversion: 2.1 time: 0.052401 Nov 02 22:04:04.747658 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3348/6584] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:04 2022] GET /compute/v2.1/servers/f8b998f3-2b02-4a29-b08a-92cb0f176e2b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:04:04.881798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56cfdba9-d031-46d5-8de7-026c3b44c1f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: .version_select at 0x7f9b603aed30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-413771351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL+DhzelwF1OHI0pgoqRvpIZ9WiuQkrXV3K10avSpqNTruQzy+6w9VUQNbKE0fqXmMvKAoiLQToW6lNYmtIE45qCzzc2jn8hS7rbmONjirWX6+ZOeXXGrFWwJjlCi85LQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:04.940232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-56cfdba9-d031-46d5-8de7-026c3b44c1f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:04:04.952133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-56cfdba9-d031-46d5-8de7-026c3b44c1f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:04:05.098630 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56cfdba9-d031-46d5-8de7-026c3b44c1f7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.227546 Nov 02 22:04:05.099431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3349/6585] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:04:04 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:05.107306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-464b34cc-9cca-4d69-8183-d6ca0dcb0ef1 req-7e7b9c58-15e5-454c-9cdc-e7e1c0194222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f1373a-47c4-4413-86d2-86d0c939cb97", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8a8740-1190-426b-adac-9eb808bb59ae"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:05.151686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-464b34cc-9cca-4d69-8183-d6ca0dcb0ef1 req-7e7b9c58-15e5-454c-9cdc-e7e1c0194222 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:05.152118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-464b34cc-9cca-4d69-8183-d6ca0dcb0ef1 req-7e7b9c58-15e5-454c-9cdc-e7e1c0194222 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:05.152577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-464b34cc-9cca-4d69-8183-d6ca0dcb0ef1 req-7e7b9c58-15e5-454c-9cdc-e7e1c0194222 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:05.182634 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-464b34cc-9cca-4d69-8183-d6ca0dcb0ef1 req-7e7b9c58-15e5-454c-9cdc-e7e1c0194222 service nova] Creating event network-vif-unplugged:dd8a8740-1190-426b-adac-9eb808bb59ae for instance 60f1373a-47c4-4413-86d2-86d0c939cb97 on n-h2-860863-4 Nov 02 22:04:05.203084 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-464b34cc-9cca-4d69-8183-d6ca0dcb0ef1 req-7e7b9c58-15e5-454c-9cdc-e7e1c0194222 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102372 Nov 02 22:04:05.209562 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3350/6586] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:05.367231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:05.391838 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-935e97dd-be70-40b8-827f-76dbcc9ed029 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 1.029483 Nov 02 22:04:05.393581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3237/6587] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:04 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:06.420014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:06.420832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:06.439615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:06.440629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:06.442329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:06.444188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:06.465136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:06.465136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:06.923975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:06.935699 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a549de20-c9c3-4d9f-9d25-e0f1187f0b69 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.520884 Nov 02 22:04:06.938768 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3351/6588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:06 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:07.432276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a98b52ff-926e-4b23-a734-6f25de7b4dc9 req-305abcc5-fcf0-43ff-a2dc-67de263d0a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f1373a-47c4-4413-86d2-86d0c939cb97", "tag": "dd8a8740-1190-426b-adac-9eb808bb59ae"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:07.449365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a98b52ff-926e-4b23-a734-6f25de7b4dc9 req-305abcc5-fcf0-43ff-a2dc-67de263d0a05 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:07.451438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a98b52ff-926e-4b23-a734-6f25de7b4dc9 req-305abcc5-fcf0-43ff-a2dc-67de263d0a05 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:07.452109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a98b52ff-926e-4b23-a734-6f25de7b4dc9 req-305abcc5-fcf0-43ff-a2dc-67de263d0a05 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:07.483295 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a98b52ff-926e-4b23-a734-6f25de7b4dc9 req-305abcc5-fcf0-43ff-a2dc-67de263d0a05 service nova] Creating event network-changed:dd8a8740-1190-426b-adac-9eb808bb59ae for instance 60f1373a-47c4-4413-86d2-86d0c939cb97 on n-h2-860863-4 Nov 02 22:04:07.490148 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a98b52ff-926e-4b23-a734-6f25de7b4dc9 req-305abcc5-fcf0-43ff-a2dc-67de263d0a05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063798 Nov 02 22:04:07.491714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3238/6589] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:07.966471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:07.968127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:07.981164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:07.982085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:07.983014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:07.985435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:07.987485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:07.989753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:08.578686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:08.589466 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08430119-2ec2-4aa4-b243-834a628742de tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.628323 Nov 02 22:04:08.590271 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3352/6590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:07 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:09.618265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:09.619715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:09.642948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:09.644631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:09.647685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:09.648623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:09.649218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:09.649721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:09.684254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:09.947835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:09.960609 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7adec71a-2dea-421d-82e0-25ab3848a2b5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.346597 Nov 02 22:04:09.962234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3239/6591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:09 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:10.988419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:10.989678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:10.999737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:11.000777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:11.003287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:11.010095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:11.011038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:11.011717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:11.253587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:11.258376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:11.263260 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-949d8e56-15c8-4692-8f7d-e31b112b2cc1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.280301 Nov 02 22:04:11.263918 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3353/6592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:10 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:12.292660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:12.293659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:12.316521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:12.320912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:12.320912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:12.320912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:12.322871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:12.324394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:12.541218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:12.549175 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ebee327f-d2d0-47c6-8497-87bf44f05476 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.262864 Nov 02 22:04:12.549856 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3240/6593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:12 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:13.579229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:13.579229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:13.593190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:13.593710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:13.595441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:13.596199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:13.599576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:13.600044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:13.873987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:13.896583 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5761dcc-d14f-4177-a36d-a83fd3e08ea4 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.326248 Nov 02 22:04:13.902351 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3354/6594] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:13 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:14.933337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:14.935797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:14.955932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:14.956855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:14.959307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:14.961173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:14.961814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:14.962340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:15.251602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:15.260520 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-168b941b-ab3e-4a60-a939-08976dc14c33 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.331841 Nov 02 22:04:15.261194 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3241/6595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:14 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:04:16.284375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:16.285045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:16.290837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:16.305225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:16.306074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:16.306717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:16.307765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:16.310317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:16.310989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:16.634148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:16.644302 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-174e3d8e-8116-462e-8d40-ae15da22a8e1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1693 microversion: 2.1 time: 0.364035 Nov 02 22:04:16.662325 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3355/6596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:16 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1693 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:17.671661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:17.672669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:17.681659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:17.686302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:17.686302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:17.686302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:17.686302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:17.686302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:17.888046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:17.901373 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0d242b6a-1a81-4819-9962-8136143e4685 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1683 microversion: 2.1 time: 0.235253 Nov 02 22:04:17.903636 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3242/6597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:17 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1683 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:17.927832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:17.929430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:17.939779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:17.947740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:17.947740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:17.947740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:17.947740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:17.947740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:18.198708 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-def5b94a-e632-4399-a959-e5c514e948f0 tempest-TestNetworkAdvancedServerOps-798911223 tempest-TestNetworkAdvancedServerOps-798911223-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1834 microversion: 2.1 time: 0.275002 Nov 02 22:04:18.224699 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3356/6598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:17 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1834 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:18.232624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:18.235143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:18.241985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:18.242733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:18.243467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:18.244687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:18.245353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:18.249587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:18.475495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:18.488955 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-077cd580-4823-4e04-a553-44e576c79ec0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1683 microversion: 2.1 time: 0.261667 Nov 02 22:04:18.494713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3243/6599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:18 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:20.659579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:20.663386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:20.679444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:20.681210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:20.682076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:20.690639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:20.691464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:20.692661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:20.787774 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f17d6135-81a0-4edf-b0d4-24214bae33d7 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action" status: 200 len: 38637 microversion: 2.1 time: 0.134176 Nov 02 22:04:20.788552 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3357/6600] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:04:20 2022] POST /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97/action => generated 38637 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 22:04:22.623589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:22.625066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:22.636600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:22.637178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0217dfaf-6a08-477f-ba94-773490135dc1 req-d07bbdd0-4a44-46de-af7b-45f43e0e4e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f1373a-47c4-4413-86d2-86d0c939cb97", "tag": "dd8a8740-1190-426b-adac-9eb808bb59ae"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:22.640768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:22.641265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:22.642006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:22.642469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:22.642905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:22.657137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0217dfaf-6a08-477f-ba94-773490135dc1 req-d07bbdd0-4a44-46de-af7b-45f43e0e4e1a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:22.664481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0217dfaf-6a08-477f-ba94-773490135dc1 req-d07bbdd0-4a44-46de-af7b-45f43e0e4e1a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:22.664481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0217dfaf-6a08-477f-ba94-773490135dc1 req-d07bbdd0-4a44-46de-af7b-45f43e0e4e1a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:22.684557 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0217dfaf-6a08-477f-ba94-773490135dc1 req-d07bbdd0-4a44-46de-af7b-45f43e0e4e1a service nova] Creating event network-changed:dd8a8740-1190-426b-adac-9eb808bb59ae for instance 60f1373a-47c4-4413-86d2-86d0c939cb97 on n-h1-860863-4 Nov 02 22:04:22.694399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:04:22.695014 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0217dfaf-6a08-477f-ba94-773490135dc1 req-d07bbdd0-4a44-46de-af7b-45f43e0e4e1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061750 Nov 02 22:04:22.696027 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3358/6601] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:04:23.084622 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-804a724e-bf53-41b1-8e9a-f6ecb8d46649 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 204 len: 0 microversion: 2.1 time: 0.464778 Nov 02 22:04:23.085239 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3244/6602] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:04:22 2022] DELETE /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:04:23.094805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:23.095536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:23.108197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:23.109242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:23.109819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:23.110626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:23.112315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:23.112456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:23.575265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:23.584621 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8919c67-5ed5-4e8b-8f4a-4a5afb7b8751 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1689 microversion: 2.1 time: 0.494613 Nov 02 22:04:23.593045 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3359/6603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:23 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1689 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:24.619698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:24.620401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:24.652642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:24.652642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:24.652642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:24.669208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:24.669861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:24.670317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:24.944625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e545fa1c-88c1-44f3-b166-777bf19e1106 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-780590462", "availability_zone": "foo_zone"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:24.956493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.aggregate [None req-e545fa1c-88c1-44f3-b166-777bf19e1106 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Generated uuid 39f9d56d-1147-4596-b1c3-075763f90e89 for aggregate {{(pid=121040) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 22:04:25.000887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:25.009704 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d81103bc-82ea-4a27-a172-40c6a1c7e1c6 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1570 microversion: 2.1 time: 0.394071 Nov 02 22:04:25.014048 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3245/6604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:24 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1570 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:25.107679 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e545fa1c-88c1-44f3-b166-777bf19e1106 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.448986 Nov 02 22:04:25.116898 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3360/6605] 10.222.0.25 () {60 vars in 1164 bytes} [Wed Nov 2 22:04:24 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:25.123701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-45f0d78b-eca9-44a9-9db4-6e8bc98d9476 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:25.244832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9ef407d3-3b09-439b-802d-e0595974b9eb req-2a8829a3-bbe9-4dd0-a66f-1583b27a350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f1373a-47c4-4413-86d2-86d0c939cb97", "name": "network-vif-deleted", "tag": "dd8a8740-1190-426b-adac-9eb808bb59ae"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:25.273152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ef407d3-3b09-439b-802d-e0595974b9eb req-2a8829a3-bbe9-4dd0-a66f-1583b27a350d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:25.274081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ef407d3-3b09-439b-802d-e0595974b9eb req-2a8829a3-bbe9-4dd0-a66f-1583b27a350d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:25.274532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ef407d3-3b09-439b-802d-e0595974b9eb req-2a8829a3-bbe9-4dd0-a66f-1583b27a350d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:25.291274 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9ef407d3-3b09-439b-802d-e0595974b9eb req-2a8829a3-bbe9-4dd0-a66f-1583b27a350d service nova] Creating event network-vif-deleted:dd8a8740-1190-426b-adac-9eb808bb59ae for instance 60f1373a-47c4-4413-86d2-86d0c939cb97 on n-h1-860863-4 Nov 02 22:04:25.298398 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-45f0d78b-eca9-44a9-9db4-6e8bc98d9476 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.181498 Nov 02 22:04:25.299351 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3246/6606] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 22:04:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:25.313506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:25.320615 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9ef407d3-3b09-439b-802d-e0595974b9eb req-2a8829a3-bbe9-4dd0-a66f-1583b27a350d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078589 Nov 02 22:04:25.322924 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3361/6607] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:04:25.323709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:25.324002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:25.324815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:25.325593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:25.326228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:25.330741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:25.367820 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-353f5bef-b4fb-4a90-bbcc-4a310b95838f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060290 Nov 02 22:04:25.369898 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3247/6608] 10.222.0.25 () {58 vars in 1176 bytes} [Wed Nov 2 22:04:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:25.387598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e3e08b8-5824-43d7-b62b-af03db546705 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:25.410840 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e3e08b8-5824-43d7-b62b-af03db546705 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.023810 Nov 02 22:04:25.417084 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3362/6609] 10.222.0.25 () {58 vars in 1143 bytes} [Wed Nov 2 22:04:25 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:25.422128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b5ee85f7-a87e-4b1b-8ed9-e56ac4187470 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:25.452632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5ee85f7-a87e-4b1b-8ed9-e56ac4187470 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:25.456706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5ee85f7-a87e-4b1b-8ed9-e56ac4187470 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:25.457790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5ee85f7-a87e-4b1b-8ed9-e56ac4187470 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:26.045055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:26.046833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:26.078125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:26.078661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:26.079105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:26.079830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:26.080302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:26.081249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:26.121340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:26.122082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:26.122706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:26.123355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lazy-loading 'fault' on Instance uuid 60f1373a-47c4-4413-86d2-86d0c939cb97 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:04:26.174250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:26.177141 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b5ee85f7-a87e-4b1b-8ed9-e56ac4187470 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.759472 Nov 02 22:04:26.186978 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3248/6610] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 22:04:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:26.194499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca794243-3e04-4e67-ae32-7912b51acb24 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:26.202006 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edea9790-98a0-434d-810b-31b98e69f356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 200 len: 1357 microversion: 2.1 time: 0.162331 Nov 02 22:04:26.203656 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3363/6611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:26 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:04:26.203972 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca794243-3e04-4e67-ae32-7912b51acb24 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.015666 Nov 02 22:04:26.204885 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3249/6612] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 22:04:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:26.220756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c364dc95-d593-49f6-bb53-24c797e941a3 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1634419282", "availability_zone": "foo_zone"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:26.399054 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c364dc95-d593-49f6-bb53-24c797e941a3 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.181833 Nov 02 22:04:26.399934 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3364/6613] 10.222.0.25 () {60 vars in 1173 bytes} [Wed Nov 2 22:04:26 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:26.414467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-965123a8-4377-4aa8-841f-d39553ea6c49 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:26.566115 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-965123a8-4377-4aa8-841f-d39553ea6c49 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.151298 Nov 02 22:04:26.569476 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3250/6614] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 22:04:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:26.571594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4997395-0f2a-4ecd-b186-1a42e93c66c6 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:26.581902 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4997395-0f2a-4ecd-b186-1a42e93c66c6 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.014033 Nov 02 22:04:26.582490 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3365/6615] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Nov 2 22:04:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:04:26.599883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-52b2a6e7-3d20-468e-b562-bc32fd050b5f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860863-4"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:26.623377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52b2a6e7-3d20-468e-b562-bc32fd050b5f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:26.623377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52b2a6e7-3d20-468e-b562-bc32fd050b5f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:26.623377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52b2a6e7-3d20-468e-b562-bc32fd050b5f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:27.031023 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-52b2a6e7-3d20-468e-b562-bc32fd050b5f tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.435986 Nov 02 22:04:27.031841 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3251/6616] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Nov 2 22:04:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:27.061597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf268d62-eece-4c8c-8324-6551a6422dc1 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:27.203268 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf268d62-eece-4c8c-8324-6551a6422dc1 tempest-TestAggregatesBasicOps-1731940088 tempest-TestAggregatesBasicOps-1731940088-project-admin] 10.222.0.25 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.161613 Nov 02 22:04:27.204456 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3366/6617] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Nov 2 22:04:27 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 22:04:27.229619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:27.230296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 60f1373a-47c4-4413-86d2-86d0c939cb97] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:27.237974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:27.238869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:27.239645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:27.240604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:27.241334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:27.242000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:27.257033 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] HTTP exception thrown: Instance 60f1373a-47c4-4413-86d2-86d0c939cb97 could not be found. Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Request method failure captured: Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 HTTP/1.1 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYufPX6Rr5nr0yUdeWlboFRhiIRbfN70FaGXR5l42VL99ff4QwXSASZ8gH2G8kcngmWHBOUnKDxEHG5udsXaLab0zA1qmKd0pxn2TvmKN1vh_EQYUFTlFaM3t9QlaSUDMe-Q91CN2uqH3mfhXQC5X0nf71_hjip1qxhzqvXD3EIeuvz4 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f3d5fb3af3fe44d3a742f5e902b32f4d Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 60f1373a-47c4-4413-86d2-86d0c939cb97 could not be found. Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '60f1373a-47c4-4413-86d2-86d0c939cb97'} Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60f1373a-47c4-4413-86d2-86d0c939cb97 could not be found. Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60f1373a-47c4-4413-86d2-86d0c939cb97 could not be found. Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:04:27.259286 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60f1373a-47c4-4413-86d2-86d0c939cb97 could not be found. Nov 02 22:04:27.263494 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:04:27.266520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Returning 404 to user: Instance 60f1373a-47c4-4413-86d2-86d0c939cb97 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:04:27.268749 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3e769f16-10d9-4e7e-ba58-2975247530b3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97" status: 404 len: 111 microversion: 2.1 time: 0.043204 Nov 02 22:04:27.280187 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3252/6618] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:27 2022] GET /compute/v2.1/servers/60f1373a-47c4-4413-86d2-86d0c939cb97 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:04:35.730080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67ab3681-f5ef-420a-9897-eb4f0416b356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '.version_select at 0x7f9b60349430>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:35.739941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:35.891110 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67ab3681-f5ef-420a-9897-eb4f0416b356 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1536031199" status: 202 len: 0 microversion: 2.1 time: 0.165086 Nov 02 22:04:35.894350 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3367/6619] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 22:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1536031199 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:04:35.929187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e7237eb4-b190-417b-bdc9-493a8199fd2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: .version_select at 0x7f9b63a93310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2018241682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIXtkt0RHgNwZgyfBjA8EqiP6n2oFH2Nb76/6k8rVAsVv+xyr1Einn3OSUVKTmJ/T6N7NVlbHwBk46zvDvM5UcODAFwajxq6YBVtM64WPDmXCfp3WQKcomqFiB0lDqKeg=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:35.936466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:35.937647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:35.951825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e7237eb4-b190-417b-bdc9-493a8199fd2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:04:35.960429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e7237eb4-b190-417b-bdc9-493a8199fd2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:04:36.067700 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e7237eb4-b190-417b-bdc9-493a8199fd2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.143080 Nov 02 22:04:36.069036 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3253/6620] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:04:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:50.106557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=40 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:50.116101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1295528266", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "250740a8-ac74-43be-ac3c-cb891d02c46a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2018241682", "security_groups": [{"name": "tempest-secgroup-smoke-1003836921"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:50.301459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] validate_networks() for [('250740a8-ac74-43be-ac3c-cb891d02c46a', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:04:51.079927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:04:51.080588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:04:51.081126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:04:51.082247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:04:51.082774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:04:51.093201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:51.093945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:51.094398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:51.096595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:51.096595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:51.096595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:51.122193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:04:51.128220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Getting quotas for user f3d5fb3af3fe44d3a742f5e902b32f4d and project 7b39bec3bc514c81997eb2bc7c528cbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:04:51.140781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:04:51.143136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:04:51.305813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-13028cba-9f1b-4f98-9624-b31e6b5b4e16 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.199745 Nov 02 22:04:51.313662 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3368/6621] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:04:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:04:51.319284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:51.319284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:04:51.322808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-92f8d49d-d6d5-4709-9c68-638c721eb5bf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:51.323660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-92f8d49d-d6d5-4709-9c68-638c721eb5bf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:51.408432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-92f8d49d-d6d5-4709-9c68-638c721eb5bf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:51.428462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-92f8d49d-d6d5-4709-9c68-638c721eb5bf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1267 microversion: 2.1 time: 0.111930 Nov 02 22:04:51.428462 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3254/6622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:51 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:04:52.458044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-852b9bb1-f956-4064-826d-005827595ffb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:52.460173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-852b9bb1-f956-4064-826d-005827595ffb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:52.552340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-852b9bb1-f956-4064-826d-005827595ffb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:52.560131 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-852b9bb1-f956-4064-826d-005827595ffb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1267 microversion: 2.1 time: 0.109680 Nov 02 22:04:52.573082 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3369/6623] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:52 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:53.588435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:53.589680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:53.616726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:53.621076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:53.625609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:53.626473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:53.626962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:53.627411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:53.719862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:53.731799 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8a5f95c-4f31-4fc0-bd5f-df09efc35ecf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1263 microversion: 2.1 time: 0.149494 Nov 02 22:04:53.732572 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3255/6624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:53 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:54.762702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:54.763445 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:54.772091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:54.772622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:54.773800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:54.773955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:54.774325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:54.774796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:54.864079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:54.871970 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fcf123c-fa04-4fbf-ab47-1b83e0f900b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1319 microversion: 2.1 time: 0.113261 Nov 02 22:04:54.872562 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3370/6625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:54 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1319 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:55.901820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:55.904482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:55.929012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:55.932747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:55.936041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:55.937159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:55.939698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:55.945512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:56.102541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:56.132707 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-39f8499d-5781-4c7d-9977-92027e493cbc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1337 microversion: 2.1 time: 0.236985 Nov 02 22:04:56.149305 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3256/6626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:55 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1337 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:04:57.169925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:57.171943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:57.193197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:57.200540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:57.201309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:57.204476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:57.205214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:57.205846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:57.342452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-736510816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-413771351", "security_groups": [{"name": "tempest-secgroup-smoke-355656007"}], "block_device_mapping_v2": [{"uuid": "d18a2154-0f8d-44ee-a15d-6c84142e9d7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:57.623423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:57.632676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:04:57.633905 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e23eb22-5776-4d3a-b858-e952f33b06f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1393 microversion: 2.1 time: 0.475677 Nov 02 22:04:57.646687 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3371/6627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:57 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1393 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:58.331974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-609e8789-18f4-4122-99b9-c16c10f4d1fc req-0fbb5e9b-8888-4714-ad21-85a848fa72c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5647259d-672c-4fc8-8153-9e4e017d5809", "tag": "6f791393-fc18-4155-97d0-9eaf3606b331"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:04:58.360784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-609e8789-18f4-4122-99b9-c16c10f4d1fc req-0fbb5e9b-8888-4714-ad21-85a848fa72c6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:58.362754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-609e8789-18f4-4122-99b9-c16c10f4d1fc req-0fbb5e9b-8888-4714-ad21-85a848fa72c6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:58.368571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-609e8789-18f4-4122-99b9-c16c10f4d1fc req-0fbb5e9b-8888-4714-ad21-85a848fa72c6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:58.413803 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-609e8789-18f4-4122-99b9-c16c10f4d1fc req-0fbb5e9b-8888-4714-ad21-85a848fa72c6 service nova] Creating event network-changed:6f791393-fc18-4155-97d0-9eaf3606b331 for instance 5647259d-672c-4fc8-8153-9e4e017d5809 on n-h1-860863-4 Nov 02 22:04:58.443350 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-609e8789-18f4-4122-99b9-c16c10f4d1fc req-0fbb5e9b-8888-4714-ad21-85a848fa72c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119725 Nov 02 22:04:58.444408 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3372/6628] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:04:58.663509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:58.664328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:58.674151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:58.676375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:58.676865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:58.680646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:58.682350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:58.685469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:59.089354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:59.095811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:04:59.098100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:04:59.100244 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6de17d8-0185-41aa-ae36-8f8235ccb6cd tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1393 microversion: 2.1 time: 0.442313 Nov 02 22:04:59.101425 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3373/6629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:58 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1393 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:04:59.102378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:04:59.103085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:04:59.104230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:04:59.126232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:59.126998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:59.127551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:59.128536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:04:59.129838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:04:59.130542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:04:59.150396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:04:59.156404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:04:59.227597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:04:59.230045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d18a2154-0f8d-44ee-a15d-6c84142e9d7a',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:04:59.697395 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-165f1494-2d3c-4061-b3ce-96a08ff05b4b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.358788 Nov 02 22:04:59.701370 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3257/6630] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:04:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 22:04:59.729928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-015b35f5-58ef-44b9-a565-c332688f44e9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:04:59.730518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-015b35f5-58ef-44b9-a565-c332688f44e9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:04:59.820603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-015b35f5-58ef-44b9-a565-c332688f44e9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:04:59.828088 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-015b35f5-58ef-44b9-a565-c332688f44e9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1093 microversion: 2.1 time: 0.102267 Nov 02 22:04:59.832056 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3374/6631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:04:59 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1093 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:00.125234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:00.126769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:00.136466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:00.138242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:00.138972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:00.140077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:00.140803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:00.141615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:00.564492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:00.577250 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-719690a3-6810-43e2-a519-cce48aebc587 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1393 microversion: 2.1 time: 0.456475 Nov 02 22:05:00.596562 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3258/6632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:00 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1393 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:00.854277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-97cea6e8-0a03-4ec7-83fb-3d1d36fa4386 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:00.855660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-97cea6e8-0a03-4ec7-83fb-3d1d36fa4386 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:00.938554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-97cea6e8-0a03-4ec7-83fb-3d1d36fa4386 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:00.950992 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-97cea6e8-0a03-4ec7-83fb-3d1d36fa4386 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1093 microversion: 2.1 time: 0.100936 Nov 02 22:05:00.951597 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3375/6633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:00 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1093 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:01.606787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:01.608137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:01.623300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:01.624402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:01.629734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:01.629734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:01.629734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:01.630660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:01.936293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:01.947694 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5455d58-c671-4681-89fd-862034343471 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1393 microversion: 2.1 time: 0.349170 Nov 02 22:05:01.948299 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3259/6634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:01 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1393 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:01.979758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:01.980954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:01.987436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:01.990756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:01.991265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:01.991722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:01.993162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:01.993668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:01.994131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:02.100056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:02.115523 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-21cd9c4a-94a3-4893-80f2-efb361528057 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1191 microversion: 2.1 time: 0.141185 Nov 02 22:05:02.130526 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3376/6635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:01 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1191 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:02.971029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:02.973519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:02.982723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:02.983619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:02.984345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:02.985346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:02.986510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:02.987449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:03.142514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:03.145453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:03.152672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:03.153532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:03.161165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:03.161165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:03.161165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:03.161165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:03.339752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:03.344986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:03.354563 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e07ec897-9e0d-45f2-a71b-ca64e5f3f06e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1209 microversion: 2.1 time: 0.215902 Nov 02 22:05:03.354783 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9438c8ca-db4b-450c-b05b-8eb09e2b287a tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1393 microversion: 2.1 time: 0.385435 Nov 02 22:05:03.356189 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3260/6636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:02 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1393 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:03.375066 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3377/6637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:03 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1209 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:04.379787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:04.385384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:04.389948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:04.391855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:04.397615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:04.398440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:04.399731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:04.400240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:04.400577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:04.400726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:04.401629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:04.402062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:04.402543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:04.403159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:04.403478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:04.404817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:05.212601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:05.220289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:05.227053 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93d73de0-a11d-418d-91f5-cd13b49cb14b tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1276 microversion: 2.1 time: 0.845377 Nov 02 22:05:05.229819 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3378/6638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:04 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1276 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:05.234691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-033b7b60-5692-4f94-bd62-850994408d26 req-4f01d008-9a0b-4f94-b525-d8a286f70433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647259d-672c-4fc8-8153-9e4e017d5809", "name": "network-vif-plugged", "status": "completed", "tag": "6f791393-fc18-4155-97d0-9eaf3606b331"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:05.250383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-033b7b60-5692-4f94-bd62-850994408d26 req-4f01d008-9a0b-4f94-b525-d8a286f70433 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:05.251201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-033b7b60-5692-4f94-bd62-850994408d26 req-4f01d008-9a0b-4f94-b525-d8a286f70433 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:05.251882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-033b7b60-5692-4f94-bd62-850994408d26 req-4f01d008-9a0b-4f94-b525-d8a286f70433 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:05.258365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10bed4e0-aa4c-416f-b14a-e032378ebe3b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1393 microversion: 2.1 time: 0.883766 Nov 02 22:05:05.258975 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3261/6639] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:04 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1393 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:05.266968 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-033b7b60-5692-4f94-bd62-850994408d26 req-4f01d008-9a0b-4f94-b525-d8a286f70433 service nova] Creating event network-vif-plugged:6f791393-fc18-4155-97d0-9eaf3606b331 for instance 5647259d-672c-4fc8-8153-9e4e017d5809 on n-h1-860863-4 Nov 02 22:05:05.272644 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-033b7b60-5692-4f94-bd62-850994408d26 req-4f01d008-9a0b-4f94-b525-d8a286f70433 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041310 Nov 02 22:05:05.273809 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3379/6640] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:06.257418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:06.258146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:06.272773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:06.273327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:06.273793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:06.274539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:06.284118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:06.294545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:06.480445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ac32f117-502e-46f0-a2ff-97284d1c284f req-6dede9db-ad9d-4903-8131-ac220fcf2c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fbc62ce-1d95-40c1-80ed-cd68ba710976", "tag": "076e254b-253b-4f44-864b-04a82033ae26"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:06.494130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ac32f117-502e-46f0-a2ff-97284d1c284f req-6dede9db-ad9d-4903-8131-ac220fcf2c86 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:06.495026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ac32f117-502e-46f0-a2ff-97284d1c284f req-6dede9db-ad9d-4903-8131-ac220fcf2c86 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:06.497222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ac32f117-502e-46f0-a2ff-97284d1c284f req-6dede9db-ad9d-4903-8131-ac220fcf2c86 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:06.516277 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ac32f117-502e-46f0-a2ff-97284d1c284f req-6dede9db-ad9d-4903-8131-ac220fcf2c86 service nova] Creating event network-changed:076e254b-253b-4f44-864b-04a82033ae26 for instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 on n-h2-860863-4 Nov 02 22:05:06.531528 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ac32f117-502e-46f0-a2ff-97284d1c284f req-6dede9db-ad9d-4903-8131-ac220fcf2c86 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.565391 Nov 02 22:05:06.543078 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3262/6641] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:06.555282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:06.559583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:06.573605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:06.575608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:06.577614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:06.581051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:06.581933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:06.582902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:06.905114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:06.924829 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39f42d95-3a8d-4aa0-b679-9db8091d4c23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1276 microversion: 2.1 time: 0.672766 Nov 02 22:05:06.943506 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3380/6642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:06 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1276 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:06.997402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:07.012724 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c68a0fd0-5b25-4b00-8829-36271a749535 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1393 microversion: 2.1 time: 0.465520 Nov 02 22:05:07.013552 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3263/6643] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:06 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1393 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:07.964118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:07.965014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:07.974670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:07.975184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:07.975636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:07.976356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:07.976819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:07.977398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:08.039998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:08.041843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:08.067840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:08.071333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:08.073335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:08.082027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:08.082702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:08.083413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:08.537794 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:08.549313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ba45642-34f8-4e67-ad09-f1b0d2f5b747 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1276 microversion: 2.1 time: 0.588104 Nov 02 22:05:08.549934 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3381/6644] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:07 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1276 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:08.616617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:08.626345 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a7b8fb9-02a8-4133-a5b6-20c6ce6b932f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1565 microversion: 2.1 time: 0.592121 Nov 02 22:05:08.649501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3264/6645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:08 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1565 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:08.651498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:08.651498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:08.662756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:08.663936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:08.664407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:08.665031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:08.665503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:08.665926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:08.876454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:08.944791 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16b7d72e-eaec-42d0-a436-cf778a9ff62c tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1565 microversion: 2.1 time: 0.298417 Nov 02 22:05:08.968749 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3382/6646] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:08 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1565 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:09.573734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:09.574368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:09.578057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:09.578759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:09.585627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:09.586477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:09.587236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:09.588202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:09.588993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:09.589943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:09.767994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:09.776545 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9b967d8-522f-4b19-8b37-a11219b82a2e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1276 microversion: 2.1 time: 0.207563 Nov 02 22:05:09.777440 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3265/6647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:09 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1276 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:10.799815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:10.801194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:10.818023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:10.819072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:10.819776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:10.822116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:10.823396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:10.824085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:10.945059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:11.080919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:11.132961 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4963860-360f-4740-b5ba-2ad256914914 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1276 microversion: 2.1 time: 0.336930 Nov 02 22:05:11.136269 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3383/6648] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:10 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1276 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:05:12.164087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:12.164765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:12.173445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:12.174243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:12.181448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:12.205637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:12.208945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:12.209527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:12.406020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:12.417225 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a0c5232d-38d2-41ac-96ab-5b109d81a026 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1276 microversion: 2.1 time: 0.258214 Nov 02 22:05:12.422701 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3266/6649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:12 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:13.446872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:13.447623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:13.463677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:13.465369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:13.468194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:13.469212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:13.474520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:13.474520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:13.646913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:13.649757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:13.665501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:13.668081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:13.668708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:13.670372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:13.686538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:13.686538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:13.724733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:13.739493 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0f5ec11-0871-426d-82e6-e07dc1a76cf5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1276 microversion: 2.1 time: 0.299571 Nov 02 22:05:13.740775 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3384/6650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:13 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1276 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:13.763412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0a39141d-4601-46b1-a60b-53e8b020d219 req-1d1eca77-fb03-4995-be4f-2ce3d124f63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5647259d-672c-4fc8-8153-9e4e017d5809", "tag": "6f791393-fc18-4155-97d0-9eaf3606b331"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:13.788503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0a39141d-4601-46b1-a60b-53e8b020d219 req-1d1eca77-fb03-4995-be4f-2ce3d124f63b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:13.790361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0a39141d-4601-46b1-a60b-53e8b020d219 req-1d1eca77-fb03-4995-be4f-2ce3d124f63b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:13.803696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0a39141d-4601-46b1-a60b-53e8b020d219 req-1d1eca77-fb03-4995-be4f-2ce3d124f63b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:13.837376 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0a39141d-4601-46b1-a60b-53e8b020d219 req-1d1eca77-fb03-4995-be4f-2ce3d124f63b service nova] Creating event network-changed:6f791393-fc18-4155-97d0-9eaf3606b331 for instance 5647259d-672c-4fc8-8153-9e4e017d5809 on n-h1-860863-4 Nov 02 22:05:13.870318 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0a39141d-4601-46b1-a60b-53e8b020d219 req-1d1eca77-fb03-4995-be4f-2ce3d124f63b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128033 Nov 02 22:05:13.883588 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3385/6651] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:14.043929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:14.064538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe8d799f-7f32-4b45-99ff-49a16d96105b tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1565 microversion: 2.1 time: 0.422580 Nov 02 22:05:14.067516 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3267/6652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:13 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1565 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:14.437644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96343e61-e68c-406d-82b4-eace6285a0f0 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Action: 'create', calling method: .version_select at 0x7f9b603600d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1504992150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBVtojLlB+3twUl/jAsxuSdjA9Sa1AB1JTFeNsS+KsiNYCw0BnMJePn80eheonBIUemSoU3+xZGboJHzzey/PcDIcI7fVTP4Nvuym7UZZpIDOCYdrIxxEanVMek8Hi24A=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:14.470152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-96343e61-e68c-406d-82b4-eace6285a0f0 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Getting quotas for project 54e3f4a4cf8b4738aa50d66ce3922d2c. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:05:14.486094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-96343e61-e68c-406d-82b4-eace6285a0f0 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Getting quotas for user 845cc5cd438f4cbba13402a10a037d1a and project 54e3f4a4cf8b4738aa50d66ce3922d2c. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:05:14.572813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96343e61-e68c-406d-82b4-eace6285a0f0 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.405724 Nov 02 22:05:14.572813 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3386/6653] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:05:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:14.763843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:14.764441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:14.799155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:14.799840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:14.805999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:14.805999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:14.805999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:14.805999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:15.047939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:15.057463 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6370f81d-9c32-4ae7-8257-4e5fb166e84f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.297538 Nov 02 22:05:15.058167 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3268/6654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:14 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:16.082799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:16.083561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:16.089706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:16.090200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:16.090651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:16.091435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:16.091904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:16.092394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:16.540533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:16.555635 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-408217a0-718f-4a8f-969a-04fcdb6227c5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.472135 Nov 02 22:05:16.571697 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3387/6655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:16 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:05:17.579697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:17.580293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:17.588347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:17.588347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:17.588774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:17.589418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:17.589872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:17.590304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:17.750907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:17.757201 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19188186-aaad-4932-be04-fd61a1bee258 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.181640 Nov 02 22:05:17.757905 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3269/6656] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:17 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:17.822876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1699143345", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1504992150", "security_groups": [{"name": "tempest-secgroup-smoke-1053191300"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f7089043-136f-4967-9c55-79b0a808195e"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:17.933876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] validate_networks() for [('f7089043-136f-4967-9c55-79b0a808195e', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:05:18.324573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Getting quotas for project 54e3f4a4cf8b4738aa50d66ce3922d2c. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:05:18.330556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Getting quotas for user 845cc5cd438f4cbba13402a10a037d1a and project 54e3f4a4cf8b4738aa50d66ce3922d2c. Resources: dict_keys(['metadata_items']) {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:05:18.345101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:05:18.345544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:05:18.346029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:05:18.346457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:05:18.346872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:05:18.355848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:18.356352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:18.356801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:18.357567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:18.358034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:18.358471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:18.386389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Getting quotas for project 54e3f4a4cf8b4738aa50d66ce3922d2c. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:05:18.394624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Getting quotas for user 845cc5cd438f4cbba13402a10a037d1a and project 54e3f4a4cf8b4738aa50d66ce3922d2c. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:05:18.412467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:05:18.414968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:05:18.439278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:18.591409 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b221c55-1363-4451-af76-9c5d007a7a8b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773123 Nov 02 22:05:18.592057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3388/6657] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:05:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:05:18.603846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cac073ed-3c0a-4236-948e-6646df15d2c8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:18.605584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cac073ed-3c0a-4236-948e-6646df15d2c8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:18.664627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cac073ed-3c0a-4236-948e-6646df15d2c8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:18.673027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cac073ed-3c0a-4236-948e-6646df15d2c8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1303 microversion: 2.1 time: 0.073618 Nov 02 22:05:18.673615 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3270/6658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:18 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1303 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:18.781033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:18.781738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:18.789516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:18.790115 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:18.790611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:18.791384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:18.791910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:18.792353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:18.934101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:18.943068 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9a49cd9b-3a25-4002-b76b-b86c008586e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.166211 Nov 02 22:05:18.943654 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3389/6659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:18 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:19.410425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:19.410975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:19.417894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:19.418386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:19.418838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:19.419546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:19.420004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:19.420435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:19.504295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lazy-loading 'services' on Instance uuid 1268682c-eee2-4c8c-9644-4d4f9b056dac {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:05:19.697681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a221246b-edfa-47f6-af8c-a8ffdff0a481 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:19.698347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a221246b-edfa-47f6-af8c-a8ffdff0a481 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:19.738033 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3cae2f42-7856-4648-b47c-39396538d850 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac/os-volume_attachments/65a0b832-dabf-4214-b3fd-1bce4d5d2707" status: 202 len: 0 microversion: 2.1 time: 0.331703 Nov 02 22:05:19.738690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3271/6660] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:05:19 2022] DELETE /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac/os-volume_attachments/65a0b832-dabf-4214-b3fd-1bce4d5d2707 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:05:19.760949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a221246b-edfa-47f6-af8c-a8ffdff0a481 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:19.768101 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a221246b-edfa-47f6-af8c-a8ffdff0a481 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1303 microversion: 2.1 time: 0.075603 Nov 02 22:05:19.768710 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3390/6661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:19 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1303 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:05:19.966583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:19.967325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:19.973797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:19.974428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:19.974820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:19.975516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:19.975981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:19.976413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:20.116725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:20.124554 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fbdae4d9-e190-41b7-ac5b-43e48bc4036c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.162225 Nov 02 22:05:20.125097 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3272/6662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:19 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:20.792085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:20.793093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:20.801875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:20.802366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:20.802953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:20.803663 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:20.804158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:20.804857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:20.807640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=89 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:20.874041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:20.883122 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c850c84-427d-4025-b5d6-d494d6311d31 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1355 microversion: 2.1 time: 0.094873 Nov 02 22:05:20.884454 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3391/6663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:20 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1355 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:21.148788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:21.149696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:21.159135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:21.159786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:21.161015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:21.163062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:21.163589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:21.164026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:21.169733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:21.334652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:21.347403 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ca9513f-aa6c-47ca-8ab9-4eee513eeaba tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.203545 Nov 02 22:05:21.348049 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3273/6664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:21 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:21.914309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:21.915676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:21.932533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:21.934407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:21.935086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:21.936291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:21.939834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:21.940812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:22.022997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:22.032962 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-45b94fa8-713e-4f67-85dd-54a37897744e tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1361 microversion: 2.1 time: 0.123744 Nov 02 22:05:22.044815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3392/6665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:21 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1361 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:22.371879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:22.372509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:22.388065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:22.388569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:22.389043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:22.389761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:22.390224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:22.390657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:22.566833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:22.578262 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-17ca0365-9ea2-4513-bfb4-b7cbc2c4ad8e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.210816 Nov 02 22:05:22.579088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3274/6666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:22 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:23.059566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:23.060800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:23.074243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:23.074948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:23.075407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:23.076127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:23.076751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:23.077387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:23.226185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:23.234215 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d50bf79-cad9-4d8f-b2f9-6d8827c5ff82 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1429 microversion: 2.1 time: 0.178983 Nov 02 22:05:23.234800 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3393/6667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:23 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1429 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:23.302517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-cae7ddbe-a934-4d4e-95d3-d1c5d5d43ecb req-b307ebeb-8058-4ccb-b249-81a47bf339bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda9f508-9509-400c-890d-28419fb2fb45", "tag": "d60b185d-c927-490d-974c-70348efa9d5a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:23.317638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cae7ddbe-a934-4d4e-95d3-d1c5d5d43ecb req-b307ebeb-8058-4ccb-b249-81a47bf339bf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:23.318442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cae7ddbe-a934-4d4e-95d3-d1c5d5d43ecb req-b307ebeb-8058-4ccb-b249-81a47bf339bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:23.320197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-cae7ddbe-a934-4d4e-95d3-d1c5d5d43ecb req-b307ebeb-8058-4ccb-b249-81a47bf339bf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:23.332462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-cae7ddbe-a934-4d4e-95d3-d1c5d5d43ecb req-b307ebeb-8058-4ccb-b249-81a47bf339bf service nova] Creating event network-changed:d60b185d-c927-490d-974c-70348efa9d5a for instance fda9f508-9509-400c-890d-28419fb2fb45 on n-h1-860863-4 Nov 02 22:05:23.337816 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-cae7ddbe-a934-4d4e-95d3-d1c5d5d43ecb req-b307ebeb-8058-4ccb-b249-81a47bf339bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039799 Nov 02 22:05:23.338508 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3275/6668] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:23.602815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:23.603861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:23.611306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:23.612293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:23.613066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:23.614021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:23.614827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:23.616289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:23.760243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:23.769549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d5aaf70f-c7de-4fd8-a13b-01505ac54b2f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.170973 Nov 02 22:05:23.770446 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3394/6669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:23 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:05:24.078871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2c08ab31-e100-4cf6-9153-d7149ddf6542 req-4b8e4fcf-b4d8-494b-a5ba-f255930c4de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fbc62ce-1d95-40c1-80ed-cd68ba710976", "name": "network-vif-plugged", "status": "completed", "tag": "076e254b-253b-4f44-864b-04a82033ae26"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:24.097056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2c08ab31-e100-4cf6-9153-d7149ddf6542 req-4b8e4fcf-b4d8-494b-a5ba-f255930c4de2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:24.097056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2c08ab31-e100-4cf6-9153-d7149ddf6542 req-4b8e4fcf-b4d8-494b-a5ba-f255930c4de2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:24.097056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2c08ab31-e100-4cf6-9153-d7149ddf6542 req-4b8e4fcf-b4d8-494b-a5ba-f255930c4de2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:24.104050 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2c08ab31-e100-4cf6-9153-d7149ddf6542 req-4b8e4fcf-b4d8-494b-a5ba-f255930c4de2 service nova] Creating event network-vif-plugged:076e254b-253b-4f44-864b-04a82033ae26 for instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 on n-h2-860863-4 Nov 02 22:05:24.121181 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2c08ab31-e100-4cf6-9153-d7149ddf6542 req-4b8e4fcf-b4d8-494b-a5ba-f255930c4de2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035387 Nov 02 22:05:24.121181 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3276/6670] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:24.260870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:24.261677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:24.268576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:24.269449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:24.270181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:24.271777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:24.272334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:24.272852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:24.413084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:24.421327 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48345323-3ce2-475a-a3fa-c42ef01ffd97 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1429 microversion: 2.1 time: 0.166106 Nov 02 22:05:24.429106 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3395/6671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:24 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:24.794475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:24.795095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:24.801622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:24.802120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:24.803200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:24.804003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:24.804468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:24.804911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:24.945211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:24.953067 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4409b7ef-508d-46cf-ad69-e7b3f110317e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1264 microversion: 2.1 time: 0.162994 Nov 02 22:05:24.953642 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3277/6672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:24 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:25.445876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:25.446646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:25.453998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:25.454500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:25.454951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:25.455661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:25.456128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:25.456597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:25.595798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:25.604205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ead7a3f1-aa5c-490b-bf1f-fd629445cfae tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1429 microversion: 2.1 time: 0.162864 Nov 02 22:05:25.604761 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3396/6673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:25 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:25.976832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:25.977565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:25.984389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:25.984886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:25.985422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:25.986111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:25.986591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:25.987017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.121451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:26.129240 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5b1d1372-85b1-4736-b021-dbb09a3aa355 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1452 microversion: 2.1 time: 0.157149 Nov 02 22:05:26.129814 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3278/6674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:25 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:26.153052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:26.153681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:26.159669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.160363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.160815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.161544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.162007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.162446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.255602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:26.256120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:26.267120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.267632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.268086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.268816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.269327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.269764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.300154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:05:26.313560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:26.322612 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36ab75fb-b9a3-4938-89ba-f9d3266bffb5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1452 microversion: 2.1 time: 0.173343 Nov 02 22:05:26.323217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3397/6675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:26 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:26.628168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:26.631551 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-95a62aa6-3822-41af-ac4a-aaa47cef4cf1 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 204 len: 0 microversion: 2.1 time: 0.376139 Nov 02 22:05:26.631551 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3279/6676] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:05:26 2022] DELETE /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 22:05:26.631773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:26.638148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.638351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:26.638676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.638966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:26.639151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.639878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.640356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.640806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.644855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.645575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.646015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.646715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:26.647165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:26.647831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:26.968712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:26.976418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:26.978065 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a90bd493-6e86-41a1-8d18-abc7b6fea705 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1429 microversion: 2.1 time: 0.354155 Nov 02 22:05:26.979201 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3398/6677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:26 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1429 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:05:26.993969 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f29c9d5-b1e8-4c8f-8a22-6040ca9619b2 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1469 microversion: 2.1 time: 0.359753 Nov 02 22:05:26.994971 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3280/6678] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:26 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1469 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:28.001761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:28.002397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:28.009939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:28.010447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:28.010908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:28.011628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:28.012216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:28.012544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:28.017803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:28.018454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:28.025547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:28.027416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:28.028088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:28.028707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:28.029622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:28.030238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:28.030833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:28.372470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:28.669008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:28.745605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:28.749261 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f684087a-41b4-48bb-a4fe-f9793064f139 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1429 microversion: 2.1 time: 0.751419 Nov 02 22:05:28.749836 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3399/6679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:27 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1429 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:28.754286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-07cedad9-58b7-4a55-89dd-005db1c5b348 req-0ab71e9c-9e7f-4fb9-88fe-caf5571aac25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda9f508-9509-400c-890d-28419fb2fb45", "name": "network-vif-plugged", "status": "completed", "tag": "d60b185d-c927-490d-974c-70348efa9d5a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:28.763628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07cedad9-58b7-4a55-89dd-005db1c5b348 req-0ab71e9c-9e7f-4fb9-88fe-caf5571aac25 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:28.764118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07cedad9-58b7-4a55-89dd-005db1c5b348 req-0ab71e9c-9e7f-4fb9-88fe-caf5571aac25 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:28.764560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07cedad9-58b7-4a55-89dd-005db1c5b348 req-0ab71e9c-9e7f-4fb9-88fe-caf5571aac25 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:28.776357 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-07cedad9-58b7-4a55-89dd-005db1c5b348 req-0ab71e9c-9e7f-4fb9-88fe-caf5571aac25 service nova] Creating event network-vif-plugged:d60b185d-c927-490d-974c-70348efa9d5a for instance fda9f508-9509-400c-890d-28419fb2fb45 on n-h1-860863-4 Nov 02 22:05:28.781815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-07cedad9-58b7-4a55-89dd-005db1c5b348 req-0ab71e9c-9e7f-4fb9-88fe-caf5571aac25 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030740 Nov 02 22:05:28.782672 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3400/6680] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:28.801464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:28.811711 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c11e4cb1-da15-48f6-bfe2-37661110b39c tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1469 microversion: 2.1 time: 0.797096 Nov 02 22:05:28.813556 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3281/6681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:28 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1469 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:29.486800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5e573cd5-0315-4913-8b4c-2e5e87f81de6 req-5264c494-58c3-4116-8f5a-8e5c287e03ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1268682c-eee2-4c8c-9644-4d4f9b056dac", "name": "network-vif-deleted", "tag": "f6626d2f-a508-40d0-9db8-7168787cef18"}, {"name": "network-changed", "server_uuid": "2fbc62ce-1d95-40c1-80ed-cd68ba710976", "tag": "076e254b-253b-4f44-864b-04a82033ae26"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:29.499138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5e573cd5-0315-4913-8b4c-2e5e87f81de6 req-5264c494-58c3-4116-8f5a-8e5c287e03ff service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:29.499634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5e573cd5-0315-4913-8b4c-2e5e87f81de6 req-5264c494-58c3-4116-8f5a-8e5c287e03ff service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:29.500080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5e573cd5-0315-4913-8b4c-2e5e87f81de6 req-5264c494-58c3-4116-8f5a-8e5c287e03ff service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:29.514923 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5e573cd5-0315-4913-8b4c-2e5e87f81de6 req-5264c494-58c3-4116-8f5a-8e5c287e03ff service nova] Creating event network-vif-deleted:f6626d2f-a508-40d0-9db8-7168787cef18 for instance 1268682c-eee2-4c8c-9644-4d4f9b056dac on n-h2-860863-4 Nov 02 22:05:29.515429 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5e573cd5-0315-4913-8b4c-2e5e87f81de6 req-5264c494-58c3-4116-8f5a-8e5c287e03ff service nova] Creating event network-changed:076e254b-253b-4f44-864b-04a82033ae26 for instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 on n-h2-860863-4 Nov 02 22:05:29.523572 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5e573cd5-0315-4913-8b4c-2e5e87f81de6 req-5264c494-58c3-4116-8f5a-8e5c287e03ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040353 Nov 02 22:05:29.524173 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3401/6682] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:29.771634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:29.777957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:29.787181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:29.787985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:29.789260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:29.790169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:29.790876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:29.791531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:29.839573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:29.842688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:29.847971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:29.857327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:29.857808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:29.859037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:29.859827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:29.860490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:29.860976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:29.918355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:29.919135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:29.924166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:29.924906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lazy-loading 'fault' on Instance uuid 1268682c-eee2-4c8c-9644-4d4f9b056dac {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:05:30.026019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0c93784238435f983fa36d59ca222c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c0307bf9ac4fd48746fee2c27493f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:30.057123 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5eb76da-6285-4bd6-90ec-29c170e5732b tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 200 len: 1304 microversion: 2.1 time: 0.223777 Nov 02 22:05:30.058551 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3402/6683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:29 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 1304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:30.111395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:30.120034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05aeab45-fc0d-4796-aad2-afc4a69d0917 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1429 microversion: 2.1 time: 0.352177 Nov 02 22:05:30.121258 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3282/6684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:29 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1429 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:31.082111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:31.082773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] [instance: 1268682c-eee2-4c8c-9644-4d4f9b056dac] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:31.090481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.090984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.091444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.092155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.092628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.093108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.107311 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] HTTP exception thrown: Instance 1268682c-eee2-4c8c-9644-4d4f9b056dac could not be found. Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Request method failure captured: Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac HTTP/1.1 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuj6tZwiEuCaO-vYAcIKseuK2oNPVKKjqOzyJOiulFFd1hjkVN9zStEz-d_qmtuPW0Ugmjt3R2oN85RHi1_vRncAYHkFSOmEavXWWbX5jhj4_Mbsnui62uZVg202Dy5nV0svQ1aeND0bt4P171VVZMU9Bf3I3IPonEwRXVFDWQcn8Kw Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 77c0307bf9ac4fd48746fee2c27493f7 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesBackupsTest-1886939686 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_77c0307bf9ac4fd48746fee2c27493f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/77c0307bf9ac4fd48746fee2c27493f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/77c0307bf9ac4fd48746fee2c27493f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/77c0307bf9ac4fd48746fee2c27493f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-VolumesBackupsTest-1886939686 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 77c0307bf9ac4fd48746fee2c27493f7 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesBackupsTest-1886939686 Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-VolumesBackupsTest-1886939686-project Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8f0c93784238435f983fa36d59ca222c Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-VolumesBackupsTest-1886939686-project Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 1268682c-eee2-4c8c-9644-4d4f9b056dac could not be found. Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1268682c-eee2-4c8c-9644-4d4f9b056dac'} Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1268682c-eee2-4c8c-9644-4d4f9b056dac could not be found. Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1268682c-eee2-4c8c-9644-4d4f9b056dac could not be found. Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:05:31.109007 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1268682c-eee2-4c8c-9644-4d4f9b056dac could not be found. Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] Returning 404 to user: Instance 1268682c-eee2-4c8c-9644-4d4f9b056dac could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-49b33dce-600b-4d0e-af3e-7fbcdb1cff82 tempest-VolumesBackupsTest-1886939686 tempest-VolumesBackupsTest-1886939686-project] 10.222.0.25 "GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac" status: 404 len: 111 microversion: 2.1 time: 0.032286 Nov 02 22:05:31.113770 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3403/6685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:31 2022] GET /compute/v2.1/servers/1268682c-eee2-4c8c-9644-4d4f9b056dac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:05:31.143517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:31.144163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:31.151756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.152251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.152697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.153439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.153900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.154339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.295170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:31.303060 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7b8daf1-b71f-4e85-ad41-86385db7a06b tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1609 microversion: 2.1 time: 0.163362 Nov 02 22:05:31.303659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3283/6686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:31 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1609 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:31.327303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:31.327931 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:31.335778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.337285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.337285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.337755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.338224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.338671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.478641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:31.486783 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f7addf5-21b3-4e06-87d3-dd0ebec9c9f6 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1609 microversion: 2.1 time: 0.163663 Nov 02 22:05:31.487377 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3404/6687] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:31 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1609 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:31.510679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:31.511295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:31.517415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.517907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.518351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.519043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:31.519496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:31.519926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:31.660754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:31.668853 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-347c2491-05f1-4d28-a89c-5230f8e90b85 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1609 microversion: 2.1 time: 0.163520 Nov 02 22:05:31.669465 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3284/6688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:31 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1609 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:33.719375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-61c23780-99e7-4aaf-a78d-87e176fc7c7a req-4d1dfc01-6a48-43c7-a74d-29012b7c9292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda9f508-9509-400c-890d-28419fb2fb45", "tag": "d60b185d-c927-490d-974c-70348efa9d5a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:33.730127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61c23780-99e7-4aaf-a78d-87e176fc7c7a req-4d1dfc01-6a48-43c7-a74d-29012b7c9292 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:33.730681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61c23780-99e7-4aaf-a78d-87e176fc7c7a req-4d1dfc01-6a48-43c7-a74d-29012b7c9292 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:33.731129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61c23780-99e7-4aaf-a78d-87e176fc7c7a req-4d1dfc01-6a48-43c7-a74d-29012b7c9292 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:33.743118 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-61c23780-99e7-4aaf-a78d-87e176fc7c7a req-4d1dfc01-6a48-43c7-a74d-29012b7c9292 service nova] Creating event network-changed:d60b185d-c927-490d-974c-70348efa9d5a for instance fda9f508-9509-400c-890d-28419fb2fb45 on n-h1-860863-4 Nov 02 22:05:33.748659 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-61c23780-99e7-4aaf-a78d-87e176fc7c7a req-4d1dfc01-6a48-43c7-a74d-29012b7c9292 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032932 Nov 02 22:05:33.749899 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3405/6689] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:05:35.454913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:35.457334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:35.465235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:35.465802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:35.466490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:35.467256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:35.467776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:35.468272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:35.529940 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ce793200-c2a6-468f-b184-97dc8b2f3807 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809/action" status: 200 len: 24507 microversion: 2.1 time: 0.079472 Nov 02 22:05:35.537472 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3285/6690] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:05:35 2022] POST /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809/action => generated 24507 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:05:46.478466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=38 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:46.479230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=75 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:46.483853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:05:46.486752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:46.494465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:46.496619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:46.496619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:46.496619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:46.497278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:46.497481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:46.583064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:05:46.589090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:05:46.589090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:05:46.589090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:05:46.589090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:05:46.802195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:46.809355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:46.810249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:46.810926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:46.811766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:46.813098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:46.813098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:46.842897 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72ee785c-5fea-48fb-95f1-88bdfe268464 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809/action" status: 202 len: 1138 microversion: 2.1 time: 0.367608 Nov 02 22:05:46.843587 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3406/6691] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:05:46 2022] POST /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809/action => generated 1138 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 22:05:46.864614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:46.865537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:46.868938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=9 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:46.869611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:05:46.874836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:46.877828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:46.877828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:46.877828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:46.877828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:46.877828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:47.051841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:47.072789 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b2517223-b601-410e-bd0f-72cc316dfb99 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.212189 Nov 02 22:05:47.073398 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3286/6692] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:46 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:48.097712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:48.098352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:48.105724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:48.106495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:48.106959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:48.107765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:48.108237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:48.108678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:48.271355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:48.280600 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b62e647-5312-4a1e-ba1b-8df76d54a034 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.187872 Nov 02 22:05:48.281213 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3407/6693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:48 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:49.305660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:49.306274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:49.315033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:49.315533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:49.315978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:49.316906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:49.317403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:49.320124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:49.476489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:49.485853 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-438d2197-2cbd-4bff-8ef6-6195585b3938 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.184817 Nov 02 22:05:49.497769 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3287/6694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:49 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:50.510724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:50.511280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:50.518127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:50.518621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:50.519072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:50.519799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:50.520262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:50.520704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:50.656458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:50.664952 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b7b65be7-fc69-4734-813d-a1ceefd5c13e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.158814 Nov 02 22:05:50.665553 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3408/6695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:50 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:51.689169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:51.689785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:51.697191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:51.697683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:51.698128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:51.698838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:51.699300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:51.699737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:51.841470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:51.849378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-69a6b9de-31d8-41a9-8bf5-bee3b6119357 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.164175 Nov 02 22:05:51.851714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3288/6696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:51 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:52.879649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:52.879649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:52.883186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:52.883728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:52.884256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:52.885074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:52.885596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:52.886087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:53.027828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:53.037705 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5ad4bcb-e977-4488-ae25-bcb5a8f0d5c3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.167436 Nov 02 22:05:53.038958 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3409/6697] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:52 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:54.061895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:54.062495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:54.069879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:54.070368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:54.070971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:54.071670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:54.072127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:54.072555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:54.217471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:54.225531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e2ae0067-38f2-4b84-8253-01a98077bf9e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.167642 Nov 02 22:05:54.226744 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3289/6698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:54 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:55.249236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:55.249861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:55.256911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:55.257443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:55.258411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:55.259128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:55.259599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:55.260047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:55.396652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:55.405134 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c7cfdfb0-9cf6-4fc2-8d6f-d307895f488f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.159667 Nov 02 22:05:55.405726 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3410/6699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:55 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:56.430765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:56.431492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:56.438309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:56.439879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:56.439879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:56.440115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:56.441172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:56.441611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:56.582339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:56.590996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0b333b12-bf66-4168-a289-c9ac90b9e7d9 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.165075 Nov 02 22:05:56.591586 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3290/6700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:56 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:57.614818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:57.615453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:57.623844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:57.624354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:57.624817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:57.626265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:57.626396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:57.626755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:57.794673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:57.803692 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5cc239cf-251a-4e87-8fb8-6fd7e71bb66f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.192952 Nov 02 22:05:57.804467 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3411/6701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:57 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:05:58.827548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:05:58.828254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:05:58.835152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:58.835576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:58.836018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:58.836730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:05:58.837231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:05:58.838179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:05:58.979131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:05:58.986956 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-28a8eb6f-30d6-49c5-9464-94877f33daaf tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.163363 Nov 02 22:05:58.987534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3291/6702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:05:58 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:00.010783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:00.011446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:00.018264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:00.018763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:00.019226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:00.019930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:00.020396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:00.020957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:00.159141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:00.167947 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-979aba88-5bb5-44db-b4a0-064f64a3ae55 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.161593 Nov 02 22:06:00.168529 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3412/6703] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:00 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:01.192052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:01.192753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:01.200475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:01.201015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:01.201459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:01.202154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:01.202606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:01.203030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:01.337723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:01.346259 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-39e43473-d2d8-4812-9f5e-e541c822f5b1 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.158124 Nov 02 22:06:01.346831 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3292/6704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:01 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:02.370185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:02.370838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:02.378172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:02.378668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:02.379121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:02.379822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:02.380282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:02.380749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:02.521693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:02.529526 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-372fe6ff-b4a3-4e66-90cb-0b298635e5f0 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.163578 Nov 02 22:06:02.530101 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3413/6705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:02 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:03.553444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:03.554412 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:03.562965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:03.564727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:03.564727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:03.564727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:03.565075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:03.565426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:03.702903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:03.714171 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5238b0bb-eb5d-4739-a91d-f6d74dd548fc tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1693 microversion: 2.1 time: 0.161599 Nov 02 22:06:03.714171 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3293/6706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:03 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:04.735173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:04.735723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:04.743076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:04.743576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:04.749050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:04.749050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:04.749050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:04.749050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:04.883198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:04.891234 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6312d69a-7f4d-4f07-882c-6e180872425f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1699 microversion: 2.1 time: 0.160067 Nov 02 22:06:04.891802 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3414/6707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:04 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:05.921704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:05.922314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:05.929129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:05.929614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:05.930055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:05.930767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:05.931219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:05.931645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:06.071093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:06.080384 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2893964a-8dd7-45ad-ba2a-352c3c6a5642 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1699 microversion: 2.1 time: 0.162840 Nov 02 22:06:06.080991 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3294/6708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:05 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1699 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:06:07.111451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:07.112069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:07.119381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:07.119938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:07.120434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:07.121713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:07.122188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:07.122927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:07.276779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:07.284913 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ceedebd8-ba6d-48b5-b60a-be0a9506f766 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1684 microversion: 2.1 time: 0.177349 Nov 02 22:06:07.285509 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3415/6709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:07 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:08.574768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-78897dde-4459-4a19-85ab-46dc4a6d0452 req-8c9b89ff-159f-4104-a9ea-91a940c1a5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647259d-672c-4fc8-8153-9e4e017d5809", "name": "network-vif-plugged", "status": "completed", "tag": "6f791393-fc18-4155-97d0-9eaf3606b331"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:06:08.586637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-78897dde-4459-4a19-85ab-46dc4a6d0452 req-8c9b89ff-159f-4104-a9ea-91a940c1a5cc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:08.587109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-78897dde-4459-4a19-85ab-46dc4a6d0452 req-8c9b89ff-159f-4104-a9ea-91a940c1a5cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:08.587537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-78897dde-4459-4a19-85ab-46dc4a6d0452 req-8c9b89ff-159f-4104-a9ea-91a940c1a5cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:08.599622 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-78897dde-4459-4a19-85ab-46dc4a6d0452 req-8c9b89ff-159f-4104-a9ea-91a940c1a5cc service nova] Creating event network-vif-plugged:6f791393-fc18-4155-97d0-9eaf3606b331 for instance 5647259d-672c-4fc8-8153-9e4e017d5809 on n-h1-860863-4 Nov 02 22:06:08.605418 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-78897dde-4459-4a19-85ab-46dc4a6d0452 req-8c9b89ff-159f-4104-a9ea-91a940c1a5cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034529 Nov 02 22:06:08.606015 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3295/6710] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:06:12.677577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:12.678145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:12.686471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:12.686975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:12.687439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:12.688155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:12.688628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:12.689104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:12.718064 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b34436af-478b-4ccc-a320-670262a8b2bc tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043690 Nov 02 22:06:12.718695 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3416/6711] 10.222.0.25 () {58 vars in 1293 bytes} [Wed Nov 2 22:06:12 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:06:35.505670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:06:35.507912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:35.510852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=20 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:06:35.511493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=56 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:06:35.516837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:35.517345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:35.517782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:35.518471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:35.519018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:35.519449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:35.574727 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-924cef68-2ba3-48f9-8ed3-6891d1313ceb tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "POST /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809/action" status: 200 len: 24572 microversion: 2.1 time: 0.073399 Nov 02 22:06:35.575412 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3296/6712] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:06:35 2022] POST /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809/action => generated 24572 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:06:48.006574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:48.007151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:48.010610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7ac62eb8-9293-443e-9892-78af80f0c8f6 req-8c79b062-04a2-43d0-88f0-fbaebc88073a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5647259d-672c-4fc8-8153-9e4e017d5809", "tag": "6f791393-fc18-4155-97d0-9eaf3606b331"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:06:48.011101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=26 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:06:48.011476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:06:48.019706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:06:48.024999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ac62eb8-9293-443e-9892-78af80f0c8f6 req-8c79b062-04a2-43d0-88f0-fbaebc88073a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:48.025355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ac62eb8-9293-443e-9892-78af80f0c8f6 req-8c79b062-04a2-43d0-88f0-fbaebc88073a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:48.025584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:48.025923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ac62eb8-9293-443e-9892-78af80f0c8f6 req-8c79b062-04a2-43d0-88f0-fbaebc88073a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:48.026090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:48.029555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:48.031313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:48.031954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:48.032484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:48.039597 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7ac62eb8-9293-443e-9892-78af80f0c8f6 req-8c79b062-04a2-43d0-88f0-fbaebc88073a service nova] Creating event network-changed:6f791393-fc18-4155-97d0-9eaf3606b331 for instance 5647259d-672c-4fc8-8153-9e4e017d5809 on n-h1-860863-4 Nov 02 22:06:48.044402 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7ac62eb8-9293-443e-9892-78af80f0c8f6 req-8c79b062-04a2-43d0-88f0-fbaebc88073a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038036 Nov 02 22:06:48.045761 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3297/6713] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:06:48.071810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:06:48.392308 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c51d09d9-71b4-4f53-a85f-dd6b76ce6e2f tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 204 len: 0 microversion: 2.1 time: 0.390214 Nov 02 22:06:48.401009 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3417/6714] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:06:48 2022] DELETE /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:06:48.403290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:48.404007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:48.412145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:48.412898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:48.414000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:48.414996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:48.415710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:48.416313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:48.597676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:48.604147 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-547b4e83-3f68-4278-8db9-376d2cc4a2a5 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1690 microversion: 2.1 time: 0.205276 Nov 02 22:06:48.604722 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3298/6715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:48 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1690 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:49.633613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:49.636425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:49.644403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:49.645263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:49.645786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:49.646578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:49.647116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:49.647648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:49.876960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:49.884995 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-75cb927a-a8e4-47ea-8b67-529906552677 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1690 microversion: 2.1 time: 0.258857 Nov 02 22:06:49.885577 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3418/6716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:49 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:50.481047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-87c67299-ca29-4cb5-8e49-68e9f94762a8 req-2bf12ab8-9a5a-41b3-bc4e-5f3b224c78dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647259d-672c-4fc8-8153-9e4e017d5809", "name": "network-vif-deleted", "tag": "6f791393-fc18-4155-97d0-9eaf3606b331"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:06:50.493231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-87c67299-ca29-4cb5-8e49-68e9f94762a8 req-2bf12ab8-9a5a-41b3-bc4e-5f3b224c78dd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:50.493737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-87c67299-ca29-4cb5-8e49-68e9f94762a8 req-2bf12ab8-9a5a-41b3-bc4e-5f3b224c78dd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:50.494380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-87c67299-ca29-4cb5-8e49-68e9f94762a8 req-2bf12ab8-9a5a-41b3-bc4e-5f3b224c78dd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:50.507126 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-87c67299-ca29-4cb5-8e49-68e9f94762a8 req-2bf12ab8-9a5a-41b3-bc4e-5f3b224c78dd service nova] Creating event network-vif-deleted:6f791393-fc18-4155-97d0-9eaf3606b331 for instance 5647259d-672c-4fc8-8153-9e4e017d5809 on n-h1-860863-4 Nov 02 22:06:50.512439 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-87c67299-ca29-4cb5-8e49-68e9f94762a8 req-2bf12ab8-9a5a-41b3-bc4e-5f3b224c78dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035400 Nov 02 22:06:50.513057 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3299/6717] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:06:50.913880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:50.914274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:50.922142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:50.922664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:50.923182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:50.923965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:50.925193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:50.925672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:50.969248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:50.969959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:50.970542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:50.971012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lazy-loading 'fault' on Instance uuid 5647259d-672c-4fc8-8153-9e4e017d5809 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:06:51.016226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3d5fb3af3fe44d3a742f5e902b32f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b39bec3bc514c81997eb2bc7c528cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:06:51.024758 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4677fd32-6e37-4a72-b49a-202351ab3bf3 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 200 len: 1357 microversion: 2.1 time: 0.119195 Nov 02 22:06:51.025407 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3419/6718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:50 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 1357 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:06:52.050047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:52.050752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] [instance: 5647259d-672c-4fc8-8153-9e4e017d5809] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:06:52.058522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:52.059037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:52.059475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:52.060161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:06:52.060611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:06:52.061068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:06:52.077339 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] HTTP exception thrown: Instance 5647259d-672c-4fc8-8153-9e4e017d5809 could not be found. Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Request method failure captured: Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 HTTP/1.1 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYufPX6Rr5nr0yUdeWlboFRhiIRbfN70FaGXR5l42VL99ff4QwXSASZ8gH2G8kcngmWHBOUnKDxEHG5udsXaLab0zA1qmKd0pxn2TvmKN1vh_EQYUFTlFaM3t9QlaSUDMe-Q91CN2uqH3mfhXQC5X0nf71_hjip1qxhzqvXD3EIeuvz4 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7b39bec3bc514c81997eb2bc7c528cbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 7b39bec3bc514c81997eb2bc7c528cbb Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1881336979 Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f3d5fb3af3fe44d3a742f5e902b32f4d Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1881336979-project Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 5647259d-672c-4fc8-8153-9e4e017d5809 could not be found. Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '5647259d-672c-4fc8-8153-9e4e017d5809'} Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5647259d-672c-4fc8-8153-9e4e017d5809 could not be found. Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5647259d-672c-4fc8-8153-9e4e017d5809 could not be found. Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:06:52.079064 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5647259d-672c-4fc8-8153-9e4e017d5809 could not be found. Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Returning 404 to user: Instance 5647259d-672c-4fc8-8153-9e4e017d5809 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb1c69c2-87f7-4ac2-95f6-a754d07f8463 tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809" status: 404 len: 111 microversion: 2.1 time: 0.035071 Nov 02 22:06:52.085531 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3300/6719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:06:52 2022] GET /compute/v2.1/servers/5647259d-672c-4fc8-8153-9e4e017d5809 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:06:56.095807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0cd1bd8d-b41c-46fe-96b4-d1faa5d2a23e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] Calling method '.version_select at 0x7f9b681fb550>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:06:56.182495 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0cd1bd8d-b41c-46fe-96b4-d1faa5d2a23e tempest-TestNetworkAdvancedServerOps-1881336979 tempest-TestNetworkAdvancedServerOps-1881336979-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2018241682" status: 202 len: 0 microversion: 2.1 time: 0.090756 Nov 02 22:06:56.183143 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3420/6720] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 22:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2018241682 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:07:56.003077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:07:56.004155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=16 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:07:56.215977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:07:56.216651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:07:56.223034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:56.226655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:56.226655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:56.226655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:56.226655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:56.226655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:56.252203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:07:56.551403 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e073560c-0373-41a1-be71-65119b1183f5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 204 len: 0 microversion: 2.1 time: 0.550138 Nov 02 22:07:56.551999 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3301/6721] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:07:55 2022] DELETE /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:07:56.559390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:07:56.561665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:07:56.565248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:07:56.565908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:07:56.573323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:56.573826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:56.574284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:56.574990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:56.575464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:56.575912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:56.821187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:07:56.829134 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d31664cc-8f0e-4037-b133-3afd8ce2b736 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1577 microversion: 2.1 time: 0.272229 Nov 02 22:07:56.829705 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3421/6722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:07:56 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1577 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:07:57.852336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:07:57.853194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:07:57.860340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:57.860823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:57.861355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:57.862047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:57.862496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:57.862918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:58.080521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:07:58.089163 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f6f4db11-1004-41bb-8d4f-c4c0ca23ae45 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1577 microversion: 2.1 time: 0.241077 Nov 02 22:07:58.089685 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3302/6723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:07:57 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:07:59.087494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8060a341-533c-4339-bf2d-e2d3b83daac5 req-1cd657e3-cb56-4e6f-b112-14a37f4fd663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fbc62ce-1d95-40c1-80ed-cd68ba710976", "name": "network-vif-deleted", "tag": "076e254b-253b-4f44-864b-04a82033ae26"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:07:59.097914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8060a341-533c-4339-bf2d-e2d3b83daac5 req-1cd657e3-cb56-4e6f-b112-14a37f4fd663 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:59.102392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8060a341-533c-4339-bf2d-e2d3b83daac5 req-1cd657e3-cb56-4e6f-b112-14a37f4fd663 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:59.102392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8060a341-533c-4339-bf2d-e2d3b83daac5 req-1cd657e3-cb56-4e6f-b112-14a37f4fd663 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:59.111239 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8060a341-533c-4339-bf2d-e2d3b83daac5 req-1cd657e3-cb56-4e6f-b112-14a37f4fd663 service nova] Creating event network-vif-deleted:076e254b-253b-4f44-864b-04a82033ae26 for instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 on n-h2-860863-4 Nov 02 22:07:59.117022 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8060a341-533c-4339-bf2d-e2d3b83daac5 req-1cd657e3-cb56-4e6f-b112-14a37f4fd663 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034096 Nov 02 22:07:59.118835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:07:59.120300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:07:59.123460 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3422/6724] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:07:59.129822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:59.130990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:59.135327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:59.138468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:07:59.140459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:07:59.141165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:07:59.249577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:07:59.257623 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-abcab75c-d1d9-4cd3-a7ee-c99e713e54b4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1510 microversion: 2.1 time: 0.148928 Nov 02 22:07:59.273925 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3303/6725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:07:59 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:00.284805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:00.286721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:00.293783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:00.294735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:00.296306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:00.296306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:00.296979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:00.297535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:00.383470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:00.394813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec08ce4c-25ec-4f7e-804f-542031aa597d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1224 microversion: 2.1 time: 0.115430 Nov 02 22:08:00.396000 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3423/6726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:00 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:01.418986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:01.419616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:01.427617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:01.428128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:01.428582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:01.429565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:01.430016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:01.430347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:01.519465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:01.528121 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-be376125-85a4-43b4-bb79-7a9c6d7667f9 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1224 microversion: 2.1 time: 0.113050 Nov 02 22:08:01.534599 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3304/6727] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:01 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:02.551723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:02.552454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:02.560371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:02.560876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:02.561357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:02.562080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:02.562552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:02.562998 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:02.628283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:02.637259 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0572f15-8132-4be1-a262-ab3e2b1d4f09 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1224 microversion: 2.1 time: 0.089590 Nov 02 22:08:02.637832 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3424/6728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:02 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:03.659968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:03.660738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:03.669426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:03.670385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:03.670512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:03.671122 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:03.671580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:03.672037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:03.740027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:03.748510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b46e9139-25fa-48c8-8813-3469ff84a4f3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 200 len: 1224 microversion: 2.1 time: 0.092447 Nov 02 22:08:03.749108 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3305/6729] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:03 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:08:04.771635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:04.772813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:04.779710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:04.780468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:04.780946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:04.781751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:04.782223 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:04.782666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:04.797464 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 HTTP/1.1 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2fbc62ce-1d95-40c1-80ed-cd68ba710976'} Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:08:04.799073 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:08:04.805256 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ed73210-f824-449c-af47-6106690d8955 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 404 len: 111 microversion: 2.1 time: 0.032680 Nov 02 22:08:04.806588 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3425/6730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:04 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:08:04.860203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1241951820", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-413771351", "security_groups": [{"name": "tempest-secgroup-smoke-355656007"}], "block_device_mapping_v2": [{"uuid": "d18a2154-0f8d-44ee-a15d-6c84142e9d7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:08:04.979514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:08:05.421654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:08:05.422121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:08:05.422596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:08:05.422999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:08:05.423410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:08:05.434759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:05.435246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:05.435792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:05.436635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:05.437090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:05.437638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:05.454823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:08:05.460648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:08:05.520003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:08:05.522153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d18a2154-0f8d-44ee-a15d-6c84142e9d7a',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:08:05.935230 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a89fa58-65dc-4397-9289-4fd358e2ca95 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.078973 Nov 02 22:08:05.936067 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3306/6731] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:08:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:08:05.947626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be7216f2-fb42-4a21-9893-c8db976951f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:05.948517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be7216f2-fb42-4a21-9893-c8db976951f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:06.012481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be7216f2-fb42-4a21-9893-c8db976951f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:06.023027 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be7216f2-fb42-4a21-9893-c8db976951f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1094 microversion: 2.1 time: 0.079053 Nov 02 22:08:06.023745 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3426/6732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:05 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:07.046680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:07.047295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:07.054154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:07.054809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:07.055260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:07.055981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:07.056440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:07.056869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:07.123316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:07.131247 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dfd2a7d9-9456-4d4d-8605-eb63769e0708 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1144 microversion: 2.1 time: 0.089331 Nov 02 22:08:07.132390 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3307/6733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:07 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:08.154669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:08.155446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:08.162632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:08.163458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:08.163911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:08.164624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:08.165128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:08.168443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:08.239645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:08.255069 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dad50d50-482b-46d5-a8ab-aaaba9442971 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1200 microversion: 2.1 time: 0.101029 Nov 02 22:08:08.255069 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3427/6734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:08 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:08:09.277371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:09.278166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:09.285622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:09.286404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:09.286957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:09.287770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:09.289358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:09.289902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:09.481973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:09.490538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c583670-e992-4417-ada8-edee49449013 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1277 microversion: 2.1 time: 0.218506 Nov 02 22:08:09.491170 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3308/6735] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:09 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:09.901200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5f1adcc8-2f87-487d-805a-ca04f3c5d005 req-7abee690-42b4-4bf0-ba9b-561e96fee49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51432a00-baf8-441b-b977-c626b11a232f", "tag": "8f6bf707-79d0-4d50-a50a-b283629e0a69"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:08:09.926040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5f1adcc8-2f87-487d-805a-ca04f3c5d005 req-7abee690-42b4-4bf0-ba9b-561e96fee49a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:09.926825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5f1adcc8-2f87-487d-805a-ca04f3c5d005 req-7abee690-42b4-4bf0-ba9b-561e96fee49a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:09.927293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5f1adcc8-2f87-487d-805a-ca04f3c5d005 req-7abee690-42b4-4bf0-ba9b-561e96fee49a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:09.945663 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5f1adcc8-2f87-487d-805a-ca04f3c5d005 req-7abee690-42b4-4bf0-ba9b-561e96fee49a service nova] Creating event network-changed:8f6bf707-79d0-4d50-a50a-b283629e0a69 for instance 51432a00-baf8-441b-b977-c626b11a232f on n-h2-860863-4 Nov 02 22:08:09.951901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5f1adcc8-2f87-487d-805a-ca04f3c5d005 req-7abee690-42b4-4bf0-ba9b-561e96fee49a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055383 Nov 02 22:08:09.953110 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3428/6736] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:08:10.514429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:10.515055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:10.524143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:10.524644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:10.525130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:10.525876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:10.526337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:10.527492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:10.764288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:10.773928 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ba26b88f-a5b1-4b08-a9b8-abedae69b2e0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1277 microversion: 2.1 time: 0.263463 Nov 02 22:08:10.774729 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3309/6737] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:10 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:11.798861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:11.800271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:11.807934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:11.808450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:11.808916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:11.809656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:11.810132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:11.810580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:11.954621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:11.963575 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dac2656c-c202-4216-a88d-1c0b4ca960b5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1277 microversion: 2.1 time: 0.170457 Nov 02 22:08:11.964310 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3429/6738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:11 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:12.987507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:12.988125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:12.997132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:12.997640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:12.998065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:12.998769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:12.999224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:12.999652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:13.138748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:13.146871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e9e213ba-412c-4cca-b922-d5824e6db483 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1277 microversion: 2.1 time: 0.163324 Nov 02 22:08:13.148058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3310/6739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:12 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:14.170536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:14.171169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:14.178744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:14.179327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:14.179783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:14.180519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:14.181037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:14.181489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:14.319099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:14.327204 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ab0d60c-7ed8-433f-95f9-3801adb22db4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.160729 Nov 02 22:08:14.327781 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3430/6740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:14 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:15.351143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:15.351801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:15.358698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:15.359179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:15.359613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:15.360302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:15.360749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:15.361205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:15.447410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:08:15.467619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:08:15.497800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:15.506014 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-185d9142-3268-45d7-8908-88369cfc54a3 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.159333 Nov 02 22:08:15.511790 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3311/6741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:15 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:16.530782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:16.531413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:16.533926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:08:16.539590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:16.540085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:16.544630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:16.544630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:16.544630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:16.544630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:16.679011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:16.686884 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9171d961-c41c-4f1d-886d-77a46e944fdc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.160257 Nov 02 22:08:16.687453 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3431/6742] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:16 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:17.710888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:17.711630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:17.718389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:17.718880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:17.719329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:17.720038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:17.720535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:17.720990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:17.858201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:17.866126 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3cb8f40-abeb-4fb3-9bd0-02f1f419075a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.160206 Nov 02 22:08:17.866711 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3312/6743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:17 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:18.890729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:18.891392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:18.898892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:18.899405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:18.899871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:18.900595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:18.901100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:18.901770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:19.051978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:19.061339 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-501fadea-09fc-41c9-a852-0340bee3c836 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.174445 Nov 02 22:08:19.062139 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3432/6744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:18 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:20.084264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:20.084969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:20.092117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:20.092603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:20.093073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:20.093770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:20.094878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:20.095313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:20.234475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:20.242719 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d0241b4-7ed9-462c-b89e-c8ca0fe1bc66 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.162289 Nov 02 22:08:20.243394 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3313/6745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:20 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:21.266609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:21.267267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:21.274651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:21.275389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:21.276142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:21.277303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:21.277893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:21.278354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:21.416230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:21.425909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a9e7f05-e0ad-4814-8166-db59853c260a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.162601 Nov 02 22:08:21.426517 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3433/6746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:21 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:22.450261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:22.450934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:22.458107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:22.458593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:22.459036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:22.459725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:22.460181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:22.460609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:22.601173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:22.609742 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-06a85a8d-2cbd-4153-8acf-0ca082c3d5b7 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.163389 Nov 02 22:08:22.610252 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3314/6747] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:22 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:08:23.247924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ab1ac2e9-0aa1-4f46-b027-84ddb42fb554 req-f3118f87-03f1-45b0-ad0a-23ca3ad1ecc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51432a00-baf8-441b-b977-c626b11a232f", "name": "network-vif-plugged", "status": "completed", "tag": "8f6bf707-79d0-4d50-a50a-b283629e0a69"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:08:23.258705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab1ac2e9-0aa1-4f46-b027-84ddb42fb554 req-f3118f87-03f1-45b0-ad0a-23ca3ad1ecc2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:23.259451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab1ac2e9-0aa1-4f46-b027-84ddb42fb554 req-f3118f87-03f1-45b0-ad0a-23ca3ad1ecc2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:23.259898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab1ac2e9-0aa1-4f46-b027-84ddb42fb554 req-f3118f87-03f1-45b0-ad0a-23ca3ad1ecc2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:23.271528 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ab1ac2e9-0aa1-4f46-b027-84ddb42fb554 req-f3118f87-03f1-45b0-ad0a-23ca3ad1ecc2 service nova] Creating event network-vif-plugged:8f6bf707-79d0-4d50-a50a-b283629e0a69 for instance 51432a00-baf8-441b-b977-c626b11a232f on n-h2-860863-4 Nov 02 22:08:23.277892 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ab1ac2e9-0aa1-4f46-b027-84ddb42fb554 req-f3118f87-03f1-45b0-ad0a-23ca3ad1ecc2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109252 Nov 02 22:08:23.278796 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3434/6748] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:08:23.636602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:23.637178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:23.644006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:23.644493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:23.644953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:23.645650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:23.646103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:23.646531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:23.787062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:23.795192 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01fd18e9-99b8-4c1b-884e-9e8dcfcb91c0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1265 microversion: 2.1 time: 0.162934 Nov 02 22:08:23.795761 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3315/6749] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:23 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:24.819898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:24.821129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:24.827323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:24.827817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:24.828267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:24.828985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:24.829455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:24.829899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:24.974133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:24.982096 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0805483-31f9-45d0-b8a4-8eabc1ae0071 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1453 microversion: 2.1 time: 0.167446 Nov 02 22:08:24.982686 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3435/6750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:24 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:25.004690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:08:25.005589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:08:25.013471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:25.014039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:25.014553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:25.015403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:25.015965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:25.016484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:25.034642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:08:25.154165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:08:25.162091 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fc9fe361-88a2-4248-ade7-bfccdd7d503e tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1453 microversion: 2.1 time: 0.161300 Nov 02 22:08:25.162661 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3316/6751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:08:24 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:08:27.509570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-82fc4932-533f-4bea-bb82-84e0b018ac83 req-3ef0e13e-49c9-4a9a-a795-8ea4666c422e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51432a00-baf8-441b-b977-c626b11a232f", "tag": "8f6bf707-79d0-4d50-a50a-b283629e0a69"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:08:27.515207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=33 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:08:27.521301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-82fc4932-533f-4bea-bb82-84e0b018ac83 req-3ef0e13e-49c9-4a9a-a795-8ea4666c422e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:08:27.521797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-82fc4932-533f-4bea-bb82-84e0b018ac83 req-3ef0e13e-49c9-4a9a-a795-8ea4666c422e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:08:27.522248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-82fc4932-533f-4bea-bb82-84e0b018ac83 req-3ef0e13e-49c9-4a9a-a795-8ea4666c422e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:08:27.526471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=69 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:08:27.533636 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-82fc4932-533f-4bea-bb82-84e0b018ac83 req-3ef0e13e-49c9-4a9a-a795-8ea4666c422e service nova] Creating event network-changed:8f6bf707-79d0-4d50-a50a-b283629e0a69 for instance 51432a00-baf8-441b-b977-c626b11a232f on n-h2-860863-4 Nov 02 22:08:27.540101 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-82fc4932-533f-4bea-bb82-84e0b018ac83 req-3ef0e13e-49c9-4a9a-a795-8ea4666c422e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104561 Nov 02 22:08:27.540717 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3436/6752] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:10:16.338635 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 22:10:16.345023 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 22:10:16.345969 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:10:16.353580 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 (ip 10.222.0.25) !!! Nov 02 22:10:16.361890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:16.362728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:16.557497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:16.578679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:10:16.858636 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae5ddca6-f9a8-42cf-b008-dde6439c8549 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 204 len: 0 microversion: 2.1 time: 0.522682 Nov 02 22:10:16.859232 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3317/6753] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:10:16 2022] DELETE /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:10:16.866157 n-d-860863-4 devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:10:16.867265 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:10:16.867424 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 (ip 10.222.0.25) !!! Nov 02 22:10:16.876859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:16.877602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:16.886731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:16.888852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:16.888852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:16.888852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:16.888852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:16.889319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:17.072890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:10:17.072890 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c13d880e-4292-49d5-a65a-fbb2ea112a89 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1734 microversion: 2.1 time: 0.169280 Nov 02 22:10:17.072890 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3437/6754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:16 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:18.065024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:18.065798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:18.075847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:18.076337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:18.076777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:18.077521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:18.077978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:18.084498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:18.221891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:10:18.229899 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7a3278b8-95d1-4783-b5fd-8b3a99758e00 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1734 microversion: 2.1 time: 0.175938 Nov 02 22:10:18.230982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3318/6755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:18 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:19.254676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:19.255310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:19.266023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:19.266558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:19.267172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:19.267915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:19.268381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:19.269000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:19.272921 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39534. Nov 02 22:10:19.305535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ee9844d6-3306-4b2d-a620-16b725ba4298 req-c954cae3-7ee3-43db-bb7a-370a64dadf69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda9f508-9509-400c-890d-28419fb2fb45", "name": "network-vif-deleted", "tag": "d60b185d-c927-490d-974c-70348efa9d5a"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:10:19.326302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ee9844d6-3306-4b2d-a620-16b725ba4298 req-c954cae3-7ee3-43db-bb7a-370a64dadf69 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:19.330115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ee9844d6-3306-4b2d-a620-16b725ba4298 req-c954cae3-7ee3-43db-bb7a-370a64dadf69 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:19.330724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ee9844d6-3306-4b2d-a620-16b725ba4298 req-c954cae3-7ee3-43db-bb7a-370a64dadf69 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:19.341703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cc5cd438f4cbba13402a10a037d1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e3f4a4cf8b4738aa50d66ce3922d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:10:19.350273 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ee9844d6-3306-4b2d-a620-16b725ba4298 req-c954cae3-7ee3-43db-bb7a-370a64dadf69 service nova] Creating event network-vif-deleted:d60b185d-c927-490d-974c-70348efa9d5a for instance fda9f508-9509-400c-890d-28419fb2fb45 on n-h1-860863-4 Nov 02 22:10:19.352134 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-07a799f6-1e9b-4b16-9d55-b130daf68551 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 200 len: 1666 microversion: 2.1 time: 0.101332 Nov 02 22:10:19.353308 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3438/6756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:19 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 1666 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:19.360120 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ee9844d6-3306-4b2d-a620-16b725ba4298 req-c954cae3-7ee3-43db-bb7a-370a64dadf69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060301 Nov 02 22:10:19.362864 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3319/6757] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:10:20.398065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:20.398698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:20.406464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:20.406984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:20.407442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:20.408165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:20.408637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:20.409118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:20.424769 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] HTTP exception thrown: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Request method failure captured: Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 HTTP/1.1 Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYumOhAdjywC34mc3tgJ-Yw3ADHrrnVaEpPN2jw7m4skQeWdLafuyDMCinGi0VwiA26ES8j-hO4kG_0oHiW98ph5N3-W74yfhchvKJNLqc0c9C8oG1zpk1XFWsqRLGHccgwCnpksGMNvYWYk8gJ4JU8QeUGJe-cxpJc2NVqTUBn45Umw Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 54e3f4a4cf8b4738aa50d66ce3922d2c Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestServerBasicOps-250221602 Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestServerBasicOps-250221602 Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 54e3f4a4cf8b4738aa50d66ce3922d2c Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestServerBasicOps-250221602 Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestServerBasicOps-250221602-project Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 845cc5cd438f4cbba13402a10a037d1a Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestServerBasicOps-250221602-project Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'fda9f508-9509-400c-890d-28419fb2fb45'} Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:10:20.426514 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Returning 404 to user: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:10:20.430815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1afcfa4-4c20-4645-98da-b34b6e6f5bb8 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 404 len: 111 microversion: 2.1 time: 0.033870 Nov 02 22:10:20.431970 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3439/6758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:20 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:10:21.014760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:21.015350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:21.021520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:21.021994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:21.022434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:21.023120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:21.023577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:21.024006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:21.037699 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] HTTP exception thrown: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Request method failure captured: Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 HTTP/1.1 Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYumOhAdjywC34mc3tgJ-Yw3ADHrrnVaEpPN2jw7m4skQeWdLafuyDMCinGi0VwiA26ES8j-hO4kG_0oHiW98ph5N3-W74yfhchvKJNLqc0c9C8oG1zpk1XFWsqRLGHccgwCnpksGMNvYWYk8gJ4JU8QeUGJe-cxpJc2NVqTUBn45Umw Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 54e3f4a4cf8b4738aa50d66ce3922d2c Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestServerBasicOps-250221602 Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestServerBasicOps-250221602 Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 54e3f4a4cf8b4738aa50d66ce3922d2c Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestServerBasicOps-250221602 Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestServerBasicOps-250221602-project Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 845cc5cd438f4cbba13402a10a037d1a Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestServerBasicOps-250221602-project Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'fda9f508-9509-400c-890d-28419fb2fb45'} Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:10:21.039454 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Returning 404 to user: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:10:21.044337 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a795858d-ae17-47ea-a8cc-96f0d53db375 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 404 len: 111 microversion: 2.1 time: 0.033005 Nov 02 22:10:21.045355 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3320/6759] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:10:21 2022] DELETE /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:10:21.053273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:21.054015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] [instance: fda9f508-9509-400c-890d-28419fb2fb45] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:21.060793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:21.061310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:21.061828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:21.062591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:21.063142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:21.063649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:21.077369 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] HTTP exception thrown: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Request method failure captured: Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 HTTP/1.1 Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYumOhAdjywC34mc3tgJ-Yw3ADHrrnVaEpPN2jw7m4skQeWdLafuyDMCinGi0VwiA26ES8j-hO4kG_0oHiW98ph5N3-W74yfhchvKJNLqc0c9C8oG1zpk1XFWsqRLGHccgwCnpksGMNvYWYk8gJ4JU8QeUGJe-cxpJc2NVqTUBn45Umw Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 54e3f4a4cf8b4738aa50d66ce3922d2c Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestServerBasicOps-250221602 Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/54e3f4a4cf8b4738aa50d66ce3922d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestServerBasicOps-250221602 Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 54e3f4a4cf8b4738aa50d66ce3922d2c Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestServerBasicOps-250221602 Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestServerBasicOps-250221602-project Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 845cc5cd438f4cbba13402a10a037d1a Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestServerBasicOps-250221602-project Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'fda9f508-9509-400c-890d-28419fb2fb45'} Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:10:21.079000 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:10:21.082869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Returning 404 to user: Instance fda9f508-9509-400c-890d-28419fb2fb45 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:10:21.083366 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5542d140-fb01-4c7b-8278-64caaf5e7abb tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45" status: 404 len: 111 microversion: 2.1 time: 0.032935 Nov 02 22:10:21.083989 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3440/6760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:21 2022] GET /compute/v2.1/servers/fda9f508-9509-400c-890d-28419fb2fb45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:10:21.315266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-51cdcb71-8ea3-418c-a56b-2c749a780120 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] Calling method '.version_select at 0x7f9b639d1310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:21.407948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-51cdcb71-8ea3-418c-a56b-2c749a780120 tempest-TestServerBasicOps-250221602 tempest-TestServerBasicOps-250221602-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1504992150" status: 202 len: 0 microversion: 2.1 time: 0.096835 Nov 02 22:10:21.408751 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3321/6761] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 22:10:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1504992150 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:10:48.357107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=9 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:48.357902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=17 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:48.359189 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 22:10:48.359332 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-availability-zone/detail (ip 10.222.0.25) !!! Nov 02 22:10:48.492806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:48.499734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:48.500491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:48.500981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:48.501981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:48.503069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:48.503819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:48.533900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4f4bbca-01df-4462-bcf0-d62492349bff tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.182430 Nov 02 22:10:48.541105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3441/6762] 10.222.0.25 () {58 vars in 1185 bytes} [Wed Nov 2 22:10:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:10:48.668148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:48.668912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:48.679962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-712840937", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "availability_zone": "nova:n-h1-860863-4", "networks": [{"uuid": "0ef88e16-9c96-45e9-8bf9-0662c540a288"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:10:48.761952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] validate_networks() for [('0ef88e16-9c96-45e9-8bf9-0662c540a288', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:10:49.233017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:10:49.233463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:10:49.233993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:10:49.234573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:10:49.235166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:10:49.244505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:49.245049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:49.246939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:49.246939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:49.246939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:49.247954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:49.269409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Getting quotas for project 170ed52270a24ded8cbf0b79791257a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:10:49.274949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Getting quotas for user 1923eb39838d42dea71f83971bb8fd76 and project 170ed52270a24ded8cbf0b79791257a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:10:49.295040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:10:49.297463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:10:49.440069 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4d5fca1-b69e-47c8-b113-c00264728a41 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774359 Nov 02 22:10:49.440664 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3322/6763] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:10:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:10:49.452579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c1b5189-e1a4-4397-87bc-537679837228 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:49.453262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c1b5189-e1a4-4397-87bc-537679837228 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:49.530670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c1b5189-e1a4-4397-87bc-537679837228 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1328 microversion: 2.1 time: 0.082319 Nov 02 22:10:49.531454 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3442/6764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:49 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1328 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:50.555808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b11d9a1-5301-42a2-b512-8eac4858bf7a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:50.557014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b11d9a1-5301-42a2-b512-8eac4858bf7a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:50.625425 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b11d9a1-5301-42a2-b512-8eac4858bf7a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1328 microversion: 2.1 time: 0.074230 Nov 02 22:10:50.627199 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3323/6765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:50 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1328 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:51.651073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:51.652818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:51.660246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:51.660830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:51.661387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:51.662183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:51.662754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:51.663208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:51.748106 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-880a7a8b-6503-4652-befb-6de12ff671f3 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1337 microversion: 2.1 time: 0.100686 Nov 02 22:10:51.748991 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3443/6766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:51 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:52.773754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:52.775048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:52.786568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:52.790986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:52.791455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:52.792735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:52.793857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:52.794454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:53.076306 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-758f9cbb-c434-4037-88e8-ff2a7386552f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1423 microversion: 2.1 time: 0.306468 Nov 02 22:10:53.098731 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3324/6767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:52 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1423 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:54.106198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:54.108872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:54.119570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:54.120481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:54.121423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:54.122169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:54.122643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:54.123089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:54.286486 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3885779c-0e4b-484a-ba0b-7a85eb5576aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1463 microversion: 2.1 time: 0.184853 Nov 02 22:10:54.287223 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3444/6768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:54 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1463 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:54.574403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6c060421-f76d-48c2-b2c0-673b4c1f3c42 req-9752ca92-c003-424c-9923-22f2eea7a07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13ea8e8-8f59-4973-b33c-d8e066ab5b74", "tag": "f31ce127-08bb-46ca-aeb0-7e60338effee"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:10:54.598005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c060421-f76d-48c2-b2c0-673b4c1f3c42 req-9752ca92-c003-424c-9923-22f2eea7a07e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:54.599408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c060421-f76d-48c2-b2c0-673b4c1f3c42 req-9752ca92-c003-424c-9923-22f2eea7a07e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:54.600277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6c060421-f76d-48c2-b2c0-673b4c1f3c42 req-9752ca92-c003-424c-9923-22f2eea7a07e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:54.614548 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6c060421-f76d-48c2-b2c0-673b4c1f3c42 req-9752ca92-c003-424c-9923-22f2eea7a07e service nova] Creating event network-changed:f31ce127-08bb-46ca-aeb0-7e60338effee for instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 on n-h1-860863-4 Nov 02 22:10:54.621677 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6c060421-f76d-48c2-b2c0-673b4c1f3c42 req-9752ca92-c003-424c-9923-22f2eea7a07e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054667 Nov 02 22:10:54.626755 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3325/6769] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:10:55.312956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:55.313829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:55.320735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:55.322309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:55.322309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:55.322504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:55.322874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:55.323341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:55.472170 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0531eb9f-8441-4d69-9158-3d79b134d8dd tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1463 microversion: 2.1 time: 0.162944 Nov 02 22:10:55.472989 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3445/6770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:55 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:56.497960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:56.498712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:56.505471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:56.505963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:56.506409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:56.507115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:56.507573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:56.508005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:56.648460 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ad30266-c45e-42da-871d-7ef1326da0ab tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1463 microversion: 2.1 time: 0.156227 Nov 02 22:10:56.650796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3326/6771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:56 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:57.676754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:57.678184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:57.687108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:57.687800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:57.688469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:57.689381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:57.690026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:57.690658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:57.829906 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e47f0241-09b4-44b7-a162-5c7a5fe177d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1463 microversion: 2.1 time: 0.156876 Nov 02 22:10:57.830489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3446/6772] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:57 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:58.852700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:10:58.853331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:10:58.860414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:58.860955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:58.861408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:58.862099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:58.862548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:58.862969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:59.003187 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a2d6502-aee8-4cf0-a57e-7b84f10a10ee tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1463 microversion: 2.1 time: 0.154213 Nov 02 22:10:59.003868 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3327/6773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:10:58 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:10:59.865320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-654f1fe7-0ca7-4fe4-940a-3f010e866c8b req-00ddc55a-db84-4249-9331-1f492b5f175d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13ea8e8-8f59-4973-b33c-d8e066ab5b74", "name": "network-vif-plugged", "status": "completed", "tag": "f31ce127-08bb-46ca-aeb0-7e60338effee"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:10:59.871075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:59.872565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:10:59.877942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-654f1fe7-0ca7-4fe4-940a-3f010e866c8b req-00ddc55a-db84-4249-9331-1f492b5f175d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:10:59.878469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-654f1fe7-0ca7-4fe4-940a-3f010e866c8b req-00ddc55a-db84-4249-9331-1f492b5f175d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:10:59.878912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-654f1fe7-0ca7-4fe4-940a-3f010e866c8b req-00ddc55a-db84-4249-9331-1f492b5f175d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:10:59.890056 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-654f1fe7-0ca7-4fe4-940a-3f010e866c8b req-00ddc55a-db84-4249-9331-1f492b5f175d service nova] Creating event network-vif-plugged:f31ce127-08bb-46ca-aeb0-7e60338effee for instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 on n-h1-860863-4 Nov 02 22:10:59.896308 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-654f1fe7-0ca7-4fe4-940a-3f010e866c8b req-00ddc55a-db84-4249-9331-1f492b5f175d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036072 Nov 02 22:10:59.896901 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3447/6774] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:11:00.027548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:00.028941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:00.032142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:00.037086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:00.037201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:00.037626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:00.038335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:00.038933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:00.039569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:00.174653 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb4076d4-3e3e-43a5-adc2-e39ddd3cc6ae tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1463 microversion: 2.1 time: 0.151454 Nov 02 22:11:00.175224 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3328/6775] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:00 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:01.200052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:01.200704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:01.210241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:01.210748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:01.211208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:01.211926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:01.212396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:01.212839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:01.351687 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2165a122-f1fa-4b4d-b260-edcbd714e466 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1463 microversion: 2.1 time: 0.157188 Nov 02 22:11:01.352263 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3448/6776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:01 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:02.376138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:02.376947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:02.378994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:02.384896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:02.385483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:02.385810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:02.386772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:02.387228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:02.387686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:02.526112 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3d9b46b7-f7a2-4afc-88eb-1172abb1a5a8 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1647 microversion: 2.1 time: 0.154246 Nov 02 22:11:02.532709 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3329/6777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:02 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1647 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:02.552187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:02.552187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:02.558705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:02.559184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:02.559639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:02.560348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:02.561601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:02.562062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:02.699134 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b084bb6-3599-4fc6-9277-6ddc74aa8269 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1647 microversion: 2.1 time: 0.152184 Nov 02 22:11:02.699713 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3449/6778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:02 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1647 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:02.722872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:02.723481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:02.729699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:02.730178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:02.730613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:02.731293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:02.731741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:02.732163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:02.866779 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bedf543b-ad5f-4a58-bd37-56fb439eaa81 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1647 microversion: 2.1 time: 0.147493 Nov 02 22:11:02.867590 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3330/6779] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:02 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1647 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:02.937200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1767280925", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "availability_zone": "nova:n-h2-860863-4", "networks": [{"uuid": "0ef88e16-9c96-45e9-8bf9-0662c540a288"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:03.013515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] validate_networks() for [('0ef88e16-9c96-45e9-8bf9-0662c540a288', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:11:03.530252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:11:03.530720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:11:03.531407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:11:03.531843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:11:03.532275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:11:03.541775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:03.547693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:03.547693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:03.547693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:03.547693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:03.547693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:03.567628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Getting quotas for project 170ed52270a24ded8cbf0b79791257a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:11:03.573186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Getting quotas for user 1923eb39838d42dea71f83971bb8fd76 and project 170ed52270a24ded8cbf0b79791257a7. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:11:03.586770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:11:03.589501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:11:03.700988 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e8f256d-2ed8-4bd8-860e-cfe05b8125a1 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768738 Nov 02 22:11:03.708075 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3450/6780] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:11:03.713568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-64a84ee1-48a8-456a-b423-3e9db4bb5a7d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:03.714206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-64a84ee1-48a8-456a-b423-3e9db4bb5a7d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:03.777579 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-64a84ee1-48a8-456a-b423-3e9db4bb5a7d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1329 microversion: 2.1 time: 0.067901 Nov 02 22:11:03.778156 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3331/6781] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:03 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1329 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:04.471120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2045341521", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-413771351", "security_groups": [{"name": "tempest-secgroup-smoke-355656007"}], "block_device_mapping_v2": [{"uuid": "2b26e20e-2e7b-4afe-9a0e-cbf419482333", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09b32150-92d9-4c01-a806-62a3b269b45f"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:04.598756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] validate_networks() for [('09b32150-92d9-4c01-a806-62a3b269b45f', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:11:04.801700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:04.802319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:04.809458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:04.809955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:04.810402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:04.811140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:04.811783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:04.812374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:04.917044 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41f66a7d-82d0-47fe-8e19-b776a64e6a2a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1346 microversion: 2.1 time: 0.118996 Nov 02 22:11:04.917795 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3332/6782] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:04 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:05.045026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:11:05.045490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:11:05.047762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:11:05.048335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:11:05.048777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:11:05.062236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:05.062752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:05.063209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:05.065032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:05.065569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:05.066259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:05.085127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:11:05.090314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Getting quotas for user 8ecbff97ebdb4bac9a3054dc89515415 and project 1ff4576db2804dc7b0c14bf40af4e96d. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:11:05.149874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:11:05.164221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b26e20e-2e7b-4afe-9a0e-cbf419482333',volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:11:05.620828 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9dfeb714-a2bc-4d24-aa05-95c5befef01a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.153064 Nov 02 22:11:05.620828 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3451/6783] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:11:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:11:05.633723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9409ab5-b416-43e9-a943-ec478b3bfc64 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:05.634361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9409ab5-b416-43e9-a943-ec478b3bfc64 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:05.691897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9409ab5-b416-43e9-a943-ec478b3bfc64 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:05.698924 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9409ab5-b416-43e9-a943-ec478b3bfc64 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1094 microversion: 2.1 time: 0.069112 Nov 02 22:11:05.699706 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3333/6784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:05 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:05.943899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:05.944544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:05.965697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:05.966211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:05.966669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:05.967414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:05.967903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:05.978546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:06.077405 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a9e9bb7-2089-483d-af8c-48c0007c3c09 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1424 microversion: 2.1 time: 0.138225 Nov 02 22:11:06.078328 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3452/6785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:05 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1424 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:06.723373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:06.724262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:06.733584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:06.734213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:06.734727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:06.735498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:06.736037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:06.736535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:06.814184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:06.822666 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-882d5786-5b2d-4873-83f3-d1787798fc69 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1144 microversion: 2.1 time: 0.103546 Nov 02 22:11:06.823253 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3334/6786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:06 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1144 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:07.101802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:07.103118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:07.110553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:07.111071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:07.111525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:07.112499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:07.113207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:07.113655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:07.333147 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c591e1ff-bd05-47ab-adbc-d5e44b98a810 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1464 microversion: 2.1 time: 0.235713 Nov 02 22:11:07.337923 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3453/6787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:07 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:07.665496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1fb2e22e-3bef-4676-b51f-310560ba1d8d req-3e722a6d-9179-48e2-b72e-5121ea42f672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c61e8c-98b3-4897-bdcf-31406c180a86", "tag": "f2459c58-35a4-44d1-b7e2-f72de47e8d49"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:07.675713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1fb2e22e-3bef-4676-b51f-310560ba1d8d req-3e722a6d-9179-48e2-b72e-5121ea42f672 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:07.676213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1fb2e22e-3bef-4676-b51f-310560ba1d8d req-3e722a6d-9179-48e2-b72e-5121ea42f672 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:07.676622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1fb2e22e-3bef-4676-b51f-310560ba1d8d req-3e722a6d-9179-48e2-b72e-5121ea42f672 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:07.688152 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1fb2e22e-3bef-4676-b51f-310560ba1d8d req-3e722a6d-9179-48e2-b72e-5121ea42f672 service nova] Creating event network-changed:f2459c58-35a4-44d1-b7e2-f72de47e8d49 for instance f3c61e8c-98b3-4897-bdcf-31406c180a86 on n-h2-860863-4 Nov 02 22:11:07.693411 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1fb2e22e-3bef-4676-b51f-310560ba1d8d req-3e722a6d-9179-48e2-b72e-5121ea42f672 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100013 Nov 02 22:11:07.694037 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3335/6788] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:11:07.846586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:07.847318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:07.853789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:07.854294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:07.854963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:07.855698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:07.856170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:07.856621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:07.935357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:07.943511 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23e4e928-ce85-45f8-b54b-bba328291251 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1192 microversion: 2.1 time: 0.101739 Nov 02 22:11:07.944097 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3454/6789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:07 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:08.357982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:08.358803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:08.365517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:08.369156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:08.369156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:08.369156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:08.369156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:08.369156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:08.515095 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a396d45-a764-4c39-aee8-e5cdca2050f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1464 microversion: 2.1 time: 0.162595 Nov 02 22:11:08.516262 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3336/6790] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:08 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:08.966762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:08.967460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:08.976231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:08.976742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:08.977219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:08.977936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:08.978576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:08.979171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:09.190287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:09.207859 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0f701e6-7cd8-4a9e-88b6-b812dd130aaa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1277 microversion: 2.1 time: 0.241946 Nov 02 22:11:09.208577 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3455/6791] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:08 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:09.540719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:09.542247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:09.550620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:09.551117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:09.551558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:09.552261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:09.552919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:09.553374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:09.823042 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-78ab47d9-4125-4f9b-85bb-193aaa9c00d2 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1464 microversion: 2.1 time: 0.288183 Nov 02 22:11:09.824664 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3337/6792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:09 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1464 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:10.024583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c35379bb-6794-4d9c-ad38-fb1d8664b26d req-148d889e-8285-459f-9e86-2e917f546454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0f6730-79dc-48ac-8b45-af69eaa0942f", "tag": "5d597054-4a06-46d1-be75-3fd1bfbb2670"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:10.037171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c35379bb-6794-4d9c-ad38-fb1d8664b26d req-148d889e-8285-459f-9e86-2e917f546454 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:10.037981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c35379bb-6794-4d9c-ad38-fb1d8664b26d req-148d889e-8285-459f-9e86-2e917f546454 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:10.038397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c35379bb-6794-4d9c-ad38-fb1d8664b26d req-148d889e-8285-459f-9e86-2e917f546454 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:10.051568 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c35379bb-6794-4d9c-ad38-fb1d8664b26d req-148d889e-8285-459f-9e86-2e917f546454 service nova] Creating event network-changed:5d597054-4a06-46d1-be75-3fd1bfbb2670 for instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f on n-h1-860863-4 Nov 02 22:11:10.057000 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c35379bb-6794-4d9c-ad38-fb1d8664b26d req-148d889e-8285-459f-9e86-2e917f546454 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 Nov 02 22:11:10.057915 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3456/6793] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:11:10.239491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:10.240118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:10.247179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:10.247777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:10.249199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:10.250163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:10.250770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:10.251421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:10.412290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:10.422609 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ae080032-874b-4059-be94-bea287388a6a tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1277 microversion: 2.1 time: 0.186990 Nov 02 22:11:10.430620 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3338/6794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:10 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:10.849576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:10.856771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:10.861877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:10.862414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:10.863135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:10.863872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:10.864351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:10.864795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:11.013277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28ff55a6-e6a4-4df0-b819-168f125b17aa tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1464 microversion: 2.1 time: 0.168222 Nov 02 22:11:11.014119 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3457/6795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:10 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:11.452993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:11.453617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:11.461610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:11.462109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:11.462554 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:11.463258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:11.463716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:11.464148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:11.608462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:11.616486 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-627d1b26-ca3a-42ff-b336-532425f7a722 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1277 microversion: 2.1 time: 0.168153 Nov 02 22:11:11.617087 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3339/6796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:11 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:11.953876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-626f2a30-0290-4a3f-ab5a-ae8decf1e68c req-9de957ea-1472-4150-990f-eef3b23a9942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c61e8c-98b3-4897-bdcf-31406c180a86", "name": "network-vif-plugged", "status": "completed", "tag": "f2459c58-35a4-44d1-b7e2-f72de47e8d49"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:11.964784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-626f2a30-0290-4a3f-ab5a-ae8decf1e68c req-9de957ea-1472-4150-990f-eef3b23a9942 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:11.965378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-626f2a30-0290-4a3f-ab5a-ae8decf1e68c req-9de957ea-1472-4150-990f-eef3b23a9942 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:11.965899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-626f2a30-0290-4a3f-ab5a-ae8decf1e68c req-9de957ea-1472-4150-990f-eef3b23a9942 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:11.978501 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-626f2a30-0290-4a3f-ab5a-ae8decf1e68c req-9de957ea-1472-4150-990f-eef3b23a9942 service nova] Creating event network-vif-plugged:f2459c58-35a4-44d1-b7e2-f72de47e8d49 for instance f3c61e8c-98b3-4897-bdcf-31406c180a86 on n-h2-860863-4 Nov 02 22:11:11.983566 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-626f2a30-0290-4a3f-ab5a-ae8decf1e68c req-9de957ea-1472-4150-990f-eef3b23a9942 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Nov 02 22:11:11.984159 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3458/6797] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:11:12.039755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:12.040467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:12.060110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:12.065656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:12.066223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:12.067240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:12.069231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:12.073309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:12.240095 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ac1f4a9-d99a-4f53-a747-dbaa42e646da tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1464 microversion: 2.1 time: 0.205121 Nov 02 22:11:12.240742 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3340/6798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:12 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:12.640762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:12.641524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:12.648038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:12.648550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:12.649039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:12.649803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:12.650283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:12.650731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:12.793744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:12.803334 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a331264-31ac-4778-b78d-eb4d92662aa2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1277 microversion: 2.1 time: 0.167157 Nov 02 22:11:12.814750 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3459/6799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:12 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:13.263788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:13.264637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:13.272859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:13.273404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:13.274056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:13.275011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:13.275482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:13.275918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:13.422296 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f5687515-d238-4c08-987a-11039f80268f tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1464 microversion: 2.1 time: 0.162607 Nov 02 22:11:13.437022 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3341/6800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:13 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:13.826726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:13.827257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:13.834241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:13.835607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:13.836280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:13.837370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:13.837973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:13.838668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:13.993296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:14.001665 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d86bfbf6-067d-450a-8dea-afdae3f105aa tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1277 microversion: 2.1 time: 0.179086 Nov 02 22:11:14.005002 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3460/6801] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:13 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:14.445964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:14.446605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:14.453964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.454445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.454876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.455666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.456128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.456562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.591734 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63faeaf0-08f9-48db-ae4c-b816704ec9c0 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1648 microversion: 2.1 time: 0.145860 Nov 02 22:11:14.591734 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3342/6802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:14 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1648 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:14.613083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:14.613764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:14.621186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.621696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.622154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.623386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.623874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.624319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.771238 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4be81910-a8a3-408d-bbbb-932108dcf40d tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1648 microversion: 2.1 time: 0.162158 Nov 02 22:11:14.771829 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3461/6803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:14 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1648 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:14.793935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:14.794941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:14.801063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.801547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.801988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.802680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.803136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.803661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.822012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:14.934428 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-09a5f06e-739a-43f9-9ac0-0cc6d51ae3ea tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1648 microversion: 2.1 time: 0.144496 Nov 02 22:11:14.935072 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3343/6804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:14 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1648 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:14.957038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:14.957558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:14.968111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.968111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.968111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.968111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:14.968111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:14.968111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:14.986154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:14.994085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:11:15.024189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:15.024862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:15.031974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:15.032528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:15.037135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:15.037135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:15.037135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:15.037135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:15.073167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:15.096922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:15.178176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:15.187177 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9f51c2e-601b-4868-9b46-dba3b3c9990c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1277 microversion: 2.1 time: 0.166777 Nov 02 22:11:15.187794 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3344/6805] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:15 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:15.349667 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed7e867b-3d1e-4acd-a9f7-0263c172ff51 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 204 len: 0 microversion: 2.1 time: 0.395927 Nov 02 22:11:15.350600 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3462/6806] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:11:14 2022] DELETE /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:11:15.359775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:15.360393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:15.366982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:15.367464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:15.367903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:15.368589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:15.369153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:15.369662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:15.696388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:15.788251 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-68bc422a-b37d-4d74-8775-ba67f4f8dd23 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1654 microversion: 2.1 time: 0.433076 Nov 02 22:11:15.788849 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3345/6807] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:15 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1654 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:16.213923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:16.214786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:16.222433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:16.222944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:16.223435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:16.224175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:16.224666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:16.225234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:16.378171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:16.386918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ad6b578-6fd3-4ef7-a509-3182ba6956ff tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.178970 Nov 02 22:11:16.401171 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3463/6808] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:16 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:16.812356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:16.813012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:16.819906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:16.820571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:16.821394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:16.822085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:16.822709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:16.823141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:17.009035 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14f26acb-32fe-4e65-982f-475f97fea1b6 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1654 microversion: 2.1 time: 0.201005 Nov 02 22:11:17.009849 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3346/6809] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:16 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1654 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:17.209435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-762ab691-ff9e-4829-bdbf-0a798bd7db2e req-944313c9-1fb1-44ad-9e57-6282b3043194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c61e8c-98b3-4897-bdcf-31406c180a86", "name": "network-vif-deleted", "tag": "f2459c58-35a4-44d1-b7e2-f72de47e8d49"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:17.223714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-762ab691-ff9e-4829-bdbf-0a798bd7db2e req-944313c9-1fb1-44ad-9e57-6282b3043194 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:17.225048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-762ab691-ff9e-4829-bdbf-0a798bd7db2e req-944313c9-1fb1-44ad-9e57-6282b3043194 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:17.225695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-762ab691-ff9e-4829-bdbf-0a798bd7db2e req-944313c9-1fb1-44ad-9e57-6282b3043194 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:17.243552 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-762ab691-ff9e-4829-bdbf-0a798bd7db2e req-944313c9-1fb1-44ad-9e57-6282b3043194 service nova] Creating event network-vif-deleted:f2459c58-35a4-44d1-b7e2-f72de47e8d49 for instance f3c61e8c-98b3-4897-bdcf-31406c180a86 on n-h2-860863-4 Nov 02 22:11:17.249084 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-762ab691-ff9e-4829-bdbf-0a798bd7db2e req-944313c9-1fb1-44ad-9e57-6282b3043194 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050654 Nov 02 22:11:17.249775 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3464/6810] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:11:17.413293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:17.413858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:17.420357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:17.420867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:17.421347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:17.422037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:17.422491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:17.422913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:17.572810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:17.581082 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-39960f25-906b-4f71-9f42-3bba30925ac5 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.171856 Nov 02 22:11:17.581608 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3347/6811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:17 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:18.034491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:18.035207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:18.041743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:18.042238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:18.042691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:18.043569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:18.043925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:18.044368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:18.078294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:18.079248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:18.079709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:18.080182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lazy-loading 'fault' on Instance uuid f3c61e8c-98b3-4897-bdcf-31406c180a86 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:11:18.137923 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-785ea190-93b5-4a05-a99f-34d07bc46650 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 200 len: 1454 microversion: 2.1 time: 0.107569 Nov 02 22:11:18.139223 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3465/6812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:18 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:18.605278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:18.605889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:18.613889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:18.614374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:18.614848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:18.615580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:18.616047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:18.616603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:18.751460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:18.759527 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-600dd1f8-5167-4255-a75f-20d9d3818926 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.158251 Nov 02 22:11:18.763762 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3348/6813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:18 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:19.169001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:19.170285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: f3c61e8c-98b3-4897-bdcf-31406c180a86] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:19.174064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:19.179516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.180021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.180479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.181240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.181712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.182159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.196229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] HTTP exception thrown: Instance f3c61e8c-98b3-4897-bdcf-31406c180a86 could not be found. Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Request method failure captured: Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 HTTP/1.1 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuroIhrR6ZaUXz5_DfImuKhA7Ptk-wOm8SGwGiqH0CEgRFc5V1J0z4G_mEePURkYj5XWNJpKQ1tXQGdxMTfcr-n689aekN__FrX-yQ_T2BXGI4GQOZdtQhDTtPJrE2HwChGcvmGq21jc_SOaGNFKX5gQ6CuOzyg4lqY9OZk6aJWE-2A Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 170ed52270a24ded8cbf0b79791257a7 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestServerMultinode-1785936289 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestServerMultinode-1785936289 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 170ed52270a24ded8cbf0b79791257a7 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestServerMultinode-1785936289 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestServerMultinode-1785936289-project-admin Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 1923eb39838d42dea71f83971bb8fd76 Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestServerMultinode-1785936289-project-admin Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance f3c61e8c-98b3-4897-bdcf-31406c180a86 could not be found. Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'f3c61e8c-98b3-4897-bdcf-31406c180a86'} Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c61e8c-98b3-4897-bdcf-31406c180a86 could not be found. Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c61e8c-98b3-4897-bdcf-31406c180a86 could not be found. Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:11:19.200155 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c61e8c-98b3-4897-bdcf-31406c180a86 could not be found. Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Returning 404 to user: Instance f3c61e8c-98b3-4897-bdcf-31406c180a86 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86c0132b-c437-414d-8134-7dd288577370 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86" status: 404 len: 111 microversion: 2.1 time: 0.035457 Nov 02 22:11:19.204832 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3466/6814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:19 2022] GET /compute/v2.1/servers/f3c61e8c-98b3-4897-bdcf-31406c180a86 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:11:19.208091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:19.208596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:19.214509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.215037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.215481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.216172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.217162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.219608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.244316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:11:19.532038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:11:19.636234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a1d7e247-9133-4320-8154-0bc4eb65311a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "DELETE /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 204 len: 0 microversion: 2.1 time: 0.431463 Nov 02 22:11:19.636857 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3349/6815] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:11:19 2022] DELETE /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 22:11:19.645611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:19.646472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:19.653211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.653711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.654161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.654869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.655335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.655777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.788204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:19.788983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:19.795766 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4198ebbf-508a-4e11-8661-36d5185313f7 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1653 microversion: 2.1 time: 0.154298 Nov 02 22:11:19.798026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.798146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3467/6816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:19 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:19.798233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.798233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.798233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:19.798952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:19.799703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:19.950800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:19.959445 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-30fda2f4-5872-41fc-8511-2b7d7a9ee56d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.180672 Nov 02 22:11:19.960013 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3350/6817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:19 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:20.820244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:20.822230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:20.830658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:20.831201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:20.831667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:20.832426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:20.832915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:20.833387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:20.979635 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b622e1b-f472-4f51-a160-2c3608c3ad89 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1653 microversion: 2.1 time: 0.162639 Nov 02 22:11:20.992747 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3468/6818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:20 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:20.992966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:20.992966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:20.992966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:20.992966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:20.992966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:20.993770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:20.993770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:20.994198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:21.132250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:21.140246 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86574f27-9a92-4b42-96a1-3ce343f30bfe tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.160935 Nov 02 22:11:21.141351 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3351/6819] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:20 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:22.004597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:22.005340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:22.014567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:22.015071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:22.015613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:22.017766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:22.018247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:22.019025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:22.116815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7fec1281-5e56-43ec-b22f-f29610b6f972 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1611 microversion: 2.1 time: 0.116265 Nov 02 22:11:22.117627 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3469/6820] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:21 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1611 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:22.132557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b615817d-007a-4bca-9569-784d258ed5d9 req-debf23b9-d033-40c2-82b7-c9296e077d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13ea8e8-8f59-4973-b33c-d8e066ab5b74", "name": "network-vif-deleted", "tag": "f31ce127-08bb-46ca-aeb0-7e60338effee"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:22.143823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b615817d-007a-4bca-9569-784d258ed5d9 req-debf23b9-d033-40c2-82b7-c9296e077d11 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:22.146765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b615817d-007a-4bca-9569-784d258ed5d9 req-debf23b9-d033-40c2-82b7-c9296e077d11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:22.146765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b615817d-007a-4bca-9569-784d258ed5d9 req-debf23b9-d033-40c2-82b7-c9296e077d11 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:22.158500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b615817d-007a-4bca-9569-784d258ed5d9 req-debf23b9-d033-40c2-82b7-c9296e077d11 service nova] Creating event network-vif-deleted:f31ce127-08bb-46ca-aeb0-7e60338effee for instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 on n-h1-860863-4 Nov 02 22:11:22.165037 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b615817d-007a-4bca-9569-784d258ed5d9 req-debf23b9-d033-40c2-82b7-c9296e077d11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036835 Nov 02 22:11:22.166474 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3352/6821] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:11:22.169290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:22.169977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:22.177313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:22.178602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:22.179263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:22.180251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:22.180721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:22.181277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:22.347174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:22.355209 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db382ab3-9cd0-452a-9f39-0b6cf7d35d79 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.194377 Nov 02 22:11:22.359012 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3470/6822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:22 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:23.147312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:23.148070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:23.155007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:23.155634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:23.156171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:23.157083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:23.158285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:23.158814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:23.191625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:23.192031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:23.192468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:23.192946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lazy-loading 'fault' on Instance uuid a13ea8e8-8f59-4973-b33c-d8e066ab5b74 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:11:23.243000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6760c852-ffbd-4bad-9ef9-57a3c6ba4801 tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 200 len: 1453 microversion: 2.1 time: 0.102627 Nov 02 22:11:23.243578 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3353/6823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:23 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:23.378900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:23.379565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:23.387037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:23.387489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:23.387938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:23.388673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:23.389167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:23.389609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:23.530936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:23.539763 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5c4988c1-e564-4998-a9e4-6919b56981cf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.164664 Nov 02 22:11:23.540886 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3471/6824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:23 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:24.273660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:24.274291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] [instance: a13ea8e8-8f59-4973-b33c-d8e066ab5b74] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:24.281790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:24.283146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:24.283677 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:24.284777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:24.285274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:24.285708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:24.300854 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] HTTP exception thrown: Instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 could not be found. Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Request method failure captured: Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 HTTP/1.1 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuroIhrR6ZaUXz5_DfImuKhA7Ptk-wOm8SGwGiqH0CEgRFc5V1J0z4G_mEePURkYj5XWNJpKQ1tXQGdxMTfcr-n689aekN__FrX-yQ_T2BXGI4GQOZdtQhDTtPJrE2HwChGcvmGq21jc_SOaGNFKX5gQ6CuOzyg4lqY9OZk6aJWE-2A Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 170ed52270a24ded8cbf0b79791257a7 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestServerMultinode-1785936289 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/170ed52270a24ded8cbf0b79791257a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestServerMultinode-1785936289 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 170ed52270a24ded8cbf0b79791257a7 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestServerMultinode-1785936289 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestServerMultinode-1785936289-project-admin Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 1923eb39838d42dea71f83971bb8fd76 Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestServerMultinode-1785936289-project-admin Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 could not be found. Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'a13ea8e8-8f59-4973-b33c-d8e066ab5b74'} Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 could not be found. Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 could not be found. Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:11:24.302570 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:11:24.306168 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:11:24.306168 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:11:24.306168 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:11:24.306168 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:11:24.306168 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:11:24.306168 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 could not be found. Nov 02 22:11:24.306168 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:11:24.307472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] Returning 404 to user: Instance a13ea8e8-8f59-4973-b33c-d8e066ab5b74 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:11:24.308492 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81e86072-04c2-4171-835c-47028b80641a tempest-TestServerMultinode-1785936289 tempest-TestServerMultinode-1785936289-project-admin] 10.222.0.25 "GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74" status: 404 len: 111 microversion: 2.1 time: 0.038774 Nov 02 22:11:24.309089 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3354/6825] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:24 2022] GET /compute/v2.1/servers/a13ea8e8-8f59-4973-b33c-d8e066ab5b74 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:11:24.563798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:24.564450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:24.574407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:24.574919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:24.575482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:24.576105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:24.578232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:24.579833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:24.728815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:24.737986 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e0a9c81-a905-4e96-aeb2-a0bb8531b1d2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.178183 Nov 02 22:11:24.738767 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3472/6826] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:24 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:25.760188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:25.761540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:25.769202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:25.770002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:25.770650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:25.771557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:25.772229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:25.773043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:26.007804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:26.020108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-88f0bda0-8d6f-40ac-83bc-fb0165a47d40 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.261419 Nov 02 22:11:26.020589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3355/6827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:25 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:26.027173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7b8eadfa-a487-4c7e-9c54-2ceee5868e10 req-bb1438de-419a-4a5b-b71c-a56591caf366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0f6730-79dc-48ac-8b45-af69eaa0942f", "name": "network-vif-plugged", "status": "completed", "tag": "5d597054-4a06-46d1-be75-3fd1bfbb2670"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:26.045558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7b8eadfa-a487-4c7e-9c54-2ceee5868e10 req-bb1438de-419a-4a5b-b71c-a56591caf366 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:26.046068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7b8eadfa-a487-4c7e-9c54-2ceee5868e10 req-bb1438de-419a-4a5b-b71c-a56591caf366 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:26.046518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7b8eadfa-a487-4c7e-9c54-2ceee5868e10 req-bb1438de-419a-4a5b-b71c-a56591caf366 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:26.061231 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7b8eadfa-a487-4c7e-9c54-2ceee5868e10 req-bb1438de-419a-4a5b-b71c-a56591caf366 service nova] Creating event network-vif-plugged:5d597054-4a06-46d1-be75-3fd1bfbb2670 for instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f on n-h1-860863-4 Nov 02 22:11:26.067386 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7b8eadfa-a487-4c7e-9c54-2ceee5868e10 req-bb1438de-419a-4a5b-b71c-a56591caf366 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044538 Nov 02 22:11:26.068892 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3473/6828] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:11:27.047468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:27.048371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:27.055494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:27.055977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:27.056458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:27.057171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:27.057630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:27.058054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:27.586544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:27.594946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9a587600-134f-4f02-bb14-edeea54dd7f1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1265 microversion: 2.1 time: 0.551294 Nov 02 22:11:27.600712 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3356/6829] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:27 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1265 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:28.621928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:28.622698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:28.631114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:28.632004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:28.632684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:28.633550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:28.634084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:28.635006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:28.814342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:28.824960 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf074f6a-6d1d-42b2-b82f-1ec8a434b6e1 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1452 microversion: 2.1 time: 0.208248 Nov 02 22:11:28.825945 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3474/6830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:28 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:11:28.848841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:11:28.850562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:11:28.861300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:28.862103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:28.862786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:28.863717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:28.864846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:28.865824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:29.052158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:11:29.059506 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-632fa6b7-f50b-4910-89bf-79044974c5fc tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1452 microversion: 2.1 time: 0.214584 Nov 02 22:11:29.060097 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3357/6831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:11:28 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1452 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:11:33.752221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-dfa8469b-9e56-464f-b301-52e96270ec24 req-02bfafca-d128-424b-932f-33ce01408b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0f6730-79dc-48ac-8b45-af69eaa0942f", "tag": "5d597054-4a06-46d1-be75-3fd1bfbb2670"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:11:33.763200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dfa8469b-9e56-464f-b301-52e96270ec24 req-02bfafca-d128-424b-932f-33ce01408b83 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:11:33.763780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dfa8469b-9e56-464f-b301-52e96270ec24 req-02bfafca-d128-424b-932f-33ce01408b83 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:11:33.764439 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dfa8469b-9e56-464f-b301-52e96270ec24 req-02bfafca-d128-424b-932f-33ce01408b83 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:11:33.777812 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-dfa8469b-9e56-464f-b301-52e96270ec24 req-02bfafca-d128-424b-932f-33ce01408b83 service nova] Creating event network-changed:5d597054-4a06-46d1-be75-3fd1bfbb2670 for instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f on n-h1-860863-4 Nov 02 22:11:33.783857 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-dfa8469b-9e56-464f-b301-52e96270ec24 req-02bfafca-d128-424b-932f-33ce01408b83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035404 Nov 02 22:11:33.785010 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3475/6832] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:13:53.518903 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 22:13:53.520737 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 22:13:53.520868 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:13:53.521350 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 22:13:53.521562 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:13:53.521694 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f (ip 10.222.0.25) !!! Nov 02 22:13:53.522076 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:13:53.522200 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 22:13:53.522887 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:13:53.523147 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f (ip 10.222.0.25) !!! Nov 02 22:13:53.523369 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 22:13:53.523489 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 22:13:53.524356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:13:53.525173 n-d-860863-4 devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5fc7833-b4b4-43fd-a1c3-e65a3dcf6a0f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:13:53.525619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:13:53.526174 n-d-860863-4 devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 22:13:53.526892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=19 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:13:53.527812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:13:53.537384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:13:53.538155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:13:53.546713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:53.547762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:53.548367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:53.550345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:53.551202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:53.552437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:53.588268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:13:53.753899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a4890f5f-f894-4c09-9c5a-ace00301e27d req-0dd38fd1-e762-4df3-84e3-be5a2ee7f2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0f6730-79dc-48ac-8b45-af69eaa0942f", "tag": "5d597054-4a06-46d1-be75-3fd1bfbb2670"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:13:53.764181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a4890f5f-f894-4c09-9c5a-ace00301e27d req-0dd38fd1-e762-4df3-84e3-be5a2ee7f2dd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:53.764900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a4890f5f-f894-4c09-9c5a-ace00301e27d req-0dd38fd1-e762-4df3-84e3-be5a2ee7f2dd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:53.765583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a4890f5f-f894-4c09-9c5a-ace00301e27d req-0dd38fd1-e762-4df3-84e3-be5a2ee7f2dd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:53.778706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a4890f5f-f894-4c09-9c5a-ace00301e27d req-0dd38fd1-e762-4df3-84e3-be5a2ee7f2dd service nova] Creating event network-changed:5d597054-4a06-46d1-be75-3fd1bfbb2670 for instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f on n-h1-860863-4 Nov 02 22:13:53.786319 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a4890f5f-f894-4c09-9c5a-ace00301e27d req-0dd38fd1-e762-4df3-84e3-be5a2ee7f2dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266628 Nov 02 22:13:53.791618 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3476/6833] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:13:53.920982 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ce6c8b3c-c371-4ef0-8156-f21ecd6b5ae4 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 204 len: 0 microversion: 2.1 time: 0.404680 Nov 02 22:13:53.921530 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3358/6834] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:13:53 2022] DELETE /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:13:53.931941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:13:53.937708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:13:53.939586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:53.941034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:53.941743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:53.942617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:53.943234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:53.943837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:54.215846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:13:54.228505 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7db3789c-9707-492b-a4b7-e2f0fd626b23 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1576 microversion: 2.1 time: 0.301397 Nov 02 22:13:54.241026 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3477/6835] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:13:53 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1576 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:13:55.255285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:13:55.255994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:13:55.276277 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41826. Nov 02 22:13:55.280130 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41824. Nov 02 22:13:55.284516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:55.285051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:55.285497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:55.292991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:55.292991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:55.292991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:55.484381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:13:55.493215 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec319bb7-383b-405a-a081-dd66089dc6ca tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1576 microversion: 2.1 time: 0.243247 Nov 02 22:13:55.493795 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3359/6836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:13:55 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:13:56.265892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3a948007-bf37-4728-ad7f-130519257077 req-6418c167-0014-48a1-8a36-a84afc41b04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0f6730-79dc-48ac-8b45-af69eaa0942f", "name": "network-vif-deleted", "tag": "5d597054-4a06-46d1-be75-3fd1bfbb2670"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:13:56.279025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3a948007-bf37-4728-ad7f-130519257077 req-6418c167-0014-48a1-8a36-a84afc41b04e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:56.279025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3a948007-bf37-4728-ad7f-130519257077 req-6418c167-0014-48a1-8a36-a84afc41b04e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:56.279275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3a948007-bf37-4728-ad7f-130519257077 req-6418c167-0014-48a1-8a36-a84afc41b04e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:56.293378 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3a948007-bf37-4728-ad7f-130519257077 req-6418c167-0014-48a1-8a36-a84afc41b04e service nova] Creating event network-vif-deleted:5d597054-4a06-46d1-be75-3fd1bfbb2670 for instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f on n-h1-860863-4 Nov 02 22:13:56.297838 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5fc7833-b4b4-43fd-a1c3-e65a3dcf6a0f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41840. Nov 02 22:13:56.298578 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41842. Nov 02 22:13:56.300862 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3a948007-bf37-4728-ad7f-130519257077 req-6418c167-0014-48a1-8a36-a84afc41b04e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038743 Nov 02 22:13:56.301678 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3478/6837] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:13:56.517237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:13:56.518020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:13:56.526320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:56.526922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:56.527639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:56.528572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:56.529266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:56.529890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:56.614433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:13:56.625145 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1ba5838-d891-4431-a88e-d3ffcffa4e73 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1225 microversion: 2.1 time: 0.111833 Nov 02 22:13:56.627058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3360/6838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:13:56 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:13:57.653313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:13:57.654641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:13:57.664048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:57.664787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:57.665280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:57.666010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:57.666482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:57.666955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:57.739148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:13:57.748284 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36011302-cb98-4a73-b9ad-a64731826dcf tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1225 microversion: 2.1 time: 0.101053 Nov 02 22:13:57.749045 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3479/6839] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:13:57 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:13:58.772301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:13:58.773593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:13:58.780589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:58.781105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:58.781719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:58.782417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:58.783050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:58.783506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:58.861360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:13:58.869782 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bdbe887b-b50a-455c-97cf-9535dbf97b4c tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1225 microversion: 2.1 time: 0.102038 Nov 02 22:13:58.870425 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3361/6840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:13:58 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:13:59.894077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:13:59.894753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:13:59.905258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:59.906624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:59.909022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:59.909804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:13:59.910309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:13:59.910751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:13:59.982012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:13:59.991271 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cbb6298d-38d8-469c-84af-1924ef83af9f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1225 microversion: 2.1 time: 0.101187 Nov 02 22:13:59.991857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3480/6841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:13:59 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:14:01.015371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:01.016518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:01.024401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:01.024890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:01.025400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:01.031247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:01.031247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:01.031247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:01.061871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:01.062400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:01.062840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:01.063286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lazy-loading 'fault' on Instance uuid 1d0f6730-79dc-48ac-8b45-af69eaa0942f {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:14:01.107394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:14:01.115595 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0ba839d-3f19-4f10-87e5-f8b88024de4f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 200 len: 1230 microversion: 2.1 time: 0.104437 Nov 02 22:14:01.116304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3362/6842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:01 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:14:02.139569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:02.140249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 1d0f6730-79dc-48ac-8b45-af69eaa0942f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:02.147875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:02.148377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:02.148832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:02.149569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:02.150038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:02.150483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:02.164423 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f could not be found. Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f HTTP/1.1 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f could not be found. Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '1d0f6730-79dc-48ac-8b45-af69eaa0942f'} Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f could not be found. Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f could not be found. Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:02.166027 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f could not be found. Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 1d0f6730-79dc-48ac-8b45-af69eaa0942f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dc6d9617-9df2-4469-a036-20d0e2bbd47f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f" status: 404 len: 111 microversion: 2.1 time: 0.031904 Nov 02 22:14:02.170468 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3481/6843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:02 2022] GET /compute/v2.1/servers/1d0f6730-79dc-48ac-8b45-af69eaa0942f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:14:08.748774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:08.749877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:08.750928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-726eadea-d4f3-4100-ab9c-009781e7b227 req-a7ad0a0a-7301-42f2-a57e-3b31f7c0fefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51432a00-baf8-441b-b977-c626b11a232f", "tag": "8f6bf707-79d0-4d50-a50a-b283629e0a69"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:14:08.764092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-726eadea-d4f3-4100-ab9c-009781e7b227 req-a7ad0a0a-7301-42f2-a57e-3b31f7c0fefd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:08.764589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-726eadea-d4f3-4100-ab9c-009781e7b227 req-a7ad0a0a-7301-42f2-a57e-3b31f7c0fefd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:08.765066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-726eadea-d4f3-4100-ab9c-009781e7b227 req-a7ad0a0a-7301-42f2-a57e-3b31f7c0fefd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:08.768912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:08.769466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:08.769909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:08.770623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:08.771079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:08.771510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:08.776574 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-726eadea-d4f3-4100-ab9c-009781e7b227 req-a7ad0a0a-7301-42f2-a57e-3b31f7c0fefd service nova] Creating event network-changed:8f6bf707-79d0-4d50-a50a-b283629e0a69 for instance 51432a00-baf8-441b-b977-c626b11a232f on n-h2-860863-4 Nov 02 22:14:08.782025 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-726eadea-d4f3-4100-ab9c-009781e7b227 req-a7ad0a0a-7301-42f2-a57e-3b31f7c0fefd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034803 Nov 02 22:14:08.783253 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3482/6844] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:14:08.813322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:14:09.242096 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b554099-d431-4ad6-a286-76d4359b8d12 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 204 len: 0 microversion: 2.1 time: 0.497060 Nov 02 22:14:09.242715 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3363/6845] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:14:08 2022] DELETE /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:14:09.251856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:09.253291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:09.260451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:09.260967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:09.261598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:09.262311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:09.262916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:09.263361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:09.495668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:14:09.504613 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51f03a4f-275f-4824-9bf4-24dc48d572a0 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1577 microversion: 2.1 time: 0.257251 Nov 02 22:14:09.508983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3483/6846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:09 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1577 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:14:10.367463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7a12e5eb-2f4b-4685-8608-90acc1ad9442 req-741de9bf-9221-444a-b137-61bfede536d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51432a00-baf8-441b-b977-c626b11a232f", "name": "network-vif-deleted", "tag": "8f6bf707-79d0-4d50-a50a-b283629e0a69"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:14:10.378720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a12e5eb-2f4b-4685-8608-90acc1ad9442 req-741de9bf-9221-444a-b137-61bfede536d5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:10.379196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a12e5eb-2f4b-4685-8608-90acc1ad9442 req-741de9bf-9221-444a-b137-61bfede536d5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:10.379627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a12e5eb-2f4b-4685-8608-90acc1ad9442 req-741de9bf-9221-444a-b137-61bfede536d5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:10.390198 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7a12e5eb-2f4b-4685-8608-90acc1ad9442 req-741de9bf-9221-444a-b137-61bfede536d5 service nova] Creating event network-vif-deleted:8f6bf707-79d0-4d50-a50a-b283629e0a69 for instance 51432a00-baf8-441b-b977-c626b11a232f on n-h2-860863-4 Nov 02 22:14:10.395775 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7a12e5eb-2f4b-4685-8608-90acc1ad9442 req-741de9bf-9221-444a-b137-61bfede536d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Nov 02 22:14:10.396357 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3364/6847] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:14:10.529484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:10.530116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:10.537948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:10.538457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:10.538917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:10.539810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:10.540279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:10.540900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:10.606119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:14:10.614604 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec120bb7-75d3-4239-9337-22b09470887f tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1225 microversion: 2.1 time: 0.088938 Nov 02 22:14:10.615187 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3484/6848] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:10 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:14:11.639913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:11.640574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:11.647864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:11.648345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:11.648781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:11.649507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:11.649963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:11.650389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:11.716184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:14:11.725325 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-930cdd6b-0f4b-4c21-9d4d-7f58fe2955f2 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1225 microversion: 2.1 time: 0.090902 Nov 02 22:14:11.725896 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3365/6849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:11 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:14:12.749252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:12.750591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:12.758470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:12.758984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:12.759450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:12.760376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:12.760792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:12.761387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:12.833750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:14:12.841936 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56eefb07-3cc5-4678-a846-9bb0cddd7f34 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1225 microversion: 2.1 time: 0.096529 Nov 02 22:14:12.842683 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3485/6850] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:12 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:14:13.864997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:13.865795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:13.873525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:13.874253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:13.874906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:13.875717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:13.876246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:13.876753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:13.955865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:14:13.964072 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8b0cef3-cf9d-44d4-93a1-2b679d9032e8 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1225 microversion: 2.1 time: 0.103760 Nov 02 22:14:13.964917 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3366/6851] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:13 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:14:14.988247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:14.988882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:14.995879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:14.996569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:14.997082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:14.997791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:14.998256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:14.998704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:15.031155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:15.031773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:15.032241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:15.032692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lazy-loading 'fault' on Instance uuid 51432a00-baf8-441b-b977-c626b11a232f {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:14:15.085847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ecbff97ebdb4bac9a3054dc89515415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff4576db2804dc7b0c14bf40af4e96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:14:15.094363 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa0636b5-5ec6-4ea0-8821-a90f7c3efc91 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 200 len: 1230 microversion: 2.1 time: 0.110879 Nov 02 22:14:15.094933 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3486/6852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:14 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:14:16.118546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:16.119174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 51432a00-baf8-441b-b977-c626b11a232f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:16.127585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:16.128078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:16.128869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:16.129645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:16.130106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:16.130539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:16.147011 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 51432a00-baf8-441b-b977-c626b11a232f could not be found. Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f HTTP/1.1 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 51432a00-baf8-441b-b977-c626b11a232f could not be found. Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '51432a00-baf8-441b-b977-c626b11a232f'} Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51432a00-baf8-441b-b977-c626b11a232f could not be found. Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51432a00-baf8-441b-b977-c626b11a232f could not be found. Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:16.148626 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51432a00-baf8-441b-b977-c626b11a232f could not be found. Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 51432a00-baf8-441b-b977-c626b11a232f could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-53b96b1b-3207-4565-a437-ad71b421c981 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f" status: 404 len: 111 microversion: 2.1 time: 0.035762 Nov 02 22:14:16.152427 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3367/6853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:16 2022] GET /compute/v2.1/servers/51432a00-baf8-441b-b977-c626b11a232f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:14:16.703491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:16.710476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:16.711358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:16.711891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:16.712350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:16.713088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:16.713560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:16.714010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:16.728006 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 HTTP/1.1 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2fbc62ce-1d95-40c1-80ed-cd68ba710976'} Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:14:16.729740 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82a67a88-f9d0-498e-97ce-b02f301fa5ad tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 404 len: 111 microversion: 2.1 time: 0.031748 Nov 02 22:14:16.733782 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3487/6854] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:14:16 2022] DELETE /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:14:16.741343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:16.742035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] [instance: 2fbc62ce-1d95-40c1-80ed-cd68ba710976] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:14:16.748312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:16.748800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:16.749329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:16.749999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:14:16.750456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:14:16.750889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:14:16.764654 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] HTTP exception thrown: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Request method failure captured: Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 HTTP/1.1 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYueN_qjaCdsCo1QB1N0Gaoy3RwrilD0YutqTiauEZUqyPdvLuNaDfh3iBYn665iBl0De7Kx_qoSIJy_AYxnKC5NQi1WQUcZCGP5GI_fZ83fqOPbtZGhvbCOQGvxJQHH1YmOoVQm_473EqV9L2FOrVMWc_TMpcAFKOzBNHI1huRnQ0uI Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1ff4576db2804dc7b0c14bf40af4e96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 1ff4576db2804dc7b0c14bf40af4e96d Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBootPattern-1279689436 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 8ecbff97ebdb4bac9a3054dc89515415 Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBootPattern-1279689436-project Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '2fbc62ce-1d95-40c1-80ed-cd68ba710976'} Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:14:16.766360 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Returning 404 to user: Instance 2fbc62ce-1d95-40c1-80ed-cd68ba710976 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d5da056-da29-4fca-a428-2c501fbae76d tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976" status: 404 len: 111 microversion: 2.1 time: 0.031223 Nov 02 22:14:16.771282 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3368/6855] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:14:16 2022] GET /compute/v2.1/servers/2fbc62ce-1d95-40c1-80ed-cd68ba710976 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:14:20.439269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8658a2d8-4e82-4802-b5e0-35add3e2dd80 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] Calling method '.version_select at 0x7f9b63f29d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:14:20.535773 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8658a2d8-4e82-4802-b5e0-35add3e2dd80 tempest-TestVolumeBootPattern-1279689436 tempest-TestVolumeBootPattern-1279689436-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-413771351" status: 202 len: 0 microversion: 2.1 time: 0.100132 Nov 02 22:14:20.536513 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3488/6856] 10.222.0.25 () {58 vars in 1260 bytes} [Wed Nov 2 22:14:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-413771351 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:15:38.616626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:15:38.617481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:15:38.621414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2dbf1471-dcb8-49ae-ac0b-4af1856a3831 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Action: 'create', calling method: .version_select at 0x7f9b63f90d30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2064796346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvK5OYVDem4pUFe+DtehhY6g2qXuAD5iFMF7DiTgN/Mt6l3Bl0XLlEBTZZJl6LM+Kx05dpWpKTH4s5yR8b5t1LTQ2Vov22l7k3XxtDSVEAkTOb1Vq2VIjZpn/LzpWloCA=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:15:38.637372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2dbf1471-dcb8-49ae-ac0b-4af1856a3831 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Getting quotas for project d8cddd83c5664d3983ddc212142ab68e. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:15:38.643228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-2dbf1471-dcb8-49ae-ac0b-4af1856a3831 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Getting quotas for user af340552c3da40949a32ef30031561ad and project d8cddd83c5664d3983ddc212142ab68e. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:15:38.750203 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2dbf1471-dcb8-49ae-ac0b-4af1856a3831 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136561 Nov 02 22:15:38.750733 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3369/6857] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:15:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:15:41.101944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=54 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:15:41.102833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:15:41.107490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1831432019", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "576b7a60-f48d-437a-b08c-7f2efeb21bdd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2064796346", "security_groups": [{"name": "tempest-secgroup-smoke-428716278"}], "networks": [{"uuid": "37f0fa3a-19db-4cb3-bfda-cef91beb2de8"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:15:41.223765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] validate_networks() for [('37f0fa3a-19db-4cb3-bfda-cef91beb2de8', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:15:41.590535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:15:41.590970 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:15:41.591457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:15:41.591903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:15:41.592322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:15:41.602035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:41.602529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:41.603193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:41.603940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:41.604406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:41.604870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:41.622196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Getting quotas for project d8cddd83c5664d3983ddc212142ab68e. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:15:41.627541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Getting quotas for user af340552c3da40949a32ef30031561ad and project d8cddd83c5664d3983ddc212142ab68e. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:15:41.687399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:15:41.689646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='576b7a60-f48d-437a-b08c-7f2efeb21bdd',volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:15:42.086854 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-849f1556-403c-496a-94a1-5195385daca0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988324 Nov 02 22:15:42.087521 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3489/6858] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:15:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:15:42.100848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-74003666-4f6b-4521-ad8d-b9d21cd5da3b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:42.101505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-74003666-4f6b-4521-ad8d-b9d21cd5da3b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:42.158065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-74003666-4f6b-4521-ad8d-b9d21cd5da3b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:42.165553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-74003666-4f6b-4521-ad8d-b9d21cd5da3b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1099 microversion: 2.1 time: 0.070626 Nov 02 22:15:42.166136 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3370/6859] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:42 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1099 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:43.189911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:43.190709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:43.197975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:43.198480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:43.198940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:43.199655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:43.200130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:43.200579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:43.262511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:43.271128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1139455-f362-4c2f-a3b8-1dd811936a24 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1149 microversion: 2.1 time: 0.086064 Nov 02 22:15:43.271712 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3490/6860] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:43 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:44.294772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:44.295656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:44.303206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:44.303709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:44.304151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:44.305096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:44.305716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:44.306151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:44.388160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:44.396771 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e84adbe2-74de-4350-ba29-334ae7b4b07c tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1205 microversion: 2.1 time: 0.105957 Nov 02 22:15:44.397411 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3371/6861] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:44 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:45.423855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:45.424397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:45.432389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:45.432919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:45.433396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:45.434105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:45.434570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:45.435008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:45.634847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:45.642753 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7802b12-c14c-48e2-a6d2-b6818f9b0069 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1282 microversion: 2.1 time: 0.223929 Nov 02 22:15:45.643330 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3491/6862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:45 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:46.143382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-986e1a52-eaf4-4f41-9d7a-e8e916f0d268 req-1bfc38fa-ec50-4b45-851a-c85c4139a2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f6f1fb-ac34-479b-ae6f-1a335162054e", "tag": "066449b6-12bc-46a1-bdac-24820b056d9e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:15:46.158962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-986e1a52-eaf4-4f41-9d7a-e8e916f0d268 req-1bfc38fa-ec50-4b45-851a-c85c4139a2e8 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:46.161155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-986e1a52-eaf4-4f41-9d7a-e8e916f0d268 req-1bfc38fa-ec50-4b45-851a-c85c4139a2e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:46.163343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-986e1a52-eaf4-4f41-9d7a-e8e916f0d268 req-1bfc38fa-ec50-4b45-851a-c85c4139a2e8 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:46.173905 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-986e1a52-eaf4-4f41-9d7a-e8e916f0d268 req-1bfc38fa-ec50-4b45-851a-c85c4139a2e8 service nova] Creating event network-changed:066449b6-12bc-46a1-bdac-24820b056d9e for instance 85f6f1fb-ac34-479b-ae6f-1a335162054e on n-h2-860863-4 Nov 02 22:15:46.179667 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-986e1a52-eaf4-4f41-9d7a-e8e916f0d268 req-1bfc38fa-ec50-4b45-851a-c85c4139a2e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040851 Nov 02 22:15:46.180557 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3372/6863] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:15:46.667906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:46.668540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:46.676713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:46.677291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:46.677739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:46.678476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:46.678951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:46.679398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:46.922589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:46.931680 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-054501ba-25c8-4b82-b74e-dcd0b9ce8b7b tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1282 microversion: 2.1 time: 0.267611 Nov 02 22:15:46.932426 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3492/6864] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:46 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:47.955606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:47.956450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:47.964645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:47.965174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:47.965624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:47.966324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:47.966788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:47.967223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:48.105785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:48.114544 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d98cc6af-09ca-4eaa-8ee3-748ec7a58696 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1282 microversion: 2.1 time: 0.163275 Nov 02 22:15:48.115121 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3373/6865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:47 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:49.137797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:49.138433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:49.146331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:49.146850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:49.147334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:49.148047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:49.148523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:49.148996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:49.287546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:49.295839 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c602a667-2313-4021-b1cc-ecaf3ac5a6da tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1282 microversion: 2.1 time: 0.161734 Nov 02 22:15:49.296504 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3493/6866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:49 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:50.320334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:50.320973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:50.327922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:50.330047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:50.330047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:50.330047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:50.330047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:50.330510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:50.466486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:50.474736 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c731305b-4114-43de-8608-e857402e5ff2 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.159026 Nov 02 22:15:50.475306 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3374/6867] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:50 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:51.498077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:51.498635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:51.513036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:51.513556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:51.514019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:51.514757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:51.515234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:51.515677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:51.616589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:15:51.634848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:15:51.678963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:51.687127 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f9fd57e-dadf-4ac8-8247-a5e235e65f48 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.193027 Nov 02 22:15:51.687711 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3494/6868] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:51 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:52.711357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:52.711987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:52.714838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:15:52.719693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:52.720188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:52.720639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:52.721376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:52.721848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:52.722832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:52.859012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:52.867289 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-969e226d-05bd-4e49-92ed-3bea3bf67848 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.160393 Nov 02 22:15:52.867863 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3375/6869] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:52 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:53.890993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:53.891552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:53.898660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:53.899160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:53.899616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:53.900325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:53.900791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:53.901261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:54.042766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:54.051391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86a8ca73-8b39-4be2-b7e6-850f1b596bb4 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.164276 Nov 02 22:15:54.052002 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3495/6870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:53 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:55.075082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:55.075706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:55.084044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:55.084540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:55.085020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:55.085725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:55.086196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:55.086635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:55.215873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:55.224198 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a3fb16c-1516-4bd9-8369-7fcc90d05fd5 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.153086 Nov 02 22:15:55.224772 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3376/6871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:55 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:56.247164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:56.247885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:56.256213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:56.256706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:56.257210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:56.257938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:56.258410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:56.258857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:56.399132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:56.406979 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a732e1c3-7e84-4114-81d8-e8b5901d4b75 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.163808 Nov 02 22:15:56.407550 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3496/6872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:56 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:57.432187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:57.432828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:57.439385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:57.439889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:57.440337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:57.441124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:57.441578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:57.442015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:57.579676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:57.589145 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a5ab6cf6-c56a-4240-bdc2-8c754812a680 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.160799 Nov 02 22:15:57.589938 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3377/6873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:57 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:58.614013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:58.614672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:58.621664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:58.622203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:58.622667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:58.623381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:58.623891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:58.624341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:58.758693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:58.766389 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04e2ba8c-6bef-4e0e-969e-e001b3b24dda tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.157614 Nov 02 22:15:58.766958 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3497/6874] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:58 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:15:59.785530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-748dfd56-d1db-403a-8172-470a70be3e1b req-ac03afe4-ec40-45f3-a377-ad39c6e87823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f6f1fb-ac34-479b-ae6f-1a335162054e", "name": "network-vif-plugged", "status": "completed", "tag": "066449b6-12bc-46a1-bdac-24820b056d9e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:15:59.789764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:15:59.790419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:15:59.796667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-748dfd56-d1db-403a-8172-470a70be3e1b req-ac03afe4-ec40-45f3-a377-ad39c6e87823 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:59.797175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-748dfd56-d1db-403a-8172-470a70be3e1b req-ac03afe4-ec40-45f3-a377-ad39c6e87823 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:59.797523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:59.797642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-748dfd56-d1db-403a-8172-470a70be3e1b req-ac03afe4-ec40-45f3-a377-ad39c6e87823 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:59.798073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:59.798475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:59.799183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:15:59.799650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:15:59.800092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:15:59.812192 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-748dfd56-d1db-403a-8172-470a70be3e1b req-ac03afe4-ec40-45f3-a377-ad39c6e87823 service nova] Creating event network-vif-plugged:066449b6-12bc-46a1-bdac-24820b056d9e for instance 85f6f1fb-ac34-479b-ae6f-1a335162054e on n-h2-860863-4 Nov 02 22:15:59.817857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-748dfd56-d1db-403a-8172-470a70be3e1b req-ac03afe4-ec40-45f3-a377-ad39c6e87823 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168772 Nov 02 22:15:59.818469 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3378/6875] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:15:59.976790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:15:59.984617 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b67c8e2-3ad2-4e4d-b8d6-4a20de7b42c9 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.199510 Nov 02 22:15:59.985217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3498/6876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:15:59 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:16:01.009367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:16:01.010026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:16:01.018274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:01.018774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:01.019838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:01.020810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:01.021298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:01.021733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:01.158379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:16:01.166877 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca2c6b5c-7115-4423-b0e2-59a45abbaa06 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1270 microversion: 2.1 time: 0.162044 Nov 02 22:16:01.167463 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3379/6877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:16:01 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:16:02.189753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:16:02.190307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:16:02.197904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:02.198396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:02.198851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:02.199552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:02.200019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:02.200456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:02.329919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:16:02.338639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1a43a4f-b64a-4662-9829-f5f134ad6759 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1459 microversion: 2.1 time: 0.152885 Nov 02 22:16:02.339233 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3499/6878] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:16:02 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:16:02.360817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:16:02.361459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:16:02.368284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:02.368770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:02.369253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:02.369939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:02.370397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:02.370831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:02.505493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:16:02.513352 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f6c03496-3845-4ce0-94d0-56013ab048be tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1459 microversion: 2.1 time: 0.156435 Nov 02 22:16:02.513918 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3380/6879] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:16:02 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:16:04.866294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d2aac8bf-7c39-434b-86e2-fbd6ae9d25d5 req-fc2138a5-5fc9-4b54-b415-7805c41d9105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f6f1fb-ac34-479b-ae6f-1a335162054e", "tag": "066449b6-12bc-46a1-bdac-24820b056d9e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:16:04.887004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d2aac8bf-7c39-434b-86e2-fbd6ae9d25d5 req-fc2138a5-5fc9-4b54-b415-7805c41d9105 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:04.887574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d2aac8bf-7c39-434b-86e2-fbd6ae9d25d5 req-fc2138a5-5fc9-4b54-b415-7805c41d9105 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:04.888030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d2aac8bf-7c39-434b-86e2-fbd6ae9d25d5 req-fc2138a5-5fc9-4b54-b415-7805c41d9105 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:04.901689 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d2aac8bf-7c39-434b-86e2-fbd6ae9d25d5 req-fc2138a5-5fc9-4b54-b415-7805c41d9105 service nova] Creating event network-changed:066449b6-12bc-46a1-bdac-24820b056d9e for instance 85f6f1fb-ac34-479b-ae6f-1a335162054e on n-h2-860863-4 Nov 02 22:16:04.910973 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d2aac8bf-7c39-434b-86e2-fbd6ae9d25d5 req-fc2138a5-5fc9-4b54-b415-7805c41d9105 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049676 Nov 02 22:16:04.910973 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3500/6880] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:16:06.923967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-678821ae-bf7b-4125-8348-434f86e8c32a req-0f970342-068e-43dc-a3d8-9a7b29c07b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f6f1fb-ac34-479b-ae6f-1a335162054e", "tag": "066449b6-12bc-46a1-bdac-24820b056d9e"}, {"name": "network-changed", "server_uuid": "85f6f1fb-ac34-479b-ae6f-1a335162054e", "tag": "066449b6-12bc-46a1-bdac-24820b056d9e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:16:06.935396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-678821ae-bf7b-4125-8348-434f86e8c32a req-0f970342-068e-43dc-a3d8-9a7b29c07b5f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:16:06.935877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-678821ae-bf7b-4125-8348-434f86e8c32a req-0f970342-068e-43dc-a3d8-9a7b29c07b5f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:16:06.936434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-678821ae-bf7b-4125-8348-434f86e8c32a req-0f970342-068e-43dc-a3d8-9a7b29c07b5f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:16:06.947596 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-678821ae-bf7b-4125-8348-434f86e8c32a req-0f970342-068e-43dc-a3d8-9a7b29c07b5f service nova] Creating event network-changed:066449b6-12bc-46a1-bdac-24820b056d9e for instance 85f6f1fb-ac34-479b-ae6f-1a335162054e on n-h2-860863-4 Nov 02 22:16:06.948036 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-678821ae-bf7b-4125-8348-434f86e8c32a req-0f970342-068e-43dc-a3d8-9a7b29c07b5f service nova] Creating event network-changed:066449b6-12bc-46a1-bdac-24820b056d9e for instance 85f6f1fb-ac34-479b-ae6f-1a335162054e on n-h2-860863-4 Nov 02 22:16:06.953754 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-678821ae-bf7b-4125-8348-434f86e8c32a req-0f970342-068e-43dc-a3d8-9a7b29c07b5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034210 Nov 02 22:16:06.954842 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3381/6881] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:17:07.859855 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:17:07.860380 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:17:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e (ip 10.222.0.25) !!! Nov 02 22:17:07.861691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:07.862756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=64 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:07.868812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:07.869477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:07.870059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:07.870951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=54 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:07.879370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:07.879881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:07.880526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:07.881299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:07.882306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:07.882759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:07.922773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:17:08.021687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-85337051-5e48-4967-8583-9eb06142e302 req-67f71046-14aa-4f22-a1f2-3c17f3b869a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85f6f1fb-ac34-479b-ae6f-1a335162054e", "tag": "066449b6-12bc-46a1-bdac-24820b056d9e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:08.033222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-85337051-5e48-4967-8583-9eb06142e302 req-67f71046-14aa-4f22-a1f2-3c17f3b869a7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:08.033709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-85337051-5e48-4967-8583-9eb06142e302 req-67f71046-14aa-4f22-a1f2-3c17f3b869a7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:08.034317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-85337051-5e48-4967-8583-9eb06142e302 req-67f71046-14aa-4f22-a1f2-3c17f3b869a7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:08.046267 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-85337051-5e48-4967-8583-9eb06142e302 req-67f71046-14aa-4f22-a1f2-3c17f3b869a7 service nova] Creating event network-changed:066449b6-12bc-46a1-bdac-24820b056d9e for instance 85f6f1fb-ac34-479b-ae6f-1a335162054e on n-h2-860863-4 Nov 02 22:17:08.052752 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-85337051-5e48-4967-8583-9eb06142e302 req-67f71046-14aa-4f22-a1f2-3c17f3b869a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194519 Nov 02 22:17:08.053437 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3382/6882] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:17:08.153273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4bc4ecda-5aac-4184-a64a-d25d1b8d8f15 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "DELETE /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 204 len: 0 microversion: 2.1 time: 0.296357 Nov 02 22:17:08.157518 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3501/6883] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:17:07 2022] DELETE /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:17:08.165416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:08.166117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:08.173596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:08.179563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:08.179563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:08.179563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:08.179563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:08.179563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:08.337112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:08.345600 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-670879d4-2526-46ac-9a9f-ef3528c8160a tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1584 microversion: 2.1 time: 0.185295 Nov 02 22:17:08.346312 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3383/6884] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:08 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1584 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:09.370889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:09.371620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:09.378628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:09.379126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:09.379586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:09.380294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:09.380763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:09.381229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:09.578760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:09.586553 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6ab52ae-8dd2-490f-8cbe-10f947660d07 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1584 microversion: 2.1 time: 0.219964 Nov 02 22:17:09.587134 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3502/6885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:09 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1584 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:10.496804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f6662968-b368-44a8-b972-c968222f96ab req-91732300-daa0-4400-a330-eb95fd7122e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85f6f1fb-ac34-479b-ae6f-1a335162054e", "name": "network-vif-deleted", "tag": "066449b6-12bc-46a1-bdac-24820b056d9e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:10.507626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f6662968-b368-44a8-b972-c968222f96ab req-91732300-daa0-4400-a330-eb95fd7122e3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:10.508211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f6662968-b368-44a8-b972-c968222f96ab req-91732300-daa0-4400-a330-eb95fd7122e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:10.508791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f6662968-b368-44a8-b972-c968222f96ab req-91732300-daa0-4400-a330-eb95fd7122e3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:10.520759 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f6662968-b368-44a8-b972-c968222f96ab req-91732300-daa0-4400-a330-eb95fd7122e3 service nova] Creating event network-vif-deleted:066449b6-12bc-46a1-bdac-24820b056d9e for instance 85f6f1fb-ac34-479b-ae6f-1a335162054e on n-h2-860863-4 Nov 02 22:17:10.526119 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f6662968-b368-44a8-b972-c968222f96ab req-91732300-daa0-4400-a330-eb95fd7122e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033026 Nov 02 22:17:10.530473 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3384/6886] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:17:10.611621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:10.612311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:10.619323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:10.619819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:10.620280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:10.621007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:10.621481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:10.621926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:10.691432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:10.699745 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f9ca946-175f-4f71-aa11-b513a5ac742f tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1230 microversion: 2.1 time: 0.091978 Nov 02 22:17:10.706865 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3503/6887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:10 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:11.725018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:11.725885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:11.733189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:11.733676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:11.734141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:11.734839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:11.735309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:11.735718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:11.800095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:11.808012 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b474159-50b8-4d3e-8a8b-2e5923a14653 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1230 microversion: 2.1 time: 0.088151 Nov 02 22:17:11.808587 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3385/6888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:11 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:12.831244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:12.831890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:12.839008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:12.839519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:12.839983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:12.840713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:12.841215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:12.841698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:12.907049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:12.915498 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddf18f1a-d442-4c69-9f1a-db0be454bfc0 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1230 microversion: 2.1 time: 0.088435 Nov 02 22:17:12.916085 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3504/6889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:12 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1230 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:13.939589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:13.940270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:13.947989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:13.948485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:13.948951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:13.949660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:13.950121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:13.950557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:14.015298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:14.023526 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a6e9456b-cb4c-4f0d-91fb-6ec68691757e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1230 microversion: 2.1 time: 0.087912 Nov 02 22:17:14.024122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3386/6890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:13 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:15.047147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:15.047882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:15.054492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:15.054994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:15.055452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:15.056165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:15.056636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:15.057137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:15.089900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:15.090401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:15.090850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:15.091312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lazy-loading 'fault' on Instance uuid 85f6f1fb-ac34-479b-ae6f-1a335162054e {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:17:15.136158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af340552c3da40949a32ef30031561ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cddd83c5664d3983ddc212142ab68e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:15.144693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09fc7a2b-6a68-485c-8c4f-17cffd1a7b95 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 200 len: 1235 microversion: 2.1 time: 0.101624 Nov 02 22:17:15.145288 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3505/6891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:15 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 1235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:16.168916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:16.169583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] [instance: 85f6f1fb-ac34-479b-ae6f-1a335162054e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:16.177041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:16.177560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:16.178008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:16.178708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:16.179170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:16.179603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:16.193351 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] HTTP exception thrown: Instance 85f6f1fb-ac34-479b-ae6f-1a335162054e could not be found. Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Request method failure captured: Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e HTTP/1.1 Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYut8Va_ZhU_aWVzcDLcQk3CE5sPVq3AQA_zEV6uX5bkpZk5LQ-pFpoxyo1MYoxoqQBa51Th0MSbEnVes-x7-9e1011IHzSO6BvJukD5Y70shxAmTCCqV8jiFwm860ydUvySfrrZYIeNLnD0YeWFtl4loyR2AmgmAxqTyLWt2cOtQ5Xo Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: d8cddd83c5664d3983ddc212142ab68e Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestVolumeBackupRestore-187768488 Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d8cddd83c5664d3983ddc212142ab68e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8cddd83c5664d3983ddc212142ab68e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d8cddd83c5664d3983ddc212142ab68e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d8cddd83c5664d3983ddc212142ab68e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestVolumeBackupRestore-187768488 Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: d8cddd83c5664d3983ddc212142ab68e Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestVolumeBackupRestore-187768488 Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestVolumeBackupRestore-187768488-project Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: af340552c3da40949a32ef30031561ad Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestVolumeBackupRestore-187768488-project Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 85f6f1fb-ac34-479b-ae6f-1a335162054e could not be found. Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '85f6f1fb-ac34-479b-ae6f-1a335162054e'} Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85f6f1fb-ac34-479b-ae6f-1a335162054e could not be found. Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85f6f1fb-ac34-479b-ae6f-1a335162054e could not be found. Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:16.195019 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85f6f1fb-ac34-479b-ae6f-1a335162054e could not be found. Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Returning 404 to user: Instance 85f6f1fb-ac34-479b-ae6f-1a335162054e could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b27f1b55-3604-4338-a00f-58b6da79573e tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e" status: 404 len: 111 microversion: 2.1 time: 0.031728 Nov 02 22:17:16.199519 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3387/6892] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:16 2022] GET /compute/v2.1/servers/85f6f1fb-ac34-479b-ae6f-1a335162054e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:17:16.427721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ecfda92-0c32-4c7e-af8a-33e743fc6231 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] Calling method '.version_select at 0x7f9b68090ca0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:16.508213 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ecfda92-0c32-4c7e-af8a-33e743fc6231 tempest-TestVolumeBackupRestore-187768488 tempest-TestVolumeBackupRestore-187768488-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2064796346" status: 202 len: 0 microversion: 2.1 time: 0.085582 Nov 02 22:17:16.509349 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3506/6893] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Nov 2 22:17:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2064796346 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:17:41.971499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:41.972420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=24 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:42.082407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1150927812", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:42.134539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] validate_networks() for None {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:17:42.327349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:17:42.327900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:17:42.328383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:17:42.328817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:17:42.329265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:17:42.338275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:42.338759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:42.339203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:42.339929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:42.340386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:42.340818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:42.358144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Getting quotas for project 6f4dd8fd74cf4fec94947e122d38d644. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:17:42.363913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Getting quotas for user 58fc32b622d54699bf0d39b9d53c1598 and project 6f4dd8fd74cf4fec94947e122d38d644. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:17:42.376116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:17:42.378427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:17:42.474493 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-27899cef-f488-43e2-b382-38321e0b0dd3 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508515 Nov 02 22:17:42.475481 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3388/6894] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:17:42.486482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:42.487393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:42.492326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0ec931b-4c7a-44ee-861d-42b2393cd994 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:42.492991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0ec931b-4c7a-44ee-861d-42b2393cd994 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:42.549979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b0ec931b-4c7a-44ee-861d-42b2393cd994 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:42.558742 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0ec931b-4c7a-44ee-861d-42b2393cd994 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1222 microversion: 2.1 time: 0.074881 Nov 02 22:17:42.559732 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3507/6895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:42 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:43.583464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:43.584084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:43.591300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:43.591783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:43.592223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:43.592921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:43.593395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:43.593823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:43.655708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:43.663699 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-364bdeba-d75a-44c5-97cb-89b40fa3ef95 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1226 microversion: 2.1 time: 0.085729 Nov 02 22:17:43.664496 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3389/6896] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:43 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:44.687534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:44.688164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:44.695888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:44.696394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:44.696853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:44.697598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:44.698078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:44.698569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:44.771180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:44.779760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e775588-262b-43ec-9092-b90c36143163 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1282 microversion: 2.1 time: 0.096252 Nov 02 22:17:44.784343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3508/6897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:44 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:45.804275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:45.804912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:45.812138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:45.812661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:45.813118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:45.813834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:45.814291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:45.815284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:45.956838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:45.965123 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e131bd6-edd7-486d-92fb-ed81cd8040c6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1322 microversion: 2.1 time: 0.164730 Nov 02 22:17:45.965723 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3390/6898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:45 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:46.655716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-68c44180-850d-4688-b681-4408147c62d7 req-948941ab-7c27-4d6b-a035-ea68e4a39e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46aca1bf-756e-48f8-b290-2b4bbff5205f", "tag": "57b205c1-7233-463e-a9dc-2f3a55520d06"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:46.667505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-68c44180-850d-4688-b681-4408147c62d7 req-948941ab-7c27-4d6b-a035-ea68e4a39e12 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:46.667983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-68c44180-850d-4688-b681-4408147c62d7 req-948941ab-7c27-4d6b-a035-ea68e4a39e12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:46.668422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-68c44180-850d-4688-b681-4408147c62d7 req-948941ab-7c27-4d6b-a035-ea68e4a39e12 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:46.680838 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-68c44180-850d-4688-b681-4408147c62d7 req-948941ab-7c27-4d6b-a035-ea68e4a39e12 service nova] Creating event network-changed:57b205c1-7233-463e-a9dc-2f3a55520d06 for instance 46aca1bf-756e-48f8-b290-2b4bbff5205f on n-h2-860863-4 Nov 02 22:17:46.686200 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-68c44180-850d-4688-b681-4408147c62d7 req-948941ab-7c27-4d6b-a035-ea68e4a39e12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034376 Nov 02 22:17:46.686983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3509/6899] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:17:46.987831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:46.988462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:46.995336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:46.995861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:46.996308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:46.997042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:46.997504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:46.997940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:47.129478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:47.137242 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9b93345-6dd2-458f-96dc-94172738fd0d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1322 microversion: 2.1 time: 0.153340 Nov 02 22:17:47.138040 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3391/6900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:46 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:48.162982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:48.163615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:48.170605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:48.171095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:48.171542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:48.172504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:48.172996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:48.173443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:48.307785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:48.316107 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd247b06-2844-4040-b806-0cfc00067b6f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1322 microversion: 2.1 time: 0.157978 Nov 02 22:17:48.316676 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3510/6901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:48 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:49.342462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:49.343081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:49.350595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:49.351078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:49.351521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:49.352208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:49.352662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:49.353119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:49.482899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:49.490823 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-518a0b8a-bbb3-4419-8fc0-d1511e9e0e4d tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1322 microversion: 2.1 time: 0.152244 Nov 02 22:17:49.491395 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3392/6902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:49 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:50.513313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:50.514085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:50.521321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:50.525378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:50.525378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:50.525378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:50.525378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:50.525378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:50.659260 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:50.666972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02a60106-bce2-4fc1-97b1-37916cf66eed tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1322 microversion: 2.1 time: 0.157736 Nov 02 22:17:50.667546 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3511/6903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:50 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:51.690721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:51.691336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:51.698150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:51.698636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:51.699075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:51.699756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:51.700211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:51.700636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:51.834937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:51.843251 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-014072e0-2f62-4a95-9fb6-2ca9015d3858 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1322 microversion: 2.1 time: 0.157209 Nov 02 22:17:51.843837 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3393/6904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:51 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:52.239565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c9c95759-d99f-48eb-9879-17144d4f8670 req-bea6e4bd-31bd-4477-af90-ec56781b783e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46aca1bf-756e-48f8-b290-2b4bbff5205f", "name": "network-vif-plugged", "status": "completed", "tag": "57b205c1-7233-463e-a9dc-2f3a55520d06"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:52.249913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9c95759-d99f-48eb-9879-17144d4f8670 req-bea6e4bd-31bd-4477-af90-ec56781b783e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:52.250404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9c95759-d99f-48eb-9879-17144d4f8670 req-bea6e4bd-31bd-4477-af90-ec56781b783e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:52.250845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9c95759-d99f-48eb-9879-17144d4f8670 req-bea6e4bd-31bd-4477-af90-ec56781b783e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:52.262587 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c9c95759-d99f-48eb-9879-17144d4f8670 req-bea6e4bd-31bd-4477-af90-ec56781b783e service nova] Creating event network-vif-plugged:57b205c1-7233-463e-a9dc-2f3a55520d06 for instance 46aca1bf-756e-48f8-b290-2b4bbff5205f on n-h2-860863-4 Nov 02 22:17:52.267665 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c9c95759-d99f-48eb-9879-17144d4f8670 req-bea6e4bd-31bd-4477-af90-ec56781b783e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032804 Nov 02 22:17:52.268260 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3512/6905] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:17:52.865866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:52.866521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:52.868447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:52.869295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:52.874947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:52.875439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:52.875936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:52.876632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:52.877181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:52.877793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:53.010083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:53.019135 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a7cbe28e-06cf-4df1-801d-007c494d139f tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1322 microversion: 2.1 time: 0.156727 Nov 02 22:17:53.019722 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3394/6906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:52 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:54.039996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:17:54.045050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:54.045766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:54.052879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:54.053400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:54.053867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:54.054580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:54.055048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:54.055492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:54.192807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:54.200717 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8547f3f0-57d2-4981-b184-884954d1f9b6 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1472 microversion: 2.1 time: 0.161901 Nov 02 22:17:54.201429 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3513/6907] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:54 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:54.275235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-81a5b12d-e0b1-4cbe-8499-3e288b46b71b tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Calling method '.version_select at 0x7f9b63a60310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:54.342787 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-81a5b12d-e0b1-4cbe-8499-3e288b46b71b tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/8650c7ece5534caeb80a7f2d5a652a77" status: 200 len: 371 microversion: 2.1 time: 0.119936 Nov 02 22:17:54.343361 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3395/6908] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 22:17:54 2022] GET /compute/v2.1/os-quota-sets/8650c7ece5534caeb80a7f2d5a652a77 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:17:54.355481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-833fa2dc-9ded-44d3-8cd3-4865e22b3ceb tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2129135071", "id": 815783828, "os-flavor-access:is_public": "True"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:54.444583 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-833fa2dc-9ded-44d3-8cd3-4865e22b3ceb tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.092666 Nov 02 22:17:54.445142 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3514/6909] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:17:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:17:54.457856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "815783828"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:54.460287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:54.466420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:54.466905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:54.467346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:54.468037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:54.468519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:54.468969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:54.665802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '827548ba56db4dfcb61e78c97f3214c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8650c7ece5534caeb80a7f2d5a652a77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:54.672491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2129135071 {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:17:54.679914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:54.680402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:54.680847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:54.681609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:54.682068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:54.682499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:54.708029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Getting quotas for project 6f4dd8fd74cf4fec94947e122d38d644. Resources: {'cores', 'ram'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:17:54.713070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Getting quotas for user 58fc32b622d54699bf0d39b9d53c1598 and project 6f4dd8fd74cf4fec94947e122d38d644. Resources: {'cores', 'ram'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:17:54.724832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.api [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] ram quota exceeded for 8650c7ece5534caeb80a7f2d5a652a77, tried to resize instance. Nov 02 22:17:54.725405 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Request method failure captured: Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f/action HTTP/1.1 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 38 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuyFybM1F09SdrqjUFTOh8uhwn5T6mXqiSzQxseLGVyGG0GgxFiJd5UAUxkL3DsyLk70A8JRsLD0nPHmhfGcjI5a_IqonI-iYy3YJ5g5p3lroCpPlFxvF02Ba4uNJkDnk-K3ShvZNUmeHa6Pf9llwh8SWlTzs6PIoxV3-6w3TI6lw1M Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 8650c7ece5534caeb80a7f2d5a652a77 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-963388816 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,admin,reader Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,admin,reader Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersAdminNegativeTestJSON-963388816 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 8650c7ece5534caeb80a7f2d5a652a77 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-963388816 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersAdminNegativeTestJSON-963388816-project-admin Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 827548ba56db4dfcb61e78c97f3214c7 Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersAdminNegativeTestJSON-963388816-project-admin Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: {"resize": {"flavorRef": "815783828"}} Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '46aca1bf-756e-48f8-b290-2b4bbff5205f', 'body': {'resize': {'flavorRef': '815783828'}}} Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:17:54.738071 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-32d38d93-310b-4643-b698-45bcc0b94424 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f/action" status: 403 len: 118 microversion: 2.1 time: 0.286295 Nov 02 22:17:54.742864 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3396/6910] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:17:54 2022] POST /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f/action => generated 118 bytes in 287 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:17:54.751093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7fd0a47-af7c-44ee-9d4c-2fa1d8e651e5 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:54.849284 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c7fd0a47-af7c-44ee-9d4c-2fa1d8e651e5 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/815783828" status: 202 len: 0 microversion: 2.1 time: 0.101811 Nov 02 22:17:54.849864 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3515/6911] 10.222.0.25 () {58 vars in 1158 bytes} [Wed Nov 2 22:17:54 2022] DELETE /compute/v2.1/flavors/815783828 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:17:54.857808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3e4f58b7-224c-42eb-bdb2-291b7e14548f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:54.878676 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3e4f58b7-224c-42eb-bdb2-291b7e14548f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024525 Nov 02 22:17:54.879231 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3397/6912] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 22:17:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:54.904888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd369d3e-e5cc-4df6-a4f2-5771b40ac821 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Calling method '.version_select at 0x7f9b68514280>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:54.983158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd369d3e-e5cc-4df6-a4f2-5771b40ac821 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "GET /compute/v2.1/os-quota-sets/8650c7ece5534caeb80a7f2d5a652a77" status: 200 len: 371 microversion: 2.1 time: 0.084388 Nov 02 22:17:54.983746 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3516/6913] 10.222.0.25 () {58 vars in 1242 bytes} [Wed Nov 2 22:17:54 2022] GET /compute/v2.1/os-quota-sets/8650c7ece5534caeb80a7f2d5a652a77 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:17:54.995791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e373687-bec4-430d-9414-b77a1a47a4af tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-454127519", "id": 1248384095, "os-flavor-access:is_public": "True"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:55.066986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e373687-bec4-430d-9414-b77a1a47a4af tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.074908 Nov 02 22:17:55.067579 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3398/6914] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:17:54 2022] POST /compute/v2.1/flavors => generated 436 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:17:55.079692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1248384095"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:55.082903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:55.089908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.090414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.090900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.091619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.092109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.092545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.229781 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '827548ba56db4dfcb61e78c97f3214c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8650c7ece5534caeb80a7f2d5a652a77', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:55.236052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-454127519 {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:17:55.243410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.243910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.244367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.245155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.245628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.246079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.266519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Getting quotas for project 6f4dd8fd74cf4fec94947e122d38d644. Resources: {'cores', 'ram'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:17:55.272107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Getting quotas for user 58fc32b622d54699bf0d39b9d53c1598 and project 6f4dd8fd74cf4fec94947e122d38d644. Resources: {'cores', 'ram'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:17:55.284989 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.compute.api [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] cores quota exceeded for 8650c7ece5534caeb80a7f2d5a652a77, tried to resize instance. Nov 02 22:17:55.285549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Request method failure captured: Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f/action HTTP/1.1 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 39 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuyFybM1F09SdrqjUFTOh8uhwn5T6mXqiSzQxseLGVyGG0GgxFiJd5UAUxkL3DsyLk70A8JRsLD0nPHmhfGcjI5a_IqonI-iYy3YJ5g5p3lroCpPlFxvF02Ba4uNJkDnk-K3ShvZNUmeHa6Pf9llwh8SWlTzs6PIoxV3-6w3TI6lw1M Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8650c7ece5534caeb80a7f2d5a652a77 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-963388816 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,admin,reader Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,admin,reader Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8650c7ece5534caeb80a7f2d5a652a77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersAdminNegativeTestJSON-963388816 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8650c7ece5534caeb80a7f2d5a652a77 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-963388816 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersAdminNegativeTestJSON-963388816-project-admin Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 827548ba56db4dfcb61e78c97f3214c7 Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersAdminNegativeTestJSON-963388816-project-admin Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: {"resize": {"flavorRef": "1248384095"}} Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '46aca1bf-756e-48f8-b290-2b4bbff5205f', 'body': {'resize': {'flavorRef': '1248384095'}}} Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:17:55.287631 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecaeb7e9-7177-4f8d-a2ad-a272f4e75b2f tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "POST /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f/action" status: 403 len: 113 microversion: 2.1 time: 0.213365 Nov 02 22:17:55.292010 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3517/6915] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:17:55 2022] POST /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f/action => generated 113 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:17:55.303796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1fc8676e-57b6-448f-8a0e-d4e0bb0456d0 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:55.369293 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1fc8676e-57b6-448f-8a0e-d4e0bb0456d0 tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "DELETE /compute/v2.1/flavors/1248384095" status: 202 len: 0 microversion: 2.1 time: 0.069299 Nov 02 22:17:55.369847 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3399/6916] 10.222.0.25 () {58 vars in 1161 bytes} [Wed Nov 2 22:17:55 2022] DELETE /compute/v2.1/flavors/1248384095 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:17:55.377852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3861f4c3-3727-4a39-ba93-688bc9b0e51a tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:55.399389 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3861f4c3-3727-4a39-ba93-688bc9b0e51a tempest-ServersAdminNegativeTestJSON-963388816 tempest-ServersAdminNegativeTestJSON-963388816-project-admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025306 Nov 02 22:17:55.399974 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3518/6917] 10.222.0.25 () {58 vars in 1146 bytes} [Wed Nov 2 22:17:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:55.421121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:55.421633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:55.428440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.428915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.429402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.430101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.430566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.431003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.460467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:17:55.770137 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a235a8b7-2ccd-4b02-a8d7-7018e7716480 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "DELETE /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 204 len: 0 microversion: 2.1 time: 0.352725 Nov 02 22:17:55.770781 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3400/6918] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:17:55 2022] DELETE /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:17:55.778878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:55.779511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:55.785579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.786174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.786531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.787240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:55.787713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:55.788157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:55.919572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:55.928427 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3bc61d7e-6429-4114-9505-2b92325bdfbe tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1478 microversion: 2.1 time: 0.153416 Nov 02 22:17:55.929037 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3519/6919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:55 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1478 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:17:56.952517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:56.953269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:56.960506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:56.961035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:56.961490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:56.962232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:56.962700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:56.963138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:57.110843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:57.119575 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-36584a81-9f2a-4c02-adfc-d0b82182757c tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1478 microversion: 2.1 time: 0.171606 Nov 02 22:17:57.120153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3401/6920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:56 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:57.895138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-22284416-23fb-4a1e-9d42-0e442b86271b req-584c3667-f457-4f8a-b76d-8b172ce3df42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46aca1bf-756e-48f8-b290-2b4bbff5205f", "name": "network-vif-deleted", "tag": "57b205c1-7233-463e-a9dc-2f3a55520d06"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:17:57.912543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-22284416-23fb-4a1e-9d42-0e442b86271b req-584c3667-f457-4f8a-b76d-8b172ce3df42 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:57.913095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-22284416-23fb-4a1e-9d42-0e442b86271b req-584c3667-f457-4f8a-b76d-8b172ce3df42 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:57.913557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-22284416-23fb-4a1e-9d42-0e442b86271b req-584c3667-f457-4f8a-b76d-8b172ce3df42 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:57.927385 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-22284416-23fb-4a1e-9d42-0e442b86271b req-584c3667-f457-4f8a-b76d-8b172ce3df42 service nova] Creating event network-vif-deleted:57b205c1-7233-463e-a9dc-2f3a55520d06 for instance 46aca1bf-756e-48f8-b290-2b4bbff5205f on n-h2-860863-4 Nov 02 22:17:57.932521 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-22284416-23fb-4a1e-9d42-0e442b86271b req-584c3667-f457-4f8a-b76d-8b172ce3df42 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042568 Nov 02 22:17:57.933505 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3520/6921] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:17:58.143530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:58.144219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:58.151296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:58.151792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:58.152237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:58.152969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:58.153431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:58.153861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:58.222015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58fc32b622d54699bf0d39b9d53c1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4dd8fd74cf4fec94947e122d38d644', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:17:58.229924 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e83a93af-6c48-4c56-9f58-397d176dcaa0 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 200 len: 1307 microversion: 2.1 time: 0.091179 Nov 02 22:17:58.230479 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3402/6922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:58 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:17:59.254802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:17:59.255527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] [instance: 46aca1bf-756e-48f8-b290-2b4bbff5205f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:17:59.261692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:59.262192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:59.262648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:59.263385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:17:59.263854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:17:59.264305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:17:59.277743 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] HTTP exception thrown: Instance 46aca1bf-756e-48f8-b290-2b4bbff5205f could not be found. Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Request method failure captured: Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f HTTP/1.1 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuyFgdXdCfaB8tjxLKQ-xWm_S1cfneARhsR7-7UroubxSC5ZKCXJmRbqPbVJRytfUNv4JcSa3Kt4Jt0o8gUlGawtHyh-z_iZo-eEzsmte1-7MvWQBYXAlDz9zY4Qg3S1_dmGQ5t1HNjF_bEiTfq30AdWdh6JgJq1ae4G6QQCvi2jzj8 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 6f4dd8fd74cf4fec94947e122d38d644 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-913611138 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6f4dd8fd74cf4fec94947e122d38d644"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f4dd8fd74cf4fec94947e122d38d644"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6f4dd8fd74cf4fec94947e122d38d644"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6f4dd8fd74cf4fec94947e122d38d644"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersAdminNegativeTestJSON-913611138 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 6f4dd8fd74cf4fec94947e122d38d644 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-913611138 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersAdminNegativeTestJSON-913611138-project Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 58fc32b622d54699bf0d39b9d53c1598 Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersAdminNegativeTestJSON-913611138-project Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 46aca1bf-756e-48f8-b290-2b4bbff5205f could not be found. Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '46aca1bf-756e-48f8-b290-2b4bbff5205f'} Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46aca1bf-756e-48f8-b290-2b4bbff5205f could not be found. Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46aca1bf-756e-48f8-b290-2b4bbff5205f could not be found. Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:59.279349 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46aca1bf-756e-48f8-b290-2b4bbff5205f could not be found. Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] Returning 404 to user: Instance 46aca1bf-756e-48f8-b290-2b4bbff5205f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1ddec85-c465-4e4e-be55-2d26f69da835 tempest-ServersAdminNegativeTestJSON-913611138 tempest-ServersAdminNegativeTestJSON-913611138-project] 10.222.0.25 "GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f" status: 404 len: 111 microversion: 2.1 time: 0.031119 Nov 02 22:17:59.284254 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3521/6923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:17:59 2022] GET /compute/v2.1/servers/46aca1bf-756e-48f8-b290-2b4bbff5205f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:18:07.626588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:07.627999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:07.746177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-593644197", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "370d7b6f-8c56-4496-a8ec-5e9c9dd987e5"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:18:07.802664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] validate_networks() for [('370d7b6f-8c56-4496-a8ec-5e9c9dd987e5', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:18:08.211141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:18:08.211447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:18:08.211966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:18:08.214232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:18:08.214232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:18:08.222664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:08.223147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:08.223586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:08.224337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:08.224799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:08.225329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:08.227938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:08.243757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Getting quotas for project 8a109aa1a3c7438cb3347df9bd0543e2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:18:08.249181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Getting quotas for user b9b86e89a9a74de38728bbf299e76e5b and project 8a109aa1a3c7438cb3347df9bd0543e2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:18:08.263298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:18:08.265625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:18:08.389151 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc3b9e13-b8b7-4fe9-88e6-527032fe3356 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767955 Nov 02 22:18:08.390151 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3403/6924] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:18:08.402314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c53cac4-440a-48e3-9b7f-1b61eaa45d18 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:08.403010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c53cac4-440a-48e3-9b7f-1b61eaa45d18 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:08.410009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:08.410764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:08.466635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c53cac4-440a-48e3-9b7f-1b61eaa45d18 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:08.476293 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c53cac4-440a-48e3-9b7f-1b61eaa45d18 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1214 microversion: 2.1 time: 0.077983 Nov 02 22:18:08.476999 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3522/6925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:08 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:18:09.500652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8df6b389-b8f1-4e90-958f-16b737f3d6be tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:09.501453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8df6b389-b8f1-4e90-958f-16b737f3d6be tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:09.560722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8df6b389-b8f1-4e90-958f-16b737f3d6be tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:09.568905 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8df6b389-b8f1-4e90-958f-16b737f3d6be tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1214 microversion: 2.1 time: 0.073284 Nov 02 22:18:09.569539 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3404/6926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:09 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:10.593259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:10.593910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:10.601619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=51 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:10.605095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:10.605612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:10.606102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:10.606917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:10.607307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:10.607756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:10.679562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:10.687695 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b627236-2ee6-47f5-8815-a7a5bc9e97db tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1274 microversion: 2.1 time: 0.099167 Nov 02 22:18:10.701450 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3523/6927] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:10 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:11.723333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:11.723947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:11.730776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:11.733133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:11.733133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:11.733133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:11.733133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:11.733458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:11.867030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:11.874774 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62832c69-02bd-4268-a0b3-8e34d0cb2d8a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1314 microversion: 2.1 time: 0.156094 Nov 02 22:18:11.875358 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3405/6928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:11 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:12.273762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c9e0eea0-e999-438a-bff1-7b65e8f5b4ba req-17f51591-41d2-4cd8-a85a-2bb02d471b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e902f5b-a589-4e34-a7d7-323c6f4142c0", "tag": "9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:18:12.284342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9e0eea0-e999-438a-bff1-7b65e8f5b4ba req-17f51591-41d2-4cd8-a85a-2bb02d471b99 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:12.284869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9e0eea0-e999-438a-bff1-7b65e8f5b4ba req-17f51591-41d2-4cd8-a85a-2bb02d471b99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:12.285341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c9e0eea0-e999-438a-bff1-7b65e8f5b4ba req-17f51591-41d2-4cd8-a85a-2bb02d471b99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:12.296549 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c9e0eea0-e999-438a-bff1-7b65e8f5b4ba req-17f51591-41d2-4cd8-a85a-2bb02d471b99 service nova] Creating event network-changed:9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e for instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 on n-h2-860863-4 Nov 02 22:18:12.302410 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c9e0eea0-e999-438a-bff1-7b65e8f5b4ba req-17f51591-41d2-4cd8-a85a-2bb02d471b99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032379 Nov 02 22:18:12.303013 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3524/6929] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:18:12.904162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:12.905313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:12.909405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:12.916256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:12.925156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:12.925156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:12.925156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:12.925156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:12.925156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:13.061857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:13.070004 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5e33b6fd-00f6-4495-87b2-fd54094b4817 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1314 microversion: 2.1 time: 0.170040 Nov 02 22:18:13.070602 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3406/6930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:12 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:14.095755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:14.097249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:14.103797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:14.104296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:14.104786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:14.105527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:14.106002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:14.106448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:14.237740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:14.245453 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c37ee30e-bf6d-4aec-8b48-9ec9e257445b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1314 microversion: 2.1 time: 0.155368 Nov 02 22:18:14.246046 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3525/6931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:14 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:15.267792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:15.268488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:15.275836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:15.276323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:15.276767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:15.277490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:15.277951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:15.278383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:15.414586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:15.422256 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a75ff45f-3d09-4f6b-b512-afa61b50094c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1314 microversion: 2.1 time: 0.158467 Nov 02 22:18:15.423107 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3407/6932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:15 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:16.446766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:16.447448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:16.450389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:16.455162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:16.455665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:16.456119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:16.458885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:16.460816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:16.462791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:16.598851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:16.607328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3af9263a-d87a-488c-9e38-f5893f2f0b24 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1314 microversion: 2.1 time: 0.164640 Nov 02 22:18:16.607922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3526/6933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:16 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:17.632954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:17.633678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:17.640466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:17.641007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:17.641460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:17.642139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:17.642589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:17.643014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:17.773237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:17.781000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d7472f5-da6e-42d1-b977-4acd5b83bed1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1314 microversion: 2.1 time: 0.153232 Nov 02 22:18:17.781578 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3408/6934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:17 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:18.396269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-be2c48bd-3cd8-4bb5-95f2-8fb290450fd6 req-772b464c-555c-41fc-9c27-9bf1dc3f5f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e902f5b-a589-4e34-a7d7-323c6f4142c0", "name": "network-vif-plugged", "status": "completed", "tag": "9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:18:18.406783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be2c48bd-3cd8-4bb5-95f2-8fb290450fd6 req-772b464c-555c-41fc-9c27-9bf1dc3f5f75 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:18.407274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be2c48bd-3cd8-4bb5-95f2-8fb290450fd6 req-772b464c-555c-41fc-9c27-9bf1dc3f5f75 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:18.407724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be2c48bd-3cd8-4bb5-95f2-8fb290450fd6 req-772b464c-555c-41fc-9c27-9bf1dc3f5f75 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:18.419026 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-be2c48bd-3cd8-4bb5-95f2-8fb290450fd6 req-772b464c-555c-41fc-9c27-9bf1dc3f5f75 service nova] Creating event network-vif-plugged:9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e for instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 on n-h2-860863-4 Nov 02 22:18:18.424267 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-be2c48bd-3cd8-4bb5-95f2-8fb290450fd6 req-772b464c-555c-41fc-9c27-9bf1dc3f5f75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Nov 02 22:18:18.424858 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3527/6935] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:18:18.805236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:18.805860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:18.807755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:18.813498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:18.820452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:18.820452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:18.820452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:18.820452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:18.820452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:18.949908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:18.958137 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-483bae8e-33e6-4c82-ae8f-3e0014eb1c4d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1314 microversion: 2.1 time: 0.156962 Nov 02 22:18:18.958718 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3409/6936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:18 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:19.978558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:19.983596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:19.984313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:19.990762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:19.991263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:19.991713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:19.992416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:19.992885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:19.993381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:20.125783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:20.134435 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-87a59b21-3720-40a9-85bf-62ba22b84635 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1501 microversion: 2.1 time: 0.156792 Nov 02 22:18:20.135020 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3528/6937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:19 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:20.157564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:18:20.160026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:20.161968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:20.167912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:20.173542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:20.173542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:20.173542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:20.173542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:20.173542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:20.246179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:20.251636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Old instance type m1.heat2, new instance type m1.heat {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:18:20.258760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:18:20.259187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:18:20.259651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:18:20.260063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:18:20.260472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:18:20.498868 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fba15ed-c614-4aaf-bb5d-eef2d16ebd15 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "POST /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0/action" status: 202 len: 0 microversion: 2.1 time: 0.345088 Nov 02 22:18:20.501631 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3410/6938] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:18:20 2022] POST /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:18:20.508473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:20.509161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:20.516173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:20.516989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:20.517665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:20.518170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:20.518953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:20.519657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:20.656247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:20.664656 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2077f2c-3d1f-4315-a363-a1b680b0c188 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1510 microversion: 2.1 time: 0.160609 Nov 02 22:18:20.665436 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3529/6939] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:20 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:21.688493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:21.689146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:21.696254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:21.696658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:21.697203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:21.697910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:21.698368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:21.698801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:21.836196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:21.844099 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-04bbd588-1921-40c7-92c3-15989dda23f7 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1510 microversion: 2.1 time: 0.160340 Nov 02 22:18:21.844681 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3411/6940] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:21 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:22.868228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:22.869047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:22.875977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:22.876544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:22.877026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:22.877727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:22.878190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:22.878631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:23.017107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:23.026037 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-812d2128-bd58-490a-be84-97331dc0ae2f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1510 microversion: 2.1 time: 0.161869 Nov 02 22:18:23.026627 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3530/6941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:22 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:24.050438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:24.051054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:24.058493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:24.058977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:24.059413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:24.060099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:24.060551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:24.061003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:24.197088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:24.204087 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6ec85496-bbad-44ca-bf3d-89fe21f839b1 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.157900 Nov 02 22:18:24.204735 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3412/6942] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:24 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:25.230382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:25.231042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:25.237024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:25.237521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:25.237968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:25.238693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:25.239159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:25.239601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:25.367940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:25.375640 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b250108-904c-443f-a76b-a8e13bc76583 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.150726 Nov 02 22:18:25.376212 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3531/6943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:25 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:26.399452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:26.400069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:26.406470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:26.406958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:26.407405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:26.408090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:26.408548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:26.409005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:26.543626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:26.551621 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ab90602-1694-4ad8-945e-457d5f47f92c tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.156286 Nov 02 22:18:26.552199 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3413/6944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:26 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:27.576433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:27.577086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:27.583270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:27.583764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:27.584213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:27.584909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:27.585397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:27.586458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:27.715162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:27.723080 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e24eb586-f92d-46c7-a938-d7445d463734 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.150749 Nov 02 22:18:27.723727 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3532/6945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:27 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:28.747059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:28.747682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:28.755274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:28.755757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:28.756195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:28.756888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:28.757370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:28.757851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:28.888551 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:28.896255 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cf50c55b-4f4b-4e31-89d8-c30b039c2d01 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.153470 Nov 02 22:18:28.897010 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3414/6946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:28 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:29.919696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:29.924449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:29.928114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:29.928602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:29.929089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:29.929822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:29.930269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:29.930709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:30.063465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:30.071307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1159019c-be50-4a84-adbc-d3ca08137fe6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.155564 Nov 02 22:18:30.071881 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3533/6947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:29 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:31.094848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:31.095501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:31.102462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:31.102953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:31.103399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:31.104090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:31.104557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:31.105012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:31.235539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:31.243394 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-839f2419-1d31-43fa-8f8f-65fe6dea22ab tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.152524 Nov 02 22:18:31.244032 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3415/6948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:31 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:32.267036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:32.267664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:32.275055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:32.275542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:32.275989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:32.276685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:32.277177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:32.277618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:32.411221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:32.419610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d91b7bd4-3d68-404b-ba96-b52dda8b2007 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.156525 Nov 02 22:18:32.420181 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3534/6949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:32 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:33.442842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:33.443801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:33.450991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:33.451472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:33.451911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:33.452670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:33.453104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:33.453529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:33.585342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:33.593473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0a01dfed-350e-444e-aa4c-509faf95c86a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.154572 Nov 02 22:18:33.594054 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3416/6950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:33 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:34.616860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:34.617498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:34.625124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:34.625669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:34.626134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:34.626853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:34.627368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:34.627818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:34.758898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:34.766723 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d638d1e1-accc-4b12-bc7e-cbe3c67d6009 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.153806 Nov 02 22:18:34.767298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3535/6951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:34 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:35.790439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:35.791057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:35.798258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:35.798741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:35.799184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:35.799873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:35.800329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:35.800759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:35.930388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:35.938399 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5aab75f8-6a41-4b56-bb6c-d806f22da385 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.151894 Nov 02 22:18:35.938982 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3417/6952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:35 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:36.962566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:36.963192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:36.970157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:36.970651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:36.971100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:36.971797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:36.972338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:36.972821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:37.102852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:37.110686 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc211d05-2b2d-4407-a304-fb9507638ecf tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.152249 Nov 02 22:18:37.111254 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3536/6953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:36 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:38.134307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:38.134911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:38.141879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:38.142367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:38.142808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:38.143504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:38.143956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:38.144381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:38.278547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:38.286338 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0ba4739a-95a5-4d4a-8a7d-fce159a4a96e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.156022 Nov 02 22:18:38.286911 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3418/6954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:38 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:39.311618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:39.312283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:39.319161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:39.319656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:39.320108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:39.320807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:39.321350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:39.321955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:39.451170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:39.458797 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c4054ca-3aff-4ec8-a129-dbfec807b523 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.151127 Nov 02 22:18:39.459366 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3537/6955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:39 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:40.483856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:40.484749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:40.491617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:40.492097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:40.492534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:40.493399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:40.494056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:40.494482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:40.497027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:40.628890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:40.636758 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-150c4a5d-f091-4646-8c76-658850271cd6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.156915 Nov 02 22:18:40.637371 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3419/6956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:40 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:41.659751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:41.660370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:41.667491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:41.667993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:41.668448 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:41.669194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:41.669672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:41.670116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:41.674411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=83 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:41.799275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:41.807183 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-147ff4a2-8a76-4e6d-809a-a36002aa2b57 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.151412 Nov 02 22:18:41.807758 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3538/6957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:41 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:42.830609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:42.831227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:42.838955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:42.839438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:42.839878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:42.840562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:42.841066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:42.841496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:42.975143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:42.983462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-14f3d144-cd41-4023-b8e9-67b60ee95eca tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.156779 Nov 02 22:18:42.984123 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3420/6958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:42 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:44.006929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:44.007559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:44.015193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:44.015685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:44.016136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:44.016834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:44.017324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:44.017762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:44.148956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:44.157374 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65fcd41d-4642-4dcb-8a2e-36a10fbe97bd tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.154318 Nov 02 22:18:44.157892 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3539/6959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:44 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:45.184182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:45.184752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:45.192395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:45.192873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:45.193335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:45.194022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:45.194475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:45.194936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:45.327066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:45.334724 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-24e5934f-8d23-48d8-8c6f-85c6980a322b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.155010 Nov 02 22:18:45.335317 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3421/6960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:45 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:46.358675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:46.359305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:46.366773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:46.367265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:46.368411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:46.369262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:46.369731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:46.370177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:46.501643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:46.509294 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc76fc53-56e4-4237-b415-8e7b7cb8d6d6 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.154530 Nov 02 22:18:46.509865 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3540/6961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:46 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:47.532038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:47.532649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:47.535343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=36 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:47.540832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:47.541343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:47.541786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:47.542483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:47.542938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:47.543369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:47.673854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:47.682312 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9c0b3480-3f44-498d-b229-0746d03775c5 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.154084 Nov 02 22:18:47.682887 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3422/6962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:47 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:48.705658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:48.706298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:48.709072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=30 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:18:48.714122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:48.714622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:48.721647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:48.721647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:48.721647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:48.721647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:48.849509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:48.857326 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d82e8cdf-7172-487c-9932-725555b5344e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.155666 Nov 02 22:18:48.857902 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3541/6963] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:48 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:49.880864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:49.881517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:49.888419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:49.888901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:49.889374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:49.890057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:49.890508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:49.890934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:50.024801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:50.032779 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2570e5cc-0747-4543-936f-9207f611be83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.155838 Nov 02 22:18:50.033380 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3423/6964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:49 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:51.057678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:51.058306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:51.065160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:51.065656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:51.066106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:51.066802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:51.067266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:51.067704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:51.196627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:51.204348 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1603a049-64de-4276-a717-0ce8e8228456 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.150870 Nov 02 22:18:51.204940 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3542/6965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:51 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:52.227796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:52.228465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:52.235325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:52.235807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:52.236246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:52.236953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:52.237407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:52.237836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:52.370049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:52.377854 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-abbc94ad-7408-4332-a047-0eeedcddb93f tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.154131 Nov 02 22:18:52.378434 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3424/6966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:52 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:53.402679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:53.403310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:53.410711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:53.411212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:53.411671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:53.412393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:53.412865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:53.413338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:53.634555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:53.642909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c7a45758-0ee3-4efc-ac2c-b1f3cb13d62e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.244302 Nov 02 22:18:53.645680 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3543/6967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:53 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:54.666971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:54.667739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:54.674944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:54.675431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:54.675875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:54.676565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:54.677048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:54.677481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:54.872280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:54.879978 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6555f15a-812b-475d-8809-c9ab93a7f330 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.217054 Nov 02 22:18:54.880560 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3425/6968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:54 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:55.909179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:55.909179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:55.911746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:55.912338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:55.912799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:55.913548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:55.914021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:55.914468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:56.050425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:56.058456 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff3a1c36-3ba4-464b-b660-7fa484b8781d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1515 microversion: 2.1 time: 0.158603 Nov 02 22:18:56.059033 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3544/6969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:55 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:56.931812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c6a06010-1c32-4df5-884a-a9bada973404 req-c18b5ebc-2eb6-43e6-bf18-e6b9a13061f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e902f5b-a589-4e34-a7d7-323c6f4142c0", "name": "network-vif-unplugged", "status": "completed", "tag": "9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:18:56.942838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c6a06010-1c32-4df5-884a-a9bada973404 req-c18b5ebc-2eb6-43e6-bf18-e6b9a13061f3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:56.943320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c6a06010-1c32-4df5-884a-a9bada973404 req-c18b5ebc-2eb6-43e6-bf18-e6b9a13061f3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:56.943753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c6a06010-1c32-4df5-884a-a9bada973404 req-c18b5ebc-2eb6-43e6-bf18-e6b9a13061f3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:56.955581 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c6a06010-1c32-4df5-884a-a9bada973404 req-c18b5ebc-2eb6-43e6-bf18-e6b9a13061f3 service nova] Creating event network-vif-unplugged:9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e for instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 on n-h1-860863-4 Nov 02 22:18:56.960942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-c6a06010-1c32-4df5-884a-a9bada973404 req-c18b5ebc-2eb6-43e6-bf18-e6b9a13061f3 service nova] Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:18:56.973580 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c6a06010-1c32-4df5-884a-a9bada973404 req-c18b5ebc-2eb6-43e6-bf18-e6b9a13061f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045542 Nov 02 22:18:56.974188 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3426/6970] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:18:57.083246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:57.083906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:57.091075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:57.092196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:57.092860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:57.093814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:57.094299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:57.094854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:57.310061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:57.318700 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bd79436-e7b1-4df8-99a7-cceb41f70caa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1514 microversion: 2.1 time: 0.240414 Nov 02 22:18:57.319385 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3545/6971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:57 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:58.344836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:58.345569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:58.351879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:58.352363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:58.352800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:58.353512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:58.353965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:58.354390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:58.493443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:58.502107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ec74018-6dbf-48a6-a6b6-7ccc1f2ff43d tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1512 microversion: 2.1 time: 0.163143 Nov 02 22:18:58.502620 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3427/6972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:58 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:18:58.988197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c2b227c5-a93f-4b32-a459-a9fd32594db9 req-450e0970-ff63-4325-bde7-8521e891ea82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e902f5b-a589-4e34-a7d7-323c6f4142c0", "tag": "9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:18:58.998668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c2b227c5-a93f-4b32-a459-a9fd32594db9 req-450e0970-ff63-4325-bde7-8521e891ea82 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:58.999202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c2b227c5-a93f-4b32-a459-a9fd32594db9 req-450e0970-ff63-4325-bde7-8521e891ea82 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:59.003821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c2b227c5-a93f-4b32-a459-a9fd32594db9 req-450e0970-ff63-4325-bde7-8521e891ea82 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:59.012103 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c2b227c5-a93f-4b32-a459-a9fd32594db9 req-450e0970-ff63-4325-bde7-8521e891ea82 service nova] Creating event network-changed:9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e for instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 on n-h1-860863-4 Nov 02 22:18:59.017398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-c2b227c5-a93f-4b32-a459-a9fd32594db9 req-450e0970-ff63-4325-bde7-8521e891ea82 service nova] Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:18:59.029252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c2b227c5-a93f-4b32-a459-a9fd32594db9 req-450e0970-ff63-4325-bde7-8521e891ea82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044906 Nov 02 22:18:59.029849 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3546/6973] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:18:59.527632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:18:59.528263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:18:59.535071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:59.535518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:59.535965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:59.536674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:18:59.537166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:18:59.537602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:18:59.735557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:18:59.741966 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3850409-785c-499e-88da-41c76e26fd83 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1512 microversion: 2.1 time: 0.218748 Nov 02 22:18:59.742562 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3428/6974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:18:59 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:00.766591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:00.767306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:00.773529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:00.774021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:00.774471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:00.775163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:00.775628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:00.776067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:00.908594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:00.916394 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93690d4b-a9b9-4ad6-b038-788e92c27412 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1509 microversion: 2.1 time: 0.154851 Nov 02 22:19:00.919704 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3547/6975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:00 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:00.939227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:00.939739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:00.947119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:00.947608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:00.948077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:00.948775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:00.949261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:00.949692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:00.975773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:19:01.092789 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.api [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Found an unconfirmed migration during delete, id: 16, status: finished Nov 02 22:19:03.500244 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf301a04-401f-4a77-b9b6-19c74fd3a1b8 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 204 len: 0 microversion: 2.1 time: 2.564608 Nov 02 22:19:03.501088 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3429/6976] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:19:00 2022] DELETE /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 0 bytes in 2566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:19:03.509343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:03.510372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:03.518224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:03.518726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:03.519188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:03.519895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:03.520387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:03.520954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:03.653736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:03.661832 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e800baa-4464-4254-81bd-b45da5bef4aa tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1501 microversion: 2.1 time: 0.156533 Nov 02 22:19:03.662417 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3548/6977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:03 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:03.808689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-3f31118e-1227-4909-86a7-8ed5f355caad req-30e4fefd-2c48-49f5-8653-7ad24bda48ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e902f5b-a589-4e34-a7d7-323c6f4142c0", "name": "network-vif-plugged", "status": "completed", "tag": "9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:19:03.819349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3f31118e-1227-4909-86a7-8ed5f355caad req-30e4fefd-2c48-49f5-8653-7ad24bda48ad service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:03.819831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3f31118e-1227-4909-86a7-8ed5f355caad req-30e4fefd-2c48-49f5-8653-7ad24bda48ad service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:03.820266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3f31118e-1227-4909-86a7-8ed5f355caad req-30e4fefd-2c48-49f5-8653-7ad24bda48ad service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:03.830865 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-3f31118e-1227-4909-86a7-8ed5f355caad req-30e4fefd-2c48-49f5-8653-7ad24bda48ad service nova] Creating event network-vif-plugged:9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e for instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 on n-h1-860863-4 Nov 02 22:19:03.835630 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-3f31118e-1227-4909-86a7-8ed5f355caad req-30e4fefd-2c48-49f5-8653-7ad24bda48ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Nov 02 22:19:03.836227 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3430/6978] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:19:04.688083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:04.688736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:04.694961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:04.695492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:04.695975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:04.696673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:04.697163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:04.697608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:04.861053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:04.869112 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdfe7dc9-a672-45db-9dde-f8c8005eab4e tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1501 microversion: 2.1 time: 0.186431 Nov 02 22:19:04.884679 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3549/6979] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:04 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:05.587643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-090609b1-b8fd-4642-a836-596a97122437 req-1ac46b24-9b31-4c8c-bafa-c30bd6c3e812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e902f5b-a589-4e34-a7d7-323c6f4142c0", "name": "network-vif-deleted", "tag": "9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:19:05.604503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-090609b1-b8fd-4642-a836-596a97122437 req-1ac46b24-9b31-4c8c-bafa-c30bd6c3e812 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:05.605873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-090609b1-b8fd-4642-a836-596a97122437 req-1ac46b24-9b31-4c8c-bafa-c30bd6c3e812 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:05.606317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-090609b1-b8fd-4642-a836-596a97122437 req-1ac46b24-9b31-4c8c-bafa-c30bd6c3e812 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:05.618785 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-090609b1-b8fd-4642-a836-596a97122437 req-1ac46b24-9b31-4c8c-bafa-c30bd6c3e812 service nova] Creating event network-vif-deleted:9dd53615-cc95-4fb0-8ea8-5fc8b11d2b4e for instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 on n-h1-860863-4 Nov 02 22:19:05.625130 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-090609b1-b8fd-4642-a836-596a97122437 req-1ac46b24-9b31-4c8c-bafa-c30bd6c3e812 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120494 Nov 02 22:19:05.625990 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3431/6980] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:19:05.892563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:05.893226 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:05.900534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:05.901076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:05.907547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:05.907547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:05.907547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:05.907547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:05.936575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:05.937053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:05.937498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:05.937955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lazy-loading 'fault' on Instance uuid 4e902f5b-a589-4e34-a7d7-323c6f4142c0 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:19:05.981299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b86e89a9a74de38728bbf299e76e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a109aa1a3c7438cb3347df9bd0543e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:05.994179 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4468c851-da4f-4463-a64e-43ac1f4fb4a0 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 200 len: 1470 microversion: 2.1 time: 0.100385 Nov 02 22:19:05.994179 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3550/6981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:05 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 1470 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:07.015991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:07.016736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:07.022917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:07.023399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:07.023836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:07.024526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:07.025013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:07.025442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:07.038473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] HTTP exception thrown: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Request method failure captured: Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 HTTP/1.1 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuyfZpN9iSGYx19oowlrzH4uuGojccYEqPRIP2jJuR6Ot-fQHn2DCE342Nim58pDlyqDwHRHfHO4BFOx6_RzhudkrgKtXi3-IV9P7DzFt7HJUVfpAiJz3R5AXEioMfKHymSbAiKWGo095VbTjK1ePpsjNneBzALwd0WXcsvT9QKm38k Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 8a109aa1a3c7438cb3347df9bd0543e2 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 8a109aa1a3c7438cb3347df9bd0543e2 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-1188501765-project Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b9b86e89a9a74de38728bbf299e76e5b Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-1188501765-project Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4e902f5b-a589-4e34-a7d7-323c6f4142c0'} Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:19:07.040065 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Returning 404 to user: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6cb4d3a9-d99e-488c-8250-dc14e7750453 tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 404 len: 111 microversion: 2.1 time: 0.032524 Nov 02 22:19:07.046222 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3432/6982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:07 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:19:07.059377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:07.059900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:07.066787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:07.067288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:07.067748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:07.068461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:07.068953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:07.069414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:07.082834 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] HTTP exception thrown: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Request method failure captured: Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 HTTP/1.1 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuyfZpN9iSGYx19oowlrzH4uuGojccYEqPRIP2jJuR6Ot-fQHn2DCE342Nim58pDlyqDwHRHfHO4BFOx6_RzhudkrgKtXi3-IV9P7DzFt7HJUVfpAiJz3R5AXEioMfKHymSbAiKWGo095VbTjK1ePpsjNneBzALwd0WXcsvT9QKm38k Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8a109aa1a3c7438cb3347df9bd0543e2 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8a109aa1a3c7438cb3347df9bd0543e2 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-1188501765-project Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b9b86e89a9a74de38728bbf299e76e5b Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-1188501765-project Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '4e902f5b-a589-4e34-a7d7-323c6f4142c0'} Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:19:07.084515 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Returning 404 to user: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4acb65c-dfdc-42c2-8587-986ef55d475b tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 404 len: 111 microversion: 2.1 time: 0.031460 Nov 02 22:19:07.088860 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3551/6983] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:19:07 2022] DELETE /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:19:07.094636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:07.095253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] [instance: 4e902f5b-a589-4e34-a7d7-323c6f4142c0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:07.101195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:07.101684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:07.102120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:07.102800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:07.103250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:07.103673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:07.117366 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] HTTP exception thrown: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Request method failure captured: Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 HTTP/1.1 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuyfZpN9iSGYx19oowlrzH4uuGojccYEqPRIP2jJuR6Ot-fQHn2DCE342Nim58pDlyqDwHRHfHO4BFOx6_RzhudkrgKtXi3-IV9P7DzFt7HJUVfpAiJz3R5AXEioMfKHymSbAiKWGo095VbTjK1ePpsjNneBzALwd0WXcsvT9QKm38k Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 8a109aa1a3c7438cb3347df9bd0543e2 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8a109aa1a3c7438cb3347df9bd0543e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 8a109aa1a3c7438cb3347df9bd0543e2 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-DeleteServersTestJSON-1188501765 Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-DeleteServersTestJSON-1188501765-project Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b9b86e89a9a74de38728bbf299e76e5b Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-DeleteServersTestJSON-1188501765-project Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '4e902f5b-a589-4e34-a7d7-323c6f4142c0'} Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:19:07.118852 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] Returning 404 to user: Instance 4e902f5b-a589-4e34-a7d7-323c6f4142c0 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eee08188-60d1-475c-be75-4c657b1b9a0a tempest-DeleteServersTestJSON-1188501765 tempest-DeleteServersTestJSON-1188501765-project] 10.222.0.25 "GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0" status: 404 len: 111 microversion: 2.1 time: 0.029459 Nov 02 22:19:07.123806 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3433/6984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:07 2022] GET /compute/v2.1/servers/4e902f5b-a589-4e34-a7d7-323c6f4142c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:19:17.740235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=23 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:17.741030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=79 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:17.863641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1548253554", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "33e0b714-aa05-4e07-ab7d-8637df2adee0"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:19:17.924352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] validate_networks() for [('33e0b714-aa05-4e07-ab7d-8637df2adee0', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:19:18.322959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:19:18.324242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:19:18.324733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:19:18.325187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:19:18.325612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:19:18.334683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:18.335176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:18.335625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:18.336360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:18.336821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:18.337340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:18.355280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Getting quotas for project d83aabb088e342a2aca0d33c5c013cff. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:19:18.360972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Getting quotas for user 51b888d74afe4466ab1de7fb139d504d and project d83aabb088e342a2aca0d33c5c013cff. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:19:18.373907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:19:18.376242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:19:18.499415 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-948657bc-7cd0-42aa-b788-84bf7883174c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765036 Nov 02 22:19:18.500099 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3552/6985] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:19:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:19:18.511714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1bfa0847-017d-43f4-930b-e0afc516ec8d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:18.512900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1bfa0847-017d-43f4-930b-e0afc516ec8d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:18.516665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:18.517391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:18.582704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bfa0847-017d-43f4-930b-e0afc516ec8d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:18.591722 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1bfa0847-017d-43f4-930b-e0afc516ec8d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1218 microversion: 2.1 time: 0.083916 Nov 02 22:19:18.592638 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3434/6986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:18 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:19.622362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9a6a9220-c361-4a9f-97ff-f143ada3b8bc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:19.623161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9a6a9220-c361-4a9f-97ff-f143ada3b8bc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:19.681908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9a6a9220-c361-4a9f-97ff-f143ada3b8bc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:19.690538 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9a6a9220-c361-4a9f-97ff-f143ada3b8bc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1218 microversion: 2.1 time: 0.078557 Nov 02 22:19:19.692001 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3553/6987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:19 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:20.715105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:20.715717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:20.724072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:20.724566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:20.725044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:20.725776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:20.726236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:20.726671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:20.797367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:20.808044 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-581fe326-def3-47bd-8384-36d2f9291963 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1270 microversion: 2.1 time: 0.096980 Nov 02 22:19:20.808963 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3435/6988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:20 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:21.832009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:21.832752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:21.840468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:21.841123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:21.841591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:21.842320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:21.842802 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:21.843285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:22.469798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:22.477899 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e101a653-2f55-4893-9471-b66eb1f30605 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.649906 Nov 02 22:19:22.478483 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3554/6989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:21 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:23.100705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-41f164c1-19a7-4c0c-90b2-35b24a594322 req-c9f11f22-c5ea-403a-a6cb-f4520ef8f757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520aa5dd-8cc0-4133-9113-1b7b2905a605", "tag": "a8e33653-0895-4cce-8982-4d7b85bad75e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:19:23.112324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-41f164c1-19a7-4c0c-90b2-35b24a594322 req-c9f11f22-c5ea-403a-a6cb-f4520ef8f757 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:23.112810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-41f164c1-19a7-4c0c-90b2-35b24a594322 req-c9f11f22-c5ea-403a-a6cb-f4520ef8f757 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:23.113278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-41f164c1-19a7-4c0c-90b2-35b24a594322 req-c9f11f22-c5ea-403a-a6cb-f4520ef8f757 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:23.126788 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-41f164c1-19a7-4c0c-90b2-35b24a594322 req-c9f11f22-c5ea-403a-a6cb-f4520ef8f757 service nova] Creating event network-changed:a8e33653-0895-4cce-8982-4d7b85bad75e for instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 on n-h1-860863-4 Nov 02 22:19:23.131756 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-41f164c1-19a7-4c0c-90b2-35b24a594322 req-c9f11f22-c5ea-403a-a6cb-f4520ef8f757 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034883 Nov 02 22:19:23.132573 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3436/6990] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:19:23.502541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:23.503464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:23.511106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:23.511106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:23.512183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:23.513133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:23.513615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:23.514060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:23.718298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:23.726320 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a1cf18ed-a967-4fd9-ba55-7a097c9e4d98 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.227733 Nov 02 22:19:23.726894 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3555/6991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:23 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:24.752218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:24.752843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:24.759078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:24.759576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:24.760015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:24.761422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:24.761881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:24.762311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:24.933543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:24.941276 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-edff4ee3-2b57-4a41-86ad-f8aa529c0718 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.194174 Nov 02 22:19:24.941847 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3437/6992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:24 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:19:25.965438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:25.966067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:25.973022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:25.973522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:25.973977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:25.974685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:25.975157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:25.975606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:26.107344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:26.115051 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ac2b83f1-2935-4162-ab86-8b9960ba24fc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.154335 Nov 02 22:19:26.115627 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3556/6993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:25 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:27.139421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:27.140073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:27.146646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:27.147132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:27.147578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:27.148267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:27.148726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:27.149186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:27.277422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:27.285090 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b039976-91dd-4913-a631-db3dc00ccb6d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.150576 Nov 02 22:19:27.285658 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3438/6994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:27 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:28.309185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:28.309992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:28.316179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:28.316683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:28.317172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:28.317893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:28.318362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:28.318808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:28.348799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:28.448455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:28.456223 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-43e17b87-5cc0-49b8-b41d-74904383b7e9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.151562 Nov 02 22:19:28.456795 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3557/6995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:28 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:29.479574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:29.480198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:29.483201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:29.488035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:29.488518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:29.488979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:29.489667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:29.490121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:29.490594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:29.624282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:29.631925 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f8ff008a-e56f-496d-8083-d13dffbcc6c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.156325 Nov 02 22:19:29.632491 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3439/6996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:29 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:29.926255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0d9314de-5f34-4f1b-9a09-d91a74e25ce1 req-1395b131-275a-4cd3-aa7b-15583d58c329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520aa5dd-8cc0-4133-9113-1b7b2905a605", "name": "network-vif-plugged", "status": "completed", "tag": "a8e33653-0895-4cce-8982-4d7b85bad75e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:19:29.932053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:29.937289 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0d9314de-5f34-4f1b-9a09-d91a74e25ce1 req-1395b131-275a-4cd3-aa7b-15583d58c329 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:29.937875 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0d9314de-5f34-4f1b-9a09-d91a74e25ce1 req-1395b131-275a-4cd3-aa7b-15583d58c329 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:29.938254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0d9314de-5f34-4f1b-9a09-d91a74e25ce1 req-1395b131-275a-4cd3-aa7b-15583d58c329 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:29.949721 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0d9314de-5f34-4f1b-9a09-d91a74e25ce1 req-1395b131-275a-4cd3-aa7b-15583d58c329 service nova] Creating event network-vif-plugged:a8e33653-0895-4cce-8982-4d7b85bad75e for instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 on n-h1-860863-4 Nov 02 22:19:29.954730 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0d9314de-5f34-4f1b-9a09-d91a74e25ce1 req-1395b131-275a-4cd3-aa7b-15583d58c329 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Nov 02 22:19:29.955307 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3558/6997] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:19:30.655864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:30.656525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:30.663348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:30.663775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:30.664222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:30.664917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:30.665399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:30.665833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:30.887925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:30.895654 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-beb800c0-df87-4e1c-9275-90f4c35879dd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1318 microversion: 2.1 time: 0.243849 Nov 02 22:19:30.896230 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3440/6998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:30 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:31.920739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:31.921484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:31.928506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:31.929040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:31.929500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:31.930205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:31.930703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:31.931149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.061257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:32.069152 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1dde7e1-c790-41c9-a5eb-a9b4c1097293 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1508 microversion: 2.1 time: 0.154313 Nov 02 22:19:32.069728 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3559/6999] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:31 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:32.092062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:32.092692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:32.099638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.100133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.100583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.101316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.101783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.102219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.233562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:32.241704 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1bc3c51e-5107-481d-8fe8-680787d0808c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1508 microversion: 2.1 time: 0.153524 Nov 02 22:19:32.242280 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3441/7000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:32 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:32.267591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:19:32.270939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:32.280759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.281339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.282038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.282857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.283550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.284067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.406424 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17b4af0f-5459-4907-9c1d-4014927df3a5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "PUT /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1080 microversion: 2.1 time: 0.144862 Nov 02 22:19:32.407066 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3560/7001] 10.222.0.25 () {60 vars in 1256 bytes} [Wed Nov 2 22:19:32 2022] PUT /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1080 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:32.425951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:32.426568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:32.432577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.433097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.433625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.434325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.434784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.435217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.568512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:32.577220 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15648925-858b-4c85-b5a7-8f65c42fbff0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1506 microversion: 2.1 time: 0.155320 Nov 02 22:19:32.577789 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3442/7002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:32 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:32.599099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:32.600131 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:32.606201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.606696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.607143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.607839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.608302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.608740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.743762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:32.752409 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f11a222-2c01-4cc5-9da4-4a4f71bbee1c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1506 microversion: 2.1 time: 0.157237 Nov 02 22:19:32.752996 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3561/7003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:32 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:32.774822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:19:32.777281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:32.783499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.783979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.784420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.785136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:32.785590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:32.786020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:32.814793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:32.820293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Old instance type m1.heat2, new instance type m1.heat {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:19:32.827532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:19:32.827957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:19:32.828427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:19:32.828833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:19:32.829276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:19:33.052097 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-49240c08-39a6-4fc7-94f1-42b6b408f22c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "POST /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605/action" status: 202 len: 0 microversion: 2.1 time: 0.280995 Nov 02 22:19:33.052688 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3443/7004] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:19:32 2022] POST /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:19:33.061174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:33.061816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:33.068894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:33.069642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:33.078995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:33.078995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:33.078995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:33.078995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:33.292287 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:33.301124 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-320a30bd-f26f-4687-97c2-6b631f340137 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1517 microversion: 2.1 time: 0.243774 Nov 02 22:19:33.301628 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3562/7005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:33 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:19:34.324104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:34.324850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:34.333211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:34.333706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:34.334153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:34.334853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:34.335319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:34.335753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:34.469799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:34.477684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86e66d70-736b-4f12-99bf-a17212c8ac9c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1517 microversion: 2.1 time: 0.157973 Nov 02 22:19:34.478263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3444/7006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:34 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:35.501283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:35.501924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:35.509544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:35.510049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:35.510560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:35.511257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:35.511796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:35.512247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:35.715244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:35.723042 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0d5186c-beed-4d7b-99aa-f56f01991f8c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1517 microversion: 2.1 time: 0.225776 Nov 02 22:19:35.723619 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3563/7007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:35 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:36.747287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:36.747885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:36.754868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:36.755363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:36.755814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:36.756509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:36.756995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:36.757436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:36.894442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:36.894442 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-551ca8cb-10bd-44f3-8cdc-c0cdf7ebfcfc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.151611 Nov 02 22:19:36.894842 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3445/7008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:36 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:37.918668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:37.919301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:37.926682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:37.927184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:37.927642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:37.928409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:37.928877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:37.929347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:38.062894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:38.070601 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c003ca8a-a749-4842-b50d-8834150ca4c3 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.155985 Nov 02 22:19:38.071176 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3564/7009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:37 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:39.094284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:39.094902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:39.101874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:39.102363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:39.102808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:39.103499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:39.103981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:39.104413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:39.237407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:39.245191 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2ee0e8f-f719-4972-bdd2-b5a3ce93b473 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.154826 Nov 02 22:19:39.246425 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3446/7010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:39 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:40.269360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:40.269989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:40.276796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:40.277978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:40.278434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:40.279139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:40.279603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:40.280041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:40.416003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:40.424347 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-acebf99b-eaf8-4d74-94fe-fbe7fd1db3a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.158897 Nov 02 22:19:40.424918 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3565/7011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:40 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:41.447728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:41.448362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:41.455818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:41.460910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:41.460910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:41.460910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:41.460910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:41.460910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:41.592038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:41.599926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ea293cda-fe85-4ae9-aac7-dd706b9ed894 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.156193 Nov 02 22:19:41.600509 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3447/7012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:41 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:42.624394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:42.625101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:42.632052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:42.632557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:42.633047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:42.633785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:42.634247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:42.634692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:42.767664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:42.775402 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ff65271-c5bb-4eb3-bec4-e72cfe96cb03 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.155691 Nov 02 22:19:42.775979 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3566/7013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:42 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:43.799096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:43.799711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:43.806678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:43.807164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:43.807615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:43.808306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:43.809499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:43.809934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:43.941981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:43.950718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15df65d2-e73b-4481-b830-7a0396077ef6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.155817 Nov 02 22:19:43.951356 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3448/7014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:43 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:44.974052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:44.974691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:44.981505 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:44.982007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:44.982507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:44.983262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:44.983739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:44.984187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:45.118203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:45.126280 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17974092-f220-423a-9f86-8b890f157f84 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.156167 Nov 02 22:19:45.126830 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3567/7015] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:44 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:46.149393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:46.150009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:46.157390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:46.157812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:46.158250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:46.158934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:46.159383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:46.159808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:46.287751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:46.296217 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9a7e1f10-c54e-404b-98e6-624c0e6dca05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.150681 Nov 02 22:19:46.296814 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3449/7016] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:46 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:47.319850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:47.320476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:47.327981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:47.328475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:47.328942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:47.329651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:47.330117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:47.330557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:47.461171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:47.469115 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a91c819-28da-4606-a174-7d271b489ae7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.153190 Nov 02 22:19:47.469694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3568/7017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:47 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:48.491779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:48.492466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:48.500354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:48.500841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:48.501306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:48.501998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:48.502879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:48.503425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:48.632806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:48.636227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:48.641027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-28018ca2-6b3a-4dff-a803-d629acbc26ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.153351 Nov 02 22:19:48.641603 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3450/7018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:48 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:49.665744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:49.666301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:49.669119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:49.674784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:49.681492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:49.681492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:49.681492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:49.681492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:49.681492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:49.681492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:49.812568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:49.821756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed98953e-0f5d-41a6-aa85-55599026436b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.159948 Nov 02 22:19:49.822331 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3569/7019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:49 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:50.847216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:50.847903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:50.851108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=41 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:19:50.856358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:50.856844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:50.857367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:50.858059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:50.858507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:50.858936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:50.989592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:50.997203 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5228fd7f-4647-4cce-92b3-e92112f26b50 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.154913 Nov 02 22:19:50.998326 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3451/7020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:50 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:19:52.021423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:52.022060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:52.030148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:52.030654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:52.031112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:52.031826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:52.032302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:52.032750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:52.160905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:52.168642 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ec44741-f227-4a8b-827c-f8b6b205ad4c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.151533 Nov 02 22:19:52.169247 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3570/7021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:52 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:53.191837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:53.192467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:53.199553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:53.200040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:53.200504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:53.201436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:53.201901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:53.202334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:53.337324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:53.345850 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f508143f-bbc1-4fd7-a720-8acedbe12d05 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.157938 Nov 02 22:19:53.346423 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3452/7022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:53 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:54.370882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:54.371516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:54.380372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:54.380872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:54.381356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:54.382075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:54.382566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:54.383022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:54.514316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:54.522414 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af0c47aa-bc76-4caf-8c97-e3b766858afd tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.155460 Nov 02 22:19:54.522988 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3571/7023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:54 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:55.546309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:55.547348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:55.555925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:55.556417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:55.556866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:55.557596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:55.558148 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:55.558667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:55.718754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:55.727868 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b181d433-f2f7-4548-b24d-0e31ad95e882 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.185782 Nov 02 22:19:55.728453 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3453/7024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:55 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:56.755629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:56.756264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:56.762447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:56.762941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:56.763924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:56.764628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:56.765118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:56.765662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:56.898963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:56.907725 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffe68e9a-fb6a-4279-b7b7-02f7202beb3a tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.156097 Nov 02 22:19:56.908314 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3572/7025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:56 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:57.931401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:57.937592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:57.939264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:57.939758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:57.940208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:57.940905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:57.941390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:57.941825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:58.071484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:58.079951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8fe7516e-0e4a-4513-a7b9-bc1350ecd294 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.152486 Nov 02 22:19:58.080533 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3454/7026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:57 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:19:59.103935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:19:59.104561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:19:59.111553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:59.112050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:59.112504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:59.113245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:19:59.113716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:19:59.114165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:19:59.246869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:19:59.255217 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b77d76fd-0d92-45f8-aafe-02f38eb4eecc tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.155262 Nov 02 22:19:59.255794 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3573/7027] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:19:59 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:00.279814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:00.280366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:00.287235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:00.287729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:00.288175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:00.288873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:00.289364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:00.289805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:00.429519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:00.437825 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f76ac1d6-5050-4a4d-8c62-2e4555b114c4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.162533 Nov 02 22:20:00.438411 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3455/7028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:00 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:20:01.462463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:01.463139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:01.470324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:01.470822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:01.471281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:01.471989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:01.472458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:01.472899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:01.606365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:01.614704 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1357f17-353e-41bf-9e58-fae0e4d06982 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.156159 Nov 02 22:20:01.615276 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3574/7029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:01 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:20:02.638036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:02.638698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:02.645589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:02.646143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:02.646582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:02.647262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:02.647711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:02.648136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:02.782928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:02.790714 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44819604-fc69-47e3-890a-9d92e2f05bc0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1522 microversion: 2.1 time: 0.156749 Nov 02 22:20:02.791289 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3456/7030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:02 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:03.818283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:03.819008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:03.825866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:03.826387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:03.826840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:03.827576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:03.828042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:03.828477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:03.971155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:03.979196 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d00c80fb-e51f-426d-890e-00484518ad11 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1521 microversion: 2.1 time: 0.164804 Nov 02 22:20:03.979783 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3575/7031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:03 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:20:04.152222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-59401bfa-0c91-43c8-8c1f-a4f6b76dad7e req-674f050c-374d-4f02-ab79-740dfa5fd64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520aa5dd-8cc0-4133-9113-1b7b2905a605", "name": "network-vif-unplugged", "status": "completed", "tag": "a8e33653-0895-4cce-8982-4d7b85bad75e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:04.162342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-59401bfa-0c91-43c8-8c1f-a4f6b76dad7e req-674f050c-374d-4f02-ab79-740dfa5fd64b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:04.162818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-59401bfa-0c91-43c8-8c1f-a4f6b76dad7e req-674f050c-374d-4f02-ab79-740dfa5fd64b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:04.163248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-59401bfa-0c91-43c8-8c1f-a4f6b76dad7e req-674f050c-374d-4f02-ab79-740dfa5fd64b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:04.175232 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-59401bfa-0c91-43c8-8c1f-a4f6b76dad7e req-674f050c-374d-4f02-ab79-740dfa5fd64b service nova] Creating event network-vif-unplugged:a8e33653-0895-4cce-8982-4d7b85bad75e for instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 on n-h2-860863-4 Nov 02 22:20:04.180542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-59401bfa-0c91-43c8-8c1f-a4f6b76dad7e req-674f050c-374d-4f02-ab79-740dfa5fd64b service nova] Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:20:04.191718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-59401bfa-0c91-43c8-8c1f-a4f6b76dad7e req-674f050c-374d-4f02-ab79-740dfa5fd64b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094997 Nov 02 22:20:04.192496 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3457/7032] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:20:05.004554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:05.004978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:05.011633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:05.015516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:05.015516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:05.015516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:05.015516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:05.015516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:05.145401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:05.154884 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3c558aca-25d3-4213-9ec6-4d27fb1c8253 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1521 microversion: 2.1 time: 0.153086 Nov 02 22:20:05.154884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3576/7033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:04 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:06.180101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:06.180806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:06.187859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:06.188355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:06.188803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:06.189534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:06.189993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:06.190425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:06.213033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-66539d2e-6d15-4dfb-9222-eaeb935b0085 req-17716163-70c2-4d89-be13-1442767cf318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520aa5dd-8cc0-4133-9113-1b7b2905a605", "tag": "a8e33653-0895-4cce-8982-4d7b85bad75e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:06.223130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66539d2e-6d15-4dfb-9222-eaeb935b0085 req-17716163-70c2-4d89-be13-1442767cf318 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:06.223619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66539d2e-6d15-4dfb-9222-eaeb935b0085 req-17716163-70c2-4d89-be13-1442767cf318 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:06.224062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-66539d2e-6d15-4dfb-9222-eaeb935b0085 req-17716163-70c2-4d89-be13-1442767cf318 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:06.236476 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-66539d2e-6d15-4dfb-9222-eaeb935b0085 req-17716163-70c2-4d89-be13-1442767cf318 service nova] Creating event network-changed:a8e33653-0895-4cce-8982-4d7b85bad75e for instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 on n-h2-860863-4 Nov 02 22:20:06.242096 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-66539d2e-6d15-4dfb-9222-eaeb935b0085 req-17716163-70c2-4d89-be13-1442767cf318 service nova] Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:20:06.253965 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-66539d2e-6d15-4dfb-9222-eaeb935b0085 req-17716163-70c2-4d89-be13-1442767cf318 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044592 Nov 02 22:20:06.254619 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3577/7034] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:20:06.362238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:06.370870 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e384f587-c6f0-43c2-b9ab-68a30acf12b2 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1519 microversion: 2.1 time: 0.196713 Nov 02 22:20:06.371459 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3458/7035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:06 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:07.396352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:07.397084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:07.403509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:07.404001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:07.404979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:07.405745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:07.406245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:07.406687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:07.540510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:07.548232 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e901018-0b42-43dd-9e0d-d4ac9a12fe99 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1516 microversion: 2.1 time: 0.157629 Nov 02 22:20:07.548797 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3578/7036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:07 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:07.570956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:07.571502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:07.579395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:07.579889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:07.580332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:07.581065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:07.581526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:07.581962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:07.851876 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6cf829e9-40d8-42e5-a3a0-6b16d96613b7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "POST /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605/action" status: 204 len: 0 microversion: 2.1 time: 0.284632 Nov 02 22:20:07.852582 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3459/7037] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:20:07 2022] POST /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605/action => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:20:07.862361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:07.863422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:07.869466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:07.869963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:07.870465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:07.871160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:07.871619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:07.872052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:08.057284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:08.066083 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-64b6dac0-2433-43b2-b4a0-06d50d09a6ab tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1516 microversion: 2.1 time: 0.209195 Nov 02 22:20:08.066687 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3579/7038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:07 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:09.007844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5ed36039-8ddc-447f-96cf-47340e393aa8 req-f658840b-ac4f-4f15-99c6-f20759a8d09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520aa5dd-8cc0-4133-9113-1b7b2905a605", "name": "network-vif-plugged", "status": "completed", "tag": "a8e33653-0895-4cce-8982-4d7b85bad75e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:09.020397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5ed36039-8ddc-447f-96cf-47340e393aa8 req-f658840b-ac4f-4f15-99c6-f20759a8d09a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:09.020982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5ed36039-8ddc-447f-96cf-47340e393aa8 req-f658840b-ac4f-4f15-99c6-f20759a8d09a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:09.021496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5ed36039-8ddc-447f-96cf-47340e393aa8 req-f658840b-ac4f-4f15-99c6-f20759a8d09a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:09.033678 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5ed36039-8ddc-447f-96cf-47340e393aa8 req-f658840b-ac4f-4f15-99c6-f20759a8d09a service nova] Creating event network-vif-plugged:a8e33653-0895-4cce-8982-4d7b85bad75e for instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 on n-h2-860863-4 Nov 02 22:20:09.041662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-5ed36039-8ddc-447f-96cf-47340e393aa8 req-f658840b-ac4f-4f15-99c6-f20759a8d09a service nova] Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:20:09.050918 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5ed36039-8ddc-447f-96cf-47340e393aa8 req-f658840b-ac4f-4f15-99c6-f20759a8d09a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096390 Nov 02 22:20:09.051547 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3460/7039] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:20:09.089444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:09.090075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:09.097168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:09.097676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:09.098132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:09.098841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:09.099313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:09.099757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:09.228116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:09.236915 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e85af08-da51-4fbb-9117-8976af509b2c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1516 microversion: 2.1 time: 0.151409 Nov 02 22:20:09.237718 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3580/7040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:09 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:10.261765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:10.262469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:10.269965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:10.270451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:10.270895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:10.271583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:10.272039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:10.272465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:10.400755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:10.408527 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5e10381-6f47-41c9-b1a2-108fb3bf41ce tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1508 microversion: 2.1 time: 0.150992 Nov 02 22:20:10.409126 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3461/7041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:10 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:10.431075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:10.431710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:10.439164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:10.439657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:10.440157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:10.440891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:10.441381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:10.441820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:10.571256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:10.579144 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c3326de-300f-41c1-93e9-b83325fbb56f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1508 microversion: 2.1 time: 0.151945 Nov 02 22:20:10.579717 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3581/7042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:10 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:10.605431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31ab89ad-2876-408b-bb9e-5310ee2b165c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'create', calling method: .version_select at 0x7f9b68727f70>, body: {"keypair": {"name": "tempest-keypair-1922624712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+QQok+4x4rq1jbKx9rkRxi+rNK6yNxX8O8PQITERsptP989IayCGyIhSEZPMHLvQEe9jjTZy9wqAhbG+I7TM+mftpIqzk3YHYpRqycDtcge6Ryg3qx4PCMY+v5n/fF6A=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:10.621185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-31ab89ad-2876-408b-bb9e-5310ee2b165c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Getting quotas for project d83aabb088e342a2aca0d33c5c013cff. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:20:10.626486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-31ab89ad-2876-408b-bb9e-5310ee2b165c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Getting quotas for user 51b888d74afe4466ab1de7fb139d504d and project d83aabb088e342a2aca0d33c5c013cff. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:20:10.713360 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31ab89ad-2876-408b-bb9e-5310ee2b165c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111816 Nov 02 22:20:10.714217 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3462/7043] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:20:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:20:13.188838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:13.189502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:13.196325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:13.196825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:13.197318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:13.198030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:13.198502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:13.198963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:13.328847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:13.336577 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7210478d-9755-4345-8d03-feb555ed1fc5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 200 len: 1508 microversion: 2.1 time: 0.152381 Nov 02 22:20:13.337180 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3582/7044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:13 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:13.360189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:13.360703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:13.370176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:13.370666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:13.371113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:13.371804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:13.372261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:13.372688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:13.398049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:20:13.683098 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cbd1d66-66c8-490f-91d9-1ca98f83ec64 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "DELETE /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 204 len: 0 microversion: 2.1 time: 0.327420 Nov 02 22:20:13.683623 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3463/7045] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:20:13 2022] DELETE /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:20:13.741898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2089473528", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "33e0b714-aa05-4e07-ab7d-8637df2adee0"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:13.794965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] validate_networks() for [('33e0b714-aa05-4e07-ab7d-8637df2adee0', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:20:14.159364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:20:14.159838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:20:14.160331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:20:14.160858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:20:14.161310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:20:14.170687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:14.171182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:14.171636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:14.172377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:14.172846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:14.173319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:14.190714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Getting quotas for project d83aabb088e342a2aca0d33c5c013cff. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:20:14.196582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Getting quotas for user 51b888d74afe4466ab1de7fb139d504d and project d83aabb088e342a2aca0d33c5c013cff. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:20:14.209371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:20:14.211675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:20:14.340175 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0d26c04-3e13-40e3-94b7-8b0b8663934c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602045 Nov 02 22:20:14.342368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3583/7046] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:20:14.352588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d33651c0-eb7d-49e2-bb3b-288b802b5058 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:14.353313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d33651c0-eb7d-49e2-bb3b-288b802b5058 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:14.408383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d33651c0-eb7d-49e2-bb3b-288b802b5058 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:14.416270 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d33651c0-eb7d-49e2-bb3b-288b802b5058 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1218 microversion: 2.1 time: 0.067923 Nov 02 22:20:14.416837 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3464/7047] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:14 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:15.442045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:15.442683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:15.449528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:15.449966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:15.450415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:15.451124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:15.451800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:15.452309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:15.514669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:15.522909 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cfab3820-a728-4a61-a7a5-b8d0039e0a7d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1222 microversion: 2.1 time: 0.086846 Nov 02 22:20:15.523486 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3584/7048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:15 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:15.839155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-8c0e5d66-8524-4d9a-aed5-68a925ad1c26 req-0119f3fa-c618-476a-8ac2-b58eeada3a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520aa5dd-8cc0-4133-9113-1b7b2905a605", "name": "network-vif-deleted", "tag": "a8e33653-0895-4cce-8982-4d7b85bad75e"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:15.850005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8c0e5d66-8524-4d9a-aed5-68a925ad1c26 req-0119f3fa-c618-476a-8ac2-b58eeada3a7e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:15.850484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8c0e5d66-8524-4d9a-aed5-68a925ad1c26 req-0119f3fa-c618-476a-8ac2-b58eeada3a7e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:15.850911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-8c0e5d66-8524-4d9a-aed5-68a925ad1c26 req-0119f3fa-c618-476a-8ac2-b58eeada3a7e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:15.863527 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-8c0e5d66-8524-4d9a-aed5-68a925ad1c26 req-0119f3fa-c618-476a-8ac2-b58eeada3a7e service nova] Creating event network-vif-deleted:a8e33653-0895-4cce-8982-4d7b85bad75e for instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 on n-h2-860863-4 Nov 02 22:20:15.869421 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-8c0e5d66-8524-4d9a-aed5-68a925ad1c26 req-0119f3fa-c618-476a-8ac2-b58eeada3a7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 Nov 02 22:20:15.870044 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3465/7049] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:20:16.548123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:16.548687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:16.555943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:16.556454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:16.556907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:16.557647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:16.558290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:16.558738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:16.622623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:16.631600 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ed7f5c9-abae-45d8-901d-35b083ef7a58 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1288 microversion: 2.1 time: 0.088382 Nov 02 22:20:16.637567 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3585/7050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:16 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:20:17.656482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:17.657201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:17.663326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:17.663805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:17.664244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:17.665044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:17.665514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:17.665922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:17.877881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:17.885738 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-001cd6e0-e519-49e1-aed7-790d539164c5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1318 microversion: 2.1 time: 0.234530 Nov 02 22:20:17.886403 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3466/7051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:17 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:18.243828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-be8e6e83-1a2c-443a-83cb-a5e28c48f636 req-506610c6-b78c-4ccc-845a-380100a0c879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf", "tag": "8de11fb6-d67e-4c68-8c2c-2a2a09276997"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:18.254508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be8e6e83-1a2c-443a-83cb-a5e28c48f636 req-506610c6-b78c-4ccc-845a-380100a0c879 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:18.255007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be8e6e83-1a2c-443a-83cb-a5e28c48f636 req-506610c6-b78c-4ccc-845a-380100a0c879 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:18.255459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be8e6e83-1a2c-443a-83cb-a5e28c48f636 req-506610c6-b78c-4ccc-845a-380100a0c879 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:18.269904 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-be8e6e83-1a2c-443a-83cb-a5e28c48f636 req-506610c6-b78c-4ccc-845a-380100a0c879 service nova] Creating event network-changed:8de11fb6-d67e-4c68-8c2c-2a2a09276997 for instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf on n-h1-860863-4 Nov 02 22:20:18.275197 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-be8e6e83-1a2c-443a-83cb-a5e28c48f636 req-506610c6-b78c-4ccc-845a-380100a0c879 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088531 Nov 02 22:20:18.275817 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3586/7052] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:20:18.910460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:18.911074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:18.917917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:18.918408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:18.918850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:18.919544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:18.920001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:18.920429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:19.050125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:19.057828 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-72df155b-a008-4201-a2aa-af6a2640d10b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1318 microversion: 2.1 time: 0.151326 Nov 02 22:20:19.058406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3467/7053] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:18 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:20:20.082646 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:20.083364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:20.086415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:20.091345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:20.091884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:20.092349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:20.093099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:20.093568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:20.094009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:20.110050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:20.265606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:20.273177 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8190977-aa22-44c6-861d-e1c5096735d7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1318 microversion: 2.1 time: 0.194997 Nov 02 22:20:20.273759 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3587/7054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:20 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:21.296004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:21.296598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:21.300543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:21.305331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:21.305811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:21.306243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:21.306932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:21.307381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:21.307801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:21.310404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:21.443844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:21.451651 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4564035f-3cd9-484f-9cc6-fbd27c06efc9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1318 microversion: 2.1 time: 0.159495 Nov 02 22:20:21.452206 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3468/7055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:21 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:22.475356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:22.475899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:22.483471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:22.484611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:22.485291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:22.486024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:22.487146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:22.487607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:22.620720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:22.628860 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af7f01a2-ffd0-4e7c-b719-6fec5c6f256e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1318 microversion: 2.1 time: 0.157531 Nov 02 22:20:22.629470 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3588/7056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:22 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:23.652392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:23.653043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:23.660296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:23.660778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:23.661244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:23.661931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:23.662384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:23.662811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:23.798507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:23.806630 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c4f63735-e036-4543-931e-0ba4aadedd54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1318 microversion: 2.1 time: 0.158864 Nov 02 22:20:23.807217 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3469/7057] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:23 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:24.165169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1d28935e-dde4-40ff-9f46-a50ad8c4b8dc req-43b243ab-9ee8-43b0-ab94-a71b99c41fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf", "name": "network-vif-plugged", "status": "completed", "tag": "8de11fb6-d67e-4c68-8c2c-2a2a09276997"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:24.176991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1d28935e-dde4-40ff-9f46-a50ad8c4b8dc req-43b243ab-9ee8-43b0-ab94-a71b99c41fbc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:24.177531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1d28935e-dde4-40ff-9f46-a50ad8c4b8dc req-43b243ab-9ee8-43b0-ab94-a71b99c41fbc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:24.177935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1d28935e-dde4-40ff-9f46-a50ad8c4b8dc req-43b243ab-9ee8-43b0-ab94-a71b99c41fbc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:24.180477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:24.189761 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1d28935e-dde4-40ff-9f46-a50ad8c4b8dc req-43b243ab-9ee8-43b0-ab94-a71b99c41fbc service nova] Creating event network-vif-plugged:8de11fb6-d67e-4c68-8c2c-2a2a09276997 for instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf on n-h1-860863-4 Nov 02 22:20:24.194706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1d28935e-dde4-40ff-9f46-a50ad8c4b8dc req-43b243ab-9ee8-43b0-ab94-a71b99c41fbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Nov 02 22:20:24.195324 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3589/7058] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:20:24.831034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:24.833022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:24.833218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:24.838938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:24.839421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:24.839858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:24.840540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:24.841023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:24.841445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:24.971926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:24.979606 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-39526fbc-e3ee-4a6d-87d7-e6a09d0a6782 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1318 microversion: 2.1 time: 0.153522 Nov 02 22:20:24.980174 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3470/7059] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:24 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:26.000331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:26.005815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:26.006541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:26.013023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.013534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.013994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.014705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.015367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.015901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.149664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:26.157650 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6080f3a2-536e-4067-8210-29651f2aca54 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1508 microversion: 2.1 time: 0.158277 Nov 02 22:20:26.158234 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3590/7060] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:25 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:26.180952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:26.181591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:26.188482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.188991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.189437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.190133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.190695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.191130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.319548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:26.327329 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eead2720-b3e7-4f2d-9c49-c563acf0ae32 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1508 microversion: 2.1 time: 0.150318 Nov 02 22:20:26.327924 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3471/7061] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:26 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:20:26.349349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:26.351721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:26.357959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.358465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.359613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.360315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.360786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.361259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.389224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:26.394656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Old instance type m1.heat2, new instance type m1.heat {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:20:26.401098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:20:26.401543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:20:26.402032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:20:26.402458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:20:26.402881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:20:26.623512 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f29b7efa-7af1-40a8-922e-ab23d7902e9d tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "POST /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf/action" status: 202 len: 0 microversion: 2.1 time: 0.278043 Nov 02 22:20:26.624037 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3591/7062] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:20:26 2022] POST /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:20:26.632260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:26.632871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:26.638843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.639320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.639757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.640754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:26.641236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:26.641663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:26.773358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:26.781948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03be9846-7467-4197-ad9d-80e87d4be5f0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1515 microversion: 2.1 time: 0.153629 Nov 02 22:20:26.782532 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3472/7063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:26 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:27.807856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:27.808487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:27.816095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:27.816597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:27.817086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:27.817801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:27.818271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:27.818715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:27.953889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:27.961900 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a934008-7c2e-4f47-9a5a-8f4a1de8345f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1515 microversion: 2.1 time: 0.159398 Nov 02 22:20:27.962743 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3592/7064] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:27 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:28.986256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:28.986867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:28.993856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:28.994425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:28.994786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:28.995485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:28.995944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:28.996390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:29.197726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:29.206319 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5725f0f7-efc5-45ef-bdf0-2432d61de224 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1515 microversion: 2.1 time: 0.224163 Nov 02 22:20:29.206901 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3473/7065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:28 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:30.230360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:30.230894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:30.237932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:30.238430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:30.238883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:30.239582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:30.240054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:30.240493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:30.372820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:30.381228 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1111cd2-0636-4115-a22e-7521abe1d773 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.154907 Nov 02 22:20:30.381803 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3593/7066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:30 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:31.405019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:31.405667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:31.413390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:31.413884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:31.414325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:31.415016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:31.415469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:31.415898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:31.546037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:31.554255 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-66985d1d-84ae-4861-a601-5b3bc9bc9711 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.153177 Nov 02 22:20:31.554977 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3474/7067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:31 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:32.577007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:32.582097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:32.585306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:32.585843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:32.586303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:32.587042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:32.587515 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:32.587964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:32.720898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:32.728557 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf49c596-ec5e-4ef9-b12d-3f7ee76288a4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.155477 Nov 02 22:20:32.729167 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3594/7068] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:32 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:33.752178 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:33.752845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:33.759559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:33.760034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:33.760467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:33.761258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:33.761706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:33.762128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:33.892262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:33.900180 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c49067fa-a20a-4ea0-972c-3c90f25e8ed6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.152673 Nov 02 22:20:33.900766 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3475/7069] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:33 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:34.924293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:34.925213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:34.932103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:34.933290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:34.933290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:34.933764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:34.934234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:34.934679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:35.061620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:35.069554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-542f0751-b68f-46a4-b9af-7eb9c7390f43 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.149962 Nov 02 22:20:35.070062 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3595/7070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:34 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:36.093226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:36.094087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:36.101020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:36.101500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:36.101934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:36.102617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:36.103067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:36.103492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:36.238814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:36.246484 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d01ee49e-eb94-430e-920e-8347ed0f32e7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.157160 Nov 02 22:20:36.247044 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3476/7071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:36 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:37.271428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:37.271976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:37.278945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:37.279441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:37.279895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:37.280599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:37.281121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:37.281565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:37.410994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:37.418963 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f2ad20f-13f3-43f1-bf5d-a2caf0ea7292 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.151554 Nov 02 22:20:37.419537 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3596/7072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:37 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:38.443328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:38.443942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:38.453938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:38.454419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:38.454857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:38.455546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:38.456001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:38.456427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:38.594346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:38.606464 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-055e9fba-cda1-420e-88f5-2c5e794044b0 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.162969 Nov 02 22:20:38.606464 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3477/7073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:38 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:39.626259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:39.626882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:39.634593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:39.635105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:39.635566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:39.636288 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:39.636749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:39.637227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:39.772353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:39.780294 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f426b48-ad9c-448c-9319-08e2826c983f tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.158086 Nov 02 22:20:39.781623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3597/7074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:39 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:40.804670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:40.805299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:40.812804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:40.813320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:40.813763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:40.814454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:40.814910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:40.815338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:40.950477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:40.958251 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b6383ac3-9311-41ab-a274-2799cc1267ff tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.157596 Nov 02 22:20:40.958822 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3478/7075] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:40 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:41.982257 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:41.982933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:41.990457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:41.990956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:41.991415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:41.992122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:41.992592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:41.993064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:42.125988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:42.133842 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9beb379b-b630-422a-8e16-b50d853dca56 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.155515 Nov 02 22:20:42.134431 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3598/7076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:41 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:43.157883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:43.158444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:43.165234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:43.165719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:43.166158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:43.166846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:43.167304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:43.167735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:43.297325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:43.305347 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c3414002-fe73-4bd0-9b8a-606a43262b93 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.152076 Nov 02 22:20:43.305914 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3479/7077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:43 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:44.328486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:44.329152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:44.338060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:44.338558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:44.339016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:44.339724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:44.340195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:44.340642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:44.472274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:44.480141 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0955f236-f7cd-4924-a83d-d3f9547397d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.155805 Nov 02 22:20:44.480711 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3599/7078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:44 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:45.503995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:45.504615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:45.511624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:45.512110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:45.512552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:45.513281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:45.513743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:45.514175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:45.642213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:45.649907 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8031211c-c0b7-4f52-8caf-76cacac9508e tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.150491 Nov 02 22:20:45.650491 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3480/7079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:45 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:46.674125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:46.674993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:46.682032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:46.682528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:46.682981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:46.683683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:46.684184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:46.684629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:46.815507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:46.823419 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c6f26d9a-f587-4a52-890e-2db0104b4e74 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.153918 Nov 02 22:20:46.824002 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3600/7080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:46 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:47.847126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:47.847672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:47.854650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:47.855139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:47.855580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:47.856267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:47.856720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:47.857183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:47.987099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:47.994832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a9ad636-808a-4910-9609-e500f369508b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.151786 Nov 02 22:20:47.995401 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3481/7081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:47 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:49.020507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:49.021163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:49.028049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:49.028544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:49.029023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:49.029725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:49.030195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:49.030688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:49.158029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:49.165769 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78b2e207-34f6-48ce-b9f3-1376cab7321b tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.149313 Nov 02 22:20:49.166343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3601/7082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:49 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:50.189385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:50.189949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:50.196767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:50.197280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:50.197716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:50.198397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:50.198847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:50.199271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:50.333439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:50.341059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4cad8f02-e5ef-4d28-8320-c129c549a7d1 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.155845 Nov 02 22:20:50.341638 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3482/7083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:50 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:51.367299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:51.368308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:51.372767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:51.379017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:51.379524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:51.379985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:51.380702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:51.381204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:51.381652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:51.384256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:51.517363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:51.525160 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-259809f8-2465-4946-93c7-c2a73e1e85ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.164589 Nov 02 22:20:51.525731 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3602/7084] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:51 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:52.548561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:52.549177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:52.556146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:52.556626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:52.557086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:52.557772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:52.558224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:52.558650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:52.692498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:52.700314 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91a1aa50-6d98-4947-8280-622bdddde2f6 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.155649 Nov 02 22:20:52.707332 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3483/7085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:52 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:53.723823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:53.724493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:53.731864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:53.732364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:53.732824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:53.733571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:53.734038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:53.734489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:53.865044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:53.872732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6823075e-1118-4184-b928-6de2f5b707c7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.152944 Nov 02 22:20:53.873328 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3603/7086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:53 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:54.895673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:54.896289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:54.899576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=32 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:54.904717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:54.905229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:54.910851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:54.910851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:54.910851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:54.910851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:54.910851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:20:55.043476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:55.052207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9e235f9-4814-449e-956e-e5d127956140 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.160439 Nov 02 22:20:55.052788 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3484/7087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:54 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:56.075270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:56.075896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:56.083890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:56.084394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:56.084846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:56.085698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:56.086174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:56.086618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:56.221809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:56.229566 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c7b4e0df-fe72-4704-ba12-b60bf02012ca tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1520 microversion: 2.1 time: 0.158254 Nov 02 22:20:56.230147 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3604/7088] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:56 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:57.253361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:57.253973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:57.260838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:57.261614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:57.262276 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:57.263211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:57.263753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:57.264242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:57.418446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:57.426496 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f37e972a-e609-41b5-9fa5-5371094b74fb tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1519 microversion: 2.1 time: 0.177432 Nov 02 22:20:57.427066 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3485/7089] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:57 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:57.700157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8da2cef4-0cc6-4a67-8b6e-0175f18c819b req-e1387f48-382c-4223-9cc0-27f9c5d8dc6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf", "name": "network-vif-unplugged", "status": "completed", "tag": "8de11fb6-d67e-4c68-8c2c-2a2a09276997"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:57.711473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8da2cef4-0cc6-4a67-8b6e-0175f18c819b req-e1387f48-382c-4223-9cc0-27f9c5d8dc6e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:57.712117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8da2cef4-0cc6-4a67-8b6e-0175f18c819b req-e1387f48-382c-4223-9cc0-27f9c5d8dc6e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:57.712558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8da2cef4-0cc6-4a67-8b6e-0175f18c819b req-e1387f48-382c-4223-9cc0-27f9c5d8dc6e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:57.725381 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8da2cef4-0cc6-4a67-8b6e-0175f18c819b req-e1387f48-382c-4223-9cc0-27f9c5d8dc6e service nova] Creating event network-vif-unplugged:8de11fb6-d67e-4c68-8c2c-2a2a09276997 for instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf on n-h2-860863-4 Nov 02 22:20:57.730816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-8da2cef4-0cc6-4a67-8b6e-0175f18c819b req-e1387f48-382c-4223-9cc0-27f9c5d8dc6e service nova] Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:20:57.742713 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8da2cef4-0cc6-4a67-8b6e-0175f18c819b req-e1387f48-382c-4223-9cc0-27f9c5d8dc6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046358 Nov 02 22:20:57.743331 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3605/7090] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:20:58.450624 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:58.451249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:58.458841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:58.459333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:58.459785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:58.460489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:58.460966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:58.461409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:58.601430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:58.609964 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1998e249-f532-4c6e-b16f-a62fb470d17c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1519 microversion: 2.1 time: 0.163125 Nov 02 22:20:58.610539 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3486/7091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:58 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:59.636271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:20:59.637064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:20:59.643834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:59.644328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:59.644784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:59.645508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:59.645974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:59.646414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:59.757684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d0e8cccf-5f49-4535-b6be-e1a43c47aab4 req-d74c0083-8118-4329-a165-ab972295551f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf", "tag": "8de11fb6-d67e-4c68-8c2c-2a2a09276997"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:20:59.768690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d0e8cccf-5f49-4535-b6be-e1a43c47aab4 req-d74c0083-8118-4329-a165-ab972295551f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:20:59.769201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d0e8cccf-5f49-4535-b6be-e1a43c47aab4 req-d74c0083-8118-4329-a165-ab972295551f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:20:59.769638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d0e8cccf-5f49-4535-b6be-e1a43c47aab4 req-d74c0083-8118-4329-a165-ab972295551f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:20:59.778293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:20:59.781405 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d0e8cccf-5f49-4535-b6be-e1a43c47aab4 req-d74c0083-8118-4329-a165-ab972295551f service nova] Creating event network-changed:8de11fb6-d67e-4c68-8c2c-2a2a09276997 for instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf on n-h2-860863-4 Nov 02 22:20:59.786384 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4dd3ddf8-60ff-4162-8854-442ebcb311d5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1517 microversion: 2.1 time: 0.155356 Nov 02 22:20:59.786816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-d0e8cccf-5f49-4535-b6be-e1a43c47aab4 req-d74c0083-8118-4329-a165-ab972295551f service nova] Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:20:59.787268 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3606/7092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:20:59 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:20:59.797821 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d0e8cccf-5f49-4535-b6be-e1a43c47aab4 req-d74c0083-8118-4329-a165-ab972295551f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043829 Nov 02 22:20:59.798415 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3487/7093] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:21:00.810764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:00.811405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:00.818957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:00.819467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:00.819925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:00.820635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:00.821158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:00.821609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:00.959085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:00.966799 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7314b5d-c2ba-4fc7-a314-6e292c4eae06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1514 microversion: 2.1 time: 0.159986 Nov 02 22:21:00.967710 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3607/7094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:00 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:00.991622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:00.992242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:00.998408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:00.998895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:00.999882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:01.000736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:01.001266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:01.001694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:01.213016 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-25ea9328-4114-401a-bbac-2198d0b06b91 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "POST /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf/action" status: 204 len: 0 microversion: 2.1 time: 0.226372 Nov 02 22:21:01.213671 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3488/7095] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:21:00 2022] POST /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf/action => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:21:01.221887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:01.222711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:01.229090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:01.229706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:01.230160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:01.230869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:01.231335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:01.231820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:01.380171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:01.389291 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a5cd3e7-a1dd-47a9-9d57-d3a79520f4b4 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1514 microversion: 2.1 time: 0.170851 Nov 02 22:21:01.389844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3608/7096] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:01 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:02.413504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:02.414249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:02.420394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:02.420883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:02.421367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:02.422060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:02.422519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:02.422972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:02.557058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:02.566153 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-adb63f26-9364-42b6-99f5-56247a7ce145 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1514 microversion: 2.1 time: 0.157334 Nov 02 22:21:02.566365 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3489/7097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:02 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:03.111301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0494fc5b-60d3-49ef-abf9-7fce9b776f2f req-43579f07-e146-4b49-8180-1c4e59f96921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf", "name": "network-vif-plugged", "status": "completed", "tag": "8de11fb6-d67e-4c68-8c2c-2a2a09276997"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:03.130652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0494fc5b-60d3-49ef-abf9-7fce9b776f2f req-43579f07-e146-4b49-8180-1c4e59f96921 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:03.131934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0494fc5b-60d3-49ef-abf9-7fce9b776f2f req-43579f07-e146-4b49-8180-1c4e59f96921 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:03.132669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0494fc5b-60d3-49ef-abf9-7fce9b776f2f req-43579f07-e146-4b49-8180-1c4e59f96921 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:03.145729 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0494fc5b-60d3-49ef-abf9-7fce9b776f2f req-43579f07-e146-4b49-8180-1c4e59f96921 service nova] Creating event network-vif-plugged:8de11fb6-d67e-4c68-8c2c-2a2a09276997 for instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf on n-h2-860863-4 Nov 02 22:21:03.151125 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0494fc5b-60d3-49ef-abf9-7fce9b776f2f req-43579f07-e146-4b49-8180-1c4e59f96921 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044327 Nov 02 22:21:03.152174 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3609/7098] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:21:03.589548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:03.590167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:03.597280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:03.597766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:03.598206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:03.598895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:03.599347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:03.599773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:03.729197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:03.737454 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-304d2c36-2f58-49be-bc8f-f77e68a90ad9 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1506 microversion: 2.1 time: 0.151758 Nov 02 22:21:03.738017 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3490/7099] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:03 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:03.760607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:03.761350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:03.767973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:03.768471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:03.768917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:03.769638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:03.770103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:03.770541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:03.904869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:03.912887 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-782b9d4d-2e92-4376-91d1-02ade35f23ea tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1506 microversion: 2.1 time: 0.156538 Nov 02 22:21:03.913485 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3610/7100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:03 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:03.935657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:03.936268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:03.942830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:03.943313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:03.943742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:03.944421 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:03.944871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:03.945314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:04.076007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:04.083992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f306f857-92a9-480d-9ccb-3610866f2e82 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1506 microversion: 2.1 time: 0.152320 Nov 02 22:21:04.084589 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3491/7101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:03 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:04.106333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:04.106784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:04.113879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:04.114500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:04.114828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:04.115540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:04.116014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:04.116464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:04.142813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:21:04.488187 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53d7566d-a901-4719-8e20-a6169977c2ed tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 204 len: 0 microversion: 2.1 time: 0.385354 Nov 02 22:21:04.488722 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3611/7102] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:21:04 2022] DELETE /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:21:04.506848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:04.507351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:04.513870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:04.514355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:04.514980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:04.515962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:04.516424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:04.516882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:04.542253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:21:04.684987 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.compute.api [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Instance is already in deleting state, ignoring this request Nov 02 22:21:04.685819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-811067e9-c0af-487a-8da9-3cfff77ac5ba tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 204 len: 0 microversion: 2.1 time: 0.182982 Nov 02 22:21:04.686383 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3492/7103] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:21:04 2022] DELETE /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 22:21:04.696245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:04.697040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:04.703388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:04.703879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:04.704329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:04.705058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:04.705524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:04.705960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:04.840059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:04.848404 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90b50ebb-143f-4a65-950d-ead6e2010fc7 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1512 microversion: 2.1 time: 0.156796 Nov 02 22:21:04.848996 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3612/7104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:04 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:05.870905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:05.871784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:05.880778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:05.881696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:05.881817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:05.882547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:05.883134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:05.883782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:06.016759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:06.024653 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-04ac1b82-c134-4ab9-a319-8910ff5fff21 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1512 microversion: 2.1 time: 0.157656 Nov 02 22:21:06.025482 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3493/7105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:05 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:06.363861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-cd583256-6b7b-4144-8fd5-9972ead91902 req-ac8193b9-7d99-4499-ac92-66b62f6b4020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf", "name": "network-vif-deleted", "tag": "8de11fb6-d67e-4c68-8c2c-2a2a09276997"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:06.374435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd583256-6b7b-4144-8fd5-9972ead91902 req-ac8193b9-7d99-4499-ac92-66b62f6b4020 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:06.374925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd583256-6b7b-4144-8fd5-9972ead91902 req-ac8193b9-7d99-4499-ac92-66b62f6b4020 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:06.375367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd583256-6b7b-4144-8fd5-9972ead91902 req-ac8193b9-7d99-4499-ac92-66b62f6b4020 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:06.387222 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-cd583256-6b7b-4144-8fd5-9972ead91902 req-ac8193b9-7d99-4499-ac92-66b62f6b4020 service nova] Creating event network-vif-deleted:8de11fb6-d67e-4c68-8c2c-2a2a09276997 for instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf on n-h2-860863-4 Nov 02 22:21:06.392619 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-cd583256-6b7b-4144-8fd5-9972ead91902 req-ac8193b9-7d99-4499-ac92-66b62f6b4020 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Nov 02 22:21:06.393286 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3613/7106] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:21:07.050472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:07.051302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:07.058787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:07.059420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:07.059968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:07.060716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:07.061202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:07.062257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:07.093669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:07.094145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:07.094582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:07.095045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lazy-loading 'fault' on Instance uuid 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:21:07.136273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b888d74afe4466ab1de7fb139d504d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83aabb088e342a2aca0d33c5c013cff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:07.144768 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4f5a00f8-e9ae-4f9d-8983-4b7e30751c06 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 200 len: 1306 microversion: 2.1 time: 0.100981 Nov 02 22:21:07.145371 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3494/7107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:07 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:08.169632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:08.170268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:08.177386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:08.177905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:08.178380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:08.179086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:08.179556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:08.180003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:08.194957 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] HTTP exception thrown: Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf could not be found. Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Request method failure captured: Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf HTTP/1.1 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuzl_PW-wQhBjAvFkp1OE6LMDhWuMLLyd-ufyEzUagtXCmfkYOE8l5-gOeoV2uBw3KLRZaYJv7gna88KybdtQzyFZGyocvFSkbKO-qFtRQi4oBLT2FddRGxVX-3r7xk7ZUMcIZLe0xAM9boweWpkQ_4qbBcQlFfOrHgD3friANvRrm0 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: d83aabb088e342a2aca0d33c5c013cff Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: d83aabb088e342a2aca0d33c5c013cff Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerDiskConfigTestJSON-48536274-project Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 51b888d74afe4466ab1de7fb139d504d Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerDiskConfigTestJSON-48536274-project Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf could not be found. Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf'} Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf could not be found. Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf could not be found. Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:21:08.196665 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf could not be found. Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Returning 404 to user: Instance 9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c7c1e105-380c-4d55-8fad-38528c8fb095 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf" status: 404 len: 111 microversion: 2.1 time: 0.034080 Nov 02 22:21:08.205571 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3614/7108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:08 2022] GET /compute/v2.1/servers/9fbf9afd-3cdf-4a53-b274-e76a98fc8cdf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:21:08.207777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0beb6cca-77d6-4ba4-9514-5709fcebe35c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '.version_select at 0x7f9b68766d30>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:08.292305 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0beb6cca-77d6-4ba4-9514-5709fcebe35c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922624712" status: 202 len: 0 microversion: 2.1 time: 0.088495 Nov 02 22:21:08.292967 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3495/7109] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 22:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922624712 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 22:21:09.016029 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:09.016551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:09.022552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:09.023052 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:09.023513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:09.024225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:09.024696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:09.025179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:09.038992 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] HTTP exception thrown: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Request method failure captured: Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 HTTP/1.1 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYuzl_PW-wQhBjAvFkp1OE6LMDhWuMLLyd-ufyEzUagtXCmfkYOE8l5-gOeoV2uBw3KLRZaYJv7gna88KybdtQzyFZGyocvFSkbKO-qFtRQi4oBLT2FddRGxVX-3r7xk7ZUMcIZLe0xAM9boweWpkQ_4qbBcQlFfOrHgD3friANvRrm0 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: d83aabb088e342a2aca0d33c5c013cff Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: d83aabb088e342a2aca0d33c5c013cff Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerDiskConfigTestJSON-48536274-project Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 51b888d74afe4466ab1de7fb139d504d Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerDiskConfigTestJSON-48536274-project Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '520aa5dd-8cc0-4133-9113-1b7b2905a605'} Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:21:09.040548 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Returning 404 to user: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa527a4d-4cdb-47d9-bb18-074e0e63cee5 tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "DELETE /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 404 len: 111 microversion: 2.1 time: 0.029973 Nov 02 22:21:09.047844 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3615/7110] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:21:09 2022] DELETE /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:21:09.053061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:09.054304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] [instance: 520aa5dd-8cc0-4133-9113-1b7b2905a605] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:09.060794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:09.061298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:09.062414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:09.063057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:09.063508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:09.063930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:09.077272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] HTTP exception thrown: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Request method failure captured: Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 HTTP/1.1 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYuzl_PW-wQhBjAvFkp1OE6LMDhWuMLLyd-ufyEzUagtXCmfkYOE8l5-gOeoV2uBw3KLRZaYJv7gna88KybdtQzyFZGyocvFSkbKO-qFtRQi4oBLT2FddRGxVX-3r7xk7ZUMcIZLe0xAM9boweWpkQ_4qbBcQlFfOrHgD3friANvRrm0 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: d83aabb088e342a2aca0d33c5c013cff Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d83aabb088e342a2aca0d33c5c013cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: d83aabb088e342a2aca0d33c5c013cff Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-48536274 Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerDiskConfigTestJSON-48536274-project Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 51b888d74afe4466ab1de7fb139d504d Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerDiskConfigTestJSON-48536274-project Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '520aa5dd-8cc0-4133-9113-1b7b2905a605'} Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:21:09.078978 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] Returning 404 to user: Instance 520aa5dd-8cc0-4133-9113-1b7b2905a605 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d6523d86-295d-4218-a8ba-510deca8f99c tempest-ServerDiskConfigTestJSON-48536274 tempest-ServerDiskConfigTestJSON-48536274-project] 10.222.0.25 "GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605" status: 404 len: 111 microversion: 2.1 time: 0.032613 Nov 02 22:21:09.083782 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3496/7111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:09 2022] GET /compute/v2.1/servers/520aa5dd-8cc0-4133-9113-1b7b2905a605 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:21:20.181116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:21:20.182039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:21:20.299119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51d1fefa-4f52-4b6c-bad7-0e789cb35a23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'create', calling method: .version_select at 0x7f9b69074160>, body: {"keypair": {"name": "tempest-keypair-1777483192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ9CN4Y1ulPJX0J40rl9s5aXs8xTnX/UTpidCEjfQxOeaQHkanKSw6C1TPASOrNyyqReBmqWBbsGMQP637VEjtVHgjXfUQEuS3KlWZk99YCuvg8UpiIzcWDwuWAZm3uBA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:20.320487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-51d1fefa-4f52-4b6c-bad7-0e789cb35a23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:21:20.326001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-51d1fefa-4f52-4b6c-bad7-0e789cb35a23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for user b64d5fbeb3f340acbfd1c3307535a03c and project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:21:20.406629 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51d1fefa-4f52-4b6c-bad7-0e789cb35a23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.232253 Nov 02 22:21:20.407234 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3616/7112] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:21:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:21:22.698712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1228111511", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2506f3b5-ce5f-454b-84fb-0d067b205af8"}], "security_groups": [{"name": "tempest-securitygroup--9544789"}], "key_name": "tempest-keypair-1777483192", "user_data": "}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:22.728209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:21:22.729473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:21:22.820176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] validate_networks() for [('2506f3b5-ce5f-454b-84fb-0d067b205af8', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:21:23.347957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:21:23.348555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:21:23.348891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:21:23.349339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:21:23.349748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:21:23.365452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:23.365452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:23.365726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:23.366304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:23.366753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:23.367183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:23.390190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:21:23.400153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for user b64d5fbeb3f340acbfd1c3307535a03c and project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:21:23.414962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:21:23.417395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:21:23.529302 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d615c8c-6c5d-409a-91aa-ec995b768efa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.834796 Nov 02 22:21:23.537021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3497/7113] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:21:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:21:23.543462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-243b4b6a-6d0f-4b4c-b103-c5138079ffe2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:23.544104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-243b4b6a-6d0f-4b4c-b103-c5138079ffe2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:23.611408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-243b4b6a-6d0f-4b4c-b103-c5138079ffe2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:23.619035 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-243b4b6a-6d0f-4b4c-b103-c5138079ffe2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1239 microversion: 2.1 time: 0.080696 Nov 02 22:21:23.619609 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3617/7114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:23 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:24.643589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:24.644205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:24.651307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:24.651804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:24.652249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:24.652959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:24.653414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:24.653846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:24.718302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:24.726268 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5138d4a-2660-4a0f-bed9-78384c72ab5b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1243 microversion: 2.1 time: 0.087677 Nov 02 22:21:24.726849 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3498/7115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:24 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:25.749055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:25.750230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:25.757904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:25.758399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:25.758845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:25.763732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:25.763732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:25.763732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:25.833716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:25.841445 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a9955eb-8ee4-4c65-939a-5abf469358ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1291 microversion: 2.1 time: 0.096489 Nov 02 22:21:25.842016 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3618/7116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:25 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1291 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:26.865350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:26.865922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:26.872567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:26.873091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:26.873533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:26.874250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:26.874754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:26.875443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:27.095535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:27.103306 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a4ec1cb2-96b8-49e3-9080-f4cfbba2184f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1362 microversion: 2.1 time: 0.242362 Nov 02 22:21:27.103888 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3499/7117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:26 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:27.615905 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a30d9d6b-00e3-498c-8850-250155451266 req-61603367-943d-4507-a574-980944c573b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303cd34b-e819-467c-8aa2-7b5daf23b22f", "tag": "8028a568-25cb-42d9-8d03-0eeb1e406d28"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:27.629839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a30d9d6b-00e3-498c-8850-250155451266 req-61603367-943d-4507-a574-980944c573b3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:27.630330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a30d9d6b-00e3-498c-8850-250155451266 req-61603367-943d-4507-a574-980944c573b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:27.630850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a30d9d6b-00e3-498c-8850-250155451266 req-61603367-943d-4507-a574-980944c573b3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:27.642296 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a30d9d6b-00e3-498c-8850-250155451266 req-61603367-943d-4507-a574-980944c573b3 service nova] Creating event network-changed:8028a568-25cb-42d9-8d03-0eeb1e406d28 for instance 303cd34b-e819-467c-8aa2-7b5daf23b22f on n-h1-860863-4 Nov 02 22:21:27.647338 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a30d9d6b-00e3-498c-8850-250155451266 req-61603367-943d-4507-a574-980944c573b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035519 Nov 02 22:21:27.648217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3619/7118] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:21:28.127347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:28.128092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:28.135195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:28.135897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:28.136340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:28.137064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:28.137518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:28.138075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:28.366851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:28.374643 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-328222f9-792a-4eff-a8a1-4ad01f38e9a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1362 microversion: 2.1 time: 0.251397 Nov 02 22:21:28.375234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3500/7119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:28 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:29.399444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:29.400163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:29.407303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:29.407841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:29.408301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:29.409030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:29.409503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:29.409946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:29.543259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:29.551455 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44919e2f-6c09-4435-a027-f72ee38e02c8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1362 microversion: 2.1 time: 0.157106 Nov 02 22:21:29.552017 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3620/7120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:29 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:30.574697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:30.575322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:30.583006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:30.583496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:30.583947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:30.584652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:30.585143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:30.585580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:30.722791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:30.730605 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22c9e886-396a-4447-8aa9-2a4bf8bdfb9a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1362 microversion: 2.1 time: 0.159731 Nov 02 22:21:30.731129 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3501/7121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:30 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:31.753574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:31.754207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:31.761266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:31.761771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:31.762233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:31.763025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:31.763496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:31.763942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:31.896474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:31.904450 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a09f81d7-8838-4225-bf28-ed46c604a2ef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1362 microversion: 2.1 time: 0.155433 Nov 02 22:21:31.905143 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3621/7122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:31 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:32.449909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-083a2e17-449f-413a-8039-a761fb056225 req-e003b214-55c2-4fc4-ad18-043f7204a493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303cd34b-e819-467c-8aa2-7b5daf23b22f", "name": "network-vif-plugged", "status": "completed", "tag": "8028a568-25cb-42d9-8d03-0eeb1e406d28"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:32.460518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-083a2e17-449f-413a-8039-a761fb056225 req-e003b214-55c2-4fc4-ad18-043f7204a493 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:32.461059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-083a2e17-449f-413a-8039-a761fb056225 req-e003b214-55c2-4fc4-ad18-043f7204a493 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:32.461491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-083a2e17-449f-413a-8039-a761fb056225 req-e003b214-55c2-4fc4-ad18-043f7204a493 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:32.472955 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-083a2e17-449f-413a-8039-a761fb056225 req-e003b214-55c2-4fc4-ad18-043f7204a493 service nova] Creating event network-vif-plugged:8028a568-25cb-42d9-8d03-0eeb1e406d28 for instance 303cd34b-e819-467c-8aa2-7b5daf23b22f on n-h1-860863-4 Nov 02 22:21:32.478204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-083a2e17-449f-413a-8039-a761fb056225 req-e003b214-55c2-4fc4-ad18-043f7204a493 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031866 Nov 02 22:21:32.478755 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3502/7123] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:21:32.928576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:32.929240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:32.936105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:32.936598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:32.937081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:32.939209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:32.939209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:32.939400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:33.074298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:33.082290 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08439ae0-2e36-4289-87c5-6782a278a11e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1362 microversion: 2.1 time: 0.157803 Nov 02 22:21:33.082862 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3622/7124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:32 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:34.105607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:34.106288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:34.108279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:21:34.109037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:21:34.114960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:34.115440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:34.115878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:34.116563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:34.117045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:34.117476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:34.247952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:21:34.256419 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-029ad56e-f672-47ff-a40e-668c001b284f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1549 microversion: 2.1 time: 0.155127 Nov 02 22:21:34.256945 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3503/7125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:21:34 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:21:34.279071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:21:34.279621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:21:34.281789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:21:34.287694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:34.288194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:34.288653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:34.289390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:34.295045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:34.295045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:34.371366 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e007709-8bbc-46c8-89ec-a3dd7bc40847 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096134 Nov 02 22:21:34.371978 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3623/7126] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 22:21:34 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:21:35.693275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d454d754-17e8-452e-83a1-4a34a057ce44 req-67bd8950-2ea3-40d1-b6b1-3acf3032db47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303cd34b-e819-467c-8aa2-7b5daf23b22f", "tag": "8028a568-25cb-42d9-8d03-0eeb1e406d28"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:21:35.703128 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d454d754-17e8-452e-83a1-4a34a057ce44 req-67bd8950-2ea3-40d1-b6b1-3acf3032db47 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:21:35.703776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d454d754-17e8-452e-83a1-4a34a057ce44 req-67bd8950-2ea3-40d1-b6b1-3acf3032db47 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:21:35.704210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d454d754-17e8-452e-83a1-4a34a057ce44 req-67bd8950-2ea3-40d1-b6b1-3acf3032db47 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:21:35.715643 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d454d754-17e8-452e-83a1-4a34a057ce44 req-67bd8950-2ea3-40d1-b6b1-3acf3032db47 service nova] Creating event network-changed:8028a568-25cb-42d9-8d03-0eeb1e406d28 for instance 303cd34b-e819-467c-8aa2-7b5daf23b22f on n-h1-860863-4 Nov 02 22:21:35.722607 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d454d754-17e8-452e-83a1-4a34a057ce44 req-67bd8950-2ea3-40d1-b6b1-3acf3032db47 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032895 Nov 02 22:21:35.723263 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3504/7127] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:22:11.869572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:11.870282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=30 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:11.874498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:11.875978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:11.882179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:11.882679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:11.883130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:11.883832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:11.884296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:11.884735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.016338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:12.023991 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab21c02c-dee3-4461-8fc1-2f3af4909dac tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1667 microversion: 2.1 time: 0.157068 Nov 02 22:22:12.024563 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3624/7128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:11 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:12.045125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:12.045875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=36 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:12.050592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:12.053133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:12.057867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.058349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.058797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.059478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.059932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.060368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.192156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:12.199990 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6fa2d206-5667-4145-ab59-46ffab2297f3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1667 microversion: 2.1 time: 0.157621 Nov 02 22:22:12.200577 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3505/7129] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:12 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:12.222775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:12.223404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:12.229345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.229842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.230295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.230996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.231465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.231909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.361397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:12.369111 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8211751-2142-467c-b00c-e05eee80bfca tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1667 microversion: 2.1 time: 0.150177 Nov 02 22:22:12.369683 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3625/7130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:12 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:12.392616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:12.394963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:12.401040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.401529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.401968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.402662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.403116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.403543 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.432343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:12.437834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Old instance type m1.heat2, new instance type m1.heat {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:22:12.444264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:22:12.444693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:22:12.445190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:22:12.445603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:22:12.446017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:22:12.636878 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0fe0ca91-97b3-4f49-b25c-df59743573c9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f/action" status: 202 len: 0 microversion: 2.1 time: 0.248251 Nov 02 22:22:12.637588 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3506/7131] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:22:12 2022] POST /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 22:22:12.646426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:12.646979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:12.653056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.653469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.653904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.654603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:12.655068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:12.655509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:12.792908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:12.801672 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7b42c597-4eed-4fe0-a3b1-afe3d5ede14b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1676 microversion: 2.1 time: 0.159178 Nov 02 22:22:12.802475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3626/7132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:12 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:22:13.825528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:13.826166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:13.833922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:13.836623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:13.836623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:13.836623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:13.836623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:13.836623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:13.972090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:13.980021 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f01ff6ee-2597-4b72-bea7-bcb300ad938c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1676 microversion: 2.1 time: 0.158531 Nov 02 22:22:13.988656 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3507/7133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:13 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:15.004377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:15.005101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:15.011652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:15.012238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:15.012695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:15.013513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:15.013978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:15.014422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:15.242568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:15.250982 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b75847f-03a4-4bc9-915b-4ea879c7fdcf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1676 microversion: 2.1 time: 0.250541 Nov 02 22:22:15.251559 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3627/7134] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:14 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1676 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:16.274906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:16.275435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:16.282775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:16.283259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:16.283701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:16.284391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:16.284845 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:16.285298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:16.416022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:16.423751 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5aa583f8-ffb4-4698-958b-c46c9ed6003b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.152831 Nov 02 22:22:16.424322 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3508/7135] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:16 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:17.447896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:17.448533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:17.455518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:17.456017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:17.456472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:17.457201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:17.457672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:17.458114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:17.587145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:17.595307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ef9168a-63e3-47c6-9297-83ca60bcf2c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.151306 Nov 02 22:22:17.595874 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3628/7136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:17 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:18.618555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:18.619223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:18.626166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:18.626649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:18.627088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:18.627770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:18.628227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:18.628652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:18.758072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:18.766249 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a6d62c7-7971-4fcb-bfbc-0103ed52ecb3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.151109 Nov 02 22:22:18.766823 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3509/7137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:18 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:19.790232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:19.790851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:19.798340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:19.798832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:19.799282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:19.799979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:19.800440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:19.801165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:19.938366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:19.946199 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0a29ca87-af9f-47d9-b1d6-1c39d4efaa90 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.159881 Nov 02 22:22:19.946779 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3629/7138] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:19 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:20.969857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:20.970473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:20.977225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:20.977707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:20.978138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:20.978821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:20.979270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:20.979694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:21.117228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:21.125428 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cc746825-bf53-4198-803c-536176d6e66d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.158901 Nov 02 22:22:21.126191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3510/7139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:20 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:22.149399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:22.150065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:22.157578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:22.158022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:22.158481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:22.159195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:22.159672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:22.160126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:22.294188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:22.302289 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a02a2962-51a7-4edc-bcfb-90b99718fc81 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.156912 Nov 02 22:22:22.302861 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3630/7140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:22 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:23.325611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:23.326222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:23.335843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:23.336220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:23.336664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:23.337404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:23.337887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:23.338313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:23.471404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:23.479171 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f23bd94e-22ee-44a5-b824-56acfa33f994 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.157557 Nov 02 22:22:23.479746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3511/7141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:23 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:24.502921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:24.503547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:24.510466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:24.510958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:24.511409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:24.512104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:24.512570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:24.513102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:24.644434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:24.652292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c970850-12aa-4bd6-bdf1-c2eb0ddf51cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.154139 Nov 02 22:22:24.653314 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3631/7142] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:24 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:25.676451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:25.677084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:25.683033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:25.683519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:25.683960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:25.684639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:25.685129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:25.685557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:25.816900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:25.824643 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f9e62e7d-ec20-4ec7-83ca-c91bf08030e9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.152631 Nov 02 22:22:25.825246 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3512/7143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:25 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:26.850004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:26.854622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:26.856919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:26.857449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:26.857916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:26.858728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:26.859234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:26.859683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:26.990456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:26.998110 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed844630-ca96-4ed2-b650-ef62334f2e89 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.152294 Nov 02 22:22:26.998681 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3632/7144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:26 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:28.021441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:28.022063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:28.029508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:28.029998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:28.030440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:28.031638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:28.032094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:28.032519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:28.165013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:28.173420 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3880c8b7-d4cb-4836-84be-d315d47a0191 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.155906 Nov 02 22:22:28.179836 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3513/7145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:28 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:29.197407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:29.197961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:29.205837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:29.206334 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:29.206786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:29.207486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:29.207953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:29.208395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:29.335362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:29.343094 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e6a4c65-7247-45ef-9c75-daaa2a20d1a7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.149626 Nov 02 22:22:29.344298 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3633/7146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:29 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:30.367130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:30.367743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:30.375134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:30.375619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:30.376052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:30.376763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:30.377248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:30.377674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:30.508667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:30.517100 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15185c85-7b4e-438e-8995-01d9740a4b30 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.153790 Nov 02 22:22:30.517669 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3514/7147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:30 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:31.540850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:31.541542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:31.548869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:31.549400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:31.549859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:31.550570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:31.551296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:31.551743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:31.685446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:31.693336 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bbc55fc-4423-482a-9b55-ab64aa427e6a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.156435 Nov 02 22:22:31.693902 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3634/7148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:31 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:32.716295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:32.716904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:32.723737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:32.724223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:32.724660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:32.725374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:32.725826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:32.726255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:32.855747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:32.864190 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc2f6598-afff-4e3a-9892-0ee84bdaeb95 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.151723 Nov 02 22:22:32.864761 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3515/7149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:32 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:33.887683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:33.888313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:33.895435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:33.895941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:33.896410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:33.897155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:33.897631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:33.898080 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:34.032316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:34.040076 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd10bd72-4f01-406f-8f33-88bfe17d40bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.156323 Nov 02 22:22:34.040649 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3635/7150] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:33 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:35.063775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:35.064411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:35.072075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:35.072559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:35.073025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:35.073717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:35.074171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:35.074600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:35.205330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:35.213221 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1cc3388-8011-4851-8354-55cb8b42053b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.153476 Nov 02 22:22:35.213804 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3516/7151] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:35 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:36.237221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:36.237783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:36.244471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:36.244987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:36.245441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:36.246140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:36.246607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:36.247044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:36.378000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:36.385733 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b6c2acff-f60a-42e6-a8fa-411ffd0f2b99 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.152645 Nov 02 22:22:36.386305 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3636/7152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:36 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:37.409798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:37.410417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:37.417216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:37.417702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:37.418139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:37.418824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:37.419274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:37.419710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:37.552891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:37.560594 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-22d1203d-66ff-4c81-876e-3504cda3e634 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1681 microversion: 2.1 time: 0.154899 Nov 02 22:22:37.561213 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3517/7153] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:37 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:38.584067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:38.584638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:38.591690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:38.592191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:38.592639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:38.593382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:38.593855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:38.594282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:38.673758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-73accbd9-cfa5-4aa2-8cdb-24c21c10f2eb req-5eb60047-a539-45a1-a667-df59bcbea2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303cd34b-e819-467c-8aa2-7b5daf23b22f", "name": "network-vif-unplugged", "status": "completed", "tag": "8028a568-25cb-42d9-8d03-0eeb1e406d28"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:38.686182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-73accbd9-cfa5-4aa2-8cdb-24c21c10f2eb req-5eb60047-a539-45a1-a667-df59bcbea2fe service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:38.686674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-73accbd9-cfa5-4aa2-8cdb-24c21c10f2eb req-5eb60047-a539-45a1-a667-df59bcbea2fe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:38.687620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-73accbd9-cfa5-4aa2-8cdb-24c21c10f2eb req-5eb60047-a539-45a1-a667-df59bcbea2fe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:38.700087 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-73accbd9-cfa5-4aa2-8cdb-24c21c10f2eb req-5eb60047-a539-45a1-a667-df59bcbea2fe service nova] Creating event network-vif-unplugged:8028a568-25cb-42d9-8d03-0eeb1e406d28 for instance 303cd34b-e819-467c-8aa2-7b5daf23b22f on n-h2-860863-4 Nov 02 22:22:38.706262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-73accbd9-cfa5-4aa2-8cdb-24c21c10f2eb req-5eb60047-a539-45a1-a667-df59bcbea2fe service nova] Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:22:38.717361 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-73accbd9-cfa5-4aa2-8cdb-24c21c10f2eb req-5eb60047-a539-45a1-a667-df59bcbea2fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048354 Nov 02 22:22:38.717979 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3518/7154] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:22:38.732266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:38.740146 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db9561be-b656-4bcc-bb7b-c32ab4e8b459 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1680 microversion: 2.1 time: 0.160052 Nov 02 22:22:38.742172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3637/7155] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:38 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:22:39.765797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:39.766486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:39.772736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:39.773266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:39.773709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:39.774406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:39.774866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:39.775347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:39.913428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:39.921294 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e6d091f-ff13-41ba-8888-ae7783abc025 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1680 microversion: 2.1 time: 0.161204 Nov 02 22:22:39.933165 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3519/7156] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:39 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:40.732447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-833d5f65-5450-4000-a784-72e911fa0bec req-98c29c68-f550-4875-ba9a-2a83d3d80993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303cd34b-e819-467c-8aa2-7b5daf23b22f", "tag": "8028a568-25cb-42d9-8d03-0eeb1e406d28"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:40.743444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-833d5f65-5450-4000-a784-72e911fa0bec req-98c29c68-f550-4875-ba9a-2a83d3d80993 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:40.743942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-833d5f65-5450-4000-a784-72e911fa0bec req-98c29c68-f550-4875-ba9a-2a83d3d80993 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:40.744388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-833d5f65-5450-4000-a784-72e911fa0bec req-98c29c68-f550-4875-ba9a-2a83d3d80993 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:40.755932 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-833d5f65-5450-4000-a784-72e911fa0bec req-98c29c68-f550-4875-ba9a-2a83d3d80993 service nova] Creating event network-changed:8028a568-25cb-42d9-8d03-0eeb1e406d28 for instance 303cd34b-e819-467c-8aa2-7b5daf23b22f on n-h2-860863-4 Nov 02 22:22:40.761318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-833d5f65-5450-4000-a784-72e911fa0bec req-98c29c68-f550-4875-ba9a-2a83d3d80993 service nova] Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:22:40.772208 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-833d5f65-5450-4000-a784-72e911fa0bec req-98c29c68-f550-4875-ba9a-2a83d3d80993 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043362 Nov 02 22:22:40.772795 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3638/7157] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:22:40.945614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:40.946399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:40.953318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:40.953882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:40.954556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:40.955263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:40.955723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:40.956155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:40.974838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:41.142247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:41.150009 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5410c91d-848b-472b-80ff-089935008ace tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1678 microversion: 2.1 time: 0.208359 Nov 02 22:22:41.150596 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3520/7158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:40 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:42.176740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:42.177497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:42.179784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=31 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:42.185357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:42.185872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:42.186320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:42.187058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:42.187533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:42.187986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:42.191307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=89 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:42.323747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:42.332106 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20fd67c5-8621-4eed-a604-b70ee7e0237a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1675 microversion: 2.1 time: 0.161464 Nov 02 22:22:42.332704 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3639/7159] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:42 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:42.354380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:42.354919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:42.357617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=37 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:22:42.362155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:42.362689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:42.368943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:42.368943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:42.368943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:42.368943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:42.591644 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c59f19c9-9676-421e-8493-1ed4b648d38e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f/action" status: 204 len: 0 microversion: 2.1 time: 0.240697 Nov 02 22:22:42.592289 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3521/7160] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:22:42 2022] POST /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f/action => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:22:42.600743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:42.601451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:42.608097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:42.608295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:42.608747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:42.609488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:42.610512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:42.611030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:42.745937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:42.754712 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf799baf-6ffd-46a9-af3b-48727cce0457 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1675 microversion: 2.1 time: 0.157790 Nov 02 22:22:42.755308 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3640/7161] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:42 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:43.779933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:43.780638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:43.787741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:43.788228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:43.788668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:43.789391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:43.789848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:43.790279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:43.924864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:43.933178 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98418332-ecaa-4339-8c49-c9982c7b65bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1675 microversion: 2.1 time: 0.158755 Nov 02 22:22:43.933842 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3522/7162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:43 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:44.959497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:44.960124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:44.966051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:44.966549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:44.966997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:44.967693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:44.968155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:44.968593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.106543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:45.114502 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5905f5d3-b158-42bf-9717-9b65f116f493 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1667 microversion: 2.1 time: 0.159862 Nov 02 22:22:45.115083 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3641/7163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:44 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:45.137641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:45.138221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:45.145898 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.146378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.146827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.147494 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.147941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.148365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.279012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:45.286951 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4942c635-bdae-42e1-9800-18fa887af197 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1667 microversion: 2.1 time: 0.153296 Nov 02 22:22:45.287533 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3523/7164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:45 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:45.309617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:45.310251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:45.316729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.317251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.317705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.318416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.318890 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.319333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.451925 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:45.460399 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-054a566c-2702-4241-91fd-ef7f42c3e0ee tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1667 microversion: 2.1 time: 0.154610 Nov 02 22:22:45.460998 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3642/7165] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:45 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:45.482581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:45.483077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:45.489560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.490046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.490484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.491166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.491615 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.492033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.509455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-39e73ecb-3560-4955-ae18-d365d6aa3604 req-0bd9fba5-5c1f-47ab-8530-8eda2b8b2ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303cd34b-e819-467c-8aa2-7b5daf23b22f", "name": "network-vif-plugged", "status": "completed", "tag": "8028a568-25cb-42d9-8d03-0eeb1e406d28"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:45.518869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:22:45.520587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-39e73ecb-3560-4955-ae18-d365d6aa3604 req-0bd9fba5-5c1f-47ab-8530-8eda2b8b2ed6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.520587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-39e73ecb-3560-4955-ae18-d365d6aa3604 req-0bd9fba5-5c1f-47ab-8530-8eda2b8b2ed6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.520587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-39e73ecb-3560-4955-ae18-d365d6aa3604 req-0bd9fba5-5c1f-47ab-8530-8eda2b8b2ed6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.532158 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-39e73ecb-3560-4955-ae18-d365d6aa3604 req-0bd9fba5-5c1f-47ab-8530-8eda2b8b2ed6 service nova] Creating event network-vif-plugged:8028a568-25cb-42d9-8d03-0eeb1e406d28 for instance 303cd34b-e819-467c-8aa2-7b5daf23b22f on n-h2-860863-4 Nov 02 22:22:45.537969 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-39e73ecb-3560-4955-ae18-d365d6aa3604 req-0bd9fba5-5c1f-47ab-8530-8eda2b8b2ed6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 Nov 02 22:22:45.539020 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3643/7166] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:22:45.801876 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-16f15463-89e7-4803-808e-ba26f64a0bff tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 204 len: 0 microversion: 2.1 time: 0.322491 Nov 02 22:22:45.802408 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3524/7167] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:22:45 2022] DELETE /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:22:45.811451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:45.813863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:45.819117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.819611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.820064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.820764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:45.821255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:45.821706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:45.956255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:45.964904 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f601064-bc78-42b1-8598-0edd5c2cf3f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1673 microversion: 2.1 time: 0.157835 Nov 02 22:22:45.965514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3644/7168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:45 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:46.990246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:46.990953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:46.997767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:46.998255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:46.998700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:46.999395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:46.999850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:47.000317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:47.133912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:47.141685 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-67683a88-aca0-4e9d-b6b5-a4cf1cced8e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1673 microversion: 2.1 time: 0.156448 Nov 02 22:22:47.142274 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3525/7169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:46 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:48.025687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9ddd38f0-989b-48c7-ad39-de2e204c90cc req-5fb60b8a-79ed-42d6-bff1-9219e43886d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303cd34b-e819-467c-8aa2-7b5daf23b22f", "name": "network-vif-deleted", "tag": "8028a568-25cb-42d9-8d03-0eeb1e406d28"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:48.036952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ddd38f0-989b-48c7-ad39-de2e204c90cc req-5fb60b8a-79ed-42d6-bff1-9219e43886d2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:48.041730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ddd38f0-989b-48c7-ad39-de2e204c90cc req-5fb60b8a-79ed-42d6-bff1-9219e43886d2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:48.041730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9ddd38f0-989b-48c7-ad39-de2e204c90cc req-5fb60b8a-79ed-42d6-bff1-9219e43886d2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:48.050414 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9ddd38f0-989b-48c7-ad39-de2e204c90cc req-5fb60b8a-79ed-42d6-bff1-9219e43886d2 service nova] Creating event network-vif-deleted:8028a568-25cb-42d9-8d03-0eeb1e406d28 for instance 303cd34b-e819-467c-8aa2-7b5daf23b22f on n-h2-860863-4 Nov 02 22:22:48.056190 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9ddd38f0-989b-48c7-ad39-de2e204c90cc req-5fb60b8a-79ed-42d6-bff1-9219e43886d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Nov 02 22:22:48.057147 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3645/7170] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:22:48.165398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:48.166264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:48.174440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:48.175154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:48.175683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:48.176888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:48.177475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:48.177918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:48.250929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:48.259316 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b586e2dc-f473-4356-bd0a-628786263431 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 200 len: 1324 microversion: 2.1 time: 0.098024 Nov 02 22:22:48.260153 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3526/7171] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:48 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 1324 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:49.283441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:49.284078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:49.291097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:49.291589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:49.292042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:49.292740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:49.293240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:49.293681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:49.307966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f HTTP/1.1 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '303cd34b-e819-467c-8aa2-7b5daf23b22f'} Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:22:49.309641 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fae6befe-6793-4cae-bf13-5127a6bf9998 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 404 len: 111 microversion: 2.1 time: 0.032028 Nov 02 22:22:49.315579 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3646/7172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:49 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:22:49.326804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:49.327454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:49.334663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:49.335149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:49.335590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:49.336282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:49.336740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:49.337209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:49.350587 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f HTTP/1.1 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '303cd34b-e819-467c-8aa2-7b5daf23b22f'} Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:22:49.352213 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4147b1f1-546f-40f0-ae20-b38825d60012 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 404 len: 111 microversion: 2.1 time: 0.030939 Nov 02 22:22:49.356406 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3527/7173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:49 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:22:49.403030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1485907885", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "2506f3b5-ce5f-454b-84fb-0d067b205af8"}], "security_groups": [{"name": "tempest-securitygroup--9544789"}], "key_name": "tempest-keypair-1777483192", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:49.510321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] validate_networks() for [('2506f3b5-ce5f-454b-84fb-0d067b205af8', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:22:49.965097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:22:49.965565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:22:49.966055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:22:49.966480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:22:49.966907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:22:49.975872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:49.976369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:49.976832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:49.977600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:49.978073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:49.978521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:49.998795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:22:50.005070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for user b64d5fbeb3f340acbfd1c3307535a03c and project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:22:50.018073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:22:50.020452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:22:50.143245 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-efb23a22-e089-4ebd-b6f3-6ccff2de5a0b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.743930 Nov 02 22:22:50.143838 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3647/7174] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:22:49 2022] POST /compute/v2.1/servers => generated 403 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:22:50.155345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-988a1572-2cce-4f7e-bd16-f3907e700e49 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:50.156034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-988a1572-2cce-4f7e-bd16-f3907e700e49 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:50.209819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-988a1572-2cce-4f7e-bd16-f3907e700e49 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:50.216855 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-988a1572-2cce-4f7e-bd16-f3907e700e49 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1239 microversion: 2.1 time: 0.065335 Nov 02 22:22:50.217452 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3528/7175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:50 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1239 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:51.241527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:51.242177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:51.249206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:51.249704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:51.250153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:51.250859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:51.251314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:51.252293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:51.315619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:51.324885 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7bf43b22-06aa-431d-86de-6d552b201814 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1243 microversion: 2.1 time: 0.088179 Nov 02 22:22:51.325724 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3648/7176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:51 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:52.351403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:52.353527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:52.361650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:52.362151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:52.362597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:52.363512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:52.364142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:52.364634 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:52.428047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:52.439646 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19c06faa-7806-4d57-bf66-12dd96079685 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1309 microversion: 2.1 time: 0.089967 Nov 02 22:22:52.439646 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3529/7177] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:52 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:22:53.460876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:53.461589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:53.468950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:53.469593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:53.470485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:53.471232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:53.471707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:53.472158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:53.613362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:53.621483 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3bb26df2-b891-4380-95f3-3474ab77aef2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1362 microversion: 2.1 time: 0.164535 Nov 02 22:22:53.625080 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3649/7178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:53 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:53.815493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-bc2063e4-f2bd-4d20-a7e7-e057107ccc68 req-b917ad1c-3e07-4fb6-bd6e-c78a57c30da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c53e50-9d2e-48d9-9c49-eec1a4d75814", "tag": "a932df92-e9e8-4298-ba2c-9f61ee3d5ee7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:53.825875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-bc2063e4-f2bd-4d20-a7e7-e057107ccc68 req-b917ad1c-3e07-4fb6-bd6e-c78a57c30da1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:53.826351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-bc2063e4-f2bd-4d20-a7e7-e057107ccc68 req-b917ad1c-3e07-4fb6-bd6e-c78a57c30da1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:53.826780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-bc2063e4-f2bd-4d20-a7e7-e057107ccc68 req-b917ad1c-3e07-4fb6-bd6e-c78a57c30da1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:53.838835 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-bc2063e4-f2bd-4d20-a7e7-e057107ccc68 req-b917ad1c-3e07-4fb6-bd6e-c78a57c30da1 service nova] Creating event network-changed:a932df92-e9e8-4298-ba2c-9f61ee3d5ee7 for instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 on n-h2-860863-4 Nov 02 22:22:53.843946 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-bc2063e4-f2bd-4d20-a7e7-e057107ccc68 req-b917ad1c-3e07-4fb6-bd6e-c78a57c30da1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032327 Nov 02 22:22:53.844541 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3530/7179] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:22:54.646073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:54.646718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:54.653572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:54.654073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:54.654529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:54.655239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:54.655707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:54.656151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:54.786664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:54.794379 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1eebd164-7727-4d5c-ba02-cbc5e7f417b4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1362 microversion: 2.1 time: 0.152598 Nov 02 22:22:54.794948 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3650/7180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:54 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:55.819157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:55.819888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:55.826275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:55.826757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:55.827194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:55.827940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:55.828408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:55.828831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:55.966101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:55.974380 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6a11730a-b971-4b5d-a2ee-d8a6fd9b8c78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1362 microversion: 2.1 time: 0.160093 Nov 02 22:22:55.974960 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3531/7181] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:55 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:22:56.997555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:56.998186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:57.005418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:57.005920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:57.006380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:57.007090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:57.007562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:57.008008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:57.138291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:57.146463 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-27080026-5229-4af8-aa9f-7d406f3ed0d3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1362 microversion: 2.1 time: 0.152738 Nov 02 22:22:57.146981 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3651/7182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:56 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:58.175048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:58.175609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:58.184074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:58.184570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:58.185044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:58.193014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:58.195568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:58.196396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:58.335465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:58.343337 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-012fb5c9-aa69-409c-a16d-3c4a113a7747 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1362 microversion: 2.1 time: 0.172502 Nov 02 22:22:58.343906 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3532/7183] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:58 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:59.367995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:22:59.368630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:22:59.376023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:59.376523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:59.377275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:59.378008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:59.378484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:59.378933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:59.515062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:22:59.523206 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-54e21975-dfa4-4a5a-8875-377073f5b11d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1362 microversion: 2.1 time: 0.159107 Nov 02 22:22:59.523793 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3652/7184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:22:59 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:22:59.584820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6fc2d857-2bbb-4a2b-a735-505f565db086 req-a9180f4a-95e0-439f-a2fe-a5040d0e70fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c53e50-9d2e-48d9-9c49-eec1a4d75814", "name": "network-vif-plugged", "status": "completed", "tag": "a932df92-e9e8-4298-ba2c-9f61ee3d5ee7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:22:59.595640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6fc2d857-2bbb-4a2b-a735-505f565db086 req-a9180f4a-95e0-439f-a2fe-a5040d0e70fb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:22:59.596724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6fc2d857-2bbb-4a2b-a735-505f565db086 req-a9180f4a-95e0-439f-a2fe-a5040d0e70fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:22:59.597185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6fc2d857-2bbb-4a2b-a735-505f565db086 req-a9180f4a-95e0-439f-a2fe-a5040d0e70fb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:22:59.608073 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6fc2d857-2bbb-4a2b-a735-505f565db086 req-a9180f4a-95e0-439f-a2fe-a5040d0e70fb service nova] Creating event network-vif-plugged:a932df92-e9e8-4298-ba2c-9f61ee3d5ee7 for instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 on n-h2-860863-4 Nov 02 22:22:59.613809 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6fc2d857-2bbb-4a2b-a735-505f565db086 req-a9180f4a-95e0-439f-a2fe-a5040d0e70fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Nov 02 22:22:59.614392 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3533/7185] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:23:00.547639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:00.548210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:00.551834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:23:00.552534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:23:00.558173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:00.558679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:00.559141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:00.562571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:00.562571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:00.562571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:00.687499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:00.696447 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9969b73c-a6c0-440f-ae99-bd25c5db5735 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1362 microversion: 2.1 time: 0.152804 Nov 02 22:23:00.697057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3653/7186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:00 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:01.717716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:23:01.722648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:01.723341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:01.729540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:01.730022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:01.730460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:01.731140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:01.731597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:01.732071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:02.190390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:02.198027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-877f4933-c299-483f-b80f-e77b0324db3c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1549 microversion: 2.1 time: 0.481303 Nov 02 22:23:02.198593 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3534/7187] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:01 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1549 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:02.221135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:02.221650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:02.228441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:02.228971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:02.229436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:02.230150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:02.230627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:02.231083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:02.307296 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8a7968f-8939-439a-bc87-ed0c8f72f751 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090100 Nov 02 22:23:02.307912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3654/7188] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 22:23:02 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:23:03.282961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-32b880c6-f463-4d08-93fb-6775267f3d1b req-78d62189-69fa-4819-8d2b-fccf3ab47ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c53e50-9d2e-48d9-9c49-eec1a4d75814", "tag": "a932df92-e9e8-4298-ba2c-9f61ee3d5ee7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:23:03.293504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-32b880c6-f463-4d08-93fb-6775267f3d1b req-78d62189-69fa-4819-8d2b-fccf3ab47ca5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:03.294101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-32b880c6-f463-4d08-93fb-6775267f3d1b req-78d62189-69fa-4819-8d2b-fccf3ab47ca5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:03.294542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-32b880c6-f463-4d08-93fb-6775267f3d1b req-78d62189-69fa-4819-8d2b-fccf3ab47ca5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:03.306060 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-32b880c6-f463-4d08-93fb-6775267f3d1b req-78d62189-69fa-4819-8d2b-fccf3ab47ca5 service nova] Creating event network-changed:a932df92-e9e8-4298-ba2c-9f61ee3d5ee7 for instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 on n-h2-860863-4 Nov 02 22:23:03.310860 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-32b880c6-f463-4d08-93fb-6775267f3d1b req-78d62189-69fa-4819-8d2b-fccf3ab47ca5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031539 Nov 02 22:23:03.311484 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3535/7189] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:23:36.196583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:23:36.197309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=77 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:23:36.202034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4fa058b1-ddad-444e-84c4-a4444f295921 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:23:36.208317 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fa058b1-ddad-444e-84c4-a4444f295921 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:36.208806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fa058b1-ddad-444e-84c4-a4444f295921 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:36.209284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4fa058b1-ddad-444e-84c4-a4444f295921 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:36.232692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4fa058b1-ddad-444e-84c4-a4444f295921 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 22:23:36.377359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4fa058b1-ddad-444e-84c4-a4444f295921 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action" status: 202 len: 0 microversion: 2.1 time: 0.182595 Nov 02 22:23:36.377965 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3655/7190] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:23:36 2022] POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:23:36.384709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:23:36.385814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:23:36.390613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:36.391333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:36.399710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:36.400205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:36.400649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:36.401379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:36.401862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:36.406455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:36.536848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:36.544610 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ecdd3255-e190-43a7-b07b-3c1662af9e4b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.162132 Nov 02 22:23:36.545224 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3536/7191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:36 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:37.573330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:37.574037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:37.580309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:37.580801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:37.581282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:37.582053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:37.582534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:37.582965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:37.719399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:37.727639 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a33daf3e-1814-49da-8e2b-d2e39726f885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.159445 Nov 02 22:23:37.728222 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3656/7192] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:37 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:38.751929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:38.752556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:38.760340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:38.760824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:38.761291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:38.761992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:38.762447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:38.762925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:38.890399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:38.899919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c070b0dc-e429-4a98-8906-bb5976da7a2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.152178 Nov 02 22:23:38.900713 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3537/7193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:38 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:39.924742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:39.925404 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:39.933043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:39.933545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:39.933999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:39.934706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:39.935173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:39.935616 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:40.070017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:40.075627 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb472587-c92b-4c5d-be1d-ee625a6ca885 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.154864 Nov 02 22:23:40.076206 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3657/7194] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:39 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:41.100089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:41.100683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:41.107510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:41.107990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:41.108424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:41.109149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:41.109599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:41.110023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:41.242129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:41.249828 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71b9d50a-eaa9-4b48-b731-d507e03b1f31 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.154075 Nov 02 22:23:41.250419 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3538/7195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:41 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:42.274455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:42.275022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:42.281842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:42.282341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:42.282791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:42.283489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:42.283954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:42.284394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:42.412424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:42.420142 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05dbdb00-b6db-487d-942e-63f2afd0cc25 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.149903 Nov 02 22:23:42.420720 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3658/7196] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:42 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:43.444081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:43.444696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:43.451474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:43.451957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:43.452395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:43.453104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:43.453559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:43.453987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:43.585822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:43.593473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2425731f-aa11-4857-92f0-a3e33736a82a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.153455 Nov 02 22:23:43.594046 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3539/7197] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:43 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:44.617524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:44.618192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:44.624982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:44.628855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:44.628855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:44.628855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:44.628855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:44.628855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:44.757940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:44.765654 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-49a408e5-ea8f-47ae-b364-f45a0f4380af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.152824 Nov 02 22:23:44.766235 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3659/7198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:44 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:45.790067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:45.790684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:45.797492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:45.797976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:45.798414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:45.799106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:45.799559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:45.799992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:45.933546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:45.941284 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-13f6868d-b325-4a56-ba14-a9b13d0cd657 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.155217 Nov 02 22:23:45.941865 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3540/7199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:45 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:46.963606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:46.964237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:46.971177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:46.971680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:46.972134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:46.972891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:46.973416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:46.973862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:47.100653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:47.108391 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83f55ca5-2893-43fb-a8df-636b8a54b825 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.148724 Nov 02 22:23:47.108982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3660/7200] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:46 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:48.133940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:48.134555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:48.141451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:48.141928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:48.142362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:48.143045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:48.143496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:48.143920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:48.278283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:48.286499 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f6b896c-cd68-415a-80bc-4ea95c07ab8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.157718 Nov 02 22:23:48.287058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3541/7201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:48 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:49.310356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:49.310985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:49.318734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:49.319241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:49.319699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:49.320409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:49.320880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:49.321346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:49.450836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:49.458784 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c14f1f7-cac7-45fe-af4b-58ce3e1e7395 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.152368 Nov 02 22:23:49.465440 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3661/7202] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:49 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:50.482965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:50.483576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:50.490469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:50.490951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:50.491388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:50.492073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:50.492522 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:50.492980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:50.621587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:50.630142 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb39b857-198a-4e2a-88dd-4d2f1fde7338 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.151033 Nov 02 22:23:50.630714 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3542/7203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:50 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:51.654132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:51.654763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:51.662903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:51.663402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:51.663856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:51.664565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:51.665059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:51.665502 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:51.804953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:51.812713 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f592b06f-0ca4-4eb9-89c2-96142e375aa0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.162565 Nov 02 22:23:51.813330 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3662/7204] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:51 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:23:52.837160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:52.837754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:52.845271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:52.845750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:52.846188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:52.846868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:52.847371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:52.847792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:52.977403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:52.985339 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-998376cf-2f64-4338-847e-29cef0d58be2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1654 microversion: 2.1 time: 0.152087 Nov 02 22:23:52.985925 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3543/7205] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:52 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:53.009784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:23:53.012691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:53.020018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:53.020510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:53.020981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:53.021690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:53.022154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:53.022981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:53.052677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:53.059193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Old instance type m1.heat2, new instance type m1.heat {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:23:53.065880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:23:53.066840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:23:53.067321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:23:53.067736 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:23:53.068153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:23:53.240726 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71db41ff-22c3-4a88-baf6-5e3cab4a45c5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action" status: 202 len: 0 microversion: 2.1 time: 0.234850 Nov 02 22:23:53.241665 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3663/7206] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:23:53 2022] POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:23:53.250101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:53.250801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:53.257828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:53.258319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:53.258754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:53.259449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:53.259904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:53.260330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:53.401985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:53.409885 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2bd23b74-adbe-48ce-9274-237cf04fc500 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.163668 Nov 02 22:23:53.411021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3544/7207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:53 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:54.435276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:54.435947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:54.442876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:54.443377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:54.443836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:54.444557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:54.445090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:54.445537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:54.578774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:54.587678 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-017fd3a2-02a5-4715-b0fa-917407e9892b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.157369 Nov 02 22:23:54.588360 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3664/7208] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:54 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:55.611943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:55.612563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:55.618782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:55.619270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:55.619710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:55.620402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:55.620857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:55.621316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:55.752084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:55.760497 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e6f080f3-0de6-41af-8773-680cd63653ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1677 microversion: 2.1 time: 0.152780 Nov 02 22:23:55.761135 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3545/7209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:55 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:56.785841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:56.786476 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:56.792574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:56.793107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:56.793566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:56.794270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:56.794738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:56.795179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:56.930530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:56.938533 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58fad1eb-a650-4295-b860-44cf7c6319f2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1682 microversion: 2.1 time: 0.157561 Nov 02 22:23:56.939104 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3665/7210] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:56 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:57.962417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:57.963089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:57.969971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:57.970456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:57.970896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:57.971589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:57.972040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:57.973300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:58.118770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:58.127273 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-25adc120-e431-4b70-9534-898e3827bb6f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1682 microversion: 2.1 time: 0.168680 Nov 02 22:23:58.127849 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3546/7211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:57 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:23:58.919778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9909c3fc-79d7-446b-8464-041df2dfec1e req-1ef52be6-8ec6-44dd-9bd9-6b25e8fdba27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c53e50-9d2e-48d9-9c49-eec1a4d75814", "name": "network-vif-unplugged", "status": "completed", "tag": "a932df92-e9e8-4298-ba2c-9f61ee3d5ee7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:23:58.935422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9909c3fc-79d7-446b-8464-041df2dfec1e req-1ef52be6-8ec6-44dd-9bd9-6b25e8fdba27 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:58.935919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9909c3fc-79d7-446b-8464-041df2dfec1e req-1ef52be6-8ec6-44dd-9bd9-6b25e8fdba27 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:58.936380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9909c3fc-79d7-446b-8464-041df2dfec1e req-1ef52be6-8ec6-44dd-9bd9-6b25e8fdba27 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:58.949921 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9909c3fc-79d7-446b-8464-041df2dfec1e req-1ef52be6-8ec6-44dd-9bd9-6b25e8fdba27 service nova] Creating event network-vif-unplugged:a932df92-e9e8-4298-ba2c-9f61ee3d5ee7 for instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 on n-h1-860863-4 Nov 02 22:23:58.956561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-9909c3fc-79d7-446b-8464-041df2dfec1e req-1ef52be6-8ec6-44dd-9bd9-6b25e8fdba27 service nova] Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:23:58.969439 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9909c3fc-79d7-446b-8464-041df2dfec1e req-1ef52be6-8ec6-44dd-9bd9-6b25e8fdba27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053293 Nov 02 22:23:58.971423 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3666/7212] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:23:59.151078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:23:59.151825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:23:59.158983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:59.159557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:59.160089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:59.160908 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:23:59.161399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:23:59.161894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:23:59.358410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:23:59.366656 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d29414a-5208-4b2c-a195-f5ba5cb9528b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1681 microversion: 2.1 time: 0.219439 Nov 02 22:23:59.367325 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3547/7213] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:23:59 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:00.392991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:00.393715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:00.401366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:00.402210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:00.402345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:00.403058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:00.403530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:00.403972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:00.537158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:00.544791 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c2aa0eb-4b2d-4c3b-807c-39ca20ebd6cf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1679 microversion: 2.1 time: 0.157545 Nov 02 22:24:00.545412 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3667/7214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:00 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:00.985145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dc70c493-e637-41d4-965e-046fe16c083b req-bdf76d2e-a79a-44aa-8912-7b18c37c3be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c53e50-9d2e-48d9-9c49-eec1a4d75814", "tag": "a932df92-e9e8-4298-ba2c-9f61ee3d5ee7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:00.995986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc70c493-e637-41d4-965e-046fe16c083b req-bdf76d2e-a79a-44aa-8912-7b18c37c3be5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:00.996465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc70c493-e637-41d4-965e-046fe16c083b req-bdf76d2e-a79a-44aa-8912-7b18c37c3be5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:00.996897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc70c493-e637-41d4-965e-046fe16c083b req-bdf76d2e-a79a-44aa-8912-7b18c37c3be5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:01.008378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dc70c493-e637-41d4-965e-046fe16c083b req-bdf76d2e-a79a-44aa-8912-7b18c37c3be5 service nova] Creating event network-changed:a932df92-e9e8-4298-ba2c-9f61ee3d5ee7 for instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 on n-h1-860863-4 Nov 02 22:24:01.013566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-dc70c493-e637-41d4-965e-046fe16c083b req-bdf76d2e-a79a-44aa-8912-7b18c37c3be5 service nova] Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:24:01.024213 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dc70c493-e637-41d4-965e-046fe16c083b req-bdf76d2e-a79a-44aa-8912-7b18c37c3be5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042853 Nov 02 22:24:01.024800 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3548/7215] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:24:01.570186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:01.571518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:01.578521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:01.580447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:01.580447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:01.580447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:01.580753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:01.581079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:01.809387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:01.817950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9cfbbf0f-2580-4252-8cc1-8ecd13d5d744 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1679 microversion: 2.1 time: 0.252396 Nov 02 22:24:01.818531 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3668/7216] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:01 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:02.843825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:02.844449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:02.851434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:02.851924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:02.852376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:02.853119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:02.853580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:02.854014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:02.990590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:02.998536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5667d9b4-3d80-444b-9cb8-94a4cd39d8c7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1675 microversion: 2.1 time: 0.159890 Nov 02 22:24:02.999115 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3549/7217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:02 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:03.022836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:03.023420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:03.030272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:03.030773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:03.031232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:03.031936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:03.032405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:03.032847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:03.050914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:03.218819 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bed5fcf7-bb29-43b4-be4f-e1f0e7f593a0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action" status: 204 len: 0 microversion: 2.1 time: 0.200340 Nov 02 22:24:03.219660 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3669/7218] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:24:03 2022] POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:24:03.229196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:03.229823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:03.236051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:03.236547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:03.237013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:03.237807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:03.238487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:03.239179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:03.376368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:03.385520 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a9ffc6fa-fa5c-4d64-b375-002d1d9dac9b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1675 microversion: 2.1 time: 0.161055 Nov 02 22:24:03.386108 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3550/7219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:03 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:24:04.412627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:04.413361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:04.420267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:04.420772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:04.421246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:04.421960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:04.422428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:04.422869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:04.560653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:04.569897 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f1fb8118-fc19-492a-90a4-744aa31dca0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1675 microversion: 2.1 time: 0.163053 Nov 02 22:24:04.570471 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3670/7220] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:04 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:05.351737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a5b3158d-ade7-4c47-a3bf-f4be37e83e67 req-abb757bf-15a5-4bd0-bb34-312f1cc8567a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c53e50-9d2e-48d9-9c49-eec1a4d75814", "name": "network-vif-plugged", "status": "completed", "tag": "a932df92-e9e8-4298-ba2c-9f61ee3d5ee7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:05.362034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a5b3158d-ade7-4c47-a3bf-f4be37e83e67 req-abb757bf-15a5-4bd0-bb34-312f1cc8567a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:05.362513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a5b3158d-ade7-4c47-a3bf-f4be37e83e67 req-abb757bf-15a5-4bd0-bb34-312f1cc8567a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:05.363609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a5b3158d-ade7-4c47-a3bf-f4be37e83e67 req-abb757bf-15a5-4bd0-bb34-312f1cc8567a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:05.376803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a5b3158d-ade7-4c47-a3bf-f4be37e83e67 req-abb757bf-15a5-4bd0-bb34-312f1cc8567a service nova] Creating event network-vif-plugged:a932df92-e9e8-4298-ba2c-9f61ee3d5ee7 for instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 on n-h1-860863-4 Nov 02 22:24:05.382087 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a5b3158d-ade7-4c47-a3bf-f4be37e83e67 req-abb757bf-15a5-4bd0-bb34-312f1cc8567a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034754 Nov 02 22:24:05.382680 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3551/7221] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:24:05.594701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:05.595332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:05.602863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:05.603364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:05.603817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:05.604525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:05.605022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:05.605471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:05.741918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:05.749734 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f166496-4b98-4096-8e10-6b0caabdc14e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1654 microversion: 2.1 time: 0.159019 Nov 02 22:24:05.750305 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3671/7222] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:05 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:05.773343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:05.773981 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:05.780169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:05.780653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:05.781129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:05.781817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:05.782275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:05.782706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:05.913291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:05.921027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f4db19dd-3026-4634-b333-e20f3df66d52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1654 microversion: 2.1 time: 0.152119 Nov 02 22:24:05.921619 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3552/7223] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:05 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:05.945087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d7d8762-70a4-4852-b0db-654be51fead5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:05.951149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d7d8762-70a4-4852-b0db-654be51fead5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:05.951652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d7d8762-70a4-4852-b0db-654be51fead5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:05.952105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d7d8762-70a4-4852-b0db-654be51fead5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:05.973829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d7d8762-70a4-4852-b0db-654be51fead5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Going to try to start instance {{(pid=121040) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 22:24:06.119377 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d7d8762-70a4-4852-b0db-654be51fead5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action" status: 202 len: 0 microversion: 2.1 time: 0.178747 Nov 02 22:24:06.119997 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3672/7224] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:24:05 2022] POST /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:24:06.129702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:06.130321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:06.136954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:06.137448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:06.137884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:06.138575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:06.139030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:06.139455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:06.158242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=100 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:06.274626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:06.282809 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2ee0677-098c-4b82-9301-da7feb92f2d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1663 microversion: 2.1 time: 0.158238 Nov 02 22:24:06.283390 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3553/7225] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:06 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:07.308724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:07.309478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:07.311695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=41 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:07.316834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:07.317359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:07.317811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:07.318511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:07.319204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:07.319602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:07.455421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:07.464294 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6582464-6416-4ec7-ad98-b5b594711bda tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1663 microversion: 2.1 time: 0.161093 Nov 02 22:24:07.464878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3673/7226] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:07 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:08.487945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:08.488694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:08.491940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=37 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:08.497246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:08.498448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:08.498448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:08.499096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:08.499552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:08.499975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:08.631870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:08.639741 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3f094ce9-a28a-42ad-b662-b7e8a5c91453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1667 microversion: 2.1 time: 0.155703 Nov 02 22:24:08.640321 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3554/7227] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:08 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:08.663694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:08.666110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:08.671004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:08.671506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:08.671959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:08.672666 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:08.673174 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:08.673625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:08.704091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:24:09.024380 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-43dc2272-4818-4f4b-8b80-9461e6667575 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 204 len: 0 microversion: 2.1 time: 0.364535 Nov 02 22:24:09.025006 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3674/7228] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:24:08 2022] DELETE /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:24:09.033332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:09.034055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:09.040292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:09.040783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:09.041265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:09.041958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:09.042415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:09.042848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:09.176473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:09.184504 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4cfd831b-6554-4f9d-ba55-11117792b6bd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1673 microversion: 2.1 time: 0.155070 Nov 02 22:24:09.185093 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3555/7229] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:09 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:10.208713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:10.209493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:10.216322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:10.216822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:10.217305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:10.218014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:10.218475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:10.218911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:10.354517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:10.362386 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f39e34a-99ab-4599-ad64-d01b53367ad3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1673 microversion: 2.1 time: 0.158431 Nov 02 22:24:10.362960 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3675/7230] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:10 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:11.373316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-255b7ac6-5ae9-45a8-95ad-296094ac0faa req-82bbae1c-9b9f-46ac-ac53-dffa42a748b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c53e50-9d2e-48d9-9c49-eec1a4d75814", "name": "network-vif-deleted", "tag": "a932df92-e9e8-4298-ba2c-9f61ee3d5ee7"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:11.385846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-255b7ac6-5ae9-45a8-95ad-296094ac0faa req-82bbae1c-9b9f-46ac-ac53-dffa42a748b7 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:11.386425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-255b7ac6-5ae9-45a8-95ad-296094ac0faa req-82bbae1c-9b9f-46ac-ac53-dffa42a748b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:11.386864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-255b7ac6-5ae9-45a8-95ad-296094ac0faa req-82bbae1c-9b9f-46ac-ac53-dffa42a748b7 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:11.390752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:11.392072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:11.399851 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-255b7ac6-5ae9-45a8-95ad-296094ac0faa req-82bbae1c-9b9f-46ac-ac53-dffa42a748b7 service nova] Creating event network-vif-deleted:a932df92-e9e8-4298-ba2c-9f61ee3d5ee7 for instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 on n-h1-860863-4 Nov 02 22:24:11.400039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:11.400284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:11.400776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:11.401530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:11.402002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:11.402452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:11.405535 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-255b7ac6-5ae9-45a8-95ad-296094ac0faa req-82bbae1c-9b9f-46ac-ac53-dffa42a748b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036009 Nov 02 22:24:11.408252 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3556/7231] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:24:11.478798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:11.487167 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dcaa0531-32d8-4dfe-97b4-1b24d9de93cc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 200 len: 1608 microversion: 2.1 time: 0.101586 Nov 02 22:24:11.487769 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3676/7232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:11 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 1608 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:24:12.512950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:12.513820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:12.521086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:12.521600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:12.522001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:12.522709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:12.523170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:12.523617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:12.537241 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 HTTP/1.1 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '43c53e50-9d2e-48d9-9c49-eec1a4d75814'} Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:24:12.538868 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-41bab7ce-540c-47c3-8361-629a79bb2d19 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 404 len: 111 microversion: 2.1 time: 0.031760 Nov 02 22:24:12.543866 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3557/7233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:12 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:24:12.558346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:12.559606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:12.565960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:12.566405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:12.566836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:12.568214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:12.568724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:12.569187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:12.582657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 HTTP/1.1 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '43c53e50-9d2e-48d9-9c49-eec1a4d75814'} Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:24:12.584570 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e56479e-652f-4e7f-9302-fa178f04962c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 404 len: 111 microversion: 2.1 time: 0.031811 Nov 02 22:24:12.588903 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3677/7234] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:12 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:24:12.635946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1332043112", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "2506f3b5-ce5f-454b-84fb-0d067b205af8"}], "security_groups": [{"name": "tempest-securitygroup--9544789"}], "key_name": "tempest-keypair-1777483192", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:12.739366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] validate_networks() for [('2506f3b5-ce5f-454b-84fb-0d067b205af8', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:24:13.113363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:24:13.113787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:24:13.114790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:24:13.115200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:24:13.115609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:24:13.124492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:13.125023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:13.125497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:13.126215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:13.126669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:13.127094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:13.144966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:24:13.150341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for user b64d5fbeb3f340acbfd1c3307535a03c and project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:24:13.163513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:24:13.168219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:24:13.312903 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a2c7ff96-4ebe-4652-832a-8fc8aeab1435 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.680928 Nov 02 22:24:13.320392 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3558/7235] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:24:12 2022] POST /compute/v2.1/servers => generated 403 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:24:13.325820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46b88215-2f67-4b92-aa37-1efb89c16e8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:13.326489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46b88215-2f67-4b92-aa37-1efb89c16e8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:13.383112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-46b88215-2f67-4b92-aa37-1efb89c16e8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:13.391236 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46b88215-2f67-4b92-aa37-1efb89c16e8f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1239 microversion: 2.1 time: 0.069356 Nov 02 22:24:13.402241 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3678/7236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:13 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:14.415400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:14.416026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:14.423867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:14.424355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:14.424800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:14.425525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:14.425986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:14.426416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:14.494099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:14.501990 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9b93d78c-773b-4346-b43a-0ade50462732 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1235 microversion: 2.1 time: 0.091268 Nov 02 22:24:14.502745 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3559/7237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:14 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1235 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:15.525813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:15.526382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:15.536647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:15.536647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:15.536647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:15.536647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:15.536647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:15.537242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:15.601716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:15.609732 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2968db54-39b4-440e-9044-a7a7bb982e78 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1297 microversion: 2.1 time: 0.087882 Nov 02 22:24:15.610586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3679/7238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:15 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:16.633391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:16.634012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:16.640901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:16.641668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:16.641945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:16.642542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:16.642995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:16.643424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:16.777519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:16.785283 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61f9a222-7467-4468-8299-27c9d90dc33c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.155746 Nov 02 22:24:16.790356 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3560/7239] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:16 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:16.896829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b51496db-3b9f-41f1-b2c1-524e6614d77d req-c74e52c6-392d-44df-ae12-9a1d9535eb20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:16.915130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b51496db-3b9f-41f1-b2c1-524e6614d77d req-c74e52c6-392d-44df-ae12-9a1d9535eb20 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:16.915792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b51496db-3b9f-41f1-b2c1-524e6614d77d req-c74e52c6-392d-44df-ae12-9a1d9535eb20 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:16.916457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b51496db-3b9f-41f1-b2c1-524e6614d77d req-c74e52c6-392d-44df-ae12-9a1d9535eb20 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:16.933741 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b51496db-3b9f-41f1-b2c1-524e6614d77d req-c74e52c6-392d-44df-ae12-9a1d9535eb20 service nova] Creating event network-changed:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h2-860863-4 Nov 02 22:24:16.937092 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b51496db-3b9f-41f1-b2c1-524e6614d77d req-c74e52c6-392d-44df-ae12-9a1d9535eb20 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047682 Nov 02 22:24:16.938169 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3680/7240] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:24:17.809430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:17.810047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:17.816819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:17.817950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:17.818390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:17.819081 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:17.819533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:17.819960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:17.955021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:17.962850 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ca736dd-9ca4-4b61-9711-9fc0de1b9f2d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.157317 Nov 02 22:24:17.963434 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3561/7241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:17 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:18.987014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:18.987727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:18.994953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:18.995447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:18.995900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:18.996597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:18.997094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:18.997537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:19.128950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:19.137196 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08f00d7d-8595-4199-b4d4-c671d1079692 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.154395 Nov 02 22:24:19.137777 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3681/7242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:18 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:20.160742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:20.161564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:20.168422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:20.168985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:20.174020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:20.174020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:20.174020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:20.174020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:20.304962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:20.312975 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d9cd7eb7-30ab-46a2-a69f-a2f4857ab3d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.156177 Nov 02 22:24:20.313568 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3562/7243] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:20 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:21.337238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:21.337903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:21.344730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:21.345265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:21.345725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:21.346441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:21.346918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:21.347366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:21.479333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:21.487094 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ec67d7d-b71e-4588-a911-1a8fa14abc52 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.154392 Nov 02 22:24:21.487686 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3682/7244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:21 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:22.511406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:22.512027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:22.518889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:22.519371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:22.519811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:22.521115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:22.521575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:22.522005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:22.650320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:22.658072 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-183c4514-8f56-4276-a3a3-098e030d27a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.150531 Nov 02 22:24:22.658644 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3563/7245] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:22 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:23.682705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:23.683347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:23.686763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:23.691535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:23.692149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:23.694324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:23.694324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:23.694535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:23.694869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:23.831607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:23.839837 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7625715-c6f2-4036-8f2e-0d79a99b23bb tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.160963 Nov 02 22:24:23.840423 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3683/7246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:23 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:23.935372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5b3004a4-888a-4f16-aeff-ad03ac36a12c req-fe04ce12-a292-48ec-ae19-b8a750c473df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "name": "network-vif-plugged", "status": "completed", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:23.941598 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:23.942959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:23.948538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5b3004a4-888a-4f16-aeff-ad03ac36a12c req-fe04ce12-a292-48ec-ae19-b8a750c473df service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:23.949040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5b3004a4-888a-4f16-aeff-ad03ac36a12c req-fe04ce12-a292-48ec-ae19-b8a750c473df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:23.949471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5b3004a4-888a-4f16-aeff-ad03ac36a12c req-fe04ce12-a292-48ec-ae19-b8a750c473df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:23.960636 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5b3004a4-888a-4f16-aeff-ad03ac36a12c req-fe04ce12-a292-48ec-ae19-b8a750c473df service nova] Creating event network-vif-plugged:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h2-860863-4 Nov 02 22:24:23.965673 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5b3004a4-888a-4f16-aeff-ad03ac36a12c req-fe04ce12-a292-48ec-ae19-b8a750c473df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Nov 02 22:24:23.966455 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3564/7247] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:24:24.863263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:24.863900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:24.870790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:24.871285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:24.871734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:24.872434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:24.872899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:24.873365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:25.003004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:25.006030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:24:25.012134 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56845803-2015-4d1b-8c84-af1ba944e859 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1362 microversion: 2.1 time: 0.152843 Nov 02 22:24:25.012710 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3684/7248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:24 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:26.038270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:26.038974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:26.046151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:26.046638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:26.047083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:26.047773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:26.048229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:26.048657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:26.181446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:24:26.189150 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dde8eb04-5e70-430f-a8f8-2b2fad6a943a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1550 microversion: 2.1 time: 0.156645 Nov 02 22:24:26.189724 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3565/7249] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:24:26 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:24:26.213244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:24:26.213796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:24:26.220892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:26.221422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:26.221883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:26.222592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:26.223068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:26.224202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:26.302161 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0dd9a2c8-f6b0-488e-8a44-8768c4eeae4e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092451 Nov 02 22:24:26.303033 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3685/7250] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 22:24:26 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:24:27.268386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a6034512-b7e3-4402-b92a-3a5666e3eba7 req-a9fc4399-475b-48ca-ad3b-75209265c1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:24:27.279404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a6034512-b7e3-4402-b92a-3a5666e3eba7 req-a9fc4399-475b-48ca-ad3b-75209265c1c9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:24:27.279980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a6034512-b7e3-4402-b92a-3a5666e3eba7 req-a9fc4399-475b-48ca-ad3b-75209265c1c9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:24:27.280423 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a6034512-b7e3-4402-b92a-3a5666e3eba7 req-a9fc4399-475b-48ca-ad3b-75209265c1c9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:24:27.292376 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a6034512-b7e3-4402-b92a-3a5666e3eba7 req-a9fc4399-475b-48ca-ad3b-75209265c1c9 service nova] Creating event network-changed:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h2-860863-4 Nov 02 22:24:27.297411 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a6034512-b7e3-4402-b92a-3a5666e3eba7 req-a9fc4399-475b-48ca-ad3b-75209265c1c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 Nov 02 22:24:27.298210 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3566/7251] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:25:00.202461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:00.203139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:00.207778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:00.210711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:00.217959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:00.218458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:00.218908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:00.219619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:00.220088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:00.220526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:00.248713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:00.254121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Old instance type m1.heat2, new instance type m1.heat {{(pid=121040) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:25:00.260975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:25:00.261393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:25:00.261901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:25:00.262319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:25:00.262738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:25:00.415367 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df17e55a-d4a9-46f5-8a6f-023f4af391ce tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd/action" status: 202 len: 0 microversion: 2.1 time: 0.214974 Nov 02 22:25:00.415986 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3686/7252] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:25:00 2022] POST /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:25:00.425031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:00.425792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:00.428986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:00.429652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=60 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:00.435527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:00.436596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:00.437089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:00.437789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:00.438241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:00.438715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:00.625428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:00.633469 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2adfe0ee-fca9-4361-9e03-3d045158f5d6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1677 microversion: 2.1 time: 0.213029 Nov 02 22:25:00.634050 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3567/7253] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:00 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:01.658759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:01.659308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:01.665991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:01.666491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:01.666986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:01.667700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:01.668173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:01.668621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:01.858652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:01.866645 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a931b82-3b1d-4a12-ae59-847bc3a7ffc8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1677 microversion: 2.1 time: 0.212797 Nov 02 22:25:01.870217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3687/7254] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:01 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:02.891579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:02.892193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:02.899466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:02.899958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:02.900395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:02.901224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:02.901563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:02.901993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:03.039092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:03.047160 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d5cf04d2-0bf8-494e-aa9b-a6e7da05e377 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1677 microversion: 2.1 time: 0.159425 Nov 02 22:25:03.047763 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3568/7255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:02 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:04.071030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:04.071679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:04.078457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:04.078950 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:04.079403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:04.080098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:04.080561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:04.081032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:04.211140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:04.218893 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47e165a5-3eae-4182-b571-9745c414e764 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.152503 Nov 02 22:25:04.219473 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3688/7256] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:04 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:05.244072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:05.244622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:05.251440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:05.251918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:05.252357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:05.253068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:05.253520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:05.253943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:05.386332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:05.394151 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-db5aac35-0b1e-41fe-bb90-b9799621deb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.154627 Nov 02 22:25:05.394729 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3569/7257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:05 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:06.418984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:06.419613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:06.426410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:06.426912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:06.427373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:06.428078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:06.428815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:06.429319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:06.555854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:06.563598 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-607a4e5b-c17e-4d90-a67b-e101ece0cda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.148658 Nov 02 22:25:06.564172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3689/7258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:06 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:07.588194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:07.588834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:07.595583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:07.596068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:07.596505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:07.597214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:07.597668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:07.598095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:07.729844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:07.737593 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d0ebeaed-f557-4a73-a5e9-54fb819d81f4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.154293 Nov 02 22:25:07.738170 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3570/7259] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:07 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:08.761804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:08.762436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:08.769217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:08.769722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:08.770180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:08.770891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:08.771362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:08.771809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:08.900210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:08.908114 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8df4c927-02e2-4924-9dd8-d3cd79d1ec6b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.150801 Nov 02 22:25:08.908694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3690/7260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:08 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:09.932728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:09.933382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:09.940173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:09.940648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:09.941130 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:09.941823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:09.942280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:09.942744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:10.072817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:10.080575 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c895c52-1c7e-4a10-a295-ddeec0fdaa8e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.152766 Nov 02 22:25:10.081394 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3571/7261] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:09 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:11.104351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:11.109598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:11.111968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:11.112461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:11.113037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:11.113734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:11.114198 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:11.114635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:11.246659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:11.254450 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d2822ed-7da2-4850-9017-bd82635c3b3d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.154777 Nov 02 22:25:11.255021 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3691/7262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:11 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:12.278670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:12.279207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:12.286127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:12.286609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:12.287044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:12.287725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:12.288176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:12.289368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:12.416641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:12.424500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a374132-17b9-4eb3-8423-94d2b968f9ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.149740 Nov 02 22:25:12.425101 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3572/7263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:12 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:25:13.449039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:13.449675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:13.456474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:13.457020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:13.457479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:13.458187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:13.458658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:13.459118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:13.593776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:13.602190 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c6400e6-0476-4f9f-aeb0-e8dd1fb17a34 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.157791 Nov 02 22:25:13.602773 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3692/7264] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:13 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:14.625870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:14.632979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:14.633499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:14.634017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:14.634460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:14.635154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:14.635609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:14.636039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:14.765354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:14.774234 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dd83c63c-3905-43a2-9d11-5854eb1c8453 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.151824 Nov 02 22:25:14.774854 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3573/7265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:14 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:15.798728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:15.801415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:15.807670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:15.808170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:15.808623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:15.809390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:15.809852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:15.810295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:15.947929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:15.956306 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fa0d293-c9ba-4df2-92b3-97ebeca5ae7f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.161467 Nov 02 22:25:15.956870 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3693/7266] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:15 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:16.979246 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:16.979943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:16.987386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:16.987878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:16.988323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:16.989044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:16.989509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:16.989976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:17.125237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:17.133921 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-43d81d2e-b29d-45f7-b700-2aa6debc334e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.158618 Nov 02 22:25:17.134530 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3574/7267] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:16 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:18.157583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:18.158210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:18.165133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:18.165626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:18.166071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:18.166768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:18.167230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:18.167673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:18.298497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:18.307154 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-10c1b1de-cc95-446b-8079-4bf7a3190ee4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.153544 Nov 02 22:25:18.307721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3694/7268] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:18 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:19.331252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:19.331870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:19.338904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:19.339385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:19.339825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:19.340516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:19.340998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:19.341433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:19.476569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:19.483561 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e58d0320-d07e-4065-9266-f3e822024bd9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1682 microversion: 2.1 time: 0.156237 Nov 02 22:25:19.484181 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3575/7269] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:19 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:20.507697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:20.508320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:20.515610 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:20.516109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:20.516554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:20.517319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:20.517787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:20.518403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:21.094722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:21.103220 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-61b82a19-8ef6-4d8d-9a15-8e041d9e0bb8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1681 microversion: 2.1 time: 0.599486 Nov 02 22:25:21.103804 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3695/7270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:20 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1681 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:21.324745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-070e1904-fa56-4b60-be4b-6be031eda891 req-0d52e8ef-70fb-458b-a44e-2eeb4707899a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "name": "network-vif-unplugged", "status": "completed", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:21.334363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-070e1904-fa56-4b60-be4b-6be031eda891 req-0d52e8ef-70fb-458b-a44e-2eeb4707899a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:21.334848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-070e1904-fa56-4b60-be4b-6be031eda891 req-0d52e8ef-70fb-458b-a44e-2eeb4707899a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:21.335945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-070e1904-fa56-4b60-be4b-6be031eda891 req-0d52e8ef-70fb-458b-a44e-2eeb4707899a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:21.347847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-070e1904-fa56-4b60-be4b-6be031eda891 req-0d52e8ef-70fb-458b-a44e-2eeb4707899a service nova] Creating event network-vif-unplugged:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h1-860863-4 Nov 02 22:25:21.354204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-070e1904-fa56-4b60-be4b-6be031eda891 req-0d52e8ef-70fb-458b-a44e-2eeb4707899a service nova] Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:25:21.365084 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-070e1904-fa56-4b60-be4b-6be031eda891 req-0d52e8ef-70fb-458b-a44e-2eeb4707899a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104453 Nov 02 22:25:21.365734 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3576/7271] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:25:22.127756 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:22.128443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:22.135545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:22.136041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:22.136494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:22.137234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:22.137703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:22.138145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:22.366777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:22.375664 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93d497e9-f1a1-40f0-96a1-36096f7fc4d8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1681 microversion: 2.1 time: 0.251795 Nov 02 22:25:22.376565 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3696/7272] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:22 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:23.400586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4e562caf-b08a-4c91-8e9d-171903dbd8d9 req-cd611d22-9c10-4060-b90c-9c91cb0b8cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:23.401313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:23.402049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:23.408208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:23.408686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:23.409161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:23.409887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:23.410337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:23.410741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4e562caf-b08a-4c91-8e9d-171903dbd8d9 req-cd611d22-9c10-4060-b90c-9c91cb0b8cd6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:23.410856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:23.411229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4e562caf-b08a-4c91-8e9d-171903dbd8d9 req-cd611d22-9c10-4060-b90c-9c91cb0b8cd6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:23.411678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4e562caf-b08a-4c91-8e9d-171903dbd8d9 req-cd611d22-9c10-4060-b90c-9c91cb0b8cd6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:23.423837 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4e562caf-b08a-4c91-8e9d-171903dbd8d9 req-cd611d22-9c10-4060-b90c-9c91cb0b8cd6 service nova] Creating event network-changed:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h1-860863-4 Nov 02 22:25:23.431524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-4e562caf-b08a-4c91-8e9d-171903dbd8d9 req-cd611d22-9c10-4060-b90c-9c91cb0b8cd6 service nova] Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:25:23.442745 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4e562caf-b08a-4c91-8e9d-171903dbd8d9 req-cd611d22-9c10-4060-b90c-9c91cb0b8cd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046039 Nov 02 22:25:23.443344 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3697/7273] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:25:23.557462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:23.565457 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-78619b0d-fae4-4c70-bbb5-6867a241a598 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1679 microversion: 2.1 time: 0.169365 Nov 02 22:25:23.566024 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3577/7274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:23 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:24.590375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:24.591126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:24.598192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:24.603202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:24.603202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:24.603202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:24.603202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:24.603202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:24.795321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:24.798260 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c67343d-64eb-4baf-a0ec-5ac1d1778568 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1679 microversion: 2.1 time: 0.212337 Nov 02 22:25:24.798834 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3698/7275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:24 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:25.822940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:25.823562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:25.830266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:25.830757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:25.831210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:25.831937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:25.832398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:25.832860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:25.967714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:25.975437 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c5130a54-beae-4449-b835-a4b56fa06913 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1676 microversion: 2.1 time: 0.156486 Nov 02 22:25:25.977538 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3578/7276] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:25 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:26.008978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:26.009595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:26.016326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:26.016833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:26.017327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:26.018045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:26.018520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:26.018967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:26.057251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:26.057752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:26.058206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:26.058945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:26.059418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:26.059861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:26.080217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:25:26.086000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for user b64d5fbeb3f340acbfd1c3307535a03c and project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:25:26.198157 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:26.405573 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ebe0fc24-dd9a-4549-9158-dfcdc51ed5cd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd/action" status: 202 len: 0 microversion: 2.1 time: 0.400331 Nov 02 22:25:26.406192 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3699/7277] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:25:26 2022] POST /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:25:26.414785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:26.415468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:26.421658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:26.422133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:26.422582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:26.423309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:26.423765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:26.424198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:26.608406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:26.617179 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01e20c71-6df5-4102-86f4-5e9c3f9ec9a1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1675 microversion: 2.1 time: 0.205973 Nov 02 22:25:26.617965 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3579/7278] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:26 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:27.642923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:27.643654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:27.658099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:27.658099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:27.658861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:27.659917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:27.660589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:27.661462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:27.713024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-40e59cd5-45cd-4182-bc3b-97d467c38247 req-7961c902-2510-4ffc-9ae6-83acbab8094a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "name": "network-vif-plugged", "status": "completed", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:27.722456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-40e59cd5-45cd-4182-bc3b-97d467c38247 req-7961c902-2510-4ffc-9ae6-83acbab8094a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:27.722934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-40e59cd5-45cd-4182-bc3b-97d467c38247 req-7961c902-2510-4ffc-9ae6-83acbab8094a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:27.723370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-40e59cd5-45cd-4182-bc3b-97d467c38247 req-7961c902-2510-4ffc-9ae6-83acbab8094a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:27.737185 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-40e59cd5-45cd-4182-bc3b-97d467c38247 req-7961c902-2510-4ffc-9ae6-83acbab8094a service nova] Creating event network-vif-plugged:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h1-860863-4 Nov 02 22:25:27.743529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-40e59cd5-45cd-4182-bc3b-97d467c38247 req-7961c902-2510-4ffc-9ae6-83acbab8094a service nova] Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:25:27.754925 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-40e59cd5-45cd-4182-bc3b-97d467c38247 req-7961c902-2510-4ffc-9ae6-83acbab8094a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104075 Nov 02 22:25:27.755850 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3580/7279] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:25:27.810821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:27.818493 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d80e28b-0a3d-42af-8af9-c5d555c419c1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1675 microversion: 2.1 time: 0.180733 Nov 02 22:25:27.819076 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3700/7280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:27 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:28.844348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:28.845073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:28.851330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:28.851817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:28.852830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:28.853571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:28.854023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:28.854448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:28.989062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:28.997466 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ddf4869a-b0a0-49a6-b23b-ac4d73740c77 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1675 microversion: 2.1 time: 0.158733 Nov 02 22:25:28.998647 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3581/7281] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:28 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:30.020985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:30.021647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:30.029555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:30.030065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:30.030527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:30.031240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:30.031714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:30.032163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:30.167703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:30.175628 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24969b9b-66e5-47f4-b323-2cb2cbf11cd6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1675 microversion: 2.1 time: 0.158727 Nov 02 22:25:30.176200 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3701/7282] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:30 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:30.288713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f113ef22-460f-45a6-8cb7-53bd2c0c6ed5 req-860953f7-6282-408e-829d-639b7285bfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "name": "network-vif-unplugged", "status": "completed", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:30.299176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f113ef22-460f-45a6-8cb7-53bd2c0c6ed5 req-860953f7-6282-408e-829d-639b7285bfc9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:30.299663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f113ef22-460f-45a6-8cb7-53bd2c0c6ed5 req-860953f7-6282-408e-829d-639b7285bfc9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:30.300099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f113ef22-460f-45a6-8cb7-53bd2c0c6ed5 req-860953f7-6282-408e-829d-639b7285bfc9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:30.315579 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f113ef22-460f-45a6-8cb7-53bd2c0c6ed5 req-860953f7-6282-408e-829d-639b7285bfc9 service nova] Creating event network-vif-unplugged:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h2-860863-4 Nov 02 22:25:30.321842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-f113ef22-460f-45a6-8cb7-53bd2c0c6ed5 req-860953f7-6282-408e-829d-639b7285bfc9 service nova] Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:25:30.332773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f113ef22-460f-45a6-8cb7-53bd2c0c6ed5 req-860953f7-6282-408e-829d-639b7285bfc9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101212 Nov 02 22:25:30.333447 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3582/7283] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:25:31.200390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:31.201056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:31.204566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:31.209343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:31.209883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:31.210342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:31.211083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:31.212249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:31.221031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:31.348906 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:31.358190 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d8fff87c-6cbd-46c3-8240-3469abb4e15c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1675 microversion: 2.1 time: 0.162401 Nov 02 22:25:31.358789 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3702/7284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:31 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:32.366607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-aa3f22b6-c2bd-4052-b726-a6ad6b75c2b7 req-e84bc2f8-4fe1-49ca-b55e-208fcec9d230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:32.372486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=33 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:32.378507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aa3f22b6-c2bd-4052-b726-a6ad6b75c2b7 req-e84bc2f8-4fe1-49ca-b55e-208fcec9d230 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:32.378992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aa3f22b6-c2bd-4052-b726-a6ad6b75c2b7 req-e84bc2f8-4fe1-49ca-b55e-208fcec9d230 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:32.379428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aa3f22b6-c2bd-4052-b726-a6ad6b75c2b7 req-e84bc2f8-4fe1-49ca-b55e-208fcec9d230 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:32.382119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=91 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:32.386204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:32.386204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:32.390413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:32.390912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:32.391364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:32.392064 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-aa3f22b6-c2bd-4052-b726-a6ad6b75c2b7 req-e84bc2f8-4fe1-49ca-b55e-208fcec9d230 service nova] Creating event network-changed:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h2-860863-4 Nov 02 22:25:32.392204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:32.392551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:32.393019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:32.397478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-aa3f22b6-c2bd-4052-b726-a6ad6b75c2b7 req-e84bc2f8-4fe1-49ca-b55e-208fcec9d230 service nova] Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:25:32.408370 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-aa3f22b6-c2bd-4052-b726-a6ad6b75c2b7 req-e84bc2f8-4fe1-49ca-b55e-208fcec9d230 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047297 Nov 02 22:25:32.409204 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3583/7285] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:25:32.614546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:32.623307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6a6b7c92-bed1-4836-af8a-ab8dda2f1566 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1675 microversion: 2.1 time: 0.245071 Nov 02 22:25:32.623896 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3703/7286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:32 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:25:33.648042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:33.649449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:33.656050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:33.656562 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:33.657035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:33.657745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:33.658183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:33.658617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:33.795529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:33.803362 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4a00b6e5-9383-4300-a588-912c25b690d2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1668 microversion: 2.1 time: 0.160754 Nov 02 22:25:33.804236 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3584/7287] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:33 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:33.827398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:33.828030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:33.834833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:33.835328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:33.835786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:33.836607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:33.837235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:33.837691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:33.966897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:33.974615 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af10d92d-06e3-4693-a272-c6f98da8fcef tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1668 microversion: 2.1 time: 0.151135 Nov 02 22:25:33.975193 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3704/7288] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:33 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:34.001330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:34.001330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:34.003942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:34.004439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:34.004879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:34.005589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:34.006045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:34.006474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:34.140384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:34.148161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03f18bb5-f0aa-48e6-abe9-1b011f6053a3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1668 microversion: 2.1 time: 0.155467 Nov 02 22:25:34.148845 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3585/7289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:33 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:34.171245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:34.171762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:34.177761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:34.178256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:34.178982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:34.179680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:34.180830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:34.181449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:34.205720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:25:34.457518 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a757fd18-33e8-4fb5-8fe2-3f08aeec4ca1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 204 len: 0 microversion: 2.1 time: 0.289777 Nov 02 22:25:34.458118 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3705/7290] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:25:34 2022] DELETE /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:25:34.466994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:34.467830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:34.473679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:34.474161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:34.474594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:34.475397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:34.475885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:34.476313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:34.606525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:34.614325 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b8502c0-985b-4b60-a2bd-23276f0bbc00 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1674 microversion: 2.1 time: 0.151137 Nov 02 22:25:34.616685 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3586/7291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:34 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:35.638472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:35.639114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:35.645917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:35.646422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:35.646884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:35.647597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:35.648069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:35.648520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:35.783684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:35.792208 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9946d731-c229-4ea3-845c-2dfc251c0758 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1674 microversion: 2.1 time: 0.158183 Nov 02 22:25:35.792802 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3706/7292] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:35 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:36.563729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b2112170-fec8-4191-89f2-89e5982ebdab req-c795d4fe-fdf0-43a3-8e22-eee21790bdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f58ad0f-305d-48d0-b4de-032524bf81fd", "name": "network-vif-deleted", "tag": "8b37faec-c925-4d5a-aa0c-095a9218ae79"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:36.574316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2112170-fec8-4191-89f2-89e5982ebdab req-c795d4fe-fdf0-43a3-8e22-eee21790bdc4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:36.575369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2112170-fec8-4191-89f2-89e5982ebdab req-c795d4fe-fdf0-43a3-8e22-eee21790bdc4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:36.575369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2112170-fec8-4191-89f2-89e5982ebdab req-c795d4fe-fdf0-43a3-8e22-eee21790bdc4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:36.586993 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b2112170-fec8-4191-89f2-89e5982ebdab req-c795d4fe-fdf0-43a3-8e22-eee21790bdc4 service nova] Creating event network-vif-deleted:8b37faec-c925-4d5a-aa0c-095a9218ae79 for instance 0f58ad0f-305d-48d0-b4de-032524bf81fd on n-h2-860863-4 Nov 02 22:25:36.591985 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b2112170-fec8-4191-89f2-89e5982ebdab req-c795d4fe-fdf0-43a3-8e22-eee21790bdc4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 Nov 02 22:25:36.593063 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3587/7293] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:25:36.817306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:36.818051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:36.821323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:36.825846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:36.826424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:36.827024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:36.830344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:36.830344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:36.830344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:36.861985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:36.862501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:36.862961 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:36.863401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lazy-loading 'fault' on Instance uuid 0f58ad0f-305d-48d0-b4de-032524bf81fd {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:25:36.912719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:36.922033 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-550de212-8744-408d-b635-d32926847109 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 200 len: 1329 microversion: 2.1 time: 0.108760 Nov 02 22:25:36.922694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3707/7294] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:36 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:37.948552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:37.949281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:37.956169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:37.956629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:37.957115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:37.957800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:37.958250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:37.958674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:37.972866 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd HTTP/1.1 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0f58ad0f-305d-48d0-b4de-032524bf81fd'} Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:25:37.974499 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b3e7002-2e60-4050-ae8e-37a88275771e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 404 len: 111 microversion: 2.1 time: 0.032408 Nov 02 22:25:37.979574 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3588/7295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:37 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:25:37.993639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:37.994387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:38.001252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:38.001752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:38.002205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:38.002938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:38.003411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:38.003857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:38.018065 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd HTTP/1.1 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '0f58ad0f-305d-48d0-b4de-032524bf81fd'} Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:25:38.019752 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-142f2816-9c59-4369-80b0-5d9cd0c2e7c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 404 len: 111 microversion: 2.1 time: 0.031811 Nov 02 22:25:38.029012 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3708/7296] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:37 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:25:38.076258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-655359097", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "2506f3b5-ce5f-454b-84fb-0d067b205af8"}], "security_groups": [{"name": "tempest-securitygroup--9544789"}], "key_name": "tempest-keypair-1777483192", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:38.185407 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] validate_networks() for [('2506f3b5-ce5f-454b-84fb-0d067b205af8', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:25:38.554771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:25:38.555463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:25:38.555940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:25:38.556347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:25:38.556774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:25:38.565892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:38.566372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:38.566806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:38.567524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:38.567973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:38.568395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:38.585792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:25:38.591678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for user b64d5fbeb3f340acbfd1c3307535a03c and project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:25:38.604781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:25:38.607154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:25:38.695140 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-33c290cf-e19e-44f9-9745-7dfd81662d0f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.622951 Nov 02 22:25:38.696791 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3589/7297] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:25:38 2022] POST /compute/v2.1/servers => generated 403 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 22:25:38.708438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b371655c-2406-40da-b6bd-1b908db4d5dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:38.709368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b371655c-2406-40da-b6bd-1b908db4d5dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:38.764879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b371655c-2406-40da-b6bd-1b908db4d5dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:38.772242 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b371655c-2406-40da-b6bd-1b908db4d5dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1238 microversion: 2.1 time: 0.067727 Nov 02 22:25:38.781177 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3709/7298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:38 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:39.797115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:39.797731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:39.804736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:39.806181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:39.806627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:39.807325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:39.807784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:39.808218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:39.871663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:39.880378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5fa02ee1-56e0-49ff-a3e6-1b20acc00c26 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1242 microversion: 2.1 time: 0.088212 Nov 02 22:25:39.880986 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3590/7299] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:39 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:25:40.904658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:40.905339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:40.913470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:40.914023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:40.914988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:40.915880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:40.916587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:40.917060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:40.985215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:40.993926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-79cb7d16-e1cb-4561-a5ae-91c32a88a821 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1296 microversion: 2.1 time: 0.093228 Nov 02 22:25:40.994573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3710/7300] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:40 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:42.017853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:42.018473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:42.025955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:42.026650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:42.027102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:42.027800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:42.028251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:42.028672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:42.163648 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:42.172190 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2782628f-21d9-4639-a341-ec074dcb4411 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1361 microversion: 2.1 time: 0.158201 Nov 02 22:25:42.172779 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3591/7301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:42 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:42.303119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-83c17f5e-9388-46be-9259-f9ac8df4d80a req-7c0485a2-24dc-4120-b452-3edbeea2ba18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:42.313752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83c17f5e-9388-46be-9259-f9ac8df4d80a req-7c0485a2-24dc-4120-b452-3edbeea2ba18 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:42.314250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83c17f5e-9388-46be-9259-f9ac8df4d80a req-7c0485a2-24dc-4120-b452-3edbeea2ba18 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:42.314703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-83c17f5e-9388-46be-9259-f9ac8df4d80a req-7c0485a2-24dc-4120-b452-3edbeea2ba18 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:42.326514 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-83c17f5e-9388-46be-9259-f9ac8df4d80a req-7c0485a2-24dc-4120-b452-3edbeea2ba18 service nova] Creating event network-changed:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h2-860863-4 Nov 02 22:25:42.331449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-83c17f5e-9388-46be-9259-f9ac8df4d80a req-7c0485a2-24dc-4120-b452-3edbeea2ba18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032098 Nov 02 22:25:42.332058 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3711/7302] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:25:43.195827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:43.196470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:43.203266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:43.203751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:43.204195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:43.204881 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:43.205365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:43.205794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:43.333639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:43.342152 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e662c837-5e37-44d8-a3ad-9411ebe70f38 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1361 microversion: 2.1 time: 0.150380 Nov 02 22:25:43.342727 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3592/7303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:43 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:44.366524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:44.367286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:44.373731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:44.374236 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:44.374695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:44.375405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:44.375902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:44.376351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:44.507026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:44.514632 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b3c321e-6fc0-478b-a9b6-f8877d34d33e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1361 microversion: 2.1 time: 0.153318 Nov 02 22:25:44.515200 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3712/7304] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:44 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:45.537957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:45.538572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:45.545877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:45.546364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:45.546806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:45.547497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:45.547960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:45.548390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:45.675707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:45.684241 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1f2d8b3-d331-42e3-8744-460da921d12b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1361 microversion: 2.1 time: 0.150276 Nov 02 22:25:45.684807 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3593/7305] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:45 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:46.707803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:46.708416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:46.715897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:46.716392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:46.716846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:46.717589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:46.718055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:46.718494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:46.850375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:46.858152 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84ba6c73-514c-4241-8db7-015fc2cf36b9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1361 microversion: 2.1 time: 0.154288 Nov 02 22:25:46.858722 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3713/7306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:46 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:47.881698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:47.882260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:47.890047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:47.890534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:47.890976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:47.891665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:47.892121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:47.892550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:48.021301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:48.029658 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9a25e5d-7edd-4eb9-9bd5-c3e2338feda2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1361 microversion: 2.1 time: 0.151924 Nov 02 22:25:48.030229 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3594/7307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:47 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:48.366000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a04f3e6a-5e20-4db8-95bd-006a3ca9ac25 req-85b1092b-7d7d-424f-971d-5a41f2e6c286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "name": "network-vif-plugged", "status": "completed", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:48.376529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a04f3e6a-5e20-4db8-95bd-006a3ca9ac25 req-85b1092b-7d7d-424f-971d-5a41f2e6c286 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:48.377069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a04f3e6a-5e20-4db8-95bd-006a3ca9ac25 req-85b1092b-7d7d-424f-971d-5a41f2e6c286 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:48.377537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a04f3e6a-5e20-4db8-95bd-006a3ca9ac25 req-85b1092b-7d7d-424f-971d-5a41f2e6c286 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:48.392103 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a04f3e6a-5e20-4db8-95bd-006a3ca9ac25 req-85b1092b-7d7d-424f-971d-5a41f2e6c286 service nova] Creating event network-vif-plugged:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h2-860863-4 Nov 02 22:25:48.397269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a04f3e6a-5e20-4db8-95bd-006a3ca9ac25 req-85b1092b-7d7d-424f-971d-5a41f2e6c286 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035091 Nov 02 22:25:48.397825 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3714/7308] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:25:49.053645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:49.054517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:49.056742 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:49.057437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:49.062980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:49.063464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:49.063902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:49.064589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:49.065066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:49.065533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:49.194870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:49.202864 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2036ecf8-0231-4cd3-86ab-192768f22247 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1361 microversion: 2.1 time: 0.153127 Nov 02 22:25:49.203454 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3595/7309] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:49 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:50.227128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:50.227809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:50.230002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:50.235848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:50.241000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:50.241000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:50.241000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:50.241000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:50.241000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:50.374344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:25:50.382148 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28b40d29-5226-489c-bcb7-a385d43f941e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1548 microversion: 2.1 time: 0.159586 Nov 02 22:25:50.382728 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3715/7310] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:25:50 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:25:50.405473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:25:50.405959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:25:50.412721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:50.413228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:50.413668 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:50.414381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:50.414924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:50.415351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:50.491613 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e4431d2-d802-4645-bb1e-ddd1b54df971 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089971 Nov 02 22:25:50.492765 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3596/7311] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 22:25:50 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:25:51.819444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-36de9d38-ed8a-4fc8-93b0-ca1a061d3118 req-a091e7b4-dc5f-4d5e-86a0-8df467fe109d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:25:51.825224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-36de9d38-ed8a-4fc8-93b0-ca1a061d3118 req-a091e7b4-dc5f-4d5e-86a0-8df467fe109d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:25:51.825772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-36de9d38-ed8a-4fc8-93b0-ca1a061d3118 req-a091e7b4-dc5f-4d5e-86a0-8df467fe109d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:25:51.826178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-36de9d38-ed8a-4fc8-93b0-ca1a061d3118 req-a091e7b4-dc5f-4d5e-86a0-8df467fe109d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:25:51.830163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:25:51.837535 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-36de9d38-ed8a-4fc8-93b0-ca1a061d3118 req-a091e7b4-dc5f-4d5e-86a0-8df467fe109d service nova] Creating event network-changed:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h2-860863-4 Nov 02 22:25:51.842815 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-36de9d38-ed8a-4fc8-93b0-ca1a061d3118 req-a091e7b4-dc5f-4d5e-86a0-8df467fe109d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034284 Nov 02 22:25:51.843656 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3716/7312] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:26:25.103088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:26:25.104375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=67 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:26:25.108807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:25.109446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:25.115480 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:25.115965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:25.128571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:25.128571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:25.128571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:25.128571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:25.249220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:25.256964 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8587b26-67d5-4527-af41-8d7f2c1df9dc tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1666 microversion: 2.1 time: 0.155922 Nov 02 22:26:25.257537 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3597/7313] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:25 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:25.278747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:26:25.283098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0772734-7288-44ad-81de-c8ed77b243d5"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:26:25.285582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:25.293606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:25.294102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:25.294550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:25.295385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:25.295857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:25.296302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:26.049833 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7c80f213-686b-4553-a298-2906a4c53f7b tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774297 Nov 02 22:26:26.050447 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3717/7314] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 22:26:25 2022] POST /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:26:37.826566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:26:37.828905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:37.831184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:26:37.831830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:26:37.836521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:37.837041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:37.837487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:37.838184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:37.838640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:37.839070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:37.870070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:37.876123 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Old instance type m1.heat2, new instance type m1.heat {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:26:37.882865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:26:37.883286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:26:37.883758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:26:37.884169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:26:37.884577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:26:38.112555 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ec28711-7b15-4eba-9a80-23d652b04e12 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/action" status: 202 len: 0 microversion: 2.1 time: 0.290092 Nov 02 22:26:38.113234 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3598/7315] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:26:37 2022] POST /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 22:26:38.119682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:26:38.120567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:26:38.125125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:38.125606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:38.131928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:38.132528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:38.133013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:38.133767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:38.134266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:38.134713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:38.272064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:38.281175 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-401b4309-799b-44d1-a756-1ec9c7a4a5af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1721 microversion: 2.1 time: 0.163327 Nov 02 22:26:38.281683 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3718/7316] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:38 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:39.306256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:39.306807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:39.313454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:39.313943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:39.314383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:39.315075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:39.315531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:39.315962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:39.447451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:39.456107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1ab9db00-e2d3-4493-9c2e-1207236996a9 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1721 microversion: 2.1 time: 0.154959 Nov 02 22:26:39.456686 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3599/7317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:39 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:40.479843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:40.480490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:40.489655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:40.490160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:40.490617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:40.491393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:40.491864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:40.492311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:40.626900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:40.635280 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f155c309-f9b4-418a-9a7f-dcfcc292674d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1721 microversion: 2.1 time: 0.159509 Nov 02 22:26:40.635852 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3719/7318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:40 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:41.658910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:41.659536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:41.666875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:41.667365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:41.667809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:41.668498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:41.668976 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:41.669411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:41.798608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:41.807209 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3900986f-c760-4bec-96d0-569194b7e2b3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.152330 Nov 02 22:26:41.818035 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3600/7319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:41 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:42.831407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:42.831973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:42.838833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:42.839319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:42.839770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:42.840463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:42.840939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:42.841384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:42.982927 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:42.991316 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c272450b-4718-491f-af29-f75c26e543bf tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.164234 Nov 02 22:26:42.991902 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3720/7320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:42 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:44.014815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:44.015432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:44.022470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:44.022965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:44.023406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:44.024132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:44.024588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:44.025053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:44.158810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:44.167088 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-16a49124-383d-4163-8f14-cadac2ec7474 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.156433 Nov 02 22:26:44.167659 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3601/7321] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:44 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:45.192203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:45.192765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:45.199546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:45.200035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:45.200487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:45.201265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:45.201885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:45.202322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:45.330677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:45.338924 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-877b5055-b503-4a54-809b-1329d44fe4c0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.150702 Nov 02 22:26:45.339501 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3721/7322] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:45 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:46.362867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:46.363482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:46.370389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:46.370875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:46.371307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:46.371985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:46.372435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:46.372860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:46.504792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:46.513010 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b6ad05e-7db8-4382-93d5-7225a70bf1b2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.154084 Nov 02 22:26:46.513584 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3602/7323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:46 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:47.538032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:47.538658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:47.545531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:47.546033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:47.546487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:47.547186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:47.547650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:47.548093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:47.684516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:47.692780 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-329b62cf-90f5-4ab6-95ac-ebceb50289c2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.158650 Nov 02 22:26:47.698567 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3722/7324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:47 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:48.716802 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:48.717455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:48.724324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:48.724806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:48.725294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:48.725978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:48.726432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:48.726854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:48.862279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:48.870595 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0413983-4c53-47dd-a6b9-7b1b7ed020fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.157764 Nov 02 22:26:48.871168 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3603/7325] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:48 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:49.894643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:49.895281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:49.902541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:49.902843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:49.903299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:49.904014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:49.904525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:49.904991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:50.043973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:50.053061 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d150780-2264-4e02-bf7c-22f078c381af tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.162360 Nov 02 22:26:50.053645 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3723/7326] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:49 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:51.077273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:51.077876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:51.084685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:51.085205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:51.085642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:51.086322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:51.086865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:51.087395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:51.218537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:51.226701 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f2c138f-97da-4fab-9319-ef2dd960359a tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.153941 Nov 02 22:26:51.227267 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3604/7327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:51 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:52.251166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:52.251700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:52.258609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:52.259102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:52.259546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:52.260245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:52.260706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:52.261177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:52.395039 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:52.403322 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd235822-569a-4632-9a0c-c1f383aa075d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.156711 Nov 02 22:26:52.403896 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3724/7328] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:52 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:53.427393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:53.427989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:53.435248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:53.435720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:53.436290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:53.437008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:53.437465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:53.437891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:53.571565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:53.581116 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c457eb8-9186-49b9-bd48-950490db9975 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.158232 Nov 02 22:26:53.581705 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3605/7329] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:53 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:26:54.605123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:54.605779 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:54.612953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:54.613455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:54.613904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:54.614626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:54.615074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:54.615509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:54.752339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:54.761141 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4f1cdf34-3c9b-4e3a-b5bd-f23f40461da3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1726 microversion: 2.1 time: 0.159784 Nov 02 22:26:54.761743 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3725/7330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:54 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:55.786214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:55.786816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:55.792767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:55.796251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:55.796251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:55.796251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:55.796251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:55.796251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:56.009144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:56.017598 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cdce4171-ac89-457e-adb6-5a53fa26af4d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1725 microversion: 2.1 time: 0.235946 Nov 02 22:26:56.018176 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3606/7331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:55 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:56.068386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-072909f8-642f-45f9-91c7-672e53642756 req-eb1a9725-e53e-4432-bf45-873fbc3af9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "name": "network-vif-unplugged", "status": "completed", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:26:56.081507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-072909f8-642f-45f9-91c7-672e53642756 req-eb1a9725-e53e-4432-bf45-873fbc3af9fe service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:56.082015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-072909f8-642f-45f9-91c7-672e53642756 req-eb1a9725-e53e-4432-bf45-873fbc3af9fe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:56.082473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-072909f8-642f-45f9-91c7-672e53642756 req-eb1a9725-e53e-4432-bf45-873fbc3af9fe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:56.094912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-072909f8-642f-45f9-91c7-672e53642756 req-eb1a9725-e53e-4432-bf45-873fbc3af9fe service nova] Creating event network-vif-unplugged:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h1-860863-4 Nov 02 22:26:56.100759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-072909f8-642f-45f9-91c7-672e53642756 req-eb1a9725-e53e-4432-bf45-873fbc3af9fe service nova] Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:26:56.112867 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-072909f8-642f-45f9-91c7-672e53642756 req-eb1a9725-e53e-4432-bf45-873fbc3af9fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048763 Nov 02 22:26:56.113516 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3726/7332] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:26:57.100229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:57.100838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:57.109565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:57.110228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:57.110991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:57.112055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:57.112709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:57.113161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:57.299607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:57.308482 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d3e7996-13a2-4759-acee-46455914a264 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1725 microversion: 2.1 time: 0.212067 Nov 02 22:26:57.309083 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3607/7333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:57 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:58.129980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b454ef29-c1de-41a1-8fcd-03b72b227e3b req-a2b2d462-ac99-4e5f-b1cc-a8e121f4661b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:26:58.139860 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b454ef29-c1de-41a1-8fcd-03b72b227e3b req-a2b2d462-ac99-4e5f-b1cc-a8e121f4661b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:58.140351 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b454ef29-c1de-41a1-8fcd-03b72b227e3b req-a2b2d462-ac99-4e5f-b1cc-a8e121f4661b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:58.140798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b454ef29-c1de-41a1-8fcd-03b72b227e3b req-a2b2d462-ac99-4e5f-b1cc-a8e121f4661b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:58.155678 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b454ef29-c1de-41a1-8fcd-03b72b227e3b req-a2b2d462-ac99-4e5f-b1cc-a8e121f4661b service nova] Creating event network-changed:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h1-860863-4 Nov 02 22:26:58.161306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-b454ef29-c1de-41a1-8fcd-03b72b227e3b req-a2b2d462-ac99-4e5f-b1cc-a8e121f4661b service nova] Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:26:58.171784 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b454ef29-c1de-41a1-8fcd-03b72b227e3b req-a2b2d462-ac99-4e5f-b1cc-a8e121f4661b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047776 Nov 02 22:26:58.172903 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3727/7334] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:26:58.332198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:58.333544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:58.341512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:58.342297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:58.342970 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:58.343792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:58.345320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:58.346012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:58.587161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:58.602802 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2fe13f85-0cff-41e3-bade-3b7fa4997910 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.274430 Nov 02 22:26:58.616308 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3608/7335] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:58 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:26:59.634926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:26:59.635684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:26:59.643233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:59.643745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:59.644203 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:59.644955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:26:59.645426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:26:59.645879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:26:59.809058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:26:59.818472 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b1ec11c-2c6f-45dd-8cf8-b066abe83074 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.189898 Nov 02 22:26:59.819076 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3728/7336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:26:59 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:00.847152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:00.847776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:00.855077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:00.855558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:00.856010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:00.856772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:00.857257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:00.857690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:00.991720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:01.000247 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f70293ec-81b4-46ad-9e22-70b1fc774f9d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.157614 Nov 02 22:27:01.001321 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3609/7337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:00 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:02.024166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:02.024943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:02.032232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:02.032748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:02.033228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:02.033945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:02.034420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:02.034873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:02.169186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:02.177628 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-18632c83-9bc4-4405-a1a8-748678724c92 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.157353 Nov 02 22:27:02.178215 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3729/7338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:02 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:03.202517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:03.203126 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:03.210381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:03.210864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:03.211301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:03.211992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:03.212446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:03.212872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:03.343990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:03.352479 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b9273f4f-d837-49df-843f-5c6885428d23 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.153786 Nov 02 22:27:03.353128 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3610/7339] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:03 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:04.375693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:04.376450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:04.383292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:04.383788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:04.384244 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:04.384956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:04.385428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:04.385897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:04.514017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:04.522516 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e982ebf-b3f5-47a8-9425-0f5c4a1c2cfe tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.150679 Nov 02 22:27:04.523123 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3730/7340] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:04 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:27:05.546034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:05.546652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:05.553994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:05.554506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:05.555221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:05.555911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:05.556364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:05.556793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:05.690809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:05.699050 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b5200dbe-f6ce-47e9-85a8-1f642db3f26f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.157001 Nov 02 22:27:05.699618 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3611/7341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:05 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:06.722667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:06.723296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:06.730224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:06.730722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:06.731180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:06.731885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:06.732354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:06.732798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:06.863003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:06.871285 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f86e956d-7a5a-4ea7-bdfa-cc20a04344ae tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.152665 Nov 02 22:27:06.871857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3731/7342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:06 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:07.895311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:07.895932 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:07.898684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=33 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:07.903453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:07.903948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:07.904395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:07.905214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:07.909621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:07.909621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:07.909621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:08.047017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:08.055742 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6771c0d1-c4f6-45a3-9262-484754ebd3a4 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.164333 Nov 02 22:27:08.056317 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3612/7343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:07 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:09.079910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:09.080550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:09.083415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=29 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:09.088159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:09.088665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:09.089233 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:09.089944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:09.090421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:09.090861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:09.223715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:09.232071 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b266675-93ac-4263-b583-bf147923a93f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.156327 Nov 02 22:27:09.232642 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3732/7344] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:09 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:10.256165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:10.256848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:10.263816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:10.264311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:10.264743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:10.265463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:10.265925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:10.266357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:10.468518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:10.477778 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1984302c-37fd-40d8-b14f-3893ab3cb17e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1723 microversion: 2.1 time: 0.225485 Nov 02 22:27:10.478366 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3613/7345] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:10 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:11.503679 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:11.504303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:11.511720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:11.512220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:11.512675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:11.513410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:11.513883 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:11.514354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:11.517430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=87 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:11.653324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:11.662670 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-062623c8-3bdc-485e-aeda-922716e9f928 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1720 microversion: 2.1 time: 0.162881 Nov 02 22:27:11.663266 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3733/7346] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:11 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:11.685888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:27:11.686425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:11.693890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:11.694371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:11.694809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:11.695485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:11.695936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:11.696358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:11.733041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:11.733515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:11.733943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:11.734652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:11.735099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:11.736085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:11.755904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:27:11.760834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Getting quotas for user b64d5fbeb3f340acbfd1c3307535a03c and project 16d6374bdfe64d0a8f58c8eebbc0e418. Resources: {'cores', 'ram'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:27:12.176412 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-15977ef7-c39e-45cf-9cf1-8c9062c48ad6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "POST /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/action" status: 202 len: 0 microversion: 2.1 time: 0.494224 Nov 02 22:27:12.177058 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3614/7347] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:27:11 2022] POST /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 22:27:12.185466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:12.186106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:12.194169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:12.194169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:12.194447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:12.195088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:12.195550 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:12.195987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:12.364563 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:12.373305 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb8eca2e-c4d4-42d4-ba78-d3e8e4c5dd80 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.191606 Nov 02 22:27:12.373903 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3734/7348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:12 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:27:13.399112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:13.399819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:13.406896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:13.407473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:13.407885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:13.408575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:13.409080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:13.409518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:13.543360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:13.552697 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff49d1de-076a-43b9-87cc-f1e809c0b6dd tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.158725 Nov 02 22:27:13.553306 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3615/7349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:13 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:14.270475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a1eb62d4-f3dc-4cf7-a9b0-e0af26a6bcf4 req-dbe1c45c-5813-4f09-a121-9f5d814e8665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "name": "network-vif-plugged", "status": "completed", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:27:14.280716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a1eb62d4-f3dc-4cf7-a9b0-e0af26a6bcf4 req-dbe1c45c-5813-4f09-a121-9f5d814e8665 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:14.281230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a1eb62d4-f3dc-4cf7-a9b0-e0af26a6bcf4 req-dbe1c45c-5813-4f09-a121-9f5d814e8665 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:14.281676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a1eb62d4-f3dc-4cf7-a9b0-e0af26a6bcf4 req-dbe1c45c-5813-4f09-a121-9f5d814e8665 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:14.295764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a1eb62d4-f3dc-4cf7-a9b0-e0af26a6bcf4 req-dbe1c45c-5813-4f09-a121-9f5d814e8665 service nova] Creating event network-vif-plugged:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h1-860863-4 Nov 02 22:27:14.302654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-a1eb62d4-f3dc-4cf7-a9b0-e0af26a6bcf4 req-dbe1c45c-5813-4f09-a121-9f5d814e8665 service nova] Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:27:14.314577 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a1eb62d4-f3dc-4cf7-a9b0-e0af26a6bcf4 req-dbe1c45c-5813-4f09-a121-9f5d814e8665 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047774 Nov 02 22:27:14.315416 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3735/7350] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:27:14.590956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:14.591576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:14.598913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:14.599408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:14.599856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:14.600553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:14.601046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:14.601535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:14.737689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:14.746316 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ee18a40-d253-4726-9d20-ad58dd7f9370 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.159229 Nov 02 22:27:14.747048 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3616/7351] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:14 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:15.771572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:15.772522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:15.780435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:15.781087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:15.781544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:15.782322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:15.782796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:15.783863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:15.931934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:15.940571 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2308cc5-2312-4ed7-85fb-73557754043f tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.174138 Nov 02 22:27:15.941175 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3736/7352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:15 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:27:16.963905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:16.964500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:16.971422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:16.971905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:16.972347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:16.973062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:16.973520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:16.973950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:17.107689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:17.116635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb26ded6-b5bb-4743-8a3f-053238a7268d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.156651 Nov 02 22:27:17.117252 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3617/7353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:16 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:18.139829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:18.141635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:18.149569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:18.150074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:18.150526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:18.151269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:18.152046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:18.152498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:18.170066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-564645b8-0f1f-446e-a867-1b11d37715ba req-ae7f4d45-5cee-447d-9fab-d7d51a1fe2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "name": "network-vif-unplugged", "status": "completed", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:27:18.188466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-564645b8-0f1f-446e-a867-1b11d37715ba req-ae7f4d45-5cee-447d-9fab-d7d51a1fe2ed service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:18.189257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-564645b8-0f1f-446e-a867-1b11d37715ba req-ae7f4d45-5cee-447d-9fab-d7d51a1fe2ed service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:18.190200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-564645b8-0f1f-446e-a867-1b11d37715ba req-ae7f4d45-5cee-447d-9fab-d7d51a1fe2ed service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:18.213929 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-564645b8-0f1f-446e-a867-1b11d37715ba req-ae7f4d45-5cee-447d-9fab-d7d51a1fe2ed service nova] Creating event network-vif-unplugged:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h2-860863-4 Nov 02 22:27:18.221259 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-564645b8-0f1f-446e-a867-1b11d37715ba req-ae7f4d45-5cee-447d-9fab-d7d51a1fe2ed service nova] Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:27:18.233926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-564645b8-0f1f-446e-a867-1b11d37715ba req-ae7f4d45-5cee-447d-9fab-d7d51a1fe2ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067350 Nov 02 22:27:18.235350 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3618/7354] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:27:18.315356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:18.325138 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9272bb0c-b90f-459c-bdd9-0704918b3e59 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.189031 Nov 02 22:27:18.327072 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3737/7355] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:18 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:19.352308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:19.353031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:19.359182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:19.359658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:19.360094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:19.360772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:19.361384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:19.361808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:19.384867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8583720f-12d5-4f23-9c6d-b650f0315858 req-a26e5b66-67c5-462c-aae4-4d8c04bd6b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:27:19.397250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8583720f-12d5-4f23-9c6d-b650f0315858 req-a26e5b66-67c5-462c-aae4-4d8c04bd6b5b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:19.397953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8583720f-12d5-4f23-9c6d-b650f0315858 req-a26e5b66-67c5-462c-aae4-4d8c04bd6b5b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:19.398485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8583720f-12d5-4f23-9c6d-b650f0315858 req-a26e5b66-67c5-462c-aae4-4d8c04bd6b5b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:19.411449 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8583720f-12d5-4f23-9c6d-b650f0315858 req-a26e5b66-67c5-462c-aae4-4d8c04bd6b5b service nova] Creating event network-changed:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h2-860863-4 Nov 02 22:27:19.417851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-8583720f-12d5-4f23-9c6d-b650f0315858 req-a26e5b66-67c5-462c-aae4-4d8c04bd6b5b service nova] Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:27:19.428872 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8583720f-12d5-4f23-9c6d-b650f0315858 req-a26e5b66-67c5-462c-aae4-4d8c04bd6b5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049187 Nov 02 22:27:19.429912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3738/7356] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:27:19.905812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:19.915175 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-335b8a82-e689-49ef-8de0-b03c84b2b948 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.567756 Nov 02 22:27:19.932669 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3619/7357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:19 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:20.941604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:20.942346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:20.948644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:20.949234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:20.949691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:20.950398 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:20.950867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:20.951313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:21.087592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:21.096251 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-42859680-1710-4af3-b224-98e132db6d0d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.159958 Nov 02 22:27:21.096919 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3739/7358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:20 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:22.120890 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:22.121852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:22.124958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:22.130779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:22.132322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:22.132322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:22.132516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:22.133008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:22.133445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:22.270584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:22.279096 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d5a547c2-2382-4ac9-93b5-9324bc772923 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.162244 Nov 02 22:27:22.279676 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3620/7359] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:22 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:23.304572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:23.305605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:23.312594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:23.314869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:23.315671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:23.316406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:23.316884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:23.317358 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:23.457720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:23.466288 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71669f5b-8ce7-463d-8117-ccbb0341b9e6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.165876 Nov 02 22:27:23.468869 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3740/7360] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:23 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:24.491603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:24.492217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:24.499273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:24.499753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:24.500208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:24.500895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:24.501370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:24.501943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:24.640949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:24.650220 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-931e87ea-5ba2-45eb-b0b3-1698c49d6031 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.162372 Nov 02 22:27:24.651045 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3621/7361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:24 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:25.675732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:25.676291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:25.683583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:25.684083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:25.684538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:25.685274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:25.685742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:25.686187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:25.816964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:25.825313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c58384b-1c2a-4ec0-a02b-2601be9d2448 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.154131 Nov 02 22:27:25.825896 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3741/7362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:25 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:26.849474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:26.850090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:26.856261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:26.856741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:26.857209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:26.857886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:26.858337 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:26.858778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:26.994010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:27.002405 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b66bd88-77d0-49a7-9875-5bbee1599326 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.157358 Nov 02 22:27:27.002990 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3622/7363] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:26 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:28.026640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:28.027304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:28.034126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:28.036363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:28.036363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:28.036363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:28.036363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:28.036755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:28.166647 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:28.175531 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cecd36d9-36a5-43e7-94b3-6a0414dba9b8 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.152986 Nov 02 22:27:28.176107 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3742/7364] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:28 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:29.198618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:29.199188 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:29.207298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:29.207777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:29.208212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:29.208894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:29.209367 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:29.209791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:29.343592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:29.352117 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-07d8c468-c3f9-4efa-b5c3-af609a218e2c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.157489 Nov 02 22:27:29.352690 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3623/7365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:29 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:30.375649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:30.376272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:30.383449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:30.383951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:30.384402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:30.385132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:30.385599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:30.386037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:30.519677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:30.528033 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b0055ab-16df-416c-880e-ee857ab360fa tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.156281 Nov 02 22:27:30.528636 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3743/7366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:30 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:31.551046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:31.551646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:31.558678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:31.559344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:31.559800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:31.560482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:31.560956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:31.561381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:31.694083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:31.702494 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59e5cf9f-d048-4f3e-88cb-30d17d5cfbed tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1719 microversion: 2.1 time: 0.155375 Nov 02 22:27:31.703078 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3624/7367] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:31 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:32.727202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:32.727892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:32.734687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:32.735181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:32.735632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:32.737100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:32.737573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:32.738034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:32.871366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:32.879875 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d222ff68-2adc-4020-8c14-cd1b7aada76d tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1712 microversion: 2.1 time: 0.156677 Nov 02 22:27:32.880452 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3744/7368] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:32 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1712 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:32.902654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:32.903283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:32.911173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:32.911671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:32.912117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:32.912821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:32.916616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:32.916616 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:33.046561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:33.055871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b8bce00f-29d4-4c52-866e-1db2cc48b423 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1712 microversion: 2.1 time: 0.157005 Nov 02 22:27:33.056455 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3625/7369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:32 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1712 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:33.078607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:33.079238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:33.085523 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:33.086031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:33.086494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:33.087205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:33.087677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:33.088128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:33.222792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:33.231010 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d827d4f-ed59-4120-bb55-2ef8b9ea1dc6 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1712 microversion: 2.1 time: 0.156295 Nov 02 22:27:33.231582 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3745/7370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:33 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:33.254173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:33.254623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:33.260492 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:33.261001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:33.261445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:33.262132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:33.262588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:33.263024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:33.265574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:33.288759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:27:33.563803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bcbe8e7f-d47c-4d12-97c4-2c6a66afe46c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 204 len: 0 microversion: 2.1 time: 0.313917 Nov 02 22:27:33.564420 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3626/7371] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:27:33 2022] DELETE /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:27:33.572782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:33.573456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:33.579434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:33.579956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:33.580380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:33.581116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:33.581582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:33.582018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:33.714682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:33.723908 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7fae6a5a-efea-49be-b4a8-712f06f4fce0 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1718 microversion: 2.1 time: 0.155046 Nov 02 22:27:33.724489 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3746/7372] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:33 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:34.748163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:34.748867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:34.756594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:34.757184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:34.757627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:34.758314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:34.758765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:34.759220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:34.894559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:34.903384 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d102c8a5-c8e2-473d-a36f-e05866147569 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1718 microversion: 2.1 time: 0.159415 Nov 02 22:27:34.903968 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3627/7373] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:34 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:35.930062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:35.931588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:35.938660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:35.939427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:35.939880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:35.940606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:35.941082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:35.941744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:35.958712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-4dbbd0fc-bc4e-43cc-acf7-cecd5c998055 req-beb34420-93d6-44f0-a337-8201f71c4b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f9b5e3-4930-4839-8c58-fa9b358d38fb", "name": "network-vif-deleted", "tag": "bf037ff0-bf48-47b6-b124-57e189cac342"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:27:35.970918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4dbbd0fc-bc4e-43cc-acf7-cecd5c998055 req-beb34420-93d6-44f0-a337-8201f71c4b78 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:35.971948 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4dbbd0fc-bc4e-43cc-acf7-cecd5c998055 req-beb34420-93d6-44f0-a337-8201f71c4b78 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:35.972560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-4dbbd0fc-bc4e-43cc-acf7-cecd5c998055 req-beb34420-93d6-44f0-a337-8201f71c4b78 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:35.989700 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-4dbbd0fc-bc4e-43cc-acf7-cecd5c998055 req-beb34420-93d6-44f0-a337-8201f71c4b78 service nova] Creating event network-vif-deleted:bf037ff0-bf48-47b6-b124-57e189cac342 for instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb on n-h2-860863-4 Nov 02 22:27:35.995281 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-4dbbd0fc-bc4e-43cc-acf7-cecd5c998055 req-beb34420-93d6-44f0-a337-8201f71c4b78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040434 Nov 02 22:27:35.997062 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3628/7374] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:27:36.019119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:36.028028 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1901069c-4bb3-40b5-a8a3-341d93fba724 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1653 microversion: 2.1 time: 0.101771 Nov 02 22:27:36.028615 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3747/7375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:35 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1653 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:37.053453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:37.054220 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:37.060766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:37.061279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:37.061746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:37.062447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:37.062902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:37.063328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:37.129214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:37.138746 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62313a0c-a1ff-4bf3-bba9-50364b66a1e7 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1369 microversion: 2.1 time: 0.090552 Nov 02 22:27:37.149172 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3629/7376] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:37 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:27:38.164322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:38.164964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:38.174377 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:38.174894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:38.175357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:38.176086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:38.176594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:38.177077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:38.244235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:38.252648 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf5b8b0d-f650-4cb0-9b2f-ae707110ee5e tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1369 microversion: 2.1 time: 0.092864 Nov 02 22:27:38.253237 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3748/7377] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:38 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:39.275172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:39.275765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:39.278669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:39.283523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:39.284014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:39.284457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:39.285189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:39.285645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:39.286077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:39.356958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:39.366043 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-561d8a95-2579-4de4-b6e6-db4390148a7c tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1369 microversion: 2.1 time: 0.094692 Nov 02 22:27:39.366629 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3630/7378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:39 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:40.389799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:40.390434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:40.393929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:40.398542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:40.399042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:40.399496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:40.400202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:40.400665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:40.401146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:40.433533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:40.436017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:40.436017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:40.436017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lazy-loading 'fault' on Instance uuid 48f9b5e3-4930-4839-8c58-fa9b358d38fb {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:27:40.481253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64d5fbeb3f340acbfd1c3307535a03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d6374bdfe64d0a8f58c8eebbc0e418', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:40.489926 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7722b07b-4a91-42f7-938a-3f1170958c57 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 200 len: 1374 microversion: 2.1 time: 0.104171 Nov 02 22:27:40.490506 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3749/7379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:40 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 1374 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:41.514693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:41.515310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:41.522738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:41.523224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:41.523665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:41.524386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:41.524847 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:41.525304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:41.538365 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb HTTP/1.1 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '48f9b5e3-4930-4839-8c58-fa9b358d38fb'} Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:41.539986 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-384ff454-9f20-4981-8561-0baee785fbb1 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 404 len: 111 microversion: 2.1 time: 0.030610 Nov 02 22:27:41.545132 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3631/7380] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:41 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:41.602568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:41.604731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:41.612989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:41.613548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:41.614003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:41.614704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:41.615171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:41.615623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:41.617985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:41.628958 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/os-volume_attachments HTTP/1.1 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': '48f9b5e3-4930-4839-8c58-fa9b358d38fb'} Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:41.630635 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eac040ae-ebf7-4fa8-a8c3-d5f876943730 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033462 Nov 02 22:27:41.635328 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3750/7381] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:27:41 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.120582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.121400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.129679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.130158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.130594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.131365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.131814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.132233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.146638 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb HTTP/1.1 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '48f9b5e3-4930-4839-8c58-fa9b358d38fb'} Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.148256 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fac3c51a-2375-4b58-adb5-df772c36d079 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 404 len: 111 microversion: 2.1 time: 0.033086 Nov 02 22:27:45.152400 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3632/7382] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:27:45 2022] DELETE /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.160051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.160687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 48f9b5e3-4930-4839-8c58-fa9b358d38fb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.169028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.169538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.170050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.170775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.171302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.171752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.185787 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb HTTP/1.1 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '48f9b5e3-4930-4839-8c58-fa9b358d38fb'} Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.187333 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 48f9b5e3-4930-4839-8c58-fa9b358d38fb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8ff610d3-1a8e-42b0-8619-81010a8b4149 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb" status: 404 len: 111 microversion: 2.1 time: 0.033697 Nov 02 22:27:45.191939 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3751/7383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:45 2022] GET /compute/v2.1/servers/48f9b5e3-4930-4839-8c58-fa9b358d38fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.197967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.198461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.205088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.205577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.206035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.206876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.207335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.207792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.222257 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd HTTP/1.1 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '0f58ad0f-305d-48d0-b4de-032524bf81fd'} Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.223848 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98026750-a77d-4aab-b377-0f80d1126233 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 404 len: 111 microversion: 2.1 time: 0.031177 Nov 02 22:27:45.228219 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3633/7384] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:27:45 2022] DELETE /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.233823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.234405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 0f58ad0f-305d-48d0-b4de-032524bf81fd] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.240589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.241124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.241587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.242294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.242767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.243215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.256999 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd HTTP/1.1 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '0f58ad0f-305d-48d0-b4de-032524bf81fd'} Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.258466 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 0f58ad0f-305d-48d0-b4de-032524bf81fd could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78ecf891-7c0b-4851-ba91-b9bfeefa0280 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd" status: 404 len: 111 microversion: 2.1 time: 0.029970 Nov 02 22:27:45.262811 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3752/7385] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:45 2022] GET /compute/v2.1/servers/0f58ad0f-305d-48d0-b4de-032524bf81fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:27:45.269151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.269652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.275666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.276144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.276579 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.277283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.277737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.278160 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.292814 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 HTTP/1.1 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '43c53e50-9d2e-48d9-9c49-eec1a4d75814'} Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.294376 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-63c382af-5c25-422c-b69b-e7c6f3a9f898 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 404 len: 111 microversion: 2.1 time: 0.031130 Nov 02 22:27:45.299021 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3634/7386] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:27:45 2022] DELETE /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.304673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.305613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 43c53e50-9d2e-48d9-9c49-eec1a4d75814] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.311851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.312361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.312827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.313760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.314923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.315384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.329761 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 HTTP/1.1 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '43c53e50-9d2e-48d9-9c49-eec1a4d75814'} Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.331855 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 43c53e50-9d2e-48d9-9c49-eec1a4d75814 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b9d42dd-1baf-4f1f-b0c1-c324bb621cd2 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814" status: 404 len: 111 microversion: 2.1 time: 0.032665 Nov 02 22:27:45.336425 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3753/7387] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:45 2022] GET /compute/v2.1/servers/43c53e50-9d2e-48d9-9c49-eec1a4d75814 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.342001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.342490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.349587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.350065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.350498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.351177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.351627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.352049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.365620 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f HTTP/1.1 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '303cd34b-e819-467c-8aa2-7b5daf23b22f'} Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.367150 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f957bb8a-8ff0-49e2-a5b3-0fd645e1cac3 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 404 len: 111 microversion: 2.1 time: 0.030290 Nov 02 22:27:45.374961 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3635/7388] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:27:45 2022] DELETE /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.378219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.378879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] [instance: 303cd34b-e819-467c-8aa2-7b5daf23b22f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:45.384985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.385542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.386005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.386719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:45.387196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:45.387644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:45.401688 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] HTTP exception thrown: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Request method failure captured: Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f HTTP/1.1 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu1ggJilxDHaAZjtvyL06FdF3IZL_qSDzjGkXhmGlZJv5OMG9jSWJcW_nYnjmFdkdHhOqeG6i9JQ0ZFTLCm6WByzcxprdDTZ_qxUPtkZt-F20x6ec4wNGMqbqveG4u9x9l4emNtAtGoY8QGMOhEVXGltPXKAAitjiaeTzm55l9EWmsQ Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/16d6374bdfe64d0a8f58c8eebbc0e418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 16d6374bdfe64d0a8f58c8eebbc0e418 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerActionsTestJSON-263095248 Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b64d5fbeb3f340acbfd1c3307535a03c Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServerActionsTestJSON-263095248-project Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '303cd34b-e819-467c-8aa2-7b5daf23b22f'} Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:27:45.403213 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Returning 404 to user: Instance 303cd34b-e819-467c-8aa2-7b5daf23b22f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e54c9dcc-a12d-40a1-8a33-ab59c5564ac5 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f" status: 404 len: 111 microversion: 2.1 time: 0.031327 Nov 02 22:27:45.408104 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3754/7389] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:45 2022] GET /compute/v2.1/servers/303cd34b-e819-467c-8aa2-7b5daf23b22f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:27:45.414087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d22c808-2f32-4e68-ba06-e792b7965d56 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] Calling method '.version_select at 0x7f9b6832ec10>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:45.536445 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d22c808-2f32-4e68-ba06-e792b7965d56 tempest-ServerActionsTestJSON-263095248 tempest-ServerActionsTestJSON-263095248-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777483192" status: 202 len: 0 microversion: 2.1 time: 0.125993 Nov 02 22:27:45.536979 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3636/7390] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Nov 2 22:27:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777483192 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:27:57.424564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=13 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:57.425376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=9 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:57.546783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-315230970", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "0122bd19-427f-4b51-9846-751c1156f1cf"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:27:57.608402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] validate_networks() for [('0122bd19-427f-4b51-9846-751c1156f1cf', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:27:58.089775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:27:58.090213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:27:58.090703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:27:58.091129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:27:58.091557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:27:58.101855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:58.102601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:58.103059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:58.103801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:58.104277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:58.104715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:58.122659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Getting quotas for project 0c1cfdef470b459ea5c52d1ddac5b739. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:27:58.128552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Getting quotas for user b42f9c7abbd24d318cdcc826bf7ab769 and project 0c1cfdef470b459ea5c52d1ddac5b739. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:27:58.142322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:27:58.145006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:27:58.259946 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ae097d4-74dc-4849-9c3e-468d2985e685 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840474 Nov 02 22:27:58.260812 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3755/7391] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:27:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:27:58.272712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-96bca22e-d381-413a-9d29-4fd9ec77803d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:58.273370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-96bca22e-d381-413a-9d29-4fd9ec77803d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:58.277058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:58.277727 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:27:58.336119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-96bca22e-d381-413a-9d29-4fd9ec77803d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:58.345500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-96bca22e-d381-413a-9d29-4fd9ec77803d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1216 microversion: 2.1 time: 0.076473 Nov 02 22:27:58.346011 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3637/7392] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:58 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:27:59.370152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:27:59.371475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:27:59.378656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:59.379314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:59.379784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:59.380514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:27:59.381017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:27:59.381469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:27:59.459547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:27:59.468435 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50b8157d-9ceb-4ccd-bdd4-87517487403c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1220 microversion: 2.1 time: 0.103725 Nov 02 22:27:59.469326 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3756/7393] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:27:59 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:00.492089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:00.492694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:00.502793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:00.506594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:00.506594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:00.506594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:00.506594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:00.506594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:00.618072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:00.626319 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6933887a-3fef-437f-8929-83d1440912ea tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1276 microversion: 2.1 time: 0.138067 Nov 02 22:28:00.627525 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3638/7394] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:00 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:28:01.659742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:01.660649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:01.669173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:01.670178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:01.671057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:01.672411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:01.673361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:01.674828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:01.955903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:01.964507 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ff9cb1d-b495-4a6d-9789-254a76b51c8e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1316 microversion: 2.1 time: 0.312484 Nov 02 22:28:01.965117 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3757/7395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:01 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:02.496830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5683259f-6327-4487-b62a-318a1d742c10 req-ac3203fa-2cfd-4281-a41a-ef022e72104f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "867d3927-dd34-4281-80d9-ab8124a7da4d", "tag": "32d6a5e5-4950-495f-92ef-8dd38135d13c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:02.508266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5683259f-6327-4487-b62a-318a1d742c10 req-ac3203fa-2cfd-4281-a41a-ef022e72104f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:02.508753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5683259f-6327-4487-b62a-318a1d742c10 req-ac3203fa-2cfd-4281-a41a-ef022e72104f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:02.509489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5683259f-6327-4487-b62a-318a1d742c10 req-ac3203fa-2cfd-4281-a41a-ef022e72104f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:02.521027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5683259f-6327-4487-b62a-318a1d742c10 req-ac3203fa-2cfd-4281-a41a-ef022e72104f service nova] Creating event network-changed:32d6a5e5-4950-495f-92ef-8dd38135d13c for instance 867d3927-dd34-4281-80d9-ab8124a7da4d on n-h1-860863-4 Nov 02 22:28:02.526305 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5683259f-6327-4487-b62a-318a1d742c10 req-ac3203fa-2cfd-4281-a41a-ef022e72104f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033348 Nov 02 22:28:02.526921 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3639/7396] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:28:02.992120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:02.992659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:02.999693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:03.000186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:03.000636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:03.001369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:03.002662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:03.003108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:03.206741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:03.216226 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-447bc3f2-b4f3-4ef5-a833-a2f15313b938 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1316 microversion: 2.1 time: 0.228045 Nov 02 22:28:03.216815 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3758/7397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:02 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:04.242267 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:04.242937 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:04.249117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:04.249603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:04.250043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:04.250731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:04.251185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:04.251892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:04.381865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:04.389549 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6c847222-a7fc-4e4d-a646-42c931898c61 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1316 microversion: 2.1 time: 0.152459 Nov 02 22:28:04.390122 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3640/7398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:04 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:05.412658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:05.413321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:05.420193 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:05.420696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:05.421182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:05.421949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:05.422378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:05.422823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:05.561082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:05.569005 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9239638-6c62-40b3-be50-083e721be469 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1316 microversion: 2.1 time: 0.160728 Nov 02 22:28:05.569579 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3759/7399] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:05 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:06.591671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:06.592305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:06.599793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:06.600272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:06.600709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:06.601418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:06.601867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:06.602290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:06.731829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:06.740351 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e20cf664-84c8-498c-b9c8-a70d0ecb9dce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1316 microversion: 2.1 time: 0.152634 Nov 02 22:28:06.740945 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3641/7400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:06 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:07.763438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:07.763993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:07.771446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:07.771947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:07.772406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:07.773152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:07.773629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:07.774077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:07.907277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:07.916036 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4b270edf-ed4c-45df-b77d-df6f427faa14 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1316 microversion: 2.1 time: 0.156590 Nov 02 22:28:07.916627 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3760/7401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:07 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:08.470540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dccb0a21-6d35-4829-b489-736e2133be6d req-efa035a8-21d8-4803-9144-2be1382b5808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867d3927-dd34-4281-80d9-ab8124a7da4d", "name": "network-vif-plugged", "status": "completed", "tag": "32d6a5e5-4950-495f-92ef-8dd38135d13c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:08.476524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:08.481784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dccb0a21-6d35-4829-b489-736e2133be6d req-efa035a8-21d8-4803-9144-2be1382b5808 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:08.482263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dccb0a21-6d35-4829-b489-736e2133be6d req-efa035a8-21d8-4803-9144-2be1382b5808 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:08.482694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dccb0a21-6d35-4829-b489-736e2133be6d req-efa035a8-21d8-4803-9144-2be1382b5808 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:08.494315 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dccb0a21-6d35-4829-b489-736e2133be6d req-efa035a8-21d8-4803-9144-2be1382b5808 service nova] Creating event network-vif-plugged:32d6a5e5-4950-495f-92ef-8dd38135d13c for instance 867d3927-dd34-4281-80d9-ab8124a7da4d on n-h1-860863-4 Nov 02 22:28:08.499299 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dccb0a21-6d35-4829-b489-736e2133be6d req-efa035a8-21d8-4803-9144-2be1382b5808 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Nov 02 22:28:08.500006 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3642/7402] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:28:08.940158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:08.940782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:08.942672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:08.943488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:08.948944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:08.949496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:08.950009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:08.950708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:08.951201 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:08.951642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:09.085946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:09.093604 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fe52961-b7c9-4ef3-8453-b4cd2894b85d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1316 microversion: 2.1 time: 0.157661 Nov 02 22:28:09.094172 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3761/7403] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:08 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:10.118786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:10.119411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:10.126014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:10.127586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:10.128030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:10.128719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:10.129199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:10.129628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:10.258724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:10.266530 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a6d69de-72eb-42aa-8b37-5dd99388999d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1506 microversion: 2.1 time: 0.152944 Nov 02 22:28:10.267119 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3643/7404] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:10 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:10.328509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-452941238", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "0122bd19-427f-4b51-9846-751c1156f1cf"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:10.381529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] validate_networks() for [('0122bd19-427f-4b51-9846-751c1156f1cf', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:28:10.758652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:28:10.759095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:28:10.759585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:28:10.760009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:28:10.760603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:28:10.769493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:10.769997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:10.770457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:10.771212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:10.771687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:10.772135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:10.788813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Getting quotas for project 0c1cfdef470b459ea5c52d1ddac5b739. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:28:10.793907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Getting quotas for user b42f9c7abbd24d318cdcc826bf7ab769 and project 0c1cfdef470b459ea5c52d1ddac5b739. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:28:10.806842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:28:10.809042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:28:10.940562 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f131e38-17ec-4a60-bbfb-f74cce364843 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615864 Nov 02 22:28:10.941180 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3762/7405] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:28:10.960782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a571f5ff-e304-46ff-b87a-f950b08397c7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:10.961877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a571f5ff-e304-46ff-b87a-f950b08397c7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:11.027472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a571f5ff-e304-46ff-b87a-f950b08397c7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:11.035198 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a571f5ff-e304-46ff-b87a-f950b08397c7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1216 microversion: 2.1 time: 0.082026 Nov 02 22:28:11.035831 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3644/7406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:10 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:12.059569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:12.060138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:12.067075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:12.067572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:12.068027 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:12.069866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:12.069866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:12.069866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:12.135911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:12.143958 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2acdc684-d3d2-48ae-a1f5-425b2806bf7c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1220 microversion: 2.1 time: 0.089504 Nov 02 22:28:12.144526 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3763/7407] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:12 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:13.167693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:13.168332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:13.176659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:13.177174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:13.177649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:13.178342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:13.178813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:13.179243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:13.243465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:13.251161 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-337d3152-271a-4e0a-9420-3f81145f1e94 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1274 microversion: 2.1 time: 0.087566 Nov 02 22:28:13.251792 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3645/7408] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:13 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:14.275049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:14.275819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:14.282620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:14.283727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:14.284190 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:14.284909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:14.285396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:14.285865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:14.419777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:14.429498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f494b43e-ac2b-47f6-915a-9b0c9434d783 req-9e8b4fd1-99da-4a40-8f3d-29a421959158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c23b7ea-2857-495f-9320-ff9c0ec9200a", "tag": "41b35fe3-0c8b-4717-91a2-4cf1b68465cf"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:14.430079 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41b60e49-f8ae-453e-8b30-edf3704e1158 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.158524 Nov 02 22:28:14.430583 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3764/7409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:14 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:14.442190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f494b43e-ac2b-47f6-915a-9b0c9434d783 req-9e8b4fd1-99da-4a40-8f3d-29a421959158 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:14.442757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f494b43e-ac2b-47f6-915a-9b0c9434d783 req-9e8b4fd1-99da-4a40-8f3d-29a421959158 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:14.443241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f494b43e-ac2b-47f6-915a-9b0c9434d783 req-9e8b4fd1-99da-4a40-8f3d-29a421959158 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:14.454465 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f494b43e-ac2b-47f6-915a-9b0c9434d783 req-9e8b4fd1-99da-4a40-8f3d-29a421959158 service nova] Creating event network-changed:41b35fe3-0c8b-4717-91a2-4cf1b68465cf for instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a on n-h2-860863-4 Nov 02 22:28:14.461243 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f494b43e-ac2b-47f6-915a-9b0c9434d783 req-9e8b4fd1-99da-4a40-8f3d-29a421959158 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037406 Nov 02 22:28:14.461852 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3646/7410] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:28:15.452975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:15.453545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:15.460418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:15.462891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:15.462891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:15.462891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:15.462891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:15.463297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:15.595592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:15.603739 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc569844-d406-44f9-b362-56612eef7580 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.154946 Nov 02 22:28:15.604310 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3765/7411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:15 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:16.628649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:16.629379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:16.636721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:16.637219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:16.637652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:16.638335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:16.638780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:16.639199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:16.770572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:16.778441 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-810e3f41-0bcf-4a5a-852a-78a068674da7 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.154678 Nov 02 22:28:16.779065 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3647/7412] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:16 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:17.801528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:17.802167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:17.809719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:17.810211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:17.810658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:17.811353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:17.811834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:17.812255 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:17.941539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:17.949193 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16e5f938-45d2-456e-bcfa-a8c6f6a532fb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.151756 Nov 02 22:28:17.949755 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3766/7413] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:17 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:18.972529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:18.975236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:18.980254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:18.980739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:18.981209 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:18.981915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:18.982371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:18.982805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:19.122242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:19.130093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e83b497a-0869-451f-8502-f1b47ac18428 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.161457 Nov 02 22:28:19.130664 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3648/7414] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:18 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:20.153112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:20.153757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:20.161053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:20.161561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:20.162021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:20.162743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:20.163209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:20.163661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:20.292303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:20.300864 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4068a332-acc6-40ec-b545-c3245f2db684 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.151793 Nov 02 22:28:20.301471 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3767/7415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:20 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:21.121656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-00073ad9-01aa-414a-a146-4709d154b9da req-56d3d9a4-824b-44d0-8994-e0e73cfb9fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c23b7ea-2857-495f-9320-ff9c0ec9200a", "name": "network-vif-plugged", "status": "completed", "tag": "41b35fe3-0c8b-4717-91a2-4cf1b68465cf"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:21.127602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:21.132789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-00073ad9-01aa-414a-a146-4709d154b9da req-56d3d9a4-824b-44d0-8994-e0e73cfb9fbe service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:21.133305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-00073ad9-01aa-414a-a146-4709d154b9da req-56d3d9a4-824b-44d0-8994-e0e73cfb9fbe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:21.133779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-00073ad9-01aa-414a-a146-4709d154b9da req-56d3d9a4-824b-44d0-8994-e0e73cfb9fbe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:21.145116 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-00073ad9-01aa-414a-a146-4709d154b9da req-56d3d9a4-824b-44d0-8994-e0e73cfb9fbe service nova] Creating event network-vif-plugged:41b35fe3-0c8b-4717-91a2-4cf1b68465cf for instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a on n-h2-860863-4 Nov 02 22:28:21.149992 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-00073ad9-01aa-414a-a146-4709d154b9da req-56d3d9a4-824b-44d0-8994-e0e73cfb9fbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032009 Nov 02 22:28:21.154176 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3649/7416] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:28:21.326065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:21.326729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:21.328713 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:21.329455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:21.335342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:21.338412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:21.338412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:21.338412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:21.338412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:21.338412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:21.483593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:21.492626 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b6e32b92-b609-4a0e-8eb6-39991490154a tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.170459 Nov 02 22:28:21.493262 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3768/7417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:21 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:22.519365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:22.520096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:22.526437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:22.526916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:22.527351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:22.528023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:22.528471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:22.528891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:22.665010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:22.673184 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7a639499-58a5-4374-ac4b-5347cec8a432 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1316 microversion: 2.1 time: 0.159957 Nov 02 22:28:22.673762 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3650/7418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:22 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:23.697037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:23.697750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:23.704749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:23.705290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:23.705955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:23.706656 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:23.707129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:23.707568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:23.839626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:23.847936 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e01cf285-c8d2-4b88-8abe-5d784c36f714 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1505 microversion: 2.1 time: 0.154844 Nov 02 22:28:23.848436 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3769/7419] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:23 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:23.870217 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:23.870737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:23.877595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:23.878077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:23.878542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:23.879283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:23.879764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:23.880191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:23.905161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:28:24.199188 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c0249e20-d8ff-4531-8e2d-447d5f5a5d35 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 204 len: 0 microversion: 2.1 time: 0.332457 Nov 02 22:28:24.199837 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3651/7420] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:28:23 2022] DELETE /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:28:24.207809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:24.209529 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:24.214409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:24.214899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:24.215355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:24.216051 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:24.216513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:24.216966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:24.347204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:24.355191 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5302121-c11f-418c-b6e2-485f60f60d71 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1511 microversion: 2.1 time: 0.151218 Nov 02 22:28:24.355774 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3770/7421] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:24 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:25.378697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:25.379397 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:25.385309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:25.385795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:25.386236 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:25.386924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:25.387377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:25.387806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:25.520248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:25.527963 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ccc7e43f-7bbe-41b3-be55-84167f37b12d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1511 microversion: 2.1 time: 0.153910 Nov 02 22:28:25.528534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3652/7422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:25 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:26.082874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-250721e8-0dce-434b-8bc4-df4289e93f42 req-2641b2c9-2431-48b1-9e99-9042709d1d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c23b7ea-2857-495f-9320-ff9c0ec9200a", "name": "network-vif-deleted", "tag": "41b35fe3-0c8b-4717-91a2-4cf1b68465cf"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:26.095735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-250721e8-0dce-434b-8bc4-df4289e93f42 req-2641b2c9-2431-48b1-9e99-9042709d1d2a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:26.096434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-250721e8-0dce-434b-8bc4-df4289e93f42 req-2641b2c9-2431-48b1-9e99-9042709d1d2a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:26.097263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-250721e8-0dce-434b-8bc4-df4289e93f42 req-2641b2c9-2431-48b1-9e99-9042709d1d2a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:26.110235 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-250721e8-0dce-434b-8bc4-df4289e93f42 req-2641b2c9-2431-48b1-9e99-9042709d1d2a service nova] Creating event network-vif-deleted:41b35fe3-0c8b-4717-91a2-4cf1b68465cf for instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a on n-h2-860863-4 Nov 02 22:28:26.116452 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-250721e8-0dce-434b-8bc4-df4289e93f42 req-2641b2c9-2431-48b1-9e99-9042709d1d2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040264 Nov 02 22:28:26.121845 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3771/7423] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:28:26.551694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:26.552306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:26.559570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:26.560137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:26.560588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:26.561302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:26.561792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:26.562222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:26.596205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:26.596682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:26.597159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:26.597797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lazy-loading 'fault' on Instance uuid 2c23b7ea-2857-495f-9320-ff9c0ec9200a {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:28:26.640919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:26.649359 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1dd3d337-98b9-401f-8398-d9e671916a20 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 200 len: 1306 microversion: 2.1 time: 0.101599 Nov 02 22:28:26.649930 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3653/7424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:26 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:27.673225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:27.673956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:27.676149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:27.681341 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:27.681841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:27.682299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:27.683004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:27.683471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:27.683914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:27.686486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=91 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:27.698473 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] HTTP exception thrown: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Request method failure captured: Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a HTTP/1.1 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu7tyk0WSwynhTts_ypoamWVz9YN8bWrYraVPUl_e9Q9yXhoekBjmrSRsxN8IH32NY8ZHjJuFVOHHuqLN5zzmDCi0f_8sZPSMyN04H6kF1ABHJOa5PtmUmKif4sGR5jtc4C6Om050UMRluCMks8uoUrt95dW6HKlxJmZvz7bMGQhOmk Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b42f9c7abbd24d318cdcc826bf7ab769 Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2c23b7ea-2857-495f-9320-ff9c0ec9200a'} Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:27.700146 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Returning 404 to user: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74a15732-c7a2-4859-9892-09cfe87b58b6 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 404 len: 111 microversion: 2.1 time: 0.033726 Nov 02 22:28:27.705153 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3772/7425] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:27 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:28:27.711884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:27.712507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:27.719273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:27.719756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:27.720194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:27.720878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:27.721358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:27.721787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:27.848920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:27.856635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1c71fec3-a8ad-4395-9273-8a5a4d2cb366 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1506 microversion: 2.1 time: 0.148920 Nov 02 22:28:27.857238 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3654/7426] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:27 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:27.881216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1440f5da-114a-4054-b459-1b8f111ad60e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:27.883528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1440f5da-114a-4054-b459-1b8f111ad60e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 594cd39d-dec9-49ac-afb6-9d039ef1d596] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:27.889657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-1440f5da-114a-4054-b459-1b8f111ad60e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] HTTP exception thrown: Instance 594cd39d-dec9-49ac-afb6-9d039ef1d596 could not be found. Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1440f5da-114a-4054-b459-1b8f111ad60e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Request method failure captured: Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/594cd39d-dec9-49ac-afb6-9d039ef1d596/action HTTP/1.1 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 32 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu7tyk0WSwynhTts_ypoamWVz9YN8bWrYraVPUl_e9Q9yXhoekBjmrSRsxN8IH32NY8ZHjJuFVOHHuqLN5zzmDCi0f_8sZPSMyN04H6kF1ABHJOa5PtmUmKif4sGR5jtc4C6Om050UMRluCMks8uoUrt95dW6HKlxJmZvz7bMGQhOmk Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b42f9c7abbd24d318cdcc826bf7ab769 Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: {"resize": {"flavorRef": "452"}} Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 594cd39d-dec9-49ac-afb6-9d039ef1d596 could not be found. Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '594cd39d-dec9-49ac-afb6-9d039ef1d596', 'body': {'resize': {'flavorRef': '452'}}} Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594cd39d-dec9-49ac-afb6-9d039ef1d596 could not be found. Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:28:27.891206 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594cd39d-dec9-49ac-afb6-9d039ef1d596 could not be found. Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594cd39d-dec9-49ac-afb6-9d039ef1d596 could not be found. Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1440f5da-114a-4054-b459-1b8f111ad60e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Returning 404 to user: Instance 594cd39d-dec9-49ac-afb6-9d039ef1d596 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1440f5da-114a-4054-b459-1b8f111ad60e tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "POST /compute/v2.1/servers/594cd39d-dec9-49ac-afb6-9d039ef1d596/action" status: 404 len: 111 microversion: 2.1 time: 0.016872 Nov 02 22:28:27.895605 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3773/7427] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:28:27 2022] POST /compute/v2.1/servers/594cd39d-dec9-49ac-afb6-9d039ef1d596/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:28:27.906601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:27.906601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:27.908154 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:27.908664 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:27.909131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:27.909830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:27.910289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:27.910725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.037962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:28.046373 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d4ed2378-4d3a-4dcc-b5b5-48dc6b7ef8dd tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1506 microversion: 2.1 time: 0.148866 Nov 02 22:28:28.046938 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3655/7428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:27 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:28.071410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:28.072032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.078958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.079480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.079943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.080627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.081128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.081573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.214291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:28.222041 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b3ec136-94b1-44a6-8c9c-eb512fe318f4 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1506 microversion: 2.1 time: 0.154801 Nov 02 22:28:28.223113 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3774/7429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:28 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:28.245534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "871543e3-e447-4e64-b02f-6e7b9c38e94c"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:28.247661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.253666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.254151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.254581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.255263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.255712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.256134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.260344 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:28.340048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:28.343847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] HTTP exception thrown: Flavor 871543e3-e447-4e64-b02f-6e7b9c38e94c could not be found. Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Request method failure captured: Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: request: POST /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d/action HTTP/1.1 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 65 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu7tyk0WSwynhTts_ypoamWVz9YN8bWrYraVPUl_e9Q9yXhoekBjmrSRsxN8IH32NY8ZHjJuFVOHHuqLN5zzmDCi0f_8sZPSMyN04H6kF1ABHJOa5PtmUmKif4sGR5jtc4C6Om050UMRluCMks8uoUrt95dW6HKlxJmZvz7bMGQhOmk Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b42f9c7abbd24d318cdcc826bf7ab769 Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: {"resize": {"flavorRef": "871543e3-e447-4e64-b02f-6e7b9c38e94c"}} Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: exception: Flavor 871543e3-e447-4e64-b02f-6e7b9c38e94c could not be found. Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '867d3927-dd34-4281-80d9-ab8124a7da4d', 'body': {'resize': {'flavorRef': '871543e3-e447-4e64-b02f-6e7b9c38e94c'}}} Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:28.366218 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 871543e3-e447-4e64-b02f-6e7b9c38e94c could not be found. Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 871543e3-e447-4e64-b02f-6e7b9c38e94c could not be found. Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 871543e3-e447-4e64-b02f-6e7b9c38e94c could not be found. Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Returning 400 to user: Flavor 871543e3-e447-4e64-b02f-6e7b9c38e94c could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-998765a2-b374-458e-bed1-6d3dbcc2a78b tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "POST /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d/action" status: 400 len: 107 microversion: 2.1 time: 0.126282 Nov 02 22:28:28.370987 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3656/7430] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:28:28 2022] POST /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d/action => generated 107 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 22:28:28.376660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:28.377329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.383493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.383995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.384451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.385195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.385668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.386112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.515195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:28.523552 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f329e80-082a-4add-a257-775c9fe74c55 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1506 microversion: 2.1 time: 0.150666 Nov 02 22:28:28.524127 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3775/7431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:28 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:28.547427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:28.548036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.554247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.554725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.555159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.555833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.556546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.556999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.688330 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:28.696824 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9bf360d3-fd6f-419e-9ebe-beefa914dce1 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1506 microversion: 2.1 time: 0.153598 Nov 02 22:28:28.697424 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3657/7432] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:28 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:28.719729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84831f39-60d9-4da6-8f9b-924ace365234 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84831f39-60d9-4da6-8f9b-924ace365234 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Request method failure captured: Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d/action HTTP/1.1 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 29 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu7tyk0WSwynhTts_ypoamWVz9YN8bWrYraVPUl_e9Q9yXhoekBjmrSRsxN8IH32NY8ZHjJuFVOHHuqLN5zzmDCi0f_8sZPSMyN04H6kF1ABHJOa5PtmUmKif4sGR5jtc4C6Om050UMRluCMks8uoUrt95dW6HKlxJmZvz7bMGQhOmk Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b42f9c7abbd24d318cdcc826bf7ab769 Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: {"resize": {"flavorRef": ""}} Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '867d3927-dd34-4281-80d9-ab8124a7da4d', 'body': {'resize': {'flavorRef': ''}}} Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['resize']: Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '' Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.724343 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84831f39-60d9-4da6-8f9b-924ace365234 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84831f39-60d9-4da6-8f9b-924ace365234 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "POST /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d/action" status: 400 len: 113 microversion: 2.1 time: 0.010119 Nov 02 22:28:28.729652 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3776/7433] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:28:28 2022] POST /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 22:28:28.735310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:28.735936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.742901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.743380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.743811 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.744490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.744956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.745387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.873290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:28.881515 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e489c72-8c6d-48f3-b6de-8e13649aefce tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1506 microversion: 2.1 time: 0.149921 Nov 02 22:28:28.882084 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3658/7434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:28 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:28.907824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:28.908338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.916175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.916677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.917169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.917881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.918356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.918836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.934481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] HTTP exception thrown: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Request method failure captured: Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a HTTP/1.1 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu7tyk0WSwynhTts_ypoamWVz9YN8bWrYraVPUl_e9Q9yXhoekBjmrSRsxN8IH32NY8ZHjJuFVOHHuqLN5zzmDCi0f_8sZPSMyN04H6kF1ABHJOa5PtmUmKif4sGR5jtc4C6Om050UMRluCMks8uoUrt95dW6HKlxJmZvz7bMGQhOmk Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: b42f9c7abbd24d318cdcc826bf7ab769 Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '2c23b7ea-2857-495f-9320-ff9c0ec9200a'} Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:28:28.936058 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Returning 404 to user: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f1ed945-4cca-43d7-ba91-ffeb71907789 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 404 len: 111 microversion: 2.1 time: 0.034416 Nov 02 22:28:28.940519 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3777/7435] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:28:28 2022] DELETE /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:28:28.947061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:28.947678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 2c23b7ea-2857-495f-9320-ff9c0ec9200a] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.953613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.954094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.954533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.955213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.955662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.956091 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.969413 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] HTTP exception thrown: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Request method failure captured: Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a HTTP/1.1 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu7tyk0WSwynhTts_ypoamWVz9YN8bWrYraVPUl_e9Q9yXhoekBjmrSRsxN8IH32NY8ZHjJuFVOHHuqLN5zzmDCi0f_8sZPSMyN04H6kF1ABHJOa5PtmUmKif4sGR5jtc4C6Om050UMRluCMks8uoUrt95dW6HKlxJmZvz7bMGQhOmk Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b42f9c7abbd24d318cdcc826bf7ab769 Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '2c23b7ea-2857-495f-9320-ff9c0ec9200a'} Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:28.970928 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Returning 404 to user: Instance 2c23b7ea-2857-495f-9320-ff9c0ec9200a could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97b22ac9-3b65-482b-89a8-3f3f401544eb tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a" status: 404 len: 111 microversion: 2.1 time: 0.029198 Nov 02 22:28:28.976087 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3659/7436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:28 2022] GET /compute/v2.1/servers/2c23b7ea-2857-495f-9320-ff9c0ec9200a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:28:28.981969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:28.982489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:28.989066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.989570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.990033 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:28.990745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:28.991216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:28.991665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:29.019014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:28:29.276682 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-507bcf54-c317-4380-9d85-1753cb07c98c tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 204 len: 0 microversion: 2.1 time: 0.298209 Nov 02 22:28:29.277283 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3778/7437] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:28:28 2022] DELETE /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:28:29.285614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:29.286234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:29.292399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:29.292884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:29.293391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:29.294082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:29.294538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:29.294971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:29.425790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:29.433885 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb2fdc36-e837-42e9-a50a-26f19be3d944 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1512 microversion: 2.1 time: 0.152426 Nov 02 22:28:29.434479 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3660/7438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:29 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:30.458490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:30.459202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:30.466126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:30.466622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:30.467072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:30.467783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:30.468247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:30.468684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:30.603543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:30.611433 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89b36aad-429d-482b-a4ad-648a1b5d631d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1512 microversion: 2.1 time: 0.157419 Nov 02 22:28:30.612014 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3779/7439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:30 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:31.240500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-71cf44ab-f00c-4c23-bd53-1cf06c5a777c req-c3e4967a-6833-4d66-b5f7-98eabf06769f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867d3927-dd34-4281-80d9-ab8124a7da4d", "name": "network-vif-deleted", "tag": "32d6a5e5-4950-495f-92ef-8dd38135d13c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:28:31.246730 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:28:31.252675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-71cf44ab-f00c-4c23-bd53-1cf06c5a777c req-c3e4967a-6833-4d66-b5f7-98eabf06769f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:31.255709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-71cf44ab-f00c-4c23-bd53-1cf06c5a777c req-c3e4967a-6833-4d66-b5f7-98eabf06769f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:31.255709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-71cf44ab-f00c-4c23-bd53-1cf06c5a777c req-c3e4967a-6833-4d66-b5f7-98eabf06769f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:31.266216 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-71cf44ab-f00c-4c23-bd53-1cf06c5a777c req-c3e4967a-6833-4d66-b5f7-98eabf06769f service nova] Creating event network-vif-deleted:32d6a5e5-4950-495f-92ef-8dd38135d13c for instance 867d3927-dd34-4281-80d9-ab8124a7da4d on n-h1-860863-4 Nov 02 22:28:31.271738 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-71cf44ab-f00c-4c23-bd53-1cf06c5a777c req-c3e4967a-6833-4d66-b5f7-98eabf06769f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035844 Nov 02 22:28:31.272723 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3661/7440] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:28:31.636089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:31.637294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:31.644692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:31.645426 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:31.645884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:31.646597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:31.647062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:31.647507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:31.678873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:31.684216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:31.684216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:31.684216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lazy-loading 'fault' on Instance uuid 867d3927-dd34-4281-80d9-ab8124a7da4d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:28:31.724262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b42f9c7abbd24d318cdcc826bf7ab769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1cfdef470b459ea5c52d1ddac5b739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:28:31.731835 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dde58a62-3105-4ebf-b85b-0d7c4a8cde37 tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 200 len: 1306 microversion: 2.1 time: 0.100072 Nov 02 22:28:31.732407 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3780/7441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:31 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:28:32.758245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:28:32.758965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] [instance: 867d3927-dd34-4281-80d9-ab8124a7da4d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:28:32.765561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:32.766039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:32.766473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:32.767151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:28:32.767604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:28:32.768027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:28:32.782059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] HTTP exception thrown: Instance 867d3927-dd34-4281-80d9-ab8124a7da4d could not be found. Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Request method failure captured: Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d HTTP/1.1 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu7tyk0WSwynhTts_ypoamWVz9YN8bWrYraVPUl_e9Q9yXhoekBjmrSRsxN8IH32NY8ZHjJuFVOHHuqLN5zzmDCi0f_8sZPSMyN04H6kF1ABHJOa5PtmUmKif4sGR5jtc4C6Om050UMRluCMks8uoUrt95dW6HKlxJmZvz7bMGQhOmk Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0c1cfdef470b459ea5c52d1ddac5b739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 0c1cfdef470b459ea5c52d1ddac5b739 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-ServersNegativeTestJSON-369453967 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: b42f9c7abbd24d318cdcc826bf7ab769 Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-ServersNegativeTestJSON-369453967-project Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 867d3927-dd34-4281-80d9-ab8124a7da4d could not be found. Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '867d3927-dd34-4281-80d9-ab8124a7da4d'} Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867d3927-dd34-4281-80d9-ab8124a7da4d could not be found. Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867d3927-dd34-4281-80d9-ab8124a7da4d could not be found. Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:28:32.783696 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867d3927-dd34-4281-80d9-ab8124a7da4d could not be found. Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] Returning 404 to user: Instance 867d3927-dd34-4281-80d9-ab8124a7da4d could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5f9eb3ac-c374-409a-9606-1474cb22277d tempest-ServersNegativeTestJSON-369453967 tempest-ServersNegativeTestJSON-369453967-project] 10.222.0.25 "GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d" status: 404 len: 111 microversion: 2.1 time: 0.033582 Nov 02 22:28:32.788503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3662/7442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:28:32 2022] GET /compute/v2.1/servers/867d3927-dd34-4281-80d9-ab8124a7da4d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:29:16.931428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:16.932444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:17.093116 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69a59d44-5fc0-4a6d-a79d-a9a03637815d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: .version_select at 0x7f9b686cb280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1904670788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXSugHVFDCxF1gnAi4NXRFKgchN5v+s0pwKvPCxLK5W5BLoiCrlJHyUQ9JPvA/LqHZ5ubW6EHRw6IRap4ci0wQbVAINO/P/DUwBiUja7dCABPku2FBqBqbg5hUewX5wSA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:17.110273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-69a59d44-5fc0-4a6d-a79d-a9a03637815d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:29:17.116568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-69a59d44-5fc0-4a6d-a79d-a9a03637815d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for user 4b03000d3e1c437dbed778f14b5ee5a2 and project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:29:17.231788 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69a59d44-5fc0-4a6d-a79d-a9a03637815d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.306152 Nov 02 22:29:17.232744 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3781/7443] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:29:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:17.287782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-359722485", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1904670788", "networks": [{"uuid": "91f0640d-03ad-4db6-bba6-2e4a8e2e34d7"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:17.298139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=26 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:17.346987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] validate_networks() for [('91f0640d-03ad-4db6-bba6-2e4a8e2e34d7', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:29:17.766622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:29:17.767048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:29:17.767550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:29:17.767962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:29:17.769201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:29:17.781244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:17.781762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:17.782215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:17.782943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:17.783392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:17.783838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:17.802700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:29:17.808361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for user 4b03000d3e1c437dbed778f14b5ee5a2 and project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:29:17.826369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:29:17.826369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:29:17.964438 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-057de257-7d8c-42b5-acfe-9b87828b3a4c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681228 Nov 02 22:29:17.965573 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3663/7444] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:29:17.979000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bf84a34-d98a-4d1b-8a69-2f9b8a0c9a85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:17.979654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bf84a34-d98a-4d1b-8a69-2f9b8a0c9a85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:18.059354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5bf84a34-d98a-4d1b-8a69-2f9b8a0c9a85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:18.068979 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bf84a34-d98a-4d1b-8a69-2f9b8a0c9a85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1262 microversion: 2.1 time: 0.094968 Nov 02 22:29:18.070220 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3782/7445] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:17 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:19.092596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-08c86560-f2d0-4eea-adb3-97a79355820f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:19.093171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-08c86560-f2d0-4eea-adb3-97a79355820f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:19.162411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-08c86560-f2d0-4eea-adb3-97a79355820f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:19.171587 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-08c86560-f2d0-4eea-adb3-97a79355820f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1262 microversion: 2.1 time: 0.083321 Nov 02 22:29:19.172501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3664/7446] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:19 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:20.195677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:20.196378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:20.203827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:20.204416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:20.204947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:20.206280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:20.207018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:20.207281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:20.276242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:20.284882 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0bdf465f-fb92-4b76-8ec8-3d24db9d56ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1314 microversion: 2.1 time: 0.092650 Nov 02 22:29:20.285707 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3783/7447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:20 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1314 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:21.308530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:21.309376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:21.317996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:21.318627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:21.318957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:21.319827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:21.320287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:21.320718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:21.456861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:21.468857 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f03b1c93-8dab-4a44-a98d-b59dd0c231b5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1362 microversion: 2.1 time: 0.164695 Nov 02 22:29:21.470321 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3665/7448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:21 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:22.142757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-224d0ed3-df89-4625-98d1-3fe3ed8adc3b req-74b33ab3-ab16-4674-ba88-f74515ef4ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4ad377c-9a75-4edc-90c8-4e86319c373e", "tag": "4e80dc50-d5c2-4300-aa5e-93ff3e611f03"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:22.154122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-224d0ed3-df89-4625-98d1-3fe3ed8adc3b req-74b33ab3-ab16-4674-ba88-f74515ef4ff1 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:22.154530 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-224d0ed3-df89-4625-98d1-3fe3ed8adc3b req-74b33ab3-ab16-4674-ba88-f74515ef4ff1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:22.155186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-224d0ed3-df89-4625-98d1-3fe3ed8adc3b req-74b33ab3-ab16-4674-ba88-f74515ef4ff1 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:22.166357 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-224d0ed3-df89-4625-98d1-3fe3ed8adc3b req-74b33ab3-ab16-4674-ba88-f74515ef4ff1 service nova] Creating event network-changed:4e80dc50-d5c2-4300-aa5e-93ff3e611f03 for instance a4ad377c-9a75-4edc-90c8-4e86319c373e on n-h2-860863-4 Nov 02 22:29:22.171823 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-224d0ed3-df89-4625-98d1-3fe3ed8adc3b req-74b33ab3-ab16-4674-ba88-f74515ef4ff1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033047 Nov 02 22:29:22.172623 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3784/7449] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:22.492218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:22.492836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:22.504070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:22.504575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:22.505101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:22.508464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:22.508464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:22.508464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:22.644567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:22.653020 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f2941910-7f1a-4503-bd81-b6f818181865 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1362 microversion: 2.1 time: 0.164668 Nov 02 22:29:22.653608 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3666/7450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:22 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:23.678041 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:23.678743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:23.686086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:23.686577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:23.687025 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:23.687727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:23.688189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:23.688629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:23.822200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:23.829863 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfa26414-ffd3-4b2d-81d3-492c4896b39c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1362 microversion: 2.1 time: 0.156893 Nov 02 22:29:23.830433 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3785/7451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:23 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:24.852571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:24.853157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:24.859856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:24.860340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:24.860776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:24.861491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:24.862467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:24.863036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:24.992574 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:25.000397 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f181f763-9af4-499c-981c-ca02d709d57c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1362 microversion: 2.1 time: 0.151783 Nov 02 22:29:25.000985 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3667/7452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:24 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:26.025137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:26.025763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:26.032560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:26.033081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:26.033531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:26.034399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:26.034864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:26.035306 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:26.168718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:26.176547 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6de6843b-cca2-4a26-aecd-0b4dfc1144a0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1362 microversion: 2.1 time: 0.155327 Nov 02 22:29:26.177228 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3786/7453] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:26 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:27.200737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:27.207061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:27.208192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:27.208684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:27.209171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:27.209863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:27.210322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:27.210756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:27.342052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:27.350057 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8873c21d-87f1-439e-9760-780acfeb1fa0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1362 microversion: 2.1 time: 0.153530 Nov 02 22:29:27.350637 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3668/7454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:27 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:27.391533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f9f2b6dd-fc7f-4f3b-beb4-f648539adf20 req-78687e8f-2c13-44b6-b62a-e3ac97076a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ad377c-9a75-4edc-90c8-4e86319c373e", "name": "network-vif-plugged", "status": "completed", "tag": "4e80dc50-d5c2-4300-aa5e-93ff3e611f03"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:27.401945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9f2b6dd-fc7f-4f3b-beb4-f648539adf20 req-78687e8f-2c13-44b6-b62a-e3ac97076a35 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:27.405269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9f2b6dd-fc7f-4f3b-beb4-f648539adf20 req-78687e8f-2c13-44b6-b62a-e3ac97076a35 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:27.405269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f9f2b6dd-fc7f-4f3b-beb4-f648539adf20 req-78687e8f-2c13-44b6-b62a-e3ac97076a35 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:27.414017 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f9f2b6dd-fc7f-4f3b-beb4-f648539adf20 req-78687e8f-2c13-44b6-b62a-e3ac97076a35 service nova] Creating event network-vif-plugged:4e80dc50-d5c2-4300-aa5e-93ff3e611f03 for instance a4ad377c-9a75-4edc-90c8-4e86319c373e on n-h2-860863-4 Nov 02 22:29:27.418986 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f9f2b6dd-fc7f-4f3b-beb4-f648539adf20 req-78687e8f-2c13-44b6-b62a-e3ac97076a35 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031493 Nov 02 22:29:27.419568 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3787/7455] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:28.374573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:28.375193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:28.377085 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:28.383386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:28.383869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:28.384309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:28.385020 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:28.385472 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:28.385903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:28.522581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:28.530668 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe0041c4-0a7b-4394-9d5b-8a31fe5ec261 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1362 microversion: 2.1 time: 0.159951 Nov 02 22:29:28.531297 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3669/7456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:28 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:29.551849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:29.556737 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:29.557721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:29.563699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:29.564189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:29.564668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:29.566084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:29.566553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:29.571817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:29.699719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:29.708693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8aed8f88-3f49-4639-920c-46723661694e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1554 microversion: 2.1 time: 0.158012 Nov 02 22:29:29.709526 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3788/7457] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:29 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:29.731660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:29.732277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:29.734172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=8 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:29.740238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:29.740238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:29.740657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:29.741386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:29.741842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:29.742271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:29.870261 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:29.878735 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77ee1436-47f2-497c-aaa2-a72da5f23fda tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1554 microversion: 2.1 time: 0.151169 Nov 02 22:29:29.879315 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3670/7458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:29 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:29:32.997172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91a82652-8506-43e9-baeb-4ce12522a8a2"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:32.999589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:33.007302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:33.007804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:33.008261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:33.008994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:33.009474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:33.009920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:33.656494 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a28f5f70-6b5d-4d74-b3d5-115ac27b7242 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663118 Nov 02 22:29:33.657144 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3789/7459] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 22:29:32 2022] POST /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:45.434641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:45.435173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:45.438726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:45.443633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=38 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:45.444498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:45.445021 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:45.445467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:45.446170 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:45.446629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:45.447061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:45.526538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lazy-loading 'services' on Instance uuid a4ad377c-9a75-4edc-90c8-4e86319c373e {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:29:45.730732 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d513190e-5826-4497-9870-d9c92109b188 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments/91a82652-8506-43e9-baeb-4ce12522a8a2" status: 202 len: 0 microversion: 2.1 time: 0.300133 Nov 02 22:29:45.731334 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3671/7460] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:29:45 2022] DELETE /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments/91a82652-8506-43e9-baeb-4ce12522a8a2 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:29:45.737959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:45.738847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:29:45.743468 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:45.745556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:45.751564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:45.752273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:45.752675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:45.753417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:45.753886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:45.754331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:45.785019 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6afe7b0-67f3-47ad-8cf0-44f4399d88a8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048989 Nov 02 22:29:45.785584 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3790/7461] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:29:45 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:46.798886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:46.801764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:46.808411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:46.808899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:46.809365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:46.810069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:46.810521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:46.810949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:46.842311 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9f841689-c7f4-4a78-a685-ab37ea5b42b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048632 Nov 02 22:29:46.842879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3672/7462] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:29:46 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:47.854949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:47.857171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:47.866241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:47.866746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:47.867196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:47.867916 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:47.868683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:47.869161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:47.902662 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-272ba399-abbe-4e2a-abd3-ca9d956fa41c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051351 Nov 02 22:29:47.905516 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3791/7463] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:29:47 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:48.915638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:48.917724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:48.924645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:48.925167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:48.925604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:48.926288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:48.926737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:48.927158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:48.957487 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c58bc4be-e4c7-46e1-a836-53100727cfa5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Nov 02 22:29:48.958052 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3673/7464] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:29:48 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:49.970618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:49.973281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:49.984579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:49.985125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:49.985588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:49.986309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:49.986782 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:49.987228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:50.017579 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3bcfe6c6-3c18-4662-94e1-b80f3afe1f05 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051566 Nov 02 22:29:50.018884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3792/7465] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:29:49 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:51.030983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:51.033923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:51.040793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:51.041322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:51.041766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:51.042462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:51.042916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:51.043363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:51.074969 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-304e4bb7-381e-4aaf-a637-53eccc3407c6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047927 Nov 02 22:29:51.075534 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3674/7466] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:29:51 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 22:29:51.087121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:51.087621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:51.094423 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:51.094914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:51.095364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:51.096702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:51.097731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:51.097731 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:51.171626 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] HTTP exception thrown: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e is not attached to volume 91a82652-8506-43e9-baeb-4ce12522a8a2 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Request method failure captured: Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments/91a82652-8506-43e9-baeb-4ce12522a8a2 HTTP/1.1 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu82UdY3t9p4hVMt8-jU0CMneN3yzrHZPxtiBRjtyh53qLY1OtJI3SpPpuVaC1hyXr9qUgw2z6eQVDH5JFsb7SHqHq_EE2lO9uhB_LI9y7ZD1lbpnzwEsfdtfZYeKyilJw_KprO1_pNpZNOzBYIAZj-n1xj479AwyhvSZ2dX6yksi-M Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4b03000d3e1c437dbed778f14b5ee5a2 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e is not attached to volume 91a82652-8506-43e9-baeb-4ce12522a8a2 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': 'a4ad377c-9a75-4edc-90c8-4e86319c373e', 'id': '91a82652-8506-43e9-baeb-4ce12522a8a2'} Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 91a82652-8506-43e9-baeb-4ce12522a8a2. Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e is not attached to volume 91a82652-8506-43e9-baeb-4ce12522a8a2 Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:29:51.180170 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:29:51.185533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:29:51.185533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:29:51.185533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e is not attached to volume 91a82652-8506-43e9-baeb-4ce12522a8a2 Nov 02 22:29:51.185533 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:51.185533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Returning 404 to user: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e is not attached to volume 91a82652-8506-43e9-baeb-4ce12522a8a2 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:29:51.185533 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-653f5cc6-a27c-4640-bb7b-54680bb235ce tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments/91a82652-8506-43e9-baeb-4ce12522a8a2" status: 404 len: 154 microversion: 2.1 time: 0.099090 Nov 02 22:29:51.185533 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3793/7467] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:29:51 2022] DELETE /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e/os-volume_attachments/91a82652-8506-43e9-baeb-4ce12522a8a2 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:29:54.721925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:54.722774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:54.734376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:54.735231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:54.736012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:54.737630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:54.738434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:54.739241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:54.788017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:29:55.068204 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-05dab11a-df69-412d-9ddf-b72702183638 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 204 len: 0 microversion: 2.1 time: 0.353897 Nov 02 22:29:55.068812 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3675/7468] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:29:54 2022] DELETE /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:29:55.077308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:55.078246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:55.086329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:55.087444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:55.087444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:55.088076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:55.088542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:55.089016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:55.227453 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:55.235416 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74c51ad2-9136-4fe6-8f57-8067678e54c7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1560 microversion: 2.1 time: 0.162091 Nov 02 22:29:55.235990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3794/7469] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:55 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:56.259351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:56.260060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:56.266672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:56.267161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:56.268646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:56.269388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:56.269853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:56.270287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:56.402936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:56.412206 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a99ae5b1-01b7-43c0-a40d-ed27f5006d21 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1560 microversion: 2.1 time: 0.157230 Nov 02 22:29:56.412796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3676/7470] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:56 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:57.125339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2230a5b6-c320-4546-93b1-7c715c7bd263 req-738c9e61-8965-4e5d-901a-7d7ec7ec0df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ad377c-9a75-4edc-90c8-4e86319c373e", "name": "network-vif-deleted", "tag": "4e80dc50-d5c2-4300-aa5e-93ff3e611f03"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:57.137986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2230a5b6-c320-4546-93b1-7c715c7bd263 req-738c9e61-8965-4e5d-901a-7d7ec7ec0df2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:57.137986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2230a5b6-c320-4546-93b1-7c715c7bd263 req-738c9e61-8965-4e5d-901a-7d7ec7ec0df2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:57.137986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2230a5b6-c320-4546-93b1-7c715c7bd263 req-738c9e61-8965-4e5d-901a-7d7ec7ec0df2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:57.149240 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2230a5b6-c320-4546-93b1-7c715c7bd263 req-738c9e61-8965-4e5d-901a-7d7ec7ec0df2 service nova] Creating event network-vif-deleted:4e80dc50-d5c2-4300-aa5e-93ff3e611f03 for instance a4ad377c-9a75-4edc-90c8-4e86319c373e on n-h2-860863-4 Nov 02 22:29:57.154281 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2230a5b6-c320-4546-93b1-7c715c7bd263 req-738c9e61-8965-4e5d-901a-7d7ec7ec0df2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032599 Nov 02 22:29:57.154822 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3795/7471] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:57.436983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:57.437641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:57.446111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:57.446636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:57.447225 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:57.447944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:57.448404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:57.448839 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:57.485884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:57.486415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:57.487692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:57.488061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lazy-loading 'fault' on Instance uuid a4ad377c-9a75-4edc-90c8-4e86319c373e {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:29:57.538715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:57.547479 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aad5ba11-2f33-42fb-b177-60864799d0fa tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 200 len: 1352 microversion: 2.1 time: 0.114901 Nov 02 22:29:57.548176 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3677/7472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:57 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 1352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:29:58.579522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:58.580818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: a4ad377c-9a75-4edc-90c8-4e86319c373e] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:58.587435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:58.588895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:58.588895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:58.589111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:58.589578 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:58.590014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:58.604069 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] HTTP exception thrown: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e could not be found. Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Request method failure captured: Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e HTTP/1.1 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu82UdY3t9p4hVMt8-jU0CMneN3yzrHZPxtiBRjtyh53qLY1OtJI3SpPpuVaC1hyXr9qUgw2z6eQVDH5JFsb7SHqHq_EE2lO9uhB_LI9y7ZD1lbpnzwEsfdtfZYeKyilJw_KprO1_pNpZNOzBYIAZj-n1xj479AwyhvSZ2dX6yksi-M Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4b03000d3e1c437dbed778f14b5ee5a2 Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e could not be found. Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'a4ad377c-9a75-4edc-90c8-4e86319c373e'} Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e could not be found. Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e could not be found. Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:29:58.605721 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e could not be found. Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Returning 404 to user: Instance a4ad377c-9a75-4edc-90c8-4e86319c373e could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9dc78116-048a-44bb-825c-d91401c3dab0 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e" status: 404 len: 111 microversion: 2.1 time: 0.033146 Nov 02 22:29:58.610539 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3796/7473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:58 2022] GET /compute/v2.1/servers/a4ad377c-9a75-4edc-90c8-4e86319c373e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:29:58.616653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1e53ae28-ba5e-405d-892b-ff13fc3c166c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '.version_select at 0x7f9b63aeea60>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:58.750954 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1e53ae28-ba5e-405d-892b-ff13fc3c166c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1904670788" status: 202 len: 0 microversion: 2.1 time: 0.137900 Nov 02 22:29:58.751470 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3678/7474] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 22:29:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1904670788 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:29:58.769873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e863305e-9f8d-463b-b67b-9a6388526e8e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: .version_select at 0x7f9b6879aee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-516022979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx2WeyTSKY0QswaE7PXadswPLaW8USYtuqYb6AgXyfajTzgiNIhUh2rgA67cViDgriaU5QWmjf7OXSfJ1tq0Dypb0KVR8QSdT5hqpE1+mrVWfJrMLFMk6nNJFc63jbYcQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:58.786316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e863305e-9f8d-463b-b67b-9a6388526e8e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:29:58.793983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-e863305e-9f8d-463b-b67b-9a6388526e8e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for user 4b03000d3e1c437dbed778f14b5ee5a2 and project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:29:58.880059 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e863305e-9f8d-463b-b67b-9a6388526e8e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.114810 Nov 02 22:29:58.880656 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3797/7475] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:29:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:29:58.936413 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1586619614", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-516022979", "networks": [{"uuid": "91f0640d-03ad-4db6-bba6-2e4a8e2e34d7"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:29:58.989791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] validate_networks() for [('91f0640d-03ad-4db6-bba6-2e4a8e2e34d7', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:29:59.365752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:29:59.366179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:29:59.366654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:29:59.367065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:29:59.367477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:29:59.376147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:59.376622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:59.377097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:59.377821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:29:59.378271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:29:59.378697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:29:59.396297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:29:59.401566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for user 4b03000d3e1c437dbed778f14b5ee5a2 and project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:29:59.414391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:29:59.416675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:29:59.556631 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7ffb1da5-7956-4862-9fab-c235c6b5a3be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624324 Nov 02 22:29:59.557576 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3679/7476] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:29:59.570067 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72bdaf5d-265c-468f-9323-d76ab3c1cc85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:29:59.571371 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72bdaf5d-265c-468f-9323-d76ab3c1cc85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:29:59.634498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72bdaf5d-265c-468f-9323-d76ab3c1cc85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:29:59.641367 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72bdaf5d-265c-468f-9323-d76ab3c1cc85 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1262 microversion: 2.1 time: 0.075800 Nov 02 22:29:59.641937 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3798/7477] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:29:59 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:00.666670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:00.667265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:00.674319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:00.674801 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:00.675875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:00.676575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:00.677063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:00.677489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:00.837663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:00.845494 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8a10e1ec-18ad-432c-a3e6-9f7cc5750b53 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1266 microversion: 2.1 time: 0.184047 Nov 02 22:30:00.846060 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3680/7478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:00 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:01.869254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:01.870060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:01.877152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:01.877661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:01.878118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:01.878893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:01.879538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:01.879987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:02.023100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:02.032799 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53730e4e-b394-4bb4-9228-b988b3272c00 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1320 microversion: 2.1 time: 0.167425 Nov 02 22:30:02.033399 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3799/7479] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:01 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:03.061713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:03.062576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:03.070590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:03.071177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:03.071622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:03.072352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:03.072966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:03.073403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:03.182868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8e4f5a4b-bc88-48c9-bad9-3d25dfe6fba3 req-cc43c868-86dc-49c8-b48d-3e841ec6b5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d169f7-d3bd-4200-b925-41cb2bb31f66", "tag": "e8873478-ea6a-4706-8a19-0aa4ef9f6391"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:03.195510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e4f5a4b-bc88-48c9-bad9-3d25dfe6fba3 req-cc43c868-86dc-49c8-b48d-3e841ec6b5eb service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:03.196331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e4f5a4b-bc88-48c9-bad9-3d25dfe6fba3 req-cc43c868-86dc-49c8-b48d-3e841ec6b5eb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:03.196822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e4f5a4b-bc88-48c9-bad9-3d25dfe6fba3 req-cc43c868-86dc-49c8-b48d-3e841ec6b5eb service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:03.209925 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8e4f5a4b-bc88-48c9-bad9-3d25dfe6fba3 req-cc43c868-86dc-49c8-b48d-3e841ec6b5eb service nova] Creating event network-changed:e8873478-ea6a-4706-8a19-0aa4ef9f6391 for instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 on n-h2-860863-4 Nov 02 22:30:03.215274 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8e4f5a4b-bc88-48c9-bad9-3d25dfe6fba3 req-cc43c868-86dc-49c8-b48d-3e841ec6b5eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036474 Nov 02 22:30:03.215892 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3800/7480] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:03.223672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:03.235796 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-447ddb90-c487-49ca-8bc0-607dac235d62 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1362 microversion: 2.1 time: 0.175087 Nov 02 22:30:03.235796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3681/7481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:03 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:30:04.258062 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:04.258688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:04.265072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:04.265564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:04.266013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:04.266708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:04.267169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:04.267605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:04.402273 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:04.410004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24447947-be38-491d-b0ae-7383aa3435e7 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1362 microversion: 2.1 time: 0.157622 Nov 02 22:30:04.410596 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3801/7482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:04 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:05.433156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:05.433770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:05.440654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:05.443089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:05.443089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:05.443089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:05.443477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:05.443907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:05.571117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:05.578779 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-558e7b36-8736-426e-bb03-74cbc78e34cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1362 microversion: 2.1 time: 0.149733 Nov 02 22:30:05.579357 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3682/7483] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:05 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:06.602825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:06.603452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:06.610822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:06.611311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:06.611767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:06.612456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:06.613542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:06.613989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:06.745954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:06.753681 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1eee0927-332a-4f32-9fc8-4ce5971a8fea tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1362 microversion: 2.1 time: 0.154695 Nov 02 22:30:06.754278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3802/7484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:06 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:07.776296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:07.776856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:07.784003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:07.784514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:07.785508 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:07.786362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:07.786815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:07.787271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:07.917736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:07.927277 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6f648872-8d51-4b79-b47b-c3dca6add2ad tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1362 microversion: 2.1 time: 0.154717 Nov 02 22:30:07.928166 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3683/7485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:07 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:08.951177 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:08.951848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:08.959511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:08.960018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:08.960477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:08.961227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:08.961704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:08.962155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:09.094345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:09.102707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22fcd489-8330-402e-af7a-3074a5f83f77 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1362 microversion: 2.1 time: 0.155473 Nov 02 22:30:09.103474 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3803/7486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:08 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:09.461033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-aa7ac38a-828a-4377-8357-e37b40ed969d req-9f75b855-b584-480f-b2d5-e1ee36c797db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d169f7-d3bd-4200-b925-41cb2bb31f66", "name": "network-vif-plugged", "status": "completed", "tag": "e8873478-ea6a-4706-8a19-0aa4ef9f6391"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:09.466876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:09.467540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:09.472997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aa7ac38a-828a-4377-8357-e37b40ed969d req-9f75b855-b584-480f-b2d5-e1ee36c797db service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:09.473483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aa7ac38a-828a-4377-8357-e37b40ed969d req-9f75b855-b584-480f-b2d5-e1ee36c797db service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:09.473915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-aa7ac38a-828a-4377-8357-e37b40ed969d req-9f75b855-b584-480f-b2d5-e1ee36c797db service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:09.484743 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-aa7ac38a-828a-4377-8357-e37b40ed969d req-9f75b855-b584-480f-b2d5-e1ee36c797db service nova] Creating event network-vif-plugged:e8873478-ea6a-4706-8a19-0aa4ef9f6391 for instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 on n-h2-860863-4 Nov 02 22:30:09.490225 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-aa7ac38a-828a-4377-8357-e37b40ed969d req-9f75b855-b584-480f-b2d5-e1ee36c797db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033505 Nov 02 22:30:09.490888 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3684/7487] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:10.126602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:10.127237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:10.129865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:10.135480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:10.135981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:10.136438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:10.137215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:10.137690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:10.141538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:10.270496 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:10.278270 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a45bbf61-4cab-4b25-acc6-6e3db5393b64 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1362 microversion: 2.1 time: 0.155739 Nov 02 22:30:10.278837 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3804/7488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:10 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:11.304448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:11.304448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:11.312965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:11.313456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:11.313891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:11.314583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:11.315031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:11.315451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:11.445499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:11.453519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7e7cadf0-bcb0-42e0-b9f3-7dc4d8462171 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1553 microversion: 2.1 time: 0.155385 Nov 02 22:30:11.454091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3685/7489] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:11 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:11.476179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:11.476817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:11.483988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:11.484486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:11.484952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:11.485675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:11.486146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:11.486590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:11.619676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:11.627422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d993b0a4-ef28-4811-88d3-3d566960c418 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1553 microversion: 2.1 time: 0.155267 Nov 02 22:30:11.627990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3805/7490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:11 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:14.603721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c84f356-dbaf-4ecd-b3c7-883838641a53"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:14.606177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:14.613003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:14.613493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:14.617223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:14.617223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:14.617223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:14.617223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:14.800285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:15.328246 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-43ddc8f0-7e80-43b0-aec8-607aa1f7082c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728344 Nov 02 22:30:15.328978 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3686/7491] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 22:30:14 2022] POST /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:27.105204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:27.105747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:27.107948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:27.109340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=72 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:27.116849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:27.116849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:27.116849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:27.116849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:27.116849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:27.117359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:27.204372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lazy-loading 'services' on Instance uuid 31d169f7-d3bd-4200-b925-41cb2bb31f66 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:30:27.392906 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d30c4dd-870c-4a5f-ad89-a529913d2d04 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments/3c84f356-dbaf-4ecd-b3c7-883838641a53" status: 202 len: 0 microversion: 2.1 time: 0.291758 Nov 02 22:30:27.393536 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3806/7492] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:30:27 2022] DELETE /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments/3c84f356-dbaf-4ecd-b3c7-883838641a53 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:30:27.400924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:27.401726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:27.405967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:27.408841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:27.419071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:27.419555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:27.419996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:27.420768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:27.421251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:27.421682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:27.451378 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-17ba153a-d26b-421d-889d-3380aca3ad81 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052956 Nov 02 22:30:27.451973 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3687/7493] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:30:27 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:28.466090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:28.468483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:28.475840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:28.476436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:28.476922 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:28.477654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:28.478124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:28.478565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:28.512762 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bc9e75b-80cd-4caa-a00a-1bb7ef90f186 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052092 Nov 02 22:30:28.513381 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3807/7494] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:30:28 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:30:29.527628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:29.529828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:29.537498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:29.543567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:29.543567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:29.543567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:29.543567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:29.543567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:29.572107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77908b2d-d888-4d2a-838b-9f24fc9359a2 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050431 Nov 02 22:30:29.572711 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3688/7495] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:30:29 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:30.585212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:30.587628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:30.594407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:30.594915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:30.595374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:30.596147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:30.596621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:30.597097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:30.636496 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-395f5e82-34e9-4166-bf3b-293c740c1350 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056012 Nov 02 22:30:30.637413 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3808/7496] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:30:30 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:31.650899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:31.653136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:31.660707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:31.661221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:31.662307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:31.663061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:31.663517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:31.663942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:31.694742 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e35181d9-ad24-4512-8171-5ad22571a60c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049225 Nov 02 22:30:31.695310 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3689/7497] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:30:31 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:32.708522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:32.710758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:32.717566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:32.718064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:32.718521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:32.719225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:32.719702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:32.720150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:32.750348 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed611749-021a-44f0-99b5-1c6453b8533d tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045929 Nov 02 22:30:32.750912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3809/7498] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:30:32 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 22:30:32.762520 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:32.763040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:32.769896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:32.770379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:32.770815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:32.771698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:32.772152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:32.772580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:32.847872 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] HTTP exception thrown: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 is not attached to volume 3c84f356-dbaf-4ecd-b3c7-883838641a53 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Request method failure captured: Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: request: DELETE /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments/3c84f356-dbaf-4ecd-b3c7-883838641a53 HTTP/1.1 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu82UdY3t9p4hVMt8-jU0CMneN3yzrHZPxtiBRjtyh53qLY1OtJI3SpPpuVaC1hyXr9qUgw2z6eQVDH5JFsb7SHqHq_EE2lO9uhB_LI9y7ZD1lbpnzwEsfdtfZYeKyilJw_KprO1_pNpZNOzBYIAZj-n1xj479AwyhvSZ2dX6yksi-M Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4b03000d3e1c437dbed778f14b5ee5a2 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 is not attached to volume 3c84f356-dbaf-4ecd-b3c7-883838641a53 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'server_id': '31d169f7-d3bd-4200-b925-41cb2bb31f66', 'id': '3c84f356-dbaf-4ecd-b3c7-883838641a53'} Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3c84f356-dbaf-4ecd-b3c7-883838641a53. Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 is not attached to volume 3c84f356-dbaf-4ecd-b3c7-883838641a53 Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:30:32.850409 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:30:32.860356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:30:32.860356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:30:32.860356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 is not attached to volume 3c84f356-dbaf-4ecd-b3c7-883838641a53 Nov 02 22:30:32.860356 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:32.860356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Returning 404 to user: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 is not attached to volume 3c84f356-dbaf-4ecd-b3c7-883838641a53 {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:30:32.860356 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6dfee7cc-25e3-451f-a9d3-1111cfd54b0f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments/3c84f356-dbaf-4ecd-b3c7-883838641a53" status: 404 len: 154 microversion: 2.1 time: 0.093773 Nov 02 22:30:32.860356 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3690/7499] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:30:32 2022] DELETE /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66/os-volume_attachments/3c84f356-dbaf-4ecd-b3c7-883838641a53 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:30:36.362548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:36.363097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:36.371388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:36.371888 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:36.372348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:36.373101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:36.373580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:36.374028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:36.399583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:30:36.680234 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-908c2327-b3a6-492e-bd0b-e4b8ac2b90cf tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 204 len: 0 microversion: 2.1 time: 0.321240 Nov 02 22:30:36.680836 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3810/7500] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:30:36 2022] DELETE /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:30:36.689360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:36.690784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:36.697601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:36.698090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:36.698529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:36.699252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:36.699710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:36.700164 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:36.832949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:36.841349 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5444f371-9e68-4ff5-acf0-2fb4fe8e26c5 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1559 microversion: 2.1 time: 0.155814 Nov 02 22:30:36.841924 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3691/7501] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:36 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:37.865857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:37.866673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:37.873564 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:37.874063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:37.874517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:37.875224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:37.875688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:37.876130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:38.012258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:38.020069 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0af1437a-001b-43f2-8b0c-3549398738f9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1559 microversion: 2.1 time: 0.158536 Nov 02 22:30:38.020634 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3811/7502] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:37 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:39.045658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:39.045658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:39.052776 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:39.053376 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:39.054005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:39.054784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:39.055242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:39.055804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:39.130409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:39.138659 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da12e767-87e2-4f3c-be20-a7b343c1f1b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 200 len: 1517 microversion: 2.1 time: 0.098001 Nov 02 22:30:39.139238 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3692/7503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:39 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 1517 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:39.192085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e6d033f8-9434-4484-87eb-785627165b7d req-249de1d7-6d15-4a88-9b2a-3f9f0ca86aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d169f7-d3bd-4200-b925-41cb2bb31f66", "name": "network-vif-deleted", "tag": "e8873478-ea6a-4706-8a19-0aa4ef9f6391"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:39.202290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e6d033f8-9434-4484-87eb-785627165b7d req-249de1d7-6d15-4a88-9b2a-3f9f0ca86aea service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:39.202778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e6d033f8-9434-4484-87eb-785627165b7d req-249de1d7-6d15-4a88-9b2a-3f9f0ca86aea service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:39.203220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e6d033f8-9434-4484-87eb-785627165b7d req-249de1d7-6d15-4a88-9b2a-3f9f0ca86aea service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:39.214325 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e6d033f8-9434-4484-87eb-785627165b7d req-249de1d7-6d15-4a88-9b2a-3f9f0ca86aea service nova] Creating event network-vif-deleted:e8873478-ea6a-4706-8a19-0aa4ef9f6391 for instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 on n-h2-860863-4 Nov 02 22:30:39.219273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e6d033f8-9434-4484-87eb-785627165b7d req-249de1d7-6d15-4a88-9b2a-3f9f0ca86aea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099224 Nov 02 22:30:39.219869 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3812/7504] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:40.162949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:40.163710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: 31d169f7-d3bd-4200-b925-41cb2bb31f66] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:40.170569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:40.171053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:40.171525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:40.172175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:40.172625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:40.173077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:40.189871 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] HTTP exception thrown: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 could not be found. Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Request method failure captured: Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 HTTP/1.1 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYu82UdY3t9p4hVMt8-jU0CMneN3yzrHZPxtiBRjtyh53qLY1OtJI3SpPpuVaC1hyXr9qUgw2z6eQVDH5JFsb7SHqHq_EE2lO9uhB_LI9y7ZD1lbpnzwEsfdtfZYeKyilJw_KprO1_pNpZNOzBYIAZj-n1xj479AwyhvSZ2dX6yksi-M Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 4b03000d3e1c437dbed778f14b5ee5a2 Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 could not be found. Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '31d169f7-d3bd-4200-b925-41cb2bb31f66'} Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 could not be found. Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 could not be found. Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:30:40.191540 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 could not be found. Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Returning 404 to user: Instance 31d169f7-d3bd-4200-b925-41cb2bb31f66 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59c11cff-402d-4363-9c00-0fa8ec4399b8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66" status: 404 len: 111 microversion: 2.1 time: 0.033995 Nov 02 22:30:40.197093 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3693/7505] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:40 2022] GET /compute/v2.1/servers/31d169f7-d3bd-4200-b925-41cb2bb31f66 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:30:40.203878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec758cca-96ad-4a74-a5a8-1397fce162bd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '.version_select at 0x7f9b60340160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:40.298481 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec758cca-96ad-4a74-a5a8-1397fce162bd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-516022979" status: 202 len: 0 microversion: 2.1 time: 0.099625 Nov 02 22:30:40.299089 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3813/7506] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Nov 2 22:30:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-516022979 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:30:40.317242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ede69592-dbc0-4dc5-bafa-db2f25312661 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: .version_select at 0x7f9b63a271f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1384900491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/X+iVSwFmcaYPFGikXMzDoh5pO22YGqkaTerXb9XkplVYiJM3LkU2RHB1wheSmCNsM0j+MpCS1uz5DEXZPq4Y4U1q7DVJz0ObD9jkI5busDB0EKD/X5ZZMMvAjvEAuvA=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:40.333686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ede69592-dbc0-4dc5-bafa-db2f25312661 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:30:40.338968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ede69592-dbc0-4dc5-bafa-db2f25312661 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for user 4b03000d3e1c437dbed778f14b5ee5a2 and project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:30:40.401562 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ede69592-dbc0-4dc5-bafa-db2f25312661 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.088250 Nov 02 22:30:40.402190 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3694/7507] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:30:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:40.455495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-162877414", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1384900491", "networks": [{"uuid": "91f0640d-03ad-4db6-bba6-2e4a8e2e34d7"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:40.510817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] validate_networks() for [('91f0640d-03ad-4db6-bba6-2e4a8e2e34d7', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:30:40.882150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:30:40.882582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:30:40.883229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:30:40.883650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:30:40.884071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:30:40.893032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:40.893525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:40.893974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:40.894706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:40.895172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:40.895611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:40.913933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:30:40.919828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Getting quotas for user 4b03000d3e1c437dbed778f14b5ee5a2 and project edcef0ca61a5490baf5caf82f02a7bc2. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:30:40.932465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:30:40.935161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:30:41.035506 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2af71d74-ab65-42fd-a929-fa1a0df26d46 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583781 Nov 02 22:30:41.036087 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3814/7508] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:30:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:30:41.048229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1fac8f9a-5110-4bf4-9bf8-e50c4521d099 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:41.048850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1fac8f9a-5110-4bf4-9bf8-e50c4521d099 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:41.104362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1fac8f9a-5110-4bf4-9bf8-e50c4521d099 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:41.112058 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1fac8f9a-5110-4bf4-9bf8-e50c4521d099 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1262 microversion: 2.1 time: 0.067850 Nov 02 22:30:41.112621 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3695/7509] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:41 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:30:42.136372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:42.137026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:42.143727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:42.144221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:42.144675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:42.145415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:42.146021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:42.146457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:42.209687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:42.218145 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec964cce-9fa9-49de-b964-51a124b18ef4 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1266 microversion: 2.1 time: 0.087267 Nov 02 22:30:42.218718 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3815/7510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:42 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:43.243868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:43.244450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:43.253027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:43.253553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:43.258313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:43.258313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:43.258313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:43.258313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:43.323987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:43.331924 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-08690b8e-9a94-4b65-a266-ffb9c93801a6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1332 microversion: 2.1 time: 0.093652 Nov 02 22:30:43.332501 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3696/7511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:43 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:30:44.356673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:44.357340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:44.363545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:44.364045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:44.364504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:44.365246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:44.365719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:44.366259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:44.500467 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:44.508834 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24a17e54-4608-4fa1-9883-8248365755be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.156497 Nov 02 22:30:44.509451 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3816/7512] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:44 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:30:44.726996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-83aed613-b470-430e-8756-1c89d1ac545d req-4b65f90b-22af-482a-8c22-e0f6d12786df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2744b0f-f3d0-47d1-8836-1e221fb3fa0f", "tag": "d730a9f6-c5ed-41d1-b014-b246fbc9ded4"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:44.737594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-83aed613-b470-430e-8756-1c89d1ac545d req-4b65f90b-22af-482a-8c22-e0f6d12786df service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:44.738075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-83aed613-b470-430e-8756-1c89d1ac545d req-4b65f90b-22af-482a-8c22-e0f6d12786df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:44.738504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-83aed613-b470-430e-8756-1c89d1ac545d req-4b65f90b-22af-482a-8c22-e0f6d12786df service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:44.749302 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-83aed613-b470-430e-8756-1c89d1ac545d req-4b65f90b-22af-482a-8c22-e0f6d12786df service nova] Creating event network-changed:d730a9f6-c5ed-41d1-b014-b246fbc9ded4 for instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f on n-h2-860863-4 Nov 02 22:30:44.754240 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-83aed613-b470-430e-8756-1c89d1ac545d req-4b65f90b-22af-482a-8c22-e0f6d12786df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031157 Nov 02 22:30:44.755028 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3697/7513] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:30:45.532427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:45.533095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:45.540747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:45.545762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:45.545762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:45.545762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:45.545762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:45.545762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:45.671833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:45.679614 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c168ba7-4c89-49d4-92aa-4c9abb52fd8f tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.151187 Nov 02 22:30:45.680404 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3817/7514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:45 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:46.704500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:46.706957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:46.712303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:46.712775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:46.713233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:46.713922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:46.714371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:46.714793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:46.849540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:46.858233 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b74cd0fc-e84e-439a-9d2b-06a1100f5c2a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.158937 Nov 02 22:30:46.858798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3698/7515] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:46 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:47.881241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:47.881789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:47.889274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:47.889772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:47.890228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:47.890935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:47.891403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:47.891846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:48.021123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:48.029183 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7289437c-0f45-4059-b48a-4c6aea70f0e6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.151922 Nov 02 22:30:48.029772 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3818/7516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:47 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:49.051590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:49.052224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:49.059961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:49.060437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:49.061009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:49.061732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:49.062183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:49.062605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:49.194928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:49.202824 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e4452fb-6c7d-4d1f-a286-092d7361346e tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.155117 Nov 02 22:30:49.203450 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3699/7517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:49 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:50.226008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:50.226617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:50.233491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:50.234015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:50.234464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:50.235158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:50.235622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:50.236058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:50.365111 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:50.373307 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2b73f9d-7638-4eeb-87b0-d1447775bbf8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.151224 Nov 02 22:30:50.373876 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3819/7518] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:50 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:51.397425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:51.398067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:51.401672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:51.406447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:51.406927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:51.407365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:51.408100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:51.408553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:51.409003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:51.552490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:51.561281 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e15eabd-3e03-4883-bbfa-a893cc0cd1fd tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.167882 Nov 02 22:30:51.561867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3700/7519] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:51 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:51.651935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:51.652889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:51.704514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ef712200-16fb-4ce2-b9d6-ee12fd91d18b req-46fd3ce1-d394-4dbc-8705-7afcdbb4e9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2744b0f-f3d0-47d1-8836-1e221fb3fa0f", "name": "network-vif-plugged", "status": "completed", "tag": "d730a9f6-c5ed-41d1-b014-b246fbc9ded4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:51.717709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef712200-16fb-4ce2-b9d6-ee12fd91d18b req-46fd3ce1-d394-4dbc-8705-7afcdbb4e9c2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:51.718139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef712200-16fb-4ce2-b9d6-ee12fd91d18b req-46fd3ce1-d394-4dbc-8705-7afcdbb4e9c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:51.718572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef712200-16fb-4ce2-b9d6-ee12fd91d18b req-46fd3ce1-d394-4dbc-8705-7afcdbb4e9c2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:51.731052 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ef712200-16fb-4ce2-b9d6-ee12fd91d18b req-46fd3ce1-d394-4dbc-8705-7afcdbb4e9c2 service nova] Creating event network-vif-plugged:d730a9f6-c5ed-41d1-b014-b246fbc9ded4 for instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f on n-h2-860863-4 Nov 02 22:30:51.736173 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ef712200-16fb-4ce2-b9d6-ee12fd91d18b req-46fd3ce1-d394-4dbc-8705-7afcdbb4e9c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089353 Nov 02 22:30:51.736778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3820/7520] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:30:52.585043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:52.585688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:52.593387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:52.593871 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:52.594308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:52.594994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:52.595443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:52.595867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:52.732145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:52.740010 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a55f1b1-e238-4697-bf50-6e5094cdc136 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1362 microversion: 2.1 time: 0.158876 Nov 02 22:30:52.744869 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3701/7521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:52 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:53.764314 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:53.765073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:53.773136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:53.773636 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:53.774682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:53.775380 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:53.775850 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:53.776293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:53.906506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:53.914379 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd030a76-7d13-44ab-9c5d-3a6b25c43a78 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1553 microversion: 2.1 time: 0.154419 Nov 02 22:30:53.914960 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3821/7522] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:53 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:53.937176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:30:53.937791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:53.944582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:53.945105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:53.945553 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:53.946237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:53.946689 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:53.947124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:54.079195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:30:54.086948 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cdabc72a-5ac5-4a24-aa9a-6f8eb257c690 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1553 microversion: 2.1 time: 0.153940 Nov 02 22:30:54.087515 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3702/7523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:30:53 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:30:57.089040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dfc8076-2600-4ef7-bbe6-7ea553df51b3"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:30:57.091589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:30:57.097857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:57.098441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:57.098901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:57.099618 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:30:57.100089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:30:57.100536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:30:57.171729 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:30:57.748048 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52fd34e7-6471-4925-a715-609257a547be tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "POST /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663992 Nov 02 22:30:57.749187 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3822/7524] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 22:30:57 2022] POST /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:09.526072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:09.526781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:09.529663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:09.534656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=76 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:09.535179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:09.535653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:09.536098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:09.536791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:09.537322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:09.537761 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:09.619204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lazy-loading 'services' on Instance uuid d2744b0f-f3d0-47d1-8836-1e221fb3fa0f {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:31:09.781430 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9414fbbf-8b62-48c8-b2e2-69129267d3ee tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments/0dfc8076-2600-4ef7-bbe6-7ea553df51b3" status: 202 len: 0 microversion: 2.1 time: 0.259491 Nov 02 22:31:09.782044 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3703/7525] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:31:09 2022] DELETE /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments/0dfc8076-2600-4ef7-bbe6-7ea553df51b3 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:31:09.792162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:09.794747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:09.797853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:09.798557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=6,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:09.803754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:09.804312 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:09.804769 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:09.805504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:09.805979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:09.806406 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:09.837643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec39ca81-34a2-4ffb-bf28-aeea68503815 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050914 Nov 02 22:31:09.838190 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3823/7526] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:31:09 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:10.850643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:10.852965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:10.860780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:10.861291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:10.861731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:10.862416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:10.862865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:10.863294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:10.893510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86a9ec7f-b592-468d-b2a2-05226eb31387 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047264 Nov 02 22:31:10.894272 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3704/7527] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:31:10 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:11.907187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:11.909722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:11.918772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:11.919272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:11.919719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:11.920441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:11.921268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:11.923542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:11.953314 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e9ef3fb-bd52-4047-bd39-4ecf23e4a878 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051678 Nov 02 22:31:11.953897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3824/7528] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:31:11 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:12.967173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:12.969265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:12.975978 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:12.976457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:12.976892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:12.977602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:12.978051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:12.978476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:13.008258 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86b2fabc-5511-4dd7-be97-e6922a2f8d35 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045728 Nov 02 22:31:13.008832 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3705/7529] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:31:12 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:14.022139 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:14.024374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:14.032673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:14.033216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:14.033675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:14.034392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:14.034866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:14.035321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:14.067551 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9468ff8f-0900-410b-81e7-e02db1dcf55a tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049999 Nov 02 22:31:14.068137 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3825/7530] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:31:14 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:15.080564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:15.082719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:15.090336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:15.090815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:15.091254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:15.091936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:15.092382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:15.092804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:15.121926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-27be7ccd-2cff-4fb8-b827-0600425d2867 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045348 Nov 02 22:31:15.122488 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3706/7531] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:31:15 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 22:31:15.133640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:15.134138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:15.142009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:15.142418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:15.142908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:15.143566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:15.144035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:15.144479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:15.222888 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] HTTP exception thrown: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f is not attached to volume 0dfc8076-2600-4ef7-bbe6-7ea553df51b3 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Request method failure captured: Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments/0dfc8076-2600-4ef7-bbe6-7ea553df51b3 HTTP/1.1 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu82UdY3t9p4hVMt8-jU0CMneN3yzrHZPxtiBRjtyh53qLY1OtJI3SpPpuVaC1hyXr9qUgw2z6eQVDH5JFsb7SHqHq_EE2lO9uhB_LI9y7ZD1lbpnzwEsfdtfZYeKyilJw_KprO1_pNpZNOzBYIAZj-n1xj479AwyhvSZ2dX6yksi-M Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4b03000d3e1c437dbed778f14b5ee5a2 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f is not attached to volume 0dfc8076-2600-4ef7-bbe6-7ea553df51b3 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': 'd2744b0f-f3d0-47d1-8836-1e221fb3fa0f', 'id': '0dfc8076-2600-4ef7-bbe6-7ea553df51b3'} Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0dfc8076-2600-4ef7-bbe6-7ea553df51b3. Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f is not attached to volume 0dfc8076-2600-4ef7-bbe6-7ea553df51b3 Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:31:15.224385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:31:15.231176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:31:15.231176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:31:15.231176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f is not attached to volume 0dfc8076-2600-4ef7-bbe6-7ea553df51b3 Nov 02 22:31:15.231176 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:15.231176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Returning 404 to user: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f is not attached to volume 0dfc8076-2600-4ef7-bbe6-7ea553df51b3 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:31:15.231176 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92fb3d9b-8f48-4eff-8796-1b3c786fb0c9 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments/0dfc8076-2600-4ef7-bbe6-7ea553df51b3" status: 404 len: 154 microversion: 2.1 time: 0.096637 Nov 02 22:31:15.231176 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3826/7532] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:31:15 2022] DELETE /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f/os-volume_attachments/0dfc8076-2600-4ef7-bbe6-7ea553df51b3 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:31:18.745710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:18.745710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:18.753478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:18.753968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:18.754409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:18.755105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:18.755560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:18.756015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:18.785372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:31:19.058884 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9dead19d-9034-4bd3-8047-2a341262acc8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 204 len: 0 microversion: 2.1 time: 0.317288 Nov 02 22:31:19.059903 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3707/7533] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:31:18 2022] DELETE /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:31:19.069661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:19.071012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:19.078536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:19.079038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:19.079489 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:19.080959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:19.080959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:19.081749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:19.231094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:31:19.240707 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca17628c-b4dd-4c07-8766-59357c4f5df8 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1559 microversion: 2.1 time: 0.176127 Nov 02 22:31:19.241343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3827/7534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:19 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:31:20.264314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:20.265027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:20.271946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:20.272357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:20.272788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:20.273509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:20.273956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:20.274378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:20.408436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:31:20.416184 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d21ba7f8-a9e8-4f95-bd48-4bea66e17be6 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1559 microversion: 2.1 time: 0.156161 Nov 02 22:31:20.416754 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3708/7535] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:20 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:31:21.156278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-12c14328-b894-45ac-9c00-c6ce78365bbb req-11d581a0-dc2f-4637-87cd-e62dd7a25358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2744b0f-f3d0-47d1-8836-1e221fb3fa0f", "name": "network-vif-deleted", "tag": "d730a9f6-c5ed-41d1-b014-b246fbc9ded4"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:31:21.166750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-12c14328-b894-45ac-9c00-c6ce78365bbb req-11d581a0-dc2f-4637-87cd-e62dd7a25358 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:21.167969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-12c14328-b894-45ac-9c00-c6ce78365bbb req-11d581a0-dc2f-4637-87cd-e62dd7a25358 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:21.168730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-12c14328-b894-45ac-9c00-c6ce78365bbb req-11d581a0-dc2f-4637-87cd-e62dd7a25358 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:21.180886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-12c14328-b894-45ac-9c00-c6ce78365bbb req-11d581a0-dc2f-4637-87cd-e62dd7a25358 service nova] Creating event network-vif-deleted:d730a9f6-c5ed-41d1-b014-b246fbc9ded4 for instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f on n-h2-860863-4 Nov 02 22:31:21.186523 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-12c14328-b894-45ac-9c00-c6ce78365bbb req-11d581a0-dc2f-4637-87cd-e62dd7a25358 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034909 Nov 02 22:31:21.187146 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3828/7536] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:21.440728 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:21.441379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:21.449106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:21.453186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:21.453186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:21.453186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:21.453186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:21.453186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:21.488484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:21.488994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:21.489660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:21.490254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lazy-loading 'fault' on Instance uuid d2744b0f-f3d0-47d1-8836-1e221fb3fa0f {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:31:21.539709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b03000d3e1c437dbed778f14b5ee5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edcef0ca61a5490baf5caf82f02a7bc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:31:21.548278 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d8853b31-9ac3-4c65-b440-0405219327ab tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 200 len: 1352 microversion: 2.1 time: 0.111488 Nov 02 22:31:21.549069 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3709/7537] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:21 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:31:22.574700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:22.575417 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] [instance: d2744b0f-f3d0-47d1-8836-1e221fb3fa0f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:22.582695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:22.583200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:22.583651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:22.584352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:22.584821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:22.585318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:22.598637 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] HTTP exception thrown: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f could not be found. Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Request method failure captured: Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f HTTP/1.1 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu82UdY3t9p4hVMt8-jU0CMneN3yzrHZPxtiBRjtyh53qLY1OtJI3SpPpuVaC1hyXr9qUgw2z6eQVDH5JFsb7SHqHq_EE2lO9uhB_LI9y7ZD1lbpnzwEsfdtfZYeKyilJw_KprO1_pNpZNOzBYIAZj-n1xj479AwyhvSZ2dX6yksi-M Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/edcef0ca61a5490baf5caf82f02a7bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: edcef0ca61a5490baf5caf82f02a7bc2 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-60436321 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 4b03000d3e1c437dbed778f14b5ee5a2 Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestEncryptedCinderVolumes-60436321-project Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f could not be found. Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'd2744b0f-f3d0-47d1-8836-1e221fb3fa0f'} Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f could not be found. Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f could not be found. Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:31:22.600239 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f could not be found. Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Returning 404 to user: Instance d2744b0f-f3d0-47d1-8836-1e221fb3fa0f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ad7708d-57ee-4270-9e8f-5909c9dffc58 tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f" status: 404 len: 111 microversion: 2.1 time: 0.031870 Nov 02 22:31:22.605990 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3829/7538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:22 2022] GET /compute/v2.1/servers/d2744b0f-f3d0-47d1-8836-1e221fb3fa0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:31:22.611201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-212b598c-25a3-45cb-87a5-375333d4ab6c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] Calling method '.version_select at 0x7f9b687993a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:22.737272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-212b598c-25a3-45cb-87a5-375333d4ab6c tempest-TestEncryptedCinderVolumes-60436321 tempest-TestEncryptedCinderVolumes-60436321-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1384900491" status: 202 len: 0 microversion: 2.1 time: 0.129866 Nov 02 22:31:22.737881 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3710/7539] 10.222.0.25 () {58 vars in 1278 bytes} [Wed Nov 2 22:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1384900491 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:31:55.255870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc833126-4e88-4c0d-b154-a200459650cf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'create', calling method: .version_select at 0x7f9b63be5c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1103499197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMvrIfuj9IimSfiVB0VHzVadPg3m4U24y6Db85rBoMMnrA+6IML4NO7m5Er9Zz4zBY2ADM1EZ+BjquUpref2NB8dt7Mh7Y4eRqhE9ZxnxiQ5BUpeT8WVlhwmWWp9O2zgA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:31:55.263598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:55.264248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:55.275796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-fc833126-4e88-4c0d-b154-a200459650cf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:31:55.281373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-fc833126-4e88-4c0d-b154-a200459650cf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for user e6c04cb2b3da47ec9392fc86624a15c9 and project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:31:55.349781 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc833126-4e88-4c0d-b154-a200459650cf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.097605 Nov 02 22:31:55.350499 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3830/7540] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:31:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:31:55.399231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:55.400139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:31:55.403977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1025263485", "imageRef": "33ffeb04-1626-472d-ad9f-8311cff92625", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1103499197", "networks": [{"uuid": "3871b515-47c0-4d78-a6a6-6493fbfa0c51"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:31:55.456603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] validate_networks() for [('3871b515-47c0-4d78-a6a6-6493fbfa0c51', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:31:56.157899 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:31:56.158355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:31:56.158859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:31:56.159294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:31:56.159707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:31:56.168575 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:56.169092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:56.169596 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:56.170512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:56.170969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:56.171404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:56.189539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:31:56.194831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for user e6c04cb2b3da47ec9392fc86624a15c9 and project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:31:56.208146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:31:56.210438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33ffeb04-1626-472d-ad9f-8311cff92625',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:31:56.344353 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a4d2a25e-43da-4d88-8d8e-704f77ea3a86 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947734 Nov 02 22:31:56.345025 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3711/7541] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:31:56.357005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e0410428-4ad6-4755-b0ba-96297fc88e8e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:56.357638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e0410428-4ad6-4755-b0ba-96297fc88e8e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:56.416494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e0410428-4ad6-4755-b0ba-96297fc88e8e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:31:56.423950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e0410428-4ad6-4755-b0ba-96297fc88e8e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1259 microversion: 2.1 time: 0.071802 Nov 02 22:31:56.424522 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3831/7542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:56 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:31:57.448772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:57.449424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:57.457184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:57.457688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:57.458301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:57.459033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:57.459497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:57.459939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:57.524410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:31:57.533272 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b67a901e-edb4-447c-8d2c-0fd822464d38 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1263 microversion: 2.1 time: 0.089475 Nov 02 22:31:57.534019 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3712/7543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:57 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:31:58.556956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:58.557580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:58.565926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:58.566629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:58.567134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:58.567858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:58.568363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:58.569087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:58.632659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:31:58.641399 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be29251e-e6de-44a7-a101-c18a9a57f803 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1329 microversion: 2.1 time: 0.088379 Nov 02 22:31:58.642198 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3832/7544] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:58 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1329 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:31:59.664989 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:31:59.667159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:31:59.677524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:59.678256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:59.678813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:59.679626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:31:59.680321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:31:59.680903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:31:59.840684 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:31:59.848636 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fecf58b3-92b8-44d6-9ddf-936fb9899ed0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.188577 Nov 02 22:31:59.849243 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3713/7545] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:31:59 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:00.873136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:00.874708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:00.885569 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:00.886093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:00.886544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:00.887266 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:00.888668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:00.889556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:01.041395 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:01.050320 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e31867ea-8745-4571-bf22-f05a475ffec0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.181618 Nov 02 22:32:01.050897 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3833/7546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:00 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:02.075018 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:02.077541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:02.085548 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:02.086042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:02.086507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:02.087198 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:02.087651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:02.088080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:02.226113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:02.234865 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6066134d-887e-4319-8277-9647f4a608a3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.164180 Nov 02 22:32:02.235455 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3714/7547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:02 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:32:03.257966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:03.258599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:03.265614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:03.266208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:03.266672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:03.267384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:03.267878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:03.268311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:03.417980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:03.427040 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63065b9a-523b-4ca6-93fa-415c9d17b687 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.172845 Nov 02 22:32:03.427632 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3834/7548] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:03 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:04.451819 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:04.452478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:04.460556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:04.461087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:04.461532 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:04.462233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:04.462687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:04.463113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:04.621904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:04.629860 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da3f619d-398e-49f4-b3d0-2003f87d2996 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.182527 Nov 02 22:32:04.630418 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3715/7549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:04 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:05.652642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:05.653307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:05.663209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:05.663808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:05.664264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:05.665333 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:05.665938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:05.666389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:05.834940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:05.846480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7176e902-5466-4a85-8cd7-b018b46960c7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.197608 Nov 02 22:32:05.861971 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3835/7550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:05 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:06.873894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:06.875959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:06.879531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:06.880223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:06.885071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:06.885561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:06.886000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:06.886698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:06.887146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:06.887569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:07.042988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:07.048067 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9aec272f-a8c4-460e-bc00-9aed004b935b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.177242 Nov 02 22:32:07.049834 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3716/7551] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:06 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:08.081601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:08.082217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:08.084150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:08.089792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:08.093407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:08.093407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:08.093407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:08.093407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:08.093407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:08.248367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:08.257348 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-93f6d3cb-477f-4c35-8c58-f949ee0403a0 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.180139 Nov 02 22:32:08.264670 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3836/7552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:08 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:09.280445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:09.281194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:09.288823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:09.289338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:09.289780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:09.290474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:09.290928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:09.291358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:09.422031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:09.429804 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b11f27a-6552-4f5c-8d8e-c7d22197250c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.153453 Nov 02 22:32:09.430377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3717/7553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:09 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:10.453908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:10.454544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:10.461975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:10.466872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:10.466872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:10.466872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:10.466872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:10.466872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:10.600554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:10.608362 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a2f7a159-3b55-400e-9714-1d6f4446dc9b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.159110 Nov 02 22:32:10.609260 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3837/7554] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:10 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:10.923788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d65a4a28-47f5-4c19-8d98-f8e3e2db4e83 req-b0d59afe-6659-48f4-90b0-c8163326f698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fffc20-f354-4665-ab76-ef3805ccb1d4", "tag": "d9374404-f010-4896-b765-b917b8b40cb5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:32:10.935196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d65a4a28-47f5-4c19-8d98-f8e3e2db4e83 req-b0d59afe-6659-48f4-90b0-c8163326f698 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:10.935682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d65a4a28-47f5-4c19-8d98-f8e3e2db4e83 req-b0d59afe-6659-48f4-90b0-c8163326f698 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:10.936379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d65a4a28-47f5-4c19-8d98-f8e3e2db4e83 req-b0d59afe-6659-48f4-90b0-c8163326f698 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:10.949002 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d65a4a28-47f5-4c19-8d98-f8e3e2db4e83 req-b0d59afe-6659-48f4-90b0-c8163326f698 service nova] Creating event network-changed:d9374404-f010-4896-b765-b917b8b40cb5 for instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 on n-h2-860863-4 Nov 02 22:32:10.954318 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d65a4a28-47f5-4c19-8d98-f8e3e2db4e83 req-b0d59afe-6659-48f4-90b0-c8163326f698 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035611 Nov 02 22:32:10.954951 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3718/7555] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:32:11.631749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:11.632385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:11.639125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:11.639642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:11.640079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:11.641374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:11.641939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:11.642384 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:11.776403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:11.785216 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-81430ae5-687d-4a89-9508-a48470dda7bc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.157284 Nov 02 22:32:11.785784 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3838/7556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:11 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:12.809089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:12.809790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:12.816704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:12.817221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:12.817661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:12.818339 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:12.818791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:12.819214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:12.948790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:12.957110 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-da2f2b89-4d60-4912-9f6c-978b34ec27d7 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.153054 Nov 02 22:32:12.957680 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3719/7557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:12 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:13.979686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:13.980309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:13.988809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:13.989347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:13.989803 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:13.990522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:13.990987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:13.991434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:14.131007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:14.138995 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-501d8c4b-e1e4-47a2-9005-46d8c88ce0bf tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.163216 Nov 02 22:32:14.139577 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3839/7558] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:13 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:15.162341 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:15.162901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:15.169645 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:15.170125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:15.170559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:15.171237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:15.171687 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:15.172336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:15.303858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:15.311799 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c8203711-c882-40b7-9b5a-7b4eb3b45e84 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.153390 Nov 02 22:32:15.312379 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3720/7559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:15 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:16.067668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-01b6b27e-fe28-412d-aa1c-003787d546bf req-b46b0cad-f81a-4b12-b367-3fe16e1abed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6fffc20-f354-4665-ab76-ef3805ccb1d4", "name": "network-vif-plugged", "status": "completed", "tag": "d9374404-f010-4896-b765-b917b8b40cb5"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:32:16.077936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-01b6b27e-fe28-412d-aa1c-003787d546bf req-b46b0cad-f81a-4b12-b367-3fe16e1abed9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:16.078428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-01b6b27e-fe28-412d-aa1c-003787d546bf req-b46b0cad-f81a-4b12-b367-3fe16e1abed9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:16.078873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-01b6b27e-fe28-412d-aa1c-003787d546bf req-b46b0cad-f81a-4b12-b367-3fe16e1abed9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:16.089728 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-01b6b27e-fe28-412d-aa1c-003787d546bf req-b46b0cad-f81a-4b12-b367-3fe16e1abed9 service nova] Creating event network-vif-plugged:d9374404-f010-4896-b765-b917b8b40cb5 for instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 on n-h2-860863-4 Nov 02 22:32:16.095191 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-01b6b27e-fe28-412d-aa1c-003787d546bf req-b46b0cad-f81a-4b12-b367-3fe16e1abed9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031532 Nov 02 22:32:16.095777 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3840/7560] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:32:16.335102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:16.335694 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:16.342552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:16.342975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:16.343410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:16.344702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:16.345325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:16.345751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:16.473757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:16.481582 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-61a61296-9e79-444b-9533-85f371bf5cef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1359 microversion: 2.1 time: 0.150387 Nov 02 22:32:16.482169 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3721/7561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:16 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:17.506771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:17.507401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:17.513688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.514179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.514627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:17.515322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.515786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.516267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:17.654593 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:17.663506 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e3d4a0c-6b4f-446b-907b-04e4cfe3c3b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1550 microversion: 2.1 time: 0.162136 Nov 02 22:32:17.664094 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3841/7562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:17 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:17.687419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:17.688692 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:17.695769 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.696669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.697023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:17.697721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.698335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.698933 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:17.836374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:17.844236 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86e028d6-41bf-49f3-94d8-f489dce91770 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1550 microversion: 2.1 time: 0.161095 Nov 02 22:32:17.844846 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3722/7563] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:17 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:17.867038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:17.871972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:17.872854 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Searching by: {'deleted': False, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1'} {{(pid=121040) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 22:32:17.878767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.879332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.879871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:17.880673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.881167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.881611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:17.906897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.multi_cell_list [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121040) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 22:32:17.934755 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e890fbde-d198-434f-b0cb-e10bff0f3234 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071556 Nov 02 22:32:17.935346 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3842/7564] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 22:32:17 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:32:17.947714 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:17.948327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:17.954983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.955462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.955896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:17.956607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:17.957082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:17.957503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:18.096772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:18.103789 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-260dacb3-b197-4239-affd-a60b21a90001 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1550 microversion: 2.1 time: 0.159839 Nov 02 22:32:18.105082 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3723/7565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:17 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:21.072109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0103300-4f59-4889-b9e3-72e4c3bf110d"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:32:21.074484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:21.081930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:21.082420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:21.082868 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:21.083568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:21.084030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:21.084470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:21.809774 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a577d0a8-e291-4013-af03-84cdb0a38cd9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741400 Nov 02 22:32:21.810434 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3843/7566] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 22:32:21 2022] POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:32:37.169481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:37.170046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:37.172722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:37.173414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=70 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:37.178135 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:37.178621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:37.179062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:37.179754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:37.180233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:37.180661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:37.310568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:37.319431 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7090736e-aaec-47ea-89bd-398735c1c9d3 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1596 microversion: 2.1 time: 0.154301 Nov 02 22:32:37.320007 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3724/7567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:37 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1596 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:32:39.326389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:39.327688 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:39.328440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:32:39.457652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a0bb9f49-aa72-4252-8f30-47290c1b103e req-2a38f6a3-d9b4-4c28-b7fb-5d36a1fab169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fffc20-f354-4665-ab76-ef3805ccb1d4", "tag": "d9374404-f010-4896-b765-b917b8b40cb5"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:32:39.468920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a0bb9f49-aa72-4252-8f30-47290c1b103e req-2a38f6a3-d9b4-4c28-b7fb-5d36a1fab169 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:39.469787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a0bb9f49-aa72-4252-8f30-47290c1b103e req-2a38f6a3-d9b4-4c28-b7fb-5d36a1fab169 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:39.470272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a0bb9f49-aa72-4252-8f30-47290c1b103e req-2a38f6a3-d9b4-4c28-b7fb-5d36a1fab169 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:39.481566 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a0bb9f49-aa72-4252-8f30-47290c1b103e req-2a38f6a3-d9b4-4c28-b7fb-5d36a1fab169 service nova] Creating event network-changed:d9374404-f010-4896-b765-b917b8b40cb5 for instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 on n-h2-860863-4 Nov 02 22:32:39.487495 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a0bb9f49-aa72-4252-8f30-47290c1b103e req-2a38f6a3-d9b4-4c28-b7fb-5d36a1fab169 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163490 Nov 02 22:32:39.489194 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3844/7568] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:32:41.411027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1269603126"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:32:41.411618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:41.418940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:41.419415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:41.419851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:41.420538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:41.421075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:41.421444 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:41.549319 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.network.security_group_api [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Adding security group 6a237e9b-5333-41fd-958f-c77804e6e0c7 to port d9374404-f010-4896-b765-b917b8b40cb5 Nov 02 22:32:41.946169 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b22523e0-720f-4731-893e-cce387552306 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/action" status: 202 len: 0 microversion: 2.1 time: 0.539459 Nov 02 22:32:41.947173 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3725/7569] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:32:41 2022] POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:32:41.955044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d76d263c-18c1-4888-94dc-07c157b44a32 req-3be87496-e39d-4df2-9dc2-5dc0a426ec2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fffc20-f354-4665-ab76-ef3805ccb1d4", "tag": "d9374404-f010-4896-b765-b917b8b40cb5"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:32:41.955779 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:32:41.956402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:32:41.963734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:41.964254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:41.964763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:41.965501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:41.965955 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:41.966386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:41.978050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d76d263c-18c1-4888-94dc-07c157b44a32 req-3be87496-e39d-4df2-9dc2-5dc0a426ec2c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:32:41.979857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d76d263c-18c1-4888-94dc-07c157b44a32 req-3be87496-e39d-4df2-9dc2-5dc0a426ec2c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:32:41.979857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d76d263c-18c1-4888-94dc-07c157b44a32 req-3be87496-e39d-4df2-9dc2-5dc0a426ec2c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:32:42.005896 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d76d263c-18c1-4888-94dc-07c157b44a32 req-3be87496-e39d-4df2-9dc2-5dc0a426ec2c service nova] Creating event network-changed:d9374404-f010-4896-b765-b917b8b40cb5 for instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 on n-h2-860863-4 Nov 02 22:32:42.011492 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d76d263c-18c1-4888-94dc-07c157b44a32 req-3be87496-e39d-4df2-9dc2-5dc0a426ec2c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060779 Nov 02 22:32:42.012409 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3845/7570] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:32:42.120502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:32:42.130078 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-751f9783-1441-4547-869a-747aa2b9904a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1762 microversion: 2.1 time: 0.178696 Nov 02 22:32:42.131146 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3726/7571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:32:41 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1762 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:34:13.712805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:34:13.714507 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:34:13.714641 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/action (ip 10.222.0.25) !!! Nov 02 22:34:13.725224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:34:13.733545 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:34:13.734759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:13.735248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:13.736252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:13.737089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:13.737552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:13.737990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:13.935477 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-34a24519-9973-43c8-bd00-84997967a293 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/action" status: 202 len: 0 microversion: 2.1 time: 0.224790 Nov 02 22:34:13.936156 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3846/7572] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:34:13 2022] POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:34:13.942915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:34:13.943597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=16 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:34:13.944884 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 22:34:13.945973 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:34:13.946095 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:34:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 (ip 10.222.0.25) !!! Nov 02 22:34:13.950620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:34:13.951235 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:34:13.962593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:13.963084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:13.963524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:13.964232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:13.964685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:13.965153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:14.118125 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:34:14.127076 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7c2627fc-630f-4987-ba92-c585f44e07b5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1764 microversion: 2.1 time: 0.186124 Nov 02 22:34:14.127671 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3727/7573] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:34:13 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1764 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:34:15.152744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:34:15.153486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:34:15.160447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:15.160956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:15.161419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:15.162121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:15.162588 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:15.163032 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:15.306281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:34:15.315364 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c174b4e5-b85e-4796-9cf1-aa6e830a4888 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1769 microversion: 2.1 time: 0.167632 Nov 02 22:34:15.315949 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3847/7574] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:34:15 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1769 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:34:16.339445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:34:16.340058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:34:16.347593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:16.348074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:16.348510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:16.349219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:34:16.349670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:34:16.350097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:34:16.496069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:34:16.504674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eaeee667-a7ae-49cd-9b96-5c6e2b34c00d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1762 microversion: 2.1 time: 0.169150 Nov 02 22:34:16.505315 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3728/7575] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:34:16 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1762 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:26.265730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:26.266432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:26.271228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1269603126"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:35:26.271869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:26.278209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:26.280133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:26.280133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:26.280133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:26.280487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:26.280768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:26.478790 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.security_group_api [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Removing security group 6a237e9b-5333-41fd-958f-c77804e6e0c7 from port d9374404-f010-4896-b765-b917b8b40cb5 Nov 02 22:35:26.830324 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d43fc3c-0c52-4131-b74c-fc6bd79bdb03 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/action" status: 202 len: 0 microversion: 2.1 time: 0.566669 Nov 02 22:35:26.834837 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3848/7576] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:35:26 2022] POST /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:35:26.835028 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 22:35:26.838185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=4 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:26.838185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:26.841296 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-1de34c88-cb38-4082-b8c1-0042c7e84d89 req-3ac4394a-30f0-4686-afaf-c29a8230485a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fffc20-f354-4665-ab76-ef3805ccb1d4", "tag": "d9374404-f010-4896-b765-b917b8b40cb5"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:35:26.853365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1de34c88-cb38-4082-b8c1-0042c7e84d89 req-3ac4394a-30f0-4686-afaf-c29a8230485a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:26.857936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1de34c88-cb38-4082-b8c1-0042c7e84d89 req-3ac4394a-30f0-4686-afaf-c29a8230485a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:26.857936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-1de34c88-cb38-4082-b8c1-0042c7e84d89 req-3ac4394a-30f0-4686-afaf-c29a8230485a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:26.868751 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-1de34c88-cb38-4082-b8c1-0042c7e84d89 req-3ac4394a-30f0-4686-afaf-c29a8230485a service nova] Creating event network-changed:d9374404-f010-4896-b765-b917b8b40cb5 for instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 on n-h2-860863-4 Nov 02 22:35:26.875229 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-1de34c88-cb38-4082-b8c1-0042c7e84d89 req-3ac4394a-30f0-4686-afaf-c29a8230485a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042274 Nov 02 22:35:26.876493 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3729/7577] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:28.167143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:28.167665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:28.173621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:28.174119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:28.174573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:28.175271 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:28.175738 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:28.176183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:28.258878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lazy-loading 'services' on Instance uuid c6fffc20-f354-4665-ab76-ef3805ccb1d4 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:35:28.446602 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f8fad9b4-8323-4fe1-b82f-2254ac8c4a8f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments/b0103300-4f59-4889-b9e3-72e4c3bf110d" status: 202 len: 0 microversion: 2.1 time: 0.284209 Nov 02 22:35:28.447261 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3849/7578] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:35:28 2022] DELETE /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments/b0103300-4f59-4889-b9e3-72e4c3bf110d => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:35:28.462055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:28.465004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:28.474149 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 46616. Nov 02 22:35:28.482030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:28.482518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:28.482953 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:28.483659 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:28.484109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:28.484636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:28.517358 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-46d2fe42-5b80-4130-90ff-e0df68fa63cd tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063399 Nov 02 22:35:28.517955 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3730/7579] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:35:28 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:28.911869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-30daf60a-a8ab-4022-9c89-b392ecc555fd req-71dfccea-010a-4582-bd09-68d2436693b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fffc20-f354-4665-ab76-ef3805ccb1d4", "tag": "d9374404-f010-4896-b765-b917b8b40cb5"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:35:28.923167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-30daf60a-a8ab-4022-9c89-b392ecc555fd req-71dfccea-010a-4582-bd09-68d2436693b4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:28.923871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-30daf60a-a8ab-4022-9c89-b392ecc555fd req-71dfccea-010a-4582-bd09-68d2436693b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:28.924136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-30daf60a-a8ab-4022-9c89-b392ecc555fd req-71dfccea-010a-4582-bd09-68d2436693b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:28.935375 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-30daf60a-a8ab-4022-9c89-b392ecc555fd req-71dfccea-010a-4582-bd09-68d2436693b4 service nova] Creating event network-changed:d9374404-f010-4896-b765-b917b8b40cb5 for instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 on n-h2-860863-4 Nov 02 22:35:28.940342 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-30daf60a-a8ab-4022-9c89-b392ecc555fd req-71dfccea-010a-4582-bd09-68d2436693b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032537 Nov 02 22:35:28.941017 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3850/7580] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:29.531083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:29.533285 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:29.540830 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:29.541347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:29.541795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:29.542503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:29.542979 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:29.543396 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:29.574997 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d495600f-b871-42a0-a574-f2e658eda221 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047987 Nov 02 22:35:29.575796 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3731/7581] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:35:29 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:30.589473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:30.591818 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:30.598285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:30.598791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:30.599249 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:30.600503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:30.601105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:30.601553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:30.633431 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5391a54e-575f-4f91-8448-b9e288834144 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049352 Nov 02 22:35:30.634019 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3851/7582] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:35:30 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:31.646333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:31.648647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:31.655395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:31.655870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:31.656305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:31.657012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:31.657701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:31.658129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:31.689053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e1b5141-abfc-4701-a35d-e34ce91dc238 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Nov 02 22:35:31.689625 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3732/7583] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:35:31 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:32.702531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:32.704749 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:32.711801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:32.712304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:32.712760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:32.713497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:32.713965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:32.714405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:32.744813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1177386e-3685-4257-9023-39099adc90d9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Nov 02 22:35:32.745430 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3852/7584] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:35:32 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:33.756842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:33.759210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:33.766007 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:33.766498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:33.766944 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:33.767643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:33.768102 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:33.768537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:33.798431 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f446e954-1236-42e0-88d9-715c40781e24 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045643 Nov 02 22:35:33.798999 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3733/7585] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:35:33 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 22:35:33.809778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:33.810283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:33.817082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:33.817842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:33.818295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:33.819217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:33.819682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:33.820121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:33.894808 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] HTTP exception thrown: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 is not attached to volume b0103300-4f59-4889-b9e3-72e4c3bf110d Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Request method failure captured: Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments/b0103300-4f59-4889-b9e3-72e4c3bf110d HTTP/1.1 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu_JOfiu-09lJzmNot-QEvYp8ZcdzE-rZAd67ASxCry3Zb0_qKV1l567Dpz0562Pgs66U2RsD4T0XOydOe0r818hrDtO_yUwGdQT1X2I0xCFX-ToAdbApuO0N5c6TJXdNSmE335IpXvMJPxa05rhbG9mwV1sI9QoJ8SUT-OmEVaIplM Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e6c04cb2b3da47ec9392fc86624a15c9 Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 is not attached to volume b0103300-4f59-4889-b9e3-72e4c3bf110d Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': 'c6fffc20-f354-4665-ab76-ef3805ccb1d4', 'id': 'b0103300-4f59-4889-b9e3-72e4c3bf110d'} Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b0103300-4f59-4889-b9e3-72e4c3bf110d. Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 is not attached to volume b0103300-4f59-4889-b9e3-72e4c3bf110d Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:35:33.897437 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:35:33.902912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:35:33.902912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:35:33.902912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 is not attached to volume b0103300-4f59-4889-b9e3-72e4c3bf110d Nov 02 22:35:33.902912 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:33.902912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Returning 404 to user: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 is not attached to volume b0103300-4f59-4889-b9e3-72e4c3bf110d {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:35:33.902912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1604ca9-d4aa-45dc-af85-345836b7f1a4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments/b0103300-4f59-4889-b9e3-72e4c3bf110d" status: 404 len: 154 microversion: 2.1 time: 0.093140 Nov 02 22:35:33.902912 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3853/7586] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:35:33 2022] DELETE /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4/os-volume_attachments/b0103300-4f59-4889-b9e3-72e4c3bf110d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:35:37.273485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:37.273980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:37.280849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:37.281445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:37.281888 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:37.282644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:37.283105 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:37.283537 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:37.308442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:35:37.568354 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5706ffe0-2f06-4f12-b1c6-aaea0b0dee4f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 204 len: 0 microversion: 2.1 time: 0.298697 Nov 02 22:35:37.569945 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3734/7587] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:35:37 2022] DELETE /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:35:37.584220 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:37.585059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:37.592664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:37.593179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:37.593669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:37.594648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:37.595114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:37.596081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:37.731297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:37.739545 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c3b144fd-e0bd-490f-b4c0-5744aa1dd009 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1556 microversion: 2.1 time: 0.159455 Nov 02 22:35:37.747835 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3854/7588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:37 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:38.765666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:38.766374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:38.773844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:38.774327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:38.774767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:38.775450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:38.775902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:38.776329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:39.290066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:39.297806 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a676f2b0-807c-47e1-b969-711ee568138d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1556 microversion: 2.1 time: 0.536509 Nov 02 22:35:39.298386 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3735/7589] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:38 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1556 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:39.741134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b5d3f9e0-b3b4-41b8-8315-26c203784e21 req-7d21a1a9-7268-4d8c-b579-98542e3b6fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6fffc20-f354-4665-ab76-ef3805ccb1d4", "name": "network-vif-deleted", "tag": "d9374404-f010-4896-b765-b917b8b40cb5"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:35:39.751585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b5d3f9e0-b3b4-41b8-8315-26c203784e21 req-7d21a1a9-7268-4d8c-b579-98542e3b6fef service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:39.754932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b5d3f9e0-b3b4-41b8-8315-26c203784e21 req-7d21a1a9-7268-4d8c-b579-98542e3b6fef service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:39.754932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b5d3f9e0-b3b4-41b8-8315-26c203784e21 req-7d21a1a9-7268-4d8c-b579-98542e3b6fef service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:39.765912 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b5d3f9e0-b3b4-41b8-8315-26c203784e21 req-7d21a1a9-7268-4d8c-b579-98542e3b6fef service nova] Creating event network-vif-deleted:d9374404-f010-4896-b765-b917b8b40cb5 for instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 on n-h2-860863-4 Nov 02 22:35:39.770876 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b5d3f9e0-b3b4-41b8-8315-26c203784e21 req-7d21a1a9-7268-4d8c-b579-98542e3b6fef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086670 Nov 02 22:35:39.771459 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3855/7590] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:40.321747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:40.322351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:40.330559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:40.331913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:40.331913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:40.332165 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:40.332614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:40.333077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:40.367210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:40.367698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:40.371967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:40.371967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lazy-loading 'fault' on Instance uuid c6fffc20-f354-4665-ab76-ef3805ccb1d4 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:35:40.410073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:40.418831 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c53b6a13-6492-46a5-a162-83496807e2f4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 200 len: 1349 microversion: 2.1 time: 0.101542 Nov 02 22:35:40.419578 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3736/7591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:40 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:41.444862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:41.445601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: c6fffc20-f354-4665-ab76-ef3805ccb1d4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:41.452091 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:41.452581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:41.453069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:41.453765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:41.454228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:41.454668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:41.469903 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] HTTP exception thrown: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 could not be found. Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Request method failure captured: Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 HTTP/1.1 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu_JOfiu-09lJzmNot-QEvYp8ZcdzE-rZAd67ASxCry3Zb0_qKV1l567Dpz0562Pgs66U2RsD4T0XOydOe0r818hrDtO_yUwGdQT1X2I0xCFX-ToAdbApuO0N5c6TJXdNSmE335IpXvMJPxa05rhbG9mwV1sI9QoJ8SUT-OmEVaIplM Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e6c04cb2b3da47ec9392fc86624a15c9 Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 could not be found. Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'c6fffc20-f354-4665-ab76-ef3805ccb1d4'} Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 could not be found. Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 could not be found. Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:35:41.471513 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 could not be found. Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Returning 404 to user: Instance c6fffc20-f354-4665-ab76-ef3805ccb1d4 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3d41066-7158-4094-9b03-091cfe5a99e9 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4" status: 404 len: 111 microversion: 2.1 time: 0.034606 Nov 02 22:35:41.477128 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3856/7592] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:41 2022] GET /compute/v2.1/servers/c6fffc20-f354-4665-ab76-ef3805ccb1d4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:35:41.481698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d2486abf-e77e-424e-9544-180ea8f65896 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '.version_select at 0x7f9b638cdb80>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:41.573874 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d2486abf-e77e-424e-9544-180ea8f65896 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1103499197" status: 202 len: 0 microversion: 2.1 time: 0.095924 Nov 02 22:35:41.574459 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3737/7593] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 22:35:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1103499197 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:35:52.621526 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c4eca90-d1e9-4062-a13e-48edecc031ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'create', calling method: .version_select at 0x7f9b60315940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1616787042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2AhDPI5laMea1laSimkFXLR+U+bUvrCbxG30lRbcinzoqSfItKbKIt/36XlO+ptc0ekAw5astKaBf8PgjMwK6+ijmw4iUNwPC4MbR4rM4DJkks3qJo10D9lt+8qSOxCA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:35:52.627804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=18 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:52.628478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:52.640982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8c4eca90-d1e9-4062-a13e-48edecc031ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:35:52.646167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-8c4eca90-d1e9-4062-a13e-48edecc031ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for user e6c04cb2b3da47ec9392fc86624a15c9 and project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:35:52.755362 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8c4eca90-d1e9-4062-a13e-48edecc031ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.138303 Nov 02 22:35:52.755898 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3857/7594] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:35:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:35:52.803828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:52.804592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:35:52.809244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1684628212", "imageRef": "836d3911-a006-4bec-a0e6-e84788d8115f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1616787042", "networks": [{"uuid": "3871b515-47c0-4d78-a6a6-6493fbfa0c51"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:35:52.861702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] validate_networks() for [('3871b515-47c0-4d78-a6a6-6493fbfa0c51', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:35:53.277862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:35:53.278291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:35:53.278765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:35:53.279174 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:35:53.279619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:35:53.288559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:53.289131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:53.289515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:53.290265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:53.290716 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:53.291143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:53.309618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:35:53.314841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Getting quotas for user e6c04cb2b3da47ec9392fc86624a15c9 and project 8bdab870df584ffbaca3bc682fbcfae1. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:35:53.328175 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:35:53.330425 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='836d3911-a006-4bec-a0e6-e84788d8115f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:35:53.450695 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d65d543c-6533-40d2-b8a9-c658775c0987 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649275 Nov 02 22:35:53.451337 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3738/7595] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:35:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:35:53.462587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-87c4cf75-6bdb-4564-bdb5-df89779b15a1 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:53.467853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-87c4cf75-6bdb-4564-bdb5-df89779b15a1 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:53.520349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-87c4cf75-6bdb-4564-bdb5-df89779b15a1 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:53.527584 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-87c4cf75-6bdb-4564-bdb5-df89779b15a1 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1259 microversion: 2.1 time: 0.069008 Nov 02 22:35:53.528169 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3858/7596] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:53 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:54.551926 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:54.552481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:54.559232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:54.559713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:54.560146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:54.560826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:54.561299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:54.561733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:54.628013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:54.638157 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7698a7ac-12e0-4f39-a013-e1694cfdd4aa tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1263 microversion: 2.1 time: 0.090979 Nov 02 22:35:54.642009 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3739/7597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:54 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:35:55.661787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:55.663099 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:55.670308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:55.670814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:55.671270 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:55.672000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:55.672464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:55.672908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:55.745389 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:55.753569 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d7a42f9-6be9-47ec-aec2-f558257df6de tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1319 microversion: 2.1 time: 0.095824 Nov 02 22:35:55.754155 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3859/7598] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:55 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1319 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:56.776048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:56.777342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:56.783672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:56.784153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:56.784593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:56.785321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:56.786003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:56.786617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:56.991017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:57.000713 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cb669b43-3cfa-48ff-a821-ab722b96519f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.228804 Nov 02 22:35:57.016718 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3740/7599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:56 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:58.024543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:58.025517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:58.033156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:58.033661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:58.034123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:58.034846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:58.035315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:58.035759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:58.178575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:58.188522 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5b3ee0e-a426-4e4c-b6f5-c872552ad500 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.168319 Nov 02 22:35:58.208902 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3860/7600] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:58 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:35:59.212721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:35:59.213576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:35:59.220427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:59.221041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:59.221488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:59.222192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:35:59.222646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:35:59.223079 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:35:59.372121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:35:59.380218 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-120b98b8-1573-473e-bec9-1dc9485b0aa8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.171784 Nov 02 22:35:59.380809 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3741/7601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:35:59 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:00.405480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:00.406320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:00.413163 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:00.413667 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:00.414123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:00.415336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:00.416002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:00.416252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:00.568680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:00.577360 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94213889-7be0-494d-8425-8ad093e8f48f tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.175674 Nov 02 22:36:00.577955 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3861/7602] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:00 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:01.601426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:01.602322 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:01.609887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:01.610371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:01.610809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:01.611506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:01.612042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:01.612474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:01.750379 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:01.758455 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-62070e7e-5bab-4b0a-b06d-7d0643214a30 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.161859 Nov 02 22:36:01.759043 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3742/7603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:01 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:02.781745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:02.782399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:02.789908 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:02.792842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:02.792842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:02.792842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:02.792842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:02.792842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:02.942631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:02.951653 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ceb0581d-7292-41b1-bdfc-4f50860c717b tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.173750 Nov 02 22:36:02.952255 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3862/7604] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:02 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:36:03.975025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:03.975794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:03.980228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:03.981305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:03.985139 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:03.985647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:03.986094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:03.986804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:03.987269 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:03.987704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:04.194867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:04.194867 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ff62fb8-87a6-4082-89ce-8c5647f98f76 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.194915 Nov 02 22:36:04.194867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3743/7605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:03 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:05.191828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:05.193192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:05.195363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:05.201112 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:05.201703 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:05.202232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:05.202955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:05.203431 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:05.203880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:05.320914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dde949b0-2841-4eff-826f-1a140286e3f6 req-1fba8ee6-ab65-4b2e-b281-97cb7a2ca598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c650d55-36a4-4984-9105-3ef3670c0582", "tag": "3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:36:05.333418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dde949b0-2841-4eff-826f-1a140286e3f6 req-1fba8ee6-ab65-4b2e-b281-97cb7a2ca598 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:05.335106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dde949b0-2841-4eff-826f-1a140286e3f6 req-1fba8ee6-ab65-4b2e-b281-97cb7a2ca598 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:05.335106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dde949b0-2841-4eff-826f-1a140286e3f6 req-1fba8ee6-ab65-4b2e-b281-97cb7a2ca598 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:05.353473 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dde949b0-2841-4eff-826f-1a140286e3f6 req-1fba8ee6-ab65-4b2e-b281-97cb7a2ca598 service nova] Creating event network-changed:3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 for instance 3c650d55-36a4-4984-9105-3ef3670c0582 on n-h1-860863-4 Nov 02 22:36:05.359540 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dde949b0-2841-4eff-826f-1a140286e3f6 req-1fba8ee6-ab65-4b2e-b281-97cb7a2ca598 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043392 Nov 02 22:36:05.360345 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3744/7606] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:36:05.421169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:05.430132 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0dcb1aa-d7fc-450f-b51a-d992afcd3030 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.242253 Nov 02 22:36:05.440977 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3863/7607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:05 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:06.462191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:06.462886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:06.469192 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:06.469676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:06.470115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:06.470805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:06.471286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:06.471717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:06.601428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:06.609986 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-669eb6d2-5d23-46e8-8b7e-db252008f584 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.152936 Nov 02 22:36:06.610600 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3745/7608] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:06 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:07.633088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:07.633705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:07.640807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:07.641336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:07.641777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:07.642470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:07.642932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:07.643369 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:07.780252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:07.784902 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd09aa4f-255a-4cf7-8d5d-64981adefb46 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.155718 Nov 02 22:36:07.785514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3864/7609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:07 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:08.808199 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:08.808793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:08.815994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:08.816479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:08.816914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:08.817623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:08.818070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:08.818754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:08.945806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:08.954217 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4c615930-7fbc-4575-ab57-2fe30a4b07f5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.150415 Nov 02 22:36:08.954790 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3746/7610] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:08 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:09.977076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:09.978215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:09.984956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:09.985537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:09.985982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:09.986671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:09.987135 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:09.987568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:10.121525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:10.129195 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eae6e611-7d8f-4234-9122-4c5cd4300a4c tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.156013 Nov 02 22:36:10.129763 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3865/7611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:09 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:36:11.151963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:11.152610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:11.159374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:11.159875 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:11.160304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:11.161016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:11.161471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:11.161905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:11.289580 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:11.297559 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e321faea-3e88-4ad0-b391-a9f4893142ef tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.149682 Nov 02 22:36:11.298132 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3747/7612] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:11 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:12.321145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:12.321776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:12.328503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:12.329031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:12.329484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:12.330207 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:12.330664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:12.331107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:12.464614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:12.472610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a2affd3-126a-411e-806d-8320b977ee41 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.155648 Nov 02 22:36:12.473226 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3866/7613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:12 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:12.735227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-53882c67-ddbe-4406-9165-49ee5ad7e369 req-5a9f841f-9724-4eb9-a091-2ecd55053589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c650d55-36a4-4984-9105-3ef3670c0582", "name": "network-vif-plugged", "status": "completed", "tag": "3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:36:12.745549 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-53882c67-ddbe-4406-9165-49ee5ad7e369 req-5a9f841f-9724-4eb9-a091-2ecd55053589 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:12.746030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-53882c67-ddbe-4406-9165-49ee5ad7e369 req-5a9f841f-9724-4eb9-a091-2ecd55053589 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:12.746464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-53882c67-ddbe-4406-9165-49ee5ad7e369 req-5a9f841f-9724-4eb9-a091-2ecd55053589 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:12.757347 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-53882c67-ddbe-4406-9165-49ee5ad7e369 req-5a9f841f-9724-4eb9-a091-2ecd55053589 service nova] Creating event network-vif-plugged:3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 for instance 3c650d55-36a4-4984-9105-3ef3670c0582 on n-h1-860863-4 Nov 02 22:36:12.763141 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-53882c67-ddbe-4406-9165-49ee5ad7e369 req-5a9f841f-9724-4eb9-a091-2ecd55053589 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090373 Nov 02 22:36:12.763746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3748/7614] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:36:13.495865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:13.496504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:13.503859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:13.504364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:13.504823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:13.505557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:13.506031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:13.506483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:13.633747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:13.641480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4eda3d96-1e5a-499d-99c8-cbc089756f56 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1359 microversion: 2.1 time: 0.149715 Nov 02 22:36:13.642057 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3867/7615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:13 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:14.666331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:14.667019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:14.673147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:14.673633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:14.674068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:14.674775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:14.675223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:14.675642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:14.810059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:14.817966 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-516eba24-2d50-4ac5-ab22-6029e7310907 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1549 microversion: 2.1 time: 0.156738 Nov 02 22:36:14.818800 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3749/7616] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:14 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:14.841141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:14.841777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:14.848541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:14.849082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:14.849538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:14.850237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:14.850704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:14.851147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:14.979107 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:14.986757 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-81a7823e-da62-4198-a99b-c080a8e41f9e tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1549 microversion: 2.1 time: 0.150173 Nov 02 22:36:14.987327 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3868/7617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:14 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:15.009883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:15.014500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:15.015255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Searching by: {'deleted': False, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1'} {{(pid=121039) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 22:36:15.020474 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:15.020973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:15.021409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:15.022116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:15.022559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:15.022980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:15.045720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.multi_cell_list [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121039) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 22:36:15.072420 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ce91aeb7-a55f-48cc-b90b-7a3567f39fd4 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067139 Nov 02 22:36:15.072998 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3750/7618] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Nov 2 22:36:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:36:15.084641 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:15.085308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:15.091407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:15.091912 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:15.092370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:15.093121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:15.093595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:15.094043 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:15.222555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:15.230784 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-429b7f8a-f5d0-4c1c-a249-b9e7feec3468 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1549 microversion: 2.1 time: 0.150027 Nov 02 22:36:15.231360 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3869/7619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:15 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:18.028746 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d00814-b09b-4e1c-bd0e-4456bda9f468"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:36:18.031064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:18.037934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:18.038414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:18.038849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:18.039530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:18.040630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:18.041008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:18.746230 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fe2328a9-c26a-4481-be99-c385b29d3926 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721944 Nov 02 22:36:18.746846 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3751/7620] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Nov 2 22:36:18 2022] POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:36:30.581877 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:30.582513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:30.584732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:30.585457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=66 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:30.591590 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:30.594517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:30.594517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:30.594517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:30.594517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:30.594517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:30.730904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:30.739171 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fa49e39-bbf2-43ca-9762-7d96686b15b8 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1595 microversion: 2.1 time: 0.161379 Nov 02 22:36:30.739754 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3870/7621] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:30 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:32.952956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:32.953873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:32.954617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:32.958829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e1bc0b38-e926-4c0c-9a73-95286f81e547 req-3b328bd2-781c-4eca-a236-628460ef10c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c650d55-36a4-4984-9105-3ef3670c0582", "tag": "3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:36:32.969637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1bc0b38-e926-4c0c-9a73-95286f81e547 req-3b328bd2-781c-4eca-a236-628460ef10c6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:32.970208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1bc0b38-e926-4c0c-9a73-95286f81e547 req-3b328bd2-781c-4eca-a236-628460ef10c6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:32.970726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e1bc0b38-e926-4c0c-9a73-95286f81e547 req-3b328bd2-781c-4eca-a236-628460ef10c6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:32.983019 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e1bc0b38-e926-4c0c-9a73-95286f81e547 req-3b328bd2-781c-4eca-a236-628460ef10c6 service nova] Creating event network-changed:3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 for instance 3c650d55-36a4-4984-9105-3ef3670c0582 on n-h1-860863-4 Nov 02 22:36:32.988184 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e1bc0b38-e926-4c0c-9a73-95286f81e547 req-3b328bd2-781c-4eca-a236-628460ef10c6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037823 Nov 02 22:36:32.988781 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3752/7622] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:36:35.386325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-154516560"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:36:35.390356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:35.394755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:35.395186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:35.395630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:35.396321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:35.396827 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:35.397284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:35.523911 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.network.security_group_api [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Adding security group 0a36aebd-dfab-477f-9009-1e3979ee8352 to port 3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 Nov 02 22:36:35.914164 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a93a43fd-3c79-46cb-b5c1-040b1609ee85 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/action" status: 202 len: 0 microversion: 2.1 time: 0.531604 Nov 02 22:36:35.918719 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3871/7623] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:36:35 2022] POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:36:35.922723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2868a410-d50f-4aab-bbf8-5efb3e5c9ff0 req-bb50ab40-15e9-42aa-8a2d-6908ebf5295c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c650d55-36a4-4984-9105-3ef3670c0582", "tag": "3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:36:35.924073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:35.924741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:35.935939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2868a410-d50f-4aab-bbf8-5efb3e5c9ff0 req-bb50ab40-15e9-42aa-8a2d-6908ebf5295c service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:35.936690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2868a410-d50f-4aab-bbf8-5efb3e5c9ff0 req-bb50ab40-15e9-42aa-8a2d-6908ebf5295c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:35.937223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2868a410-d50f-4aab-bbf8-5efb3e5c9ff0 req-bb50ab40-15e9-42aa-8a2d-6908ebf5295c service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:35.939775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:35.940323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:35.940744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:35.942160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:35.942160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:35.942486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:35.952526 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2868a410-d50f-4aab-bbf8-5efb3e5c9ff0 req-bb50ab40-15e9-42aa-8a2d-6908ebf5295c service nova] Creating event network-changed:3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 for instance 3c650d55-36a4-4984-9105-3ef3670c0582 on n-h1-860863-4 Nov 02 22:36:35.958159 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2868a410-d50f-4aab-bbf8-5efb3e5c9ff0 req-bb50ab40-15e9-42aa-8a2d-6908ebf5295c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039621 Nov 02 22:36:35.961255 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3753/7624] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:36:36.203328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:36.214357 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e1275348-9f85-46f6-813b-877fa96fe4ea tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1760 microversion: 2.1 time: 0.294006 Nov 02 22:36:36.215316 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3872/7625] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:35 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1760 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:50.276756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:36:50.279133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:50.285862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:50.286346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:50.286788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:50.287481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:50.287939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:50.288698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:50.515448 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-104fcee2-b9d2-47a4-aeff-94af91739b33 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/action" status: 202 len: 0 microversion: 2.1 time: 0.291540 Nov 02 22:36:50.515990 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3754/7626] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:36:50 2022] POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:36:50.526442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:50.527068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:50.530783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:50.531510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:36:50.540831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:50.541866 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:50.542328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:50.543095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:50.543561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:50.544000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:50.744130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:50.752576 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1060a2a2-b142-49b4-a1bc-ccc347fc1fac tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1752 microversion: 2.1 time: 0.230658 Nov 02 22:36:50.753818 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3873/7627] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:50 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1752 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:36:51.778024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:51.778722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:51.786278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:51.786753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:51.787213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:51.787895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:51.788343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:51.788766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:51.938419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:51.947120 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b5359b5-0420-437e-89af-ace0a94229c6 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.173359 Nov 02 22:36:51.947826 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3755/7628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:51 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:52.971347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:52.972120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:52.978893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:52.979387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:52.979841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:52.980542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:52.981030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:52.981471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:53.125902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:53.135216 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5100f656-dcc6-4cce-9950-061a09c0a38a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.167860 Nov 02 22:36:53.135798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3874/7629] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:52 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:54.160430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:54.161023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:54.167822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:54.168303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:54.168741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:54.169456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:54.169921 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:54.170347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:54.311864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:54.320919 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f49d0c82-df68-4a62-ac26-9c3722502180 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.165134 Nov 02 22:36:54.321870 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3756/7630] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:54 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:55.345026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:55.345657 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:55.352652 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:55.353175 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:55.353627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:55.354326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:55.354791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:55.355232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:55.500427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:55.509313 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5ec36d7-fb2f-474b-8681-236023fae437 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.168197 Nov 02 22:36:55.509922 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3875/7631] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:55 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:56.533111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:56.533704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:56.540866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:56.541373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:56.541808 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:56.542485 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:56.542935 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:56.543357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:56.688685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:56.697773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6bf83a30-d60c-40d7-a338-677c3d143526 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.168580 Nov 02 22:36:56.698381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3757/7632] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:56 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:57.723149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:57.723692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:57.730004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:57.730518 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:57.730972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:57.731683 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:57.732153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:57.732602 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:57.878290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:57.886706 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-57f0bc94-f69d-4ab9-9fdd-29c9bdad25cc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.168525 Nov 02 22:36:57.887281 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3876/7633] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:57 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:36:58.914419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:36:58.915034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:36:58.921463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:58.921949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:58.922381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:58.923057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:36:58.923504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:36:58.923923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:36:59.067283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:36:59.075838 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2fc824d7-6834-4636-95c0-e18d842c30c2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.165482 Nov 02 22:36:59.076410 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3758/7634] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:36:58 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:37:00.099294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:00.099921 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:00.106934 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:00.107424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:00.107870 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:00.108561 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:00.109046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:00.109488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:00.259808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:37:00.268023 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e58de74-6fa0-4cfd-aec9-d684ab55ac92 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.172617 Nov 02 22:37:00.268886 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3877/7635] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:37:00 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:37:01.290307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:01.290925 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:01.297735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:01.298222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:01.298660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:01.299356 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:01.299807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:01.300237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:01.449511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:37:01.458000 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eeecd175-8f73-48dc-ab0a-2cc3e78afc9a tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1757 microversion: 2.1 time: 0.171659 Nov 02 22:37:01.458578 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3759/7636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:37:01 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:37:02.481879 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:02.482492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:02.490087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:02.490583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:02.491034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:02.491726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:02.492188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:02.492623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:02.631826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:37:02.639999 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c68e61af-0a70-41a6-a404-ff878a169417 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1760 microversion: 2.1 time: 0.162051 Nov 02 22:37:02.640571 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3878/7637] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:37:02 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:37:41.335771 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-154516560"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:37:41.336310 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:41.339417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=16 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:37:41.340253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:37:41.344918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:41.345430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:41.345872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:41.346567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:41.347023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:41.347451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:41.476778 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.network.security_group_api [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Removing security group 0a36aebd-dfab-477f-9009-1e3979ee8352 from port 3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 Nov 02 22:37:41.830778 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2f1c333b-6404-4ef4-98f6-65244fc3c159 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/action" status: 202 len: 0 microversion: 2.1 time: 0.499599 Nov 02 22:37:41.831409 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3760/7638] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:37:41 2022] POST /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:37:41.843276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:37:41.844780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=36 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:37:41.952745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9935f58e-4dae-4f24-8ecc-58943b11869c req-a703cd9f-4dee-4da8-8a57-61af782a6762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c650d55-36a4-4984-9105-3ef3670c0582", "tag": "3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:37:41.963265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9935f58e-4dae-4f24-8ecc-58943b11869c req-a703cd9f-4dee-4da8-8a57-61af782a6762 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:41.963767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9935f58e-4dae-4f24-8ecc-58943b11869c req-a703cd9f-4dee-4da8-8a57-61af782a6762 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:41.964214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9935f58e-4dae-4f24-8ecc-58943b11869c req-a703cd9f-4dee-4da8-8a57-61af782a6762 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:41.975725 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9935f58e-4dae-4f24-8ecc-58943b11869c req-a703cd9f-4dee-4da8-8a57-61af782a6762 service nova] Creating event network-changed:3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 for instance 3c650d55-36a4-4984-9105-3ef3670c0582 on n-h1-860863-4 Nov 02 22:37:41.984124 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9935f58e-4dae-4f24-8ecc-58943b11869c req-a703cd9f-4dee-4da8-8a57-61af782a6762 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146353 Nov 02 22:37:41.987916 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3879/7639] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:43.040511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:43.041092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:43.044202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3a202d17-8abb-4d26-9475-2e318bdcedc5 req-0360b352-44db-4a90-bf8f-b559c474de7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c650d55-36a4-4984-9105-3ef3670c0582", "tag": "3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:37:43.047506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:43.047991 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:43.048816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:43.049603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:43.050060 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:43.050486 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:43.057114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3a202d17-8abb-4d26-9475-2e318bdcedc5 req-0360b352-44db-4a90-bf8f-b559c474de7d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:43.057742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3a202d17-8abb-4d26-9475-2e318bdcedc5 req-0360b352-44db-4a90-bf8f-b559c474de7d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:43.058472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3a202d17-8abb-4d26-9475-2e318bdcedc5 req-0360b352-44db-4a90-bf8f-b559c474de7d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:43.073817 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3a202d17-8abb-4d26-9475-2e318bdcedc5 req-0360b352-44db-4a90-bf8f-b559c474de7d service nova] Creating event network-changed:3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 for instance 3c650d55-36a4-4984-9105-3ef3670c0582 on n-h1-860863-4 Nov 02 22:37:43.078943 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3a202d17-8abb-4d26-9475-2e318bdcedc5 req-0360b352-44db-4a90-bf8f-b559c474de7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040706 Nov 02 22:37:43.079877 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3880/7640] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:43.144067 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lazy-loading 'services' on Instance uuid 3c650d55-36a4-4984-9105-3ef3670c0582 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:37:43.312819 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cfc796ab-7102-4f07-8c62-0537334298b2 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments/a4d00814-b09b-4e1c-bd0e-4456bda9f468" status: 202 len: 0 microversion: 2.1 time: 0.277805 Nov 02 22:37:43.313679 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3761/7641] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:37:43 2022] DELETE /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments/a4d00814-b09b-4e1c-bd0e-4456bda9f468 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:37:43.324751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:43.327440 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:43.334597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:43.336199 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:43.341718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:43.341718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:43.341718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:43.341718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:43.374737 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50600fb6-cb28-48a0-b92b-cf795a715831 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056331 Nov 02 22:37:43.375447 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3881/7642] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:37:43 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:44.389162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:44.391542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:44.397765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:44.398756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:44.399189 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:44.399943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:44.400391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:44.400813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:44.430845 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bce82d13-6dd2-4500-a656-2fc3ee8bbf67 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046377 Nov 02 22:37:44.431421 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3762/7643] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:37:44 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:45.444318 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:45.447031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:45.453899 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:45.454399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:45.455480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:45.455821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:45.456299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:45.456745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:45.487954 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7d04e0d-0c70-4be2-9441-f129cf955168 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047586 Nov 02 22:37:45.488545 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3882/7644] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:37:45 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:46.500385 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:46.502703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:46.510589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:46.511070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:46.511565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:46.512202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:46.512653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:46.513109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:46.543916 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ba91f04-c9b9-4659-a02f-25a8be4424da tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047528 Nov 02 22:37:46.544481 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3763/7645] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:37:46 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:47.556477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:47.558757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:47.565556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:47.566059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:47.566514 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:47.567227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:47.567697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:47.568142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:47.598941 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-395f1b0a-7fd7-4f40-b6b1-f9973bbae537 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046926 Nov 02 22:37:47.599488 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3883/7646] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:37:47 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:48.612372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:48.614607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:48.621967 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:48.622447 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:48.622884 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:48.623569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:48.624017 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:48.624482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:48.653019 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-77827d9d-d2c9-4869-8ddc-5298d8b437db tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044488 Nov 02 22:37:48.653593 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3764/7647] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Nov 2 22:37:48 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 22:37:48.665105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:48.665639 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:48.672430 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:48.672945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:48.673407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:48.674113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:48.674580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:48.675023 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:48.750875 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] HTTP exception thrown: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 is not attached to volume a4d00814-b09b-4e1c-bd0e-4456bda9f468 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Request method failure captured: Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments/a4d00814-b09b-4e1c-bd0e-4456bda9f468 HTTP/1.1 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu_JOfiu-09lJzmNot-QEvYp8ZcdzE-rZAd67ASxCry3Zb0_qKV1l567Dpz0562Pgs66U2RsD4T0XOydOe0r818hrDtO_yUwGdQT1X2I0xCFX-ToAdbApuO0N5c6TJXdNSmE335IpXvMJPxa05rhbG9mwV1sI9QoJ8SUT-OmEVaIplM Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e6c04cb2b3da47ec9392fc86624a15c9 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 is not attached to volume a4d00814-b09b-4e1c-bd0e-4456bda9f468 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'server_id': '3c650d55-36a4-4984-9105-3ef3670c0582', 'id': 'a4d00814-b09b-4e1c-bd0e-4456bda9f468'} Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a4d00814-b09b-4e1c-bd0e-4456bda9f468. Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 is not attached to volume a4d00814-b09b-4e1c-bd0e-4456bda9f468 Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:37:48.752555 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:37:48.757473 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:37:48.757473 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:37:48.757473 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 is not attached to volume a4d00814-b09b-4e1c-bd0e-4456bda9f468 Nov 02 22:37:48.757473 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:48.757473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Returning 404 to user: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 is not attached to volume a4d00814-b09b-4e1c-bd0e-4456bda9f468 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:37:48.757473 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c3e4f59-8437-4919-977b-3e0dbd04269d tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments/a4d00814-b09b-4e1c-bd0e-4456bda9f468" status: 404 len: 154 microversion: 2.1 time: 0.093877 Nov 02 22:37:48.757473 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3884/7648] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Nov 2 22:37:48 2022] DELETE /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582/os-volume_attachments/a4d00814-b09b-4e1c-bd0e-4456bda9f468 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:37:52.188297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:52.188876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:52.197637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:52.198147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:52.198681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:52.199453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:52.199988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:52.200528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:52.229589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:37:52.471206 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-334b5b1a-94f9-4469-a52d-abd23dd56e09 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 204 len: 0 microversion: 2.1 time: 0.286632 Nov 02 22:37:52.471748 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3765/7649] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:37:52 2022] DELETE /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:37:52.480806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:52.481788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:52.489960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:52.490461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:52.490915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:52.491633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:52.492215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:52.492734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:52.624554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:37:52.633226 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-910546ca-8863-4bba-945c-d464f58a2abc tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1555 microversion: 2.1 time: 0.156293 Nov 02 22:37:52.633930 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3885/7650] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:37:52 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:37:53.657916 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:53.658620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:53.665500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:53.666030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:53.666470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:53.667151 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:53.667601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:53.668052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:53.796654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:37:53.804389 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-def586d3-2e15-44e6-a554-2e8e37cc3e21 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1555 microversion: 2.1 time: 0.150842 Nov 02 22:37:53.804973 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3766/7651] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:37:53 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:37:54.828894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:54.829580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:54.836357 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:54.840551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:54.840551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:54.840551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:54.840551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:54.840551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:54.931228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c04cb2b3da47ec9392fc86624a15c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdab870df584ffbaca3bc682fbcfae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:37:54.945277 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-60398cab-26cc-4b7b-8418-02f375cca593 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 200 len: 1513 microversion: 2.1 time: 0.120435 Nov 02 22:37:54.945865 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3886/7652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:37:54 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 1513 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:37:54.992836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6abb0468-ae8f-4f24-a1be-67728f37d7db req-1913c023-9d9e-44b3-bb0e-f3ffaaf44ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c650d55-36a4-4984-9105-3ef3670c0582", "name": "network-vif-deleted", "tag": "3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:37:55.003623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6abb0468-ae8f-4f24-a1be-67728f37d7db req-1913c023-9d9e-44b3-bb0e-f3ffaaf44ca3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:55.007097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6abb0468-ae8f-4f24-a1be-67728f37d7db req-1913c023-9d9e-44b3-bb0e-f3ffaaf44ca3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:55.007097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6abb0468-ae8f-4f24-a1be-67728f37d7db req-1913c023-9d9e-44b3-bb0e-f3ffaaf44ca3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:55.015770 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6abb0468-ae8f-4f24-a1be-67728f37d7db req-1913c023-9d9e-44b3-bb0e-f3ffaaf44ca3 service nova] Creating event network-vif-deleted:3fbc72bf-9e84-45ac-94f5-e22cdcb24ae2 for instance 3c650d55-36a4-4984-9105-3ef3670c0582 on n-h1-860863-4 Nov 02 22:37:55.020579 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6abb0468-ae8f-4f24-a1be-67728f37d7db req-1913c023-9d9e-44b3-bb0e-f3ffaaf44ca3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031691 Nov 02 22:37:55.021205 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3767/7653] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:37:55.969558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:55.970719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] [instance: 3c650d55-36a4-4984-9105-3ef3670c0582] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:37:55.978510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:55.979100 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:55.979553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:55.981156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:37:55.981805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:37:55.982253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:37:55.996816 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] HTTP exception thrown: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 could not be found. Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Request method failure captured: Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 HTTP/1.1 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYu_JOfiu-09lJzmNot-QEvYp8ZcdzE-rZAd67ASxCry3Zb0_qKV1l567Dpz0562Pgs66U2RsD4T0XOydOe0r818hrDtO_yUwGdQT1X2I0xCFX-ToAdbApuO0N5c6TJXdNSmE335IpXvMJPxa05rhbG9mwV1sI9QoJ8SUT-OmEVaIplM Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8bdab870df584ffbaca3bc682fbcfae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 8bdab870df584ffbaca3bc682fbcfae1 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2040591356 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: e6c04cb2b3da47ec9392fc86624a15c9 Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestMinimumBasicScenario-2040591356-project Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 could not be found. Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3c650d55-36a4-4984-9105-3ef3670c0582'} Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 could not be found. Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 could not be found. Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:37:55.998385 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 could not be found. Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Returning 404 to user: Instance 3c650d55-36a4-4984-9105-3ef3670c0582 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea4ff6e0-2f97-4509-992d-92358b657483 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582" status: 404 len: 111 microversion: 2.1 time: 0.034316 Nov 02 22:37:56.003778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3887/7654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:37:55 2022] GET /compute/v2.1/servers/3c650d55-36a4-4984-9105-3ef3670c0582 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:37:56.011116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4612efd1-9ef7-46ba-a0d1-9f3950f975d5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] Calling method '.version_select at 0x7f9b638cd4c0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:37:56.091334 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4612efd1-9ef7-46ba-a0d1-9f3950f975d5 tempest-TestMinimumBasicScenario-2040591356 tempest-TestMinimumBasicScenario-2040591356-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1616787042" status: 202 len: 0 microversion: 2.1 time: 0.086094 Nov 02 22:37:56.091926 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3768/7655] 10.222.0.25 () {58 vars in 1272 bytes} [Wed Nov 2 22:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1616787042 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:38:08.347623 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=18 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:08.348418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=42 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:08.505274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d29eb91d-7c18-4dce-9cc2-ed2e18a642a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: .version_select at 0x7f9b602d8af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-439429250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcEfJ+PUEDhDVDNaLB/Ac0WamNHdphPbsxspxDoNVq1hKIrcOVqz1lyKpM94hBhAXgHU/DbZO41kunfzYG8tVAmaN+MnhyiKNGOvCavGnDcfKXOQsgNQLagOVcxViFB1g=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:38:08.520902 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d29eb91d-7c18-4dce-9cc2-ed2e18a642a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:38:08.527608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-d29eb91d-7c18-4dce-9cc2-ed2e18a642a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:38:08.621852 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d29eb91d-7c18-4dce-9cc2-ed2e18a642a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.279767 Nov 02 22:38:08.622475 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3888/7656] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:38:08 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:38:17.083321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:17.084119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:17.088459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-331898794", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "2978c5ef-dd80-41a4-8461-0b47349850a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-439429250", "security_groups": [{"name": "tempest-secgroup-smoke-413054910"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:38:17.210431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] validate_networks() for [('2978c5ef-dd80-41a4-8461-0b47349850a4', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:38:17.590066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:38:17.590558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:38:17.591096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:38:17.591571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:38:17.592050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:38:17.600920 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:17.601426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:17.601861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:17.602604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:17.603053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:17.603478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:17.622247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:38:17.627713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:38:17.641242 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:38:17.643722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:38:17.790035 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-698d9492-0fef-4fda-b4d6-37ce485c5d6e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708802 Nov 02 22:38:17.791040 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3769/7657] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:38:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:38:17.803724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e286f2f-0cdd-4393-8952-1288502fc683 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:17.804480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e286f2f-0cdd-4393-8952-1288502fc683 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:17.865181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e286f2f-0cdd-4393-8952-1288502fc683 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:17.874584 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e286f2f-0cdd-4393-8952-1288502fc683 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1265 microversion: 2.1 time: 0.074925 Nov 02 22:38:17.878896 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3889/7658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:17 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:38:18.898878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:18.899653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:18.910558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:18.911131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:18.911907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:18.912837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:18.913343 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:18.913755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:18.981479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:18.990655 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-52740efd-e1ed-4b7f-bc35-ef978bc9a73f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1269 microversion: 2.1 time: 0.096533 Nov 02 22:38:18.991330 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3770/7659] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:18 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:20.016307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:20.016967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:20.027235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:20.027747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:20.028222 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:20.028990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:20.029433 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:20.029876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:20.364310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:20.373143 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-13fa2825-551a-486d-adf0-ea3a55332ea2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1317 microversion: 2.1 time: 0.360991 Nov 02 22:38:20.373730 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3890/7660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:20 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:21.398484 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:21.399094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:21.406048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:21.406540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:21.406980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:21.407834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:21.408118 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:21.408744 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:21.570197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:21.580083 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f1f45417-b544-4f60-a6c8-eb7629db8264 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1390 microversion: 2.1 time: 0.185342 Nov 02 22:38:21.581358 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3771/7661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:21 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:21.814662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ab0e62a7-eda3-446b-bacd-b311efb6b07b req-e969e40c-65e0-4c22-9472-521d68a60338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4718bd5-13a4-4095-80fb-04dfe25a1613", "tag": "372c84f9-ada9-498b-b3e5-ea1bc7da45e9"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:38:21.826279 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab0e62a7-eda3-446b-bacd-b311efb6b07b req-e969e40c-65e0-4c22-9472-521d68a60338 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:21.826776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab0e62a7-eda3-446b-bacd-b311efb6b07b req-e969e40c-65e0-4c22-9472-521d68a60338 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:21.828695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ab0e62a7-eda3-446b-bacd-b311efb6b07b req-e969e40c-65e0-4c22-9472-521d68a60338 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:21.839000 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ab0e62a7-eda3-446b-bacd-b311efb6b07b req-e969e40c-65e0-4c22-9472-521d68a60338 service nova] Creating event network-changed:372c84f9-ada9-498b-b3e5-ea1bc7da45e9 for instance e4718bd5-13a4-4095-80fb-04dfe25a1613 on n-h2-860863-4 Nov 02 22:38:21.844131 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ab0e62a7-eda3-446b-bacd-b311efb6b07b req-e969e40c-65e0-4c22-9472-521d68a60338 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033480 Nov 02 22:38:21.844728 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3891/7662] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:38:22.604319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:22.604960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:22.611759 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:22.612241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:22.612680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:22.613433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:22.613887 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:22.614315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:22.747961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:22.755967 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-23795633-ef86-4ee4-91f4-24c01b42b9be tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1390 microversion: 2.1 time: 0.156222 Nov 02 22:38:22.756557 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3772/7663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:22 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:23.780837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:23.781586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:23.788521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:23.789054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:23.789517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:23.790508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:23.790992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:23.791447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:23.932872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:23.940517 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7327828d-c422-455e-b89e-efad3f50ca63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1390 microversion: 2.1 time: 0.165529 Nov 02 22:38:23.941112 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3892/7664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:23 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:24.964601 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:24.965240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:24.972057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:24.972547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:24.973051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:24.973706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:24.974162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:24.974594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:25.105243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:25.112883 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4778fb8a-7532-4681-86db-aacfb2b8af88 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1390 microversion: 2.1 time: 0.152907 Nov 02 22:38:25.113473 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3773/7665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:24 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:26.135716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:26.136340 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:26.143182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:26.143673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:26.144124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:26.144819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:26.145310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:26.148880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:26.280808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:26.288420 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b8fff2e0-99d0-47c6-9138-384725ccaf6a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1390 microversion: 2.1 time: 0.156693 Nov 02 22:38:26.289000 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3893/7666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:26 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:27.311638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:27.312255 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:27.318738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:27.319222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:27.319666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:27.320361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:27.320821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:27.321297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:27.452377 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:27.460226 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5acd107d-a280-48b8-88b0-8fe9dc551829 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1390 microversion: 2.1 time: 0.152603 Nov 02 22:38:27.460798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3774/7667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:27 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:28.048146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-014293fd-13d6-4fca-b762-263694b1082c req-4824e5cc-0c5e-4a5b-a35d-3e5d0db78d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4718bd5-13a4-4095-80fb-04dfe25a1613", "name": "network-vif-plugged", "status": "completed", "tag": "372c84f9-ada9-498b-b3e5-ea1bc7da45e9"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:38:28.053909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:28.059774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-014293fd-13d6-4fca-b762-263694b1082c req-4824e5cc-0c5e-4a5b-a35d-3e5d0db78d63 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:28.060264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-014293fd-13d6-4fca-b762-263694b1082c req-4824e5cc-0c5e-4a5b-a35d-3e5d0db78d63 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:28.060708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-014293fd-13d6-4fca-b762-263694b1082c req-4824e5cc-0c5e-4a5b-a35d-3e5d0db78d63 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:28.072610 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-014293fd-13d6-4fca-b762-263694b1082c req-4824e5cc-0c5e-4a5b-a35d-3e5d0db78d63 service nova] Creating event network-vif-plugged:372c84f9-ada9-498b-b3e5-ea1bc7da45e9 for instance e4718bd5-13a4-4095-80fb-04dfe25a1613 on n-h2-860863-4 Nov 02 22:38:28.077948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-014293fd-13d6-4fca-b762-263694b1082c req-4824e5cc-0c5e-4a5b-a35d-3e5d0db78d63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Nov 02 22:38:28.078534 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3894/7668] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:38:28.483715 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:28.484292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:28.486120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:28.486786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:28.492088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:28.492581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:28.493864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:28.499452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:28.499452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:28.499452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:28.627930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:28.636137 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff5149d9-1851-4a52-ae79-75a3d82751c0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1390 microversion: 2.1 time: 0.156664 Nov 02 22:38:28.636746 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3775/7669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:28 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:29.660390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:29.661088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:29.670451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:29.671057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:29.671534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:29.672231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:29.672698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:29.673164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:29.810309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:29.818121 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-553e1e9b-fd7a-4cfa-8b52-7d442ea736ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1563 microversion: 2.1 time: 0.162564 Nov 02 22:38:29.818687 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3895/7670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:29 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:29.841448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:29.842224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:29.849095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:29.849581 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:29.850023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:29.850711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:29.851171 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:29.851600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:29.984748 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:29.992462 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eb599cd9-998a-40c8-9821-afb79bff7da7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1563 microversion: 2.1 time: 0.154861 Nov 02 22:38:29.993765 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3776/7671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:29 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:31.895650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:38:31.896958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:31.897617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dc37c2e5-8c1e-44a6-9d24-c7e641c60fb7 req-1dee9ce2-6d57-4e6f-a961-f9cbe75e15cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4718bd5-13a4-4095-80fb-04dfe25a1613", "tag": "372c84f9-ada9-498b-b3e5-ea1bc7da45e9"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:38:31.906383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:31.907261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:31.908742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:31.909701 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:31.914728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:31.914728 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:31.916629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc37c2e5-8c1e-44a6-9d24-c7e641c60fb7 req-1dee9ce2-6d57-4e6f-a961-f9cbe75e15cf service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:31.917150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc37c2e5-8c1e-44a6-9d24-c7e641c60fb7 req-1dee9ce2-6d57-4e6f-a961-f9cbe75e15cf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:31.917772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc37c2e5-8c1e-44a6-9d24-c7e641c60fb7 req-1dee9ce2-6d57-4e6f-a961-f9cbe75e15cf service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:31.929900 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dc37c2e5-8c1e-44a6-9d24-c7e641c60fb7 req-1dee9ce2-6d57-4e6f-a961-f9cbe75e15cf service nova] Creating event network-changed:372c84f9-ada9-498b-b3e5-ea1bc7da45e9 for instance e4718bd5-13a4-4095-80fb-04dfe25a1613 on n-h2-860863-4 Nov 02 22:38:31.935479 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dc37c2e5-8c1e-44a6-9d24-c7e641c60fb7 req-1dee9ce2-6d57-4e6f-a961-f9cbe75e15cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042304 Nov 02 22:38:31.936082 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3777/7672] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:38:32.060748 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:38:32.068958 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-77f6b9ee-eaf6-40f5-ab43-bcf3b500c188 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1563 microversion: 2.1 time: 0.177748 Nov 02 22:38:32.070338 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3896/7673] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:38:31 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:38:55.329882 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:38:55.332196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:38:55.335869 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:55.336552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=46 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:38:55.341783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:55.342263 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:55.342867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:55.343559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:38:55.344010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:38:55.344441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:38:55.406725 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e55ccf5-d873-48c0-b8f9-8b9cad08b696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action" status: 200 len: 24571 microversion: 2.1 time: 0.080954 Nov 02 22:38:55.407375 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3778/7674] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:38:55 2022] POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action => generated 24571 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:39:01.780478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:01.781094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:01.783791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:01.784442 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:01.789161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:01.789659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:01.790108 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:01.791452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:01.792008 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:01.792446 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:02.029465 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e4db88e8-1849-4c81-84bf-d3d4a8db0128 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action" status: 202 len: 0 microversion: 2.1 time: 0.252966 Nov 02 22:39:02.030410 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3897/7675] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:39:01 2022] POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:39:02.039961 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:02.041253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:02.049195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:02.049693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:02.050138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:02.050854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:02.051316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:02.051827 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:02.194877 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:02.203432 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-09730ed7-527a-4506-b552-48766f34274a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1687 microversion: 2.1 time: 0.168530 Nov 02 22:39:02.204012 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3779/7676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:02 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:03.232732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:03.233465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:03.239582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:03.240077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:03.240533 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:03.241267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:03.241733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:03.242172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:03.380036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:03.388337 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28820b54-4b8d-4d8f-9fa3-7d117cb35515 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1667 microversion: 2.1 time: 0.161748 Nov 02 22:39:03.388902 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3898/7677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:03 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:39:04.482045 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:04.484226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:04.491800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:04.492313 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:04.492758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:04.493525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:04.494605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:04.495035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:04.545196 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7b3809c1-8e76-49a6-ab6c-e342d86e8510 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action" status: 200 len: 32649 microversion: 2.1 time: 0.067583 Nov 02 22:39:04.545850 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3780/7678] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:39:04 2022] POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action => generated 32649 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:39:04.558774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:04.559332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:04.566212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:04.566715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:04.567178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:04.567891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:04.568368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:04.568815 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:04.768032 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-370aa711-06cf-4f7e-951b-1edaa1525bfc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action" status: 202 len: 0 microversion: 2.1 time: 0.214070 Nov 02 22:39:04.768770 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3899/7679] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:39:04 2022] POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:39:04.778329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:04.779034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:04.786570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:04.787061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:04.787509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:04.788219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:04.788685 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:04.789176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:04.933911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:04.941649 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-796a1122-bee6-4c8c-b500-62708d37e805 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1674 microversion: 2.1 time: 0.168290 Nov 02 22:39:04.942218 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3781/7680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:04 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:05.966825 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:05.967573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:05.974792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:05.975295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:05.975754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:05.976475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:05.976968 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:05.977418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:06.116128 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:06.118459 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da6a647d-0203-4548-95b6-6b16fb18fcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1682 microversion: 2.1 time: 0.156019 Nov 02 22:39:06.119028 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3900/7681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:05 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:06.237401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:06.239566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:06.248015 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:06.248505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:06.248983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:06.249678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:06.250134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:06.250559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:06.301419 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e0c70753-aba9-4e9a-8e4d-504341eb2949 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action" status: 200 len: 36345 microversion: 2.1 time: 0.067826 Nov 02 22:39:06.302118 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3782/7682] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:39:06 2022] POST /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613/action => generated 36345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:39:07.756849 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:07.757408 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:07.766433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-5919658c-ae2e-449d-8c96-a107316ede1e req-e596da4a-aa80-44fe-87fb-f5744494b591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4718bd5-13a4-4095-80fb-04dfe25a1613", "tag": "372c84f9-ada9-498b-b3e5-ea1bc7da45e9"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:07.770964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:07.771503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:07.771963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:07.772996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:07.773542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:07.774054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:07.776812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5919658c-ae2e-449d-8c96-a107316ede1e req-e596da4a-aa80-44fe-87fb-f5744494b591 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:07.777394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5919658c-ae2e-449d-8c96-a107316ede1e req-e596da4a-aa80-44fe-87fb-f5744494b591 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:07.777824 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-5919658c-ae2e-449d-8c96-a107316ede1e req-e596da4a-aa80-44fe-87fb-f5744494b591 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:07.789104 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-5919658c-ae2e-449d-8c96-a107316ede1e req-e596da4a-aa80-44fe-87fb-f5744494b591 service nova] Creating event network-changed:372c84f9-ada9-498b-b3e5-ea1bc7da45e9 for instance e4718bd5-13a4-4095-80fb-04dfe25a1613 on n-h2-860863-4 Nov 02 22:39:07.794729 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-5919658c-ae2e-449d-8c96-a107316ede1e req-e596da4a-aa80-44fe-87fb-f5744494b591 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032194 Nov 02 22:39:07.795327 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3783/7683] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:39:07.802715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:39:08.095631 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9f30683a-5a2c-4b13-8e87-b5d6ee829511 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 204 len: 0 microversion: 2.1 time: 0.342429 Nov 02 22:39:08.096513 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3901/7684] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:39:07 2022] DELETE /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:39:08.110753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:08.111462 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:08.117644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:08.118133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:08.118572 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:08.119270 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:08.119722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:08.120281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:08.258651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:08.267041 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-362c9ff6-91dc-4bfa-aee7-ada43e335ced tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1688 microversion: 2.1 time: 0.165403 Nov 02 22:39:08.267622 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3784/7685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:08 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:09.292412 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:09.293075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:09.300560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:09.301101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:09.301552 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:09.302254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:09.302720 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:09.303161 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:09.444483 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:09.453292 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af7e3a66-a1a8-4972-845c-45c2266d2685 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1688 microversion: 2.1 time: 0.165231 Nov 02 22:39:09.453863 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3902/7686] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:09 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:10.156181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-af751698-556a-4cdb-b305-034327f1abc0 req-8fbf7951-5c92-4ea4-a856-57ad06e28980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4718bd5-13a4-4095-80fb-04dfe25a1613", "name": "network-vif-deleted", "tag": "372c84f9-ada9-498b-b3e5-ea1bc7da45e9"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:10.167066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-af751698-556a-4cdb-b305-034327f1abc0 req-8fbf7951-5c92-4ea4-a856-57ad06e28980 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:10.168371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-af751698-556a-4cdb-b305-034327f1abc0 req-8fbf7951-5c92-4ea4-a856-57ad06e28980 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:10.168371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-af751698-556a-4cdb-b305-034327f1abc0 req-8fbf7951-5c92-4ea4-a856-57ad06e28980 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:10.182036 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-af751698-556a-4cdb-b305-034327f1abc0 req-8fbf7951-5c92-4ea4-a856-57ad06e28980 service nova] Creating event network-vif-deleted:372c84f9-ada9-498b-b3e5-ea1bc7da45e9 for instance e4718bd5-13a4-4095-80fb-04dfe25a1613 on n-h2-860863-4 Nov 02 22:39:10.187558 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-af751698-556a-4cdb-b305-034327f1abc0 req-8fbf7951-5c92-4ea4-a856-57ad06e28980 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Nov 02 22:39:10.191468 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3785/7687] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:39:10.477752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:10.478471 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:10.486484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:10.487087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:10.487797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:10.489093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:10.496508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:10.496508 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:10.524596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:10.525141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:10.525603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:10.526202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lazy-loading 'fault' on Instance uuid e4718bd5-13a4-4095-80fb-04dfe25a1613 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:39:10.572773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:10.582004 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04a8bd99-a73c-45da-a95b-013c53ab2bde tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 200 len: 1355 microversion: 2.1 time: 0.108085 Nov 02 22:39:10.587363 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3903/7688] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:10 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 1355 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:11.608005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:11.608699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e4718bd5-13a4-4095-80fb-04dfe25a1613] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:11.615149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:11.615627 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:11.616059 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:11.616740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:11.617215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:11.617641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:11.631400 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] HTTP exception thrown: Instance e4718bd5-13a4-4095-80fb-04dfe25a1613 could not be found. Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Request method failure captured: Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 HTTP/1.1 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYvFPg8A0j1WSSIoKN6gTI98OlETYuXbac-jbhtzSUErHGKPjsHzUjvOFcKK5XIYwbL-ONPaiw7SDgD2hn02FR6EL-lMT0lroh9SdaulZB_YeCZpiqfyGxV0LG_xmDet15RZXCbY7sTXFyVv5f2gNGD10jj4yMYSSpzrh_ux6mYrh0-A Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f78b1be258b34cf9a765d4a4e99fc287 Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance e4718bd5-13a4-4095-80fb-04dfe25a1613 could not be found. Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': 'e4718bd5-13a4-4095-80fb-04dfe25a1613'} Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4718bd5-13a4-4095-80fb-04dfe25a1613 could not be found. Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4718bd5-13a4-4095-80fb-04dfe25a1613 could not be found. Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:39:11.632964 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4718bd5-13a4-4095-80fb-04dfe25a1613 could not be found. Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Returning 404 to user: Instance e4718bd5-13a4-4095-80fb-04dfe25a1613 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d01d20eb-9282-4714-b440-4c2d7bda3266 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613" status: 404 len: 111 microversion: 2.1 time: 0.032105 Nov 02 22:39:11.638693 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3786/7689] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:11 2022] GET /compute/v2.1/servers/e4718bd5-13a4-4095-80fb-04dfe25a1613 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:39:15.472649 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ad2b265-205b-4972-9342-54e73982d19b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '.version_select at 0x7f9b602d2700>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:15.542529 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ad2b265-205b-4972-9342-54e73982d19b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-439429250" status: 202 len: 0 microversion: 2.1 time: 0.074171 Nov 02 22:39:15.543246 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3904/7690] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 22:39:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-439429250 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:39:15.579588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ec974436-616d-4e1a-9d8e-7f48cf7efcb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: .version_select at 0x7f9b682ac8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-786433952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlX1f5sVyF7KfGykiwYzdMHUir4iaL//uobp7ZpqCrkV1rgAvlugcXq9lZaRb9XDoBY43JS3cyXvKtUwN0s93qesoKSe+00NPZGY+/Q0d5ldzuTM1nH64DFisNQan0V6w=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:15.597076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ec974436-616d-4e1a-9d8e-7f48cf7efcb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:39:15.603040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-ec974436-616d-4e1a-9d8e-7f48cf7efcb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:39:15.662284 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ec974436-616d-4e1a-9d8e-7f48cf7efcb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.087229 Nov 02 22:39:15.662798 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3787/7691] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:39:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:39:23.998677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:24.004186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-682287594", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "a5c49d8f-b662-484c-937e-548ba30f8160"}], "key_name": "tempest-TestNetworkAdvancedServerOps-786433952", "security_groups": [{"name": "tempest-secgroup-smoke-1553610228"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:24.143682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] validate_networks() for [('a5c49d8f-b662-484c-937e-548ba30f8160', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:39:24.664971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:39:24.665752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:39:24.666432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:39:24.667034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:39:24.667648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:39:24.682386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:24.683200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:24.683653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:24.684589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:24.685378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:24.686031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:24.705629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:39:24.711298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:39:24.724971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:39:24.727366 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:39:24.833220 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa17f001-afc9-4921-80c1-c40a575e2bf4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.836857 Nov 02 22:39:24.834558 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3905/7692] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:39:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:39:24.846831 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=36 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:24.851173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c0b0bf6-135a-4489-9bdf-41a4832f11f4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:24.851796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c0b0bf6-135a-4489-9bdf-41a4832f11f4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:24.937735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5c0b0bf6-135a-4489-9bdf-41a4832f11f4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:24.946107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c0b0bf6-135a-4489-9bdf-41a4832f11f4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1265 microversion: 2.1 time: 0.101142 Nov 02 22:39:24.957016 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3788/7693] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:24 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:25.973535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:25.973535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:25.981275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:25.981876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:25.982565 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:25.983293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:25.983763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:25.984204 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:26.054328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:26.062764 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-610d53e7-76a7-4064-bb87-692d2c8e4aad tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1269 microversion: 2.1 time: 0.096516 Nov 02 22:39:26.063358 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3906/7694] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:25 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:27.087277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:27.087893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:27.096190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:27.096678 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:27.097147 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:27.097893 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:27.098306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:27.098734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:27.161752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:27.170394 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-47ac933f-a22f-4bc6-a8a8-83866e2397c7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1323 microversion: 2.1 time: 0.086045 Nov 02 22:39:27.170974 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3789/7695] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:27 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1323 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:28.194410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:28.195055 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:28.202277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:28.202954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:28.203425 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:28.204156 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:28.204671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:28.205153 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:28.340118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:28.347973 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-06a288ae-68d1-49ca-b1ca-6ecd39bc49ab tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1391 microversion: 2.1 time: 0.157879 Nov 02 22:39:28.348549 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3907/7696] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:28 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:28.415699 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a4440f08-324a-44a2-837c-2202865cf00a req-85c2adcb-2317-4fc1-b3f7-aeb7a5fd7485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a8438c-45c9-46d0-afb9-79dd8d5f31cb", "tag": "1343b0dc-b78d-4af5-97f7-407600c29dac"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:28.426529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a4440f08-324a-44a2-837c-2202865cf00a req-85c2adcb-2317-4fc1-b3f7-aeb7a5fd7485 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:28.427012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a4440f08-324a-44a2-837c-2202865cf00a req-85c2adcb-2317-4fc1-b3f7-aeb7a5fd7485 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:28.427443 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a4440f08-324a-44a2-837c-2202865cf00a req-85c2adcb-2317-4fc1-b3f7-aeb7a5fd7485 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:28.439149 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a4440f08-324a-44a2-837c-2202865cf00a req-85c2adcb-2317-4fc1-b3f7-aeb7a5fd7485 service nova] Creating event network-changed:1343b0dc-b78d-4af5-97f7-407600c29dac for instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb on n-h2-860863-4 Nov 02 22:39:28.444045 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a4440f08-324a-44a2-837c-2202865cf00a req-85c2adcb-2317-4fc1-b3f7-aeb7a5fd7485 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 Nov 02 22:39:28.444640 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3790/7697] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:39:29.371624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:29.372399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:29.379178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:29.379677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:29.380130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:29.380832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:29.381324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:29.381763 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:29.523134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:29.534310 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b4325e0-f4d0-455c-891e-c47bbbaf79b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1391 microversion: 2.1 time: 0.166535 Nov 02 22:39:29.534901 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3908/7698] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:29 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:30.559183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:30.560604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:30.566823 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:30.567308 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:30.567752 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:30.568438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:30.568892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:30.569349 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:30.706870 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:30.714560 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f68613f8-d8e0-4997-9c4a-832d15b47cb4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1391 microversion: 2.1 time: 0.160515 Nov 02 22:39:30.715125 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3791/7699] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:30 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:31.743969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:31.744607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:31.752093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:31.752607 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:31.753104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:31.753819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:31.754293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:31.754743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:31.897274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:31.905229 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f62a3d0-fbaa-42c5-82d4-4784639d34b7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1391 microversion: 2.1 time: 0.165156 Nov 02 22:39:31.905833 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3909/7700] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:31 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:32.927713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:32.928251 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:32.931010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:32.936540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:32.937050 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:32.937528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:32.938232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:32.938688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:32.939115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:33.071390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:33.079472 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8b81d937-71ad-4e01-960b-6b6edca06eb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1391 microversion: 2.1 time: 0.155720 Nov 02 22:39:33.080040 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3792/7701] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:32 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:34.103242 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:34.103910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:34.107189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:34.112042 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:34.114414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:34.114414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:34.114414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:34.114414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:34.114909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:34.255148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:34.262990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95a927e1-7c4f-4f13-b17b-b060906f5b63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1391 microversion: 2.1 time: 0.163669 Nov 02 22:39:34.263690 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3910/7702] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:34 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:34.390299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f457416d-c62a-43e4-9509-817bbef54e65 req-69918bbf-51b8-4602-8967-9748b65c780e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a8438c-45c9-46d0-afb9-79dd8d5f31cb", "name": "network-vif-plugged", "status": "completed", "tag": "1343b0dc-b78d-4af5-97f7-407600c29dac"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:34.400063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f457416d-c62a-43e4-9509-817bbef54e65 req-69918bbf-51b8-4602-8967-9748b65c780e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:34.400541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f457416d-c62a-43e4-9509-817bbef54e65 req-69918bbf-51b8-4602-8967-9748b65c780e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:34.400992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f457416d-c62a-43e4-9509-817bbef54e65 req-69918bbf-51b8-4602-8967-9748b65c780e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:34.412358 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f457416d-c62a-43e4-9509-817bbef54e65 req-69918bbf-51b8-4602-8967-9748b65c780e service nova] Creating event network-vif-plugged:1343b0dc-b78d-4af5-97f7-407600c29dac for instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb on n-h2-860863-4 Nov 02 22:39:34.417268 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f457416d-c62a-43e4-9509-817bbef54e65 req-69918bbf-51b8-4602-8967-9748b65c780e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031141 Nov 02 22:39:34.417841 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3793/7703] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:39:35.286653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:35.287292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:35.289490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:35.290216 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:35.296466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:35.297057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:35.298694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:35.298694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:35.298918 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:35.299187 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:35.432838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:35.440571 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb16697b-5914-4dee-8260-b3c39d494a56 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1391 microversion: 2.1 time: 0.157878 Nov 02 22:39:35.441155 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3911/7704] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:35 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:36.460743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:39:36.465673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:36.466373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:36.473112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:36.473592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:36.474025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:36.474729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:36.475181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:36.475605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:36.609378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:36.617227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d205b253-afe7-42fa-b064-151fc5615f48 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1561 microversion: 2.1 time: 0.157508 Nov 02 22:39:36.617850 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3794/7705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:36 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:36.639958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:36.640591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:36.647620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:36.648127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:36.648589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:36.649365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:36.649845 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:36.650298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:36.786538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:36.794271 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc16f5fc-19fe-45bb-9759-b1c8cf85f2f9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1561 microversion: 2.1 time: 0.158733 Nov 02 22:39:36.794924 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3912/7706] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:36 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:39:38.594820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:39:38.596390 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:39:38.602354 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4e8e84c9-0e56-4ca5-85c2-81fc29c9b115 req-9c98eddf-0064-4bc3-96df-caaba1b48e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a8438c-45c9-46d0-afb9-79dd8d5f31cb", "tag": "1343b0dc-b78d-4af5-97f7-407600c29dac"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:39:38.604228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:38.604843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:38.605569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:38.606499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:38.607201 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:38.608002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:38.616612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4e8e84c9-0e56-4ca5-85c2-81fc29c9b115 req-9c98eddf-0064-4bc3-96df-caaba1b48e99 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:39:38.617151 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4e8e84c9-0e56-4ca5-85c2-81fc29c9b115 req-9c98eddf-0064-4bc3-96df-caaba1b48e99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:39:38.617620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4e8e84c9-0e56-4ca5-85c2-81fc29c9b115 req-9c98eddf-0064-4bc3-96df-caaba1b48e99 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:39:38.630634 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4e8e84c9-0e56-4ca5-85c2-81fc29c9b115 req-9c98eddf-0064-4bc3-96df-caaba1b48e99 service nova] Creating event network-changed:1343b0dc-b78d-4af5-97f7-407600c29dac for instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb on n-h2-860863-4 Nov 02 22:39:38.636252 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4e8e84c9-0e56-4ca5-85c2-81fc29c9b115 req-9c98eddf-0064-4bc3-96df-caaba1b48e99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043043 Nov 02 22:39:38.637293 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3913/7707] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:39:38.766683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:39:38.776081 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e86301f1-0d6f-434f-868a-00243ba6ea3d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1561 microversion: 2.1 time: 0.185398 Nov 02 22:39:38.776753 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3795/7708] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:39:38 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:00.024874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=7 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:40:00.025706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=46 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:40:00.030172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:40:00.032531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:00.040263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:00.040777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:00.041267 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:00.042005 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:00.042480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:00.042932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:00.103411 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5bd80f59-bbca-4edf-83c9-595cc629ae9b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb/action" status: 200 len: 24572 microversion: 2.1 time: 0.080813 Nov 02 22:40:00.104100 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3914/7709] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:40:00 2022] POST /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb/action => generated 24572 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:40:11.110623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:40:11.112833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:11.115468 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=7 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:40:11.116110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=34 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:40:11.120743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:11.121273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:11.121711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:11.122395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:11.122852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:11.123275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:11.327712 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3314df9c-7ba1-4535-822a-0805e23392dc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb/action" status: 202 len: 0 microversion: 2.1 time: 0.221610 Nov 02 22:40:11.328492 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3796/7710] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:40:11 2022] POST /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:40:11.337571 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:11.338290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:11.341758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:40:11.347954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:11.348455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:11.348910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:11.349648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:11.350123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:11.350598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:11.487370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:11.495288 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bc1d8d61-af66-43b0-847c-88e4ccd29417 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1672 microversion: 2.1 time: 0.161942 Nov 02 22:40:11.495866 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3915/7711] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:11 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:40:12.521818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:12.522475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:12.528701 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:12.529219 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:12.529667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:12.530966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:12.531613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:12.532048 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:12.663203 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:12.670996 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ea37494b-fa70-4d44-b6eb-eb85a55e91b9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.154499 Nov 02 22:40:12.671559 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3797/7712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:12 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:13.694537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:13.695102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:13.702373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:13.702954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:13.703410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:13.704118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:13.704586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:13.705056 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:13.840120 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:13.848644 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6d74d44d-4173-4359-beed-4d9a0f4c20e6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.158165 Nov 02 22:40:13.849252 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3916/7713] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:13 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:14.871820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:14.872437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:14.879371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:14.879860 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:14.880302 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:14.881030 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:14.881507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:14.882722 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:15.013879 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:15.021631 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ca97784a-b22e-4c07-8c42-ba18ae17d9b8 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.153754 Nov 02 22:40:15.022203 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3798/7714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:14 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:16.045228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:16.046060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:16.053422 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:16.053924 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:16.054383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:16.055137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:16.055603 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:16.056047 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:16.192685 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:16.200960 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea90940a-b686-4ea3-876e-0b4975b3b3e5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.159938 Nov 02 22:40:16.201532 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3917/7715] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:16 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:17.224179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:17.224760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:17.231883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:17.232371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:17.232817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:17.234279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:17.234829 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:17.235265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:17.419264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:17.419264 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-52c47904-cef1-448e-a3ef-d66d48b4d61c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.164951 Nov 02 22:40:17.419264 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3799/7716] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:17 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:18.410342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:18.410975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:18.417824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:18.418321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:18.418774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:18.419479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:18.419944 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:18.420385 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:18.556410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:18.564359 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8d96dbd-908e-4972-87d0-3659ea615d15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.158515 Nov 02 22:40:18.564947 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3918/7717] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:18 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:19.587669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:19.588262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:19.595942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:19.596453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:19.596876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:19.597630 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:19.598083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:19.598516 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:20.006851 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:20.014537 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7d171eda-1f06-418d-a1c4-48ea80d253a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.430813 Nov 02 22:40:20.015102 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3800/7718] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:19 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:21.038191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:21.038848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:21.046531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:21.047031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:21.047486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:21.048191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:21.048659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:21.049133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:21.178321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:21.186105 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11a94f22-5041-4a0f-b06d-13ca3f436f8a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.151847 Nov 02 22:40:21.186798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3919/7719] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:21 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:22.210260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:22.210814 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:22.218483 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:22.219108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:22.219866 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:22.220561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:22.221047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:22.221481 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:22.356093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:22.364814 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d7dae2b2-e177-4ec2-a8cf-62c115f07d8e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.158598 Nov 02 22:40:22.365705 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3801/7720] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:22 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:23.389897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:23.390740 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:23.397570 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:23.398073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:23.398534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:23.399258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:23.399734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:23.400186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:23.533401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:23.541494 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-37fe9ccc-28a8-4db6-baee-621490aafcba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.155636 Nov 02 22:40:23.542084 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3920/7721] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:23 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:24.565258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:24.565874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:24.572654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:24.573169 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:24.573610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:24.574297 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:24.574750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:24.575431 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:24.713316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:24.721474 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0298f1f7-d189-4066-99f5-abedc98188a1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.160672 Nov 02 22:40:24.725305 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3802/7722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:24 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:25.745113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:25.745698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:25.752600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:25.753141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:25.753600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:25.754308 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:25.754789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:25.755237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:25.884997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:25.893305 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b99d6a60-e162-491d-abeb-52675508fb15 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.152160 Nov 02 22:40:25.893884 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3921/7723] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:25 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:26.917446 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:26.918057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:26.928506 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:26.929082 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:26.929473 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:26.930196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:26.930683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:26.931112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:27.064402 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:27.072224 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bb29c753-3d13-4f43-86e6-52702b4e1458 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.158903 Nov 02 22:40:27.072961 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3803/7724] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:26 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:28.095911 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:28.096538 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:28.103171 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:28.103687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:28.104154 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:28.104876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:28.105383 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:28.105837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:28.299472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:28.307350 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2bb243a8-3434-4cd9-956d-6b0814b094a6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1677 microversion: 2.1 time: 0.215557 Nov 02 22:40:28.307929 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3922/7725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:28 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:29.332533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:40:29.333184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:29.341650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:29.342133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:29.342743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:29.343458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:29.343911 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:29.344336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:29.473938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:40:29.481592 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-eaa376dc-997e-4e99-b6fb-43feabb688af tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1680 microversion: 2.1 time: 0.153189 Nov 02 22:40:29.482159 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3804/7726] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:40:29 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:40:53.671106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:40:53.673363 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:40:53.677049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:40:53.677734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=52 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:40:53.682586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:53.685822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:53.685822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:53.685822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:40:53.685822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:40:53.685822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:40:53.742558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d4af579-5c36-4a5c-90e9-3a40caec4894 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb/action" status: 200 len: 69292 microversion: 2.1 time: 0.075331 Nov 02 22:40:53.743568 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3923/7727] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:40:53 2022] POST /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb/action => generated 69292 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:41:01.504282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:01.504857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:01.506525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-86da2201-fb39-4373-a628-fdfb6e137f17 req-27fd2475-86bd-468d-b356-3a578eabf2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a8438c-45c9-46d0-afb9-79dd8d5f31cb", "tag": "1343b0dc-b78d-4af5-97f7-407600c29dac"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:01.508417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=18 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:01.509317 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:01.513965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:01.514525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:01.515740 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:01.516754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:01.517265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:01.518010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:01.518513 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-86da2201-fb39-4373-a628-fdfb6e137f17 req-27fd2475-86bd-468d-b356-3a578eabf2f9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:01.519012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-86da2201-fb39-4373-a628-fdfb6e137f17 req-27fd2475-86bd-468d-b356-3a578eabf2f9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:01.519466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-86da2201-fb39-4373-a628-fdfb6e137f17 req-27fd2475-86bd-468d-b356-3a578eabf2f9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:01.532167 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-86da2201-fb39-4373-a628-fdfb6e137f17 req-27fd2475-86bd-468d-b356-3a578eabf2f9 service nova] Creating event network-changed:1343b0dc-b78d-4af5-97f7-407600c29dac for instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb on n-h2-860863-4 Nov 02 22:41:01.537579 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-86da2201-fb39-4373-a628-fdfb6e137f17 req-27fd2475-86bd-468d-b356-3a578eabf2f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035589 Nov 02 22:41:01.538420 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3924/7728] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:41:01.545658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:41:01.835416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c875e547-f0a6-4b59-bc08-df05b59615a9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 204 len: 0 microversion: 2.1 time: 0.335696 Nov 02 22:41:01.836593 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3805/7729] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:41:01 2022] DELETE /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:41:01.846852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:01.853085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:01.854735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:01.855240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:01.855697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:01.856427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:01.856898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:01.857400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:01.997329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:02.005233 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5fd740de-c8ba-4913-81c6-02f1a00c9b0b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1686 microversion: 2.1 time: 0.164211 Nov 02 22:41:02.005812 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3925/7730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:01 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:03.030281 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:03.031411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:03.038096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:03.038622 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:03.039069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:03.039768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:03.040228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:03.040661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:03.244109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:03.252193 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-122be5c5-40c8-4957-a9ba-57183cdf2482 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1686 microversion: 2.1 time: 0.226312 Nov 02 22:41:03.252970 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3806/7731] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:03 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1686 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:03.907462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b8b0cb8c-103d-4d8e-a51f-1931234b70cc req-b280cbec-da8f-4ef9-99ad-e0114294f01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a8438c-45c9-46d0-afb9-79dd8d5f31cb", "name": "network-vif-deleted", "tag": "1343b0dc-b78d-4af5-97f7-407600c29dac"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:03.917947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b8b0cb8c-103d-4d8e-a51f-1931234b70cc req-b280cbec-da8f-4ef9-99ad-e0114294f01e service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:03.921585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b8b0cb8c-103d-4d8e-a51f-1931234b70cc req-b280cbec-da8f-4ef9-99ad-e0114294f01e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:03.921585 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b8b0cb8c-103d-4d8e-a51f-1931234b70cc req-b280cbec-da8f-4ef9-99ad-e0114294f01e service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:03.930203 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b8b0cb8c-103d-4d8e-a51f-1931234b70cc req-b280cbec-da8f-4ef9-99ad-e0114294f01e service nova] Creating event network-vif-deleted:1343b0dc-b78d-4af5-97f7-407600c29dac for instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb on n-h2-860863-4 Nov 02 22:41:03.935205 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b8b0cb8c-103d-4d8e-a51f-1931234b70cc req-b280cbec-da8f-4ef9-99ad-e0114294f01e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103226 Nov 02 22:41:03.935794 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3926/7732] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:41:04.275747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:04.276422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:04.284345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:04.284840 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:04.285315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:04.286023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:04.286491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:04.286928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:04.319526 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:04.320022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:04.320465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:04.320919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lazy-loading 'fault' on Instance uuid e3a8438c-45c9-46d0-afb9-79dd8d5f31cb {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:41:04.364707 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:04.372503 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5ab22d48-feb4-40c6-9097-6562d35c7a67 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 200 len: 1355 microversion: 2.1 time: 0.100703 Nov 02 22:41:04.373107 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3807/7733] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:04 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 1355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:05.398659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:05.399370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: e3a8438c-45c9-46d0-afb9-79dd8d5f31cb] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:05.405574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:05.406066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:05.406521 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:05.407229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:05.407700 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:05.408142 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:05.422558 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] HTTP exception thrown: Instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb could not be found. Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Request method failure captured: Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb HTTP/1.1 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYvFPg8A0j1WSSIoKN6gTI98OlETYuXbac-jbhtzSUErHGKPjsHzUjvOFcKK5XIYwbL-ONPaiw7SDgD2hn02FR6EL-lMT0lroh9SdaulZB_YeCZpiqfyGxV0LG_xmDet15RZXCbY7sTXFyVv5f2gNGD10jj4yMYSSpzrh_ux6mYrh0-A Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: f78b1be258b34cf9a765d4a4e99fc287 Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb could not be found. Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': 'e3a8438c-45c9-46d0-afb9-79dd8d5f31cb'} Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb could not be found. Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb could not be found. Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:41:05.424208 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb could not be found. Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Returning 404 to user: Instance e3a8438c-45c9-46d0-afb9-79dd8d5f31cb could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6034c8a3-8573-4ae5-8e31-37d187e39428 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb" status: 404 len: 111 microversion: 2.1 time: 0.032104 Nov 02 22:41:05.430021 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3927/7734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:05 2022] GET /compute/v2.1/servers/e3a8438c-45c9-46d0-afb9-79dd8d5f31cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:41:09.008011 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-79916072-8ef4-4d1c-bf74-4f7ed77aa90b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '.version_select at 0x7f9b638c1550>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:09.062893 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-79916072-8ef4-4d1c-bf74-4f7ed77aa90b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-786433952" status: 202 len: 0 microversion: 2.1 time: 0.058707 Nov 02 22:41:09.063503 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3808/7735] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 22:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-786433952 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:41:09.097886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed8dab81-a3e5-44d3-8a53-7e10875a9e0f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: .version_select at 0x7f9b602d8280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-250417029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSUYslLHKs9qDr9cGRCPnIqDifEjS+PKiJQxc0ccYExCLAVhzq9O5teWy+dWhCdqxEZ1MEOxfidnle+8Apao4STghCDJCiWbvnEnv4TJSppALx4N4w0AB041JvA1OkJ3g=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:09.116510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ed8dab81-a3e5-44d3-8a53-7e10875a9e0f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:41:09.121668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-ed8dab81-a3e5-44d3-8a53-7e10875a9e0f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:41:09.205085 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed8dab81-a3e5-44d3-8a53-7e10875a9e0f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.110968 Nov 02 22:41:09.205634 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3928/7736] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:41:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:41:17.362070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:17.366713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2042484625", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "8696b234-daf7-4706-86af-3a895d6278bc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-250417029", "security_groups": [{"name": "tempest-secgroup-smoke-1608604712"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:17.490923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] validate_networks() for [('8696b234-daf7-4706-86af-3a895d6278bc', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:41:18.293734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:41:18.294280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:41:18.294638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:41:18.295052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:41:18.295464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:41:18.305072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:18.305558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:18.305997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:18.306719 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:18.307177 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:18.307607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:18.325793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:41:18.331621 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:41:18.344614 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:41:18.346959 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:41:18.456340 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-03c6aab4-3e4e-4048-83ea-1dd3f3f2844d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.096194 Nov 02 22:41:18.457057 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3809/7737] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:41:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:41:18.466387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:18.470705 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f3e4bd3-f7c8-4221-9c38-e0107e2f4116 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:18.471339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f3e4bd3-f7c8-4221-9c38-e0107e2f4116 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:18.531230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f3e4bd3-f7c8-4221-9c38-e0107e2f4116 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:18.539473 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f3e4bd3-f7c8-4221-9c38-e0107e2f4116 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1266 microversion: 2.1 time: 0.075110 Nov 02 22:41:18.547611 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3929/7738] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:18 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:41:19.565196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:19.566577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:19.575582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:19.576631 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:19.578010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:19.579027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:19.579731 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:19.580234 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:19.669857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:19.685375 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c542e4c1-c6ca-491c-931c-fecb7fcf5814 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1270 microversion: 2.1 time: 0.125586 Nov 02 22:41:19.687060 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3810/7739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:19 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1270 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:20.709388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:20.710149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:20.718528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:20.723405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:20.723405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:20.723405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:20.723405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:20.723405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:20.787455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:20.795421 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1e0dfbc-8ae7-4f22-a2af-73f0d9e1a2eb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1336 microversion: 2.1 time: 0.089959 Nov 02 22:41:20.796549 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3930/7740] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:20 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:21.818570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:21.819183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:21.826565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:21.827765 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:21.828218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:21.828919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:21.829498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:21.829936 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:21.977844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:21.986487 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4af02b05-7fd8-4d61-b418-81cc16e04efb tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1392 microversion: 2.1 time: 0.171834 Nov 02 22:41:21.987071 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3811/7741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:21 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:22.259486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2ca4f47f-d50e-4647-82db-a506c7036d43 req-d071732d-4c7c-40a5-850b-854aecd72003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:22.270461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2ca4f47f-d50e-4647-82db-a506c7036d43 req-d071732d-4c7c-40a5-850b-854aecd72003 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:22.270982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2ca4f47f-d50e-4647-82db-a506c7036d43 req-d071732d-4c7c-40a5-850b-854aecd72003 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:22.271434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2ca4f47f-d50e-4647-82db-a506c7036d43 req-d071732d-4c7c-40a5-850b-854aecd72003 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:22.284774 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2ca4f47f-d50e-4647-82db-a506c7036d43 req-d071732d-4c7c-40a5-850b-854aecd72003 service nova] Creating event network-changed:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h2-860863-4 Nov 02 22:41:22.290147 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2ca4f47f-d50e-4647-82db-a506c7036d43 req-d071732d-4c7c-40a5-850b-854aecd72003 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034591 Nov 02 22:41:22.290776 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3931/7742] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:41:23.009442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:23.010093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:23.017724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:23.018223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:23.018670 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:23.019381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:23.019828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:23.020262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:23.153454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:23.161904 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8ed4ff0a-09e8-4a13-85ed-c77d1318ae09 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1392 microversion: 2.1 time: 0.156599 Nov 02 22:41:23.162491 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3812/7743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:23 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:24.185592 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:24.186734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:24.190076 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:24.198332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:24.198836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:24.199293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:24.200022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:24.200480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:24.200997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:24.340263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:24.348257 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e889f81-62c9-4dae-92a6-6d5ecc8576ae tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1392 microversion: 2.1 time: 0.167018 Nov 02 22:41:24.348834 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3932/7744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:24 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:25.371369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:25.372046 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:25.379369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:25.379858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:25.380305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:25.381037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:25.381495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:25.381928 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:25.519478 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:25.528002 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-02a9790b-c574-4099-b18d-ae302f1c7007 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1392 microversion: 2.1 time: 0.160756 Nov 02 22:41:25.528610 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3813/7745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:25 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:26.552504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:26.553162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:26.559682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:26.560182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:26.560680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:26.561954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:26.562424 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:26.562867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:26.698037 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:26.706103 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd59be59-75a2-4414-acff-042fe63366cf tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1392 microversion: 2.1 time: 0.158072 Nov 02 22:41:26.706678 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3933/7746] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:26 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:27.191420 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-f808f6b7-2c17-487f-980b-7fd8479dd005 req-d26c0952-890d-4570-9607-9b9ad29f4e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "name": "network-vif-plugged", "status": "completed", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:27.200805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f808f6b7-2c17-487f-980b-7fd8479dd005 req-d26c0952-890d-4570-9607-9b9ad29f4e56 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:27.201600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f808f6b7-2c17-487f-980b-7fd8479dd005 req-d26c0952-890d-4570-9607-9b9ad29f4e56 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:27.202618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-f808f6b7-2c17-487f-980b-7fd8479dd005 req-d26c0952-890d-4570-9607-9b9ad29f4e56 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:27.213691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-f808f6b7-2c17-487f-980b-7fd8479dd005 req-d26c0952-890d-4570-9607-9b9ad29f4e56 service nova] Creating event network-vif-plugged:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h2-860863-4 Nov 02 22:41:27.219390 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-f808f6b7-2c17-487f-980b-7fd8479dd005 req-d26c0952-890d-4570-9607-9b9ad29f4e56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090916 Nov 02 22:41:27.219985 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3814/7747] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:41:27.729540 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:27.730079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:27.737718 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:27.738218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:27.738670 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:27.739373 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:27.739838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:27.740277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:27.871454 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:27.879556 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fffc1719-7d69-42d4-be16-6d90e0124014 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1392 microversion: 2.1 time: 0.154370 Nov 02 22:41:27.880136 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3934/7748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:27 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:28.901304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:28.901986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:28.906820 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:28.910351 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:28.913590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:28.914073 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:28.914504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:28.915187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:28.915644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:28.916068 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:29.049428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:29.057188 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8c990041-624c-478b-b135-340357ebdae6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1564 microversion: 2.1 time: 0.157774 Nov 02 22:41:29.057764 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3815/7749] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:28 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:29.080687 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:29.082045 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:29.083302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:29.088882 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:29.089414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:29.089871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:29.090576 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:29.091117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:29.091559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:29.227812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:29.236234 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9310b9c3-45b4-4836-9ff5-5000bf9acdb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1564 microversion: 2.1 time: 0.159983 Nov 02 22:41:29.236802 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3935/7750] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:29 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:31.328228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:41:31.328857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:31.330342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-9fa9ca84-b17d-44f8-b7dc-158174083b38 req-1f6f27a3-b85a-453e-87b4-6aeb116f2f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:31.342595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:31.343291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:31.344221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:31.345061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:31.345202 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9fa9ca84-b17d-44f8-b7dc-158174083b38 req-1f6f27a3-b85a-453e-87b4-6aeb116f2f19 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:31.345671 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9fa9ca84-b17d-44f8-b7dc-158174083b38 req-1f6f27a3-b85a-453e-87b4-6aeb116f2f19 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:31.345794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:31.346117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-9fa9ca84-b17d-44f8-b7dc-158174083b38 req-1f6f27a3-b85a-453e-87b4-6aeb116f2f19 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:31.346389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:31.359057 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-9fa9ca84-b17d-44f8-b7dc-158174083b38 req-1f6f27a3-b85a-453e-87b4-6aeb116f2f19 service nova] Creating event network-changed:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h2-860863-4 Nov 02 22:41:31.365837 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-9fa9ca84-b17d-44f8-b7dc-158174083b38 req-1f6f27a3-b85a-453e-87b4-6aeb116f2f19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043007 Nov 02 22:41:31.367028 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3936/7751] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:41:31.490975 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:41:31.499543 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bc2902f4-e24c-4e53-b61d-e292af77740d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1564 microversion: 2.1 time: 0.179742 Nov 02 22:41:31.513468 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3816/7752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:41:31 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1564 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:41:52.752750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:41:52.755259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:41:52.758873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=9 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:52.759549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:41:52.765106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:52.767871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:52.767871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:52.767871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:41:52.767871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:41:52.768367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:41:52.820453 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a4811d94-99bc-4caf-bbc4-1d793368a350 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action" status: 200 len: 24574 microversion: 2.1 time: 0.072072 Nov 02 22:41:52.821120 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3937/7753] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:41:52 2022] POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action => generated 24574 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:42:03.883525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:42:03.885903 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:03.888809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:42:03.889509 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=40 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:42:03.894179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:03.894671 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:03.895120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:03.895826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:03.896836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:03.897294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:03.937855 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:03.943940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Old instance type m1.heat2, new instance type m1.heat {{(pid=121039) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 02 22:42:03.950560 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:42:03.950988 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:42:03.951466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:42:03.951880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:42:03.952561 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:42:04.142975 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c1913f39-51b4-4995-8990-5f3c3b8c5d84 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action" status: 202 len: 0 microversion: 2.1 time: 0.263499 Nov 02 22:42:04.143496 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3817/7754] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:42:03 2022] POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:42:04.153437 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:04.154237 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:04.163305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:04.163808 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:04.164263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:04.165063 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:04.165532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:04.165976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:04.304852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:04.312949 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65d77b5b-a742-4c1e-b5f4-ae9b7c5d7b2c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1692 microversion: 2.1 time: 0.164164 Nov 02 22:42:04.313524 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3938/7755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:04 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:05.339449 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:05.340076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:05.346247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:05.346733 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:05.347179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:05.347876 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:05.348335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:05.348764 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:05.491029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:05.500361 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ded51b6-d180-4038-a0b5-292e0083d914 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1692 microversion: 2.1 time: 0.165815 Nov 02 22:42:05.500969 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3818/7756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:05 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:06.525393 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:06.526022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:06.536181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:06.536693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:06.537179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:06.537892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:06.538365 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:06.538812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:06.672030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:06.680403 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96d4c2df-17ed-4e34-8350-1376347521d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1692 microversion: 2.1 time: 0.159500 Nov 02 22:42:06.681574 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3939/7757] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:06 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:07.704753 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:07.705392 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:07.712904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:07.713435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:07.713883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:07.714577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:07.715043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:07.715479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:07.848872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:07.856747 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a449b4e7-af33-45bc-95ff-5731ed415809 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.156198 Nov 02 22:42:07.857351 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3819/7758] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:07 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:08.880419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:08.881117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:08.888324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:08.888817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:08.889298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:08.889990 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:08.890451 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:08.890889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:09.026606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:09.034516 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ceda9ce5-ece0-4e22-aa27-ef33480fa4ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.158024 Nov 02 22:42:09.035084 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3940/7759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:08 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:10.057796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:10.058403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:10.065962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:10.066448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:10.066889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:10.067578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:10.068193 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:10.068812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:10.201134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:10.209383 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4460e2ce-a288-4c13-b415-d5b00b400f69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.155339 Nov 02 22:42:10.209964 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3820/7760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:10 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:11.233397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:11.233972 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:11.241613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:11.242114 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:11.242572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:11.243277 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:11.243751 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:11.244192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:11.377887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:11.385666 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fbd75ce-f91d-48fb-95ff-0e44f6bf763f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.156302 Nov 02 22:42:11.386237 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3941/7761] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:11 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:12.409586 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:12.410197 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:12.417023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:12.417507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:12.417941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:12.418625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:12.419076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:12.419499 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:12.548144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:12.556536 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5a2b4f63-d307-499e-89d1-b0afc0f53e8c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.150891 Nov 02 22:42:12.557148 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3821/7762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:12 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:13.580798 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:13.581456 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:13.588852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:13.589381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:13.589864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:13.590568 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:13.591034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:13.591478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:13.725874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:13.733572 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-025cf06b-e255-45d9-bba2-69c090a00626 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.156891 Nov 02 22:42:13.734142 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3942/7763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:13 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:14.757538 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:14.758155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:14.765360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:14.765853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:14.766300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:14.767029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:14.767488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:14.767922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:14.903084 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:14.911173 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-10c927c3-08f7-439f-88c1-ffd100e809fe tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.157527 Nov 02 22:42:14.912954 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3822/7764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:14 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:15.935655 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:15.936299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:15.943999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:15.944506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:15.944991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:15.945709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:15.946182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:15.946634 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:16.077846 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:16.085711 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a96e74a7-c1d8-4aa3-98fa-487cd97eea8f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.153972 Nov 02 22:42:16.086278 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3943/7765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:15 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:17.109791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:17.110405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:17.117941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:17.118428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:17.118865 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:17.119552 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:17.120005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:17.120433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:17.252786 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:17.260785 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac93adcd-cd5b-4e5d-94ae-9436138e1047 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.154852 Nov 02 22:42:17.261395 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3823/7766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:17 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:18.285061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:18.285723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:18.293410 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:18.293904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:18.294353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:18.295058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:18.295524 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:18.295966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:18.427839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:18.435588 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76ee1d92-3dbf-4c49-be29-b7312ae82b37 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.154569 Nov 02 22:42:18.436151 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3944/7767] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:18 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:19.460374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:19.461187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:19.469555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:19.470037 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:19.470471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:19.471162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:19.471610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:19.472043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:19.613375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:19.621510 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-325f38f6-f998-47ef-be36-2671eed73f4c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1697 microversion: 2.1 time: 0.165565 Nov 02 22:42:19.622096 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3824/7768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:19 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:20.298490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-16118d4d-3277-4647-8b1c-f15bfceb6c9d req-c8930502-1ee6-46f3-8465-46fa4fe69f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "name": "network-vif-unplugged", "status": "completed", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:42:20.309822 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-16118d4d-3277-4647-8b1c-f15bfceb6c9d req-c8930502-1ee6-46f3-8465-46fa4fe69f3f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:20.314933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-16118d4d-3277-4647-8b1c-f15bfceb6c9d req-c8930502-1ee6-46f3-8465-46fa4fe69f3f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:20.314933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-16118d4d-3277-4647-8b1c-f15bfceb6c9d req-c8930502-1ee6-46f3-8465-46fa4fe69f3f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:20.326886 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-16118d4d-3277-4647-8b1c-f15bfceb6c9d req-c8930502-1ee6-46f3-8465-46fa4fe69f3f service nova] Creating event network-vif-unplugged:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h1-860863-4 Nov 02 22:42:20.332541 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-16118d4d-3277-4647-8b1c-f15bfceb6c9d req-c8930502-1ee6-46f3-8465-46fa4fe69f3f service nova] Instance 6dde041c-392e-4bef-b127-1801f550f483 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:42:20.343554 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-16118d4d-3277-4647-8b1c-f15bfceb6c9d req-c8930502-1ee6-46f3-8465-46fa4fe69f3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048919 Nov 02 22:42:20.347229 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3945/7769] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:42:20.645417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:20.646031 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:20.653300 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:20.653790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:20.654268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:20.654943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:20.655403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:20.655833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:20.855798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:20.863513 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-097bac2a-6955-4642-9c6a-17a9e347e8ba tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1696 microversion: 2.1 time: 0.222170 Nov 02 22:42:20.864101 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3825/7770] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:20 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:21.890126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:21.890847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:21.897132 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:21.897638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:21.898097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:21.898851 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:21.899327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:21.899775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:22.033881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:22.042484 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-034c5656-5b20-42bf-abf5-8ddddf41fb82 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1694 microversion: 2.1 time: 0.157539 Nov 02 22:42:22.043052 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3946/7771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:21 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:22.358191 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7a5ca934-e804-4f32-9b4c-d55a9a30f421 req-0a6fd805-42cb-4474-8e6c-cb985faca041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:42:22.368816 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a5ca934-e804-4f32-9b4c-d55a9a30f421 req-0a6fd805-42cb-4474-8e6c-cb985faca041 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:22.369314 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a5ca934-e804-4f32-9b4c-d55a9a30f421 req-0a6fd805-42cb-4474-8e6c-cb985faca041 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:22.369743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7a5ca934-e804-4f32-9b4c-d55a9a30f421 req-0a6fd805-42cb-4474-8e6c-cb985faca041 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:22.381215 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7a5ca934-e804-4f32-9b4c-d55a9a30f421 req-0a6fd805-42cb-4474-8e6c-cb985faca041 service nova] Creating event network-changed:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h1-860863-4 Nov 02 22:42:22.386986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [req-7a5ca934-e804-4f32-9b4c-d55a9a30f421 req-0a6fd805-42cb-4474-8e6c-cb985faca041 service nova] Instance 6dde041c-392e-4bef-b127-1801f550f483 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121039) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:42:22.398192 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7a5ca934-e804-4f32-9b4c-d55a9a30f421 req-0a6fd805-42cb-4474-8e6c-cb985faca041 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043750 Nov 02 22:42:22.398815 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3826/7772] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:42:23.066812 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:23.067447 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:23.074986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:23.075532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:23.075994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:23.076726 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:23.077307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:23.077976 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:23.289094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:23.297974 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02b10bc2-8bc4-4160-ab21-fc309e79bcdc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1694 microversion: 2.1 time: 0.234985 Nov 02 22:42:23.298774 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3947/7773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:23 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:24.323289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:24.324187 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:24.331453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.331868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.332332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:24.333064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.333519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.333949 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:24.469510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:24.477878 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e3596e13-09bc-411f-8709-7b83a65d790a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1691 microversion: 2.1 time: 0.158968 Nov 02 22:42:24.478405 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3827/7774] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:24 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:24.500914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:42:24.501485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:24.509326 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.509826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.510284 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:24.510992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.511462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.511979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:24.704734 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84af69ac-57da-42e4-954a-d4c0c03de4a2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action" status: 204 len: 0 microversion: 2.1 time: 0.207404 Nov 02 22:42:24.705441 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3948/7775] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:42:24 2022] POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:42:24.715395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:24.716022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:24.723254 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.723757 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.724215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:24.724987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.725450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.725885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:24.869721 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:24.877689 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7f01ad9e-cabf-4330-9d4b-ddef55632c4f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1691 microversion: 2.1 time: 0.167977 Nov 02 22:42:24.878306 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3828/7776] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:24 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:24.901784 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:24.903510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:24.909893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.910402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.910863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:24.911581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:24.912054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:24.912498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:25.056457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:25.064577 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4f5146b-7c7c-4605-846e-e009c63994ed tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1691 microversion: 2.1 time: 0.167790 Nov 02 22:42:25.065179 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3949/7777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:24 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:26.089533 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:26.090163 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:26.096858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:26.097386 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:26.097837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:26.098541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:26.099004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:26.099435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:26.236383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:26.245129 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6bab0420-4b4f-4652-875e-448315940659 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1691 microversion: 2.1 time: 0.160032 Nov 02 22:42:26.245958 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3829/7778] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:26 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:26.322336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-a1481b2d-addc-488a-bea9-57c9b17423cf req-b8445654-b85e-46f9-9c7d-540b4a82e809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "name": "network-vif-plugged", "status": "completed", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:42:26.333534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a1481b2d-addc-488a-bea9-57c9b17423cf req-b8445654-b85e-46f9-9c7d-540b4a82e809 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:26.333957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a1481b2d-addc-488a-bea9-57c9b17423cf req-b8445654-b85e-46f9-9c7d-540b4a82e809 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:26.334403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-a1481b2d-addc-488a-bea9-57c9b17423cf req-b8445654-b85e-46f9-9c7d-540b4a82e809 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:26.347006 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-a1481b2d-addc-488a-bea9-57c9b17423cf req-b8445654-b85e-46f9-9c7d-540b4a82e809 service nova] Creating event network-vif-plugged:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h1-860863-4 Nov 02 22:42:26.352562 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [req-a1481b2d-addc-488a-bea9-57c9b17423cf req-b8445654-b85e-46f9-9c7d-540b4a82e809 service nova] Instance 6dde041c-392e-4bef-b127-1801f550f483 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860863-4', 'n-h2-860863-4'} {{(pid=121040) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 02 22:42:26.363520 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-a1481b2d-addc-488a-bea9-57c9b17423cf req-b8445654-b85e-46f9-9c7d-540b4a82e809 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046014 Nov 02 22:42:26.364122 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3950/7779] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:42:27.269223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:27.269787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:27.277113 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:27.277609 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:27.278058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:27.278763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:27.279222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:27.279667 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:27.736441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:27.744685 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-aefff41f-1573-48f2-b0b1-7966b40447c3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1683 microversion: 2.1 time: 0.479731 Nov 02 22:42:27.745299 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3830/7780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:27 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1683 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:42:51.930418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=28 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:42:51.931286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:42:51.936941 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:42:51.939209 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:51.946225 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:51.946725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:51.947179 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:51.947929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:51.948516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:51.948978 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:52.002146 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6b1df84-521f-4091-9c2b-ce3406afcc0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action" status: 200 len: 24566 microversion: 2.1 time: 0.073496 Nov 02 22:42:52.002810 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3951/7781] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:42:51 2022] POST /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:42:59.253076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:59.253602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:59.256797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=32 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:42:59.257703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:42:59.263868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:59.264448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:59.265014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:59.265797 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:59.266324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:59.266778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:59.296557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:42:59.322717 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1cbb3dd4-984a-405f-b678-004816a1de8f req-8e6cc7f8-2742-4dbd-bbb7-d543d5a75018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:42:59.337992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1cbb3dd4-984a-405f-b678-004816a1de8f req-8e6cc7f8-2742-4dbd-bbb7-d543d5a75018 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:59.339085 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1cbb3dd4-984a-405f-b678-004816a1de8f req-8e6cc7f8-2742-4dbd-bbb7-d543d5a75018 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:59.339551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1cbb3dd4-984a-405f-b678-004816a1de8f req-8e6cc7f8-2742-4dbd-bbb7-d543d5a75018 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:59.350564 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1cbb3dd4-984a-405f-b678-004816a1de8f req-8e6cc7f8-2742-4dbd-bbb7-d543d5a75018 service nova] Creating event network-changed:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h1-860863-4 Nov 02 22:42:59.356643 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1cbb3dd4-984a-405f-b678-004816a1de8f req-8e6cc7f8-2742-4dbd-bbb7-d543d5a75018 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105391 Nov 02 22:42:59.357593 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3952/7782] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:42:59.546331 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ee04fc21-59d2-4515-aa5a-5def96c85b21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 204 len: 0 microversion: 2.1 time: 0.297517 Nov 02 22:42:59.549642 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3831/7783] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:42:59 2022] DELETE /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:42:59.556215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:42:59.557491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:42:59.565119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:59.565692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:59.566212 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:59.567228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:42:59.567785 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:42:59.568295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:42:59.709987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:42:59.718882 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b95eb92c-5bfd-4180-b8a5-fa1dfa27aa3b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1689 microversion: 2.1 time: 0.166887 Nov 02 22:42:59.719471 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3953/7784] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:42:59 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:00.744304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:00.745224 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:00.752747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:00.753253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:00.753693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:00.754387 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:00.754838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:00.755264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:00.923368 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:00.931165 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3ea73f28-de93-4854-b634-3aa5c1064ae9 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1689 microversion: 2.1 time: 0.191200 Nov 02 22:43:00.931745 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3832/7785] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:00 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:01.551494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-92772237-90a9-4fee-b72b-19068cd0f47c req-f2afcffb-3f3d-4f70-9a59-a7d15ca261fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dde041c-392e-4bef-b127-1801f550f483", "name": "network-vif-deleted", "tag": "76bfbd2a-6e87-4898-abe1-afbdf1ae5881"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:43:01.562830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-92772237-90a9-4fee-b72b-19068cd0f47c req-f2afcffb-3f3d-4f70-9a59-a7d15ca261fa service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:01.563324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-92772237-90a9-4fee-b72b-19068cd0f47c req-f2afcffb-3f3d-4f70-9a59-a7d15ca261fa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:01.563776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-92772237-90a9-4fee-b72b-19068cd0f47c req-f2afcffb-3f3d-4f70-9a59-a7d15ca261fa service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:01.575840 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-92772237-90a9-4fee-b72b-19068cd0f47c req-f2afcffb-3f3d-4f70-9a59-a7d15ca261fa service nova] Creating event network-vif-deleted:76bfbd2a-6e87-4898-abe1-afbdf1ae5881 for instance 6dde041c-392e-4bef-b127-1801f550f483 on n-h1-860863-4 Nov 02 22:43:01.581589 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-92772237-90a9-4fee-b72b-19068cd0f47c req-f2afcffb-3f3d-4f70-9a59-a7d15ca261fa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 Nov 02 22:43:01.582016 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3954/7786] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:43:01.956489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:01.962638 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:01.964998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:01.965711 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:01.966172 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:01.967070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:01.967525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:01.967957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:02.001434 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:02.001915 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:02.002348 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:02.002787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lazy-loading 'fault' on Instance uuid 6dde041c-392e-4bef-b127-1801f550f483 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:43:02.049074 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:02.056847 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-487c3887-b57d-40b2-915a-3050eec4a4b4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 200 len: 1356 microversion: 2.1 time: 0.105390 Nov 02 22:43:02.057913 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3833/7787] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:01 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:03.082407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:03.083123 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 6dde041c-392e-4bef-b127-1801f550f483] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:03.090400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:03.090894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:03.091345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:03.092046 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:03.092511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:03.092985 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:03.106362 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] HTTP exception thrown: Instance 6dde041c-392e-4bef-b127-1801f550f483 could not be found. Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Request method failure captured: Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 HTTP/1.1 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYvFPg8A0j1WSSIoKN6gTI98OlETYuXbac-jbhtzSUErHGKPjsHzUjvOFcKK5XIYwbL-ONPaiw7SDgD2hn02FR6EL-lMT0lroh9SdaulZB_YeCZpiqfyGxV0LG_xmDet15RZXCbY7sTXFyVv5f2gNGD10jj4yMYSSpzrh_ux6mYrh0-A Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: f78b1be258b34cf9a765d4a4e99fc287 Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 6dde041c-392e-4bef-b127-1801f550f483 could not be found. Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '6dde041c-392e-4bef-b127-1801f550f483'} Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dde041c-392e-4bef-b127-1801f550f483 could not be found. Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dde041c-392e-4bef-b127-1801f550f483 could not be found. Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:43:03.107993 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dde041c-392e-4bef-b127-1801f550f483 could not be found. Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Returning 404 to user: Instance 6dde041c-392e-4bef-b127-1801f550f483 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29c6599e-78a6-4759-abf2-a118f6b3ef59 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483" status: 404 len: 111 microversion: 2.1 time: 0.031818 Nov 02 22:43:03.113478 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3955/7788] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:03 2022] GET /compute/v2.1/servers/6dde041c-392e-4bef-b127-1801f550f483 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:43:06.640792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d58efd1-5c58-40a8-886d-0f667d7266ce tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '.version_select at 0x7f9b685e6af0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:06.735928 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d58efd1-5c58-40a8-886d-0f667d7266ce tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-250417029" status: 202 len: 0 microversion: 2.1 time: 0.099047 Nov 02 22:43:06.736457 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3834/7789] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 22:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-250417029 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:43:06.764605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7a9a4559-aeba-47e2-bf01-704b19a8012e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: .version_select at 0x7f9b68744d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-829423804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeCp+IBsr/lgevLdATvmm7za43I0LcGVwA83sNdNv0RV+KGW90ig9LdFQUX0IWQCKPll0D5eE5MZTZcpwkzKSD2HQj1bwDSN2RfkSySe0lkokIN8OlNF01kLDFTeMgslg=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:43:06.781196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7a9a4559-aeba-47e2-bf01-704b19a8012e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:43:06.787188 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-7a9a4559-aeba-47e2-bf01-704b19a8012e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:43:06.844342 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7a9a4559-aeba-47e2-bf01-704b19a8012e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.084401 Nov 02 22:43:06.844975 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3956/7790] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:43:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:43:15.114370 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:43:15.119415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-306704566", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "b8bdeec1-ebbd-4267-87ff-e0f544ff8755"}], "key_name": "tempest-TestNetworkAdvancedServerOps-829423804", "security_groups": [{"name": "tempest-secgroup-smoke-240423333"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:43:15.241232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] validate_networks() for [('b8bdeec1-ebbd-4267-87ff-e0f544ff8755', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:43:15.715495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:43:15.716194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:43:15.716706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:43:15.717162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:43:15.717573 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:43:15.727326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:15.727806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:15.728555 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:15.729309 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:15.729934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:15.730363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:15.750299 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:43:15.755641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:43:15.768641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:43:15.771000 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:43:15.937367 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-817f5bc7-00f8-4be0-8700-942b3daedd5c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824313 Nov 02 22:43:15.939601 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3835/7791] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:43:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:43:15.952178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb0a2e6a-095f-4a8d-8d9c-d8e20a61d261 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:15.953953 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb0a2e6a-095f-4a8d-8d9c-d8e20a61d261 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:15.958831 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:43:16.048302 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb0a2e6a-095f-4a8d-8d9c-d8e20a61d261 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:16.057800 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb0a2e6a-095f-4a8d-8d9c-d8e20a61d261 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1265 microversion: 2.1 time: 0.109926 Nov 02 22:43:16.058699 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3957/7792] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:15 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:17.085713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:17.086345 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:17.093718 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:17.094213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:17.094651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:17.095930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:17.096488 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:17.097057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:17.167080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:17.175870 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cab0bf88-f707-4d97-9f69-056d1cf790c5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1261 microversion: 2.1 time: 0.095358 Nov 02 22:43:17.176454 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3836/7793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:17 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1261 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:18.199988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:18.202036 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:18.212969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:18.213764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:18.214413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:18.215600 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:18.216441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:18.217265 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:18.287847 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:18.297011 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e18c1669-26da-453c-99b7-b5cfc3a18c21 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1325 microversion: 2.1 time: 0.101879 Nov 02 22:43:18.297615 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3958/7794] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:18 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1325 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:19.321602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:19.322230 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:19.330111 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:19.330606 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:19.331062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:19.331767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:19.332231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:19.332669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:19.469950 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:19.477773 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-803a737f-b102-47b6-b79e-19ef1dbb969f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1390 microversion: 2.1 time: 0.160187 Nov 02 22:43:19.478353 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3837/7795] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:19 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:19.738352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-09fbad5a-d1fa-4e3e-8e51-2cf9bf46f295 req-6f7e70d1-9c3c-4f14-98f2-ac5ae09b6af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "559ec9b9-9bc8-4326-9790-6de965648428", "tag": "4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:43:19.749303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09fbad5a-d1fa-4e3e-8e51-2cf9bf46f295 req-6f7e70d1-9c3c-4f14-98f2-ac5ae09b6af5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:19.749801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09fbad5a-d1fa-4e3e-8e51-2cf9bf46f295 req-6f7e70d1-9c3c-4f14-98f2-ac5ae09b6af5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:19.750254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-09fbad5a-d1fa-4e3e-8e51-2cf9bf46f295 req-6f7e70d1-9c3c-4f14-98f2-ac5ae09b6af5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:19.761728 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-09fbad5a-d1fa-4e3e-8e51-2cf9bf46f295 req-6f7e70d1-9c3c-4f14-98f2-ac5ae09b6af5 service nova] Creating event network-changed:4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834 for instance 559ec9b9-9bc8-4326-9790-6de965648428 on n-h1-860863-4 Nov 02 22:43:19.769472 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-09fbad5a-d1fa-4e3e-8e51-2cf9bf46f295 req-6f7e70d1-9c3c-4f14-98f2-ac5ae09b6af5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032206 Nov 02 22:43:19.769472 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3959/7796] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:43:20.501705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:20.502358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:20.509149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:20.509642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:20.510089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:20.510783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:20.511241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:20.511777 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:20.642625 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:20.650282 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c9e8bfad-fb53-4b18-9312-00a5133589b1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1390 microversion: 2.1 time: 0.152510 Nov 02 22:43:20.650867 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3838/7797] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:20 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:43:21.674531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:21.675243 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:21.681544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:21.682040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:21.682495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:21.683194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:21.684164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:21.684598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:21.819048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:21.827513 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50a1cc27-d2bd-43e7-9cfb-714f66656c63 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1390 microversion: 2.1 time: 0.158266 Nov 02 22:43:21.828078 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3960/7798] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:21 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:22.850997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:22.851546 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:22.858594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:22.859083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:22.859524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:22.860226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:22.860682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:22.861138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:22.997817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:23.005585 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e1cee6aa-be8a-4b34-9623-28ca694d0a10 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1390 microversion: 2.1 time: 0.158696 Nov 02 22:43:23.006188 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3839/7799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:22 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:24.029452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:24.030084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:24.037090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:24.037595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:24.038082 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:24.038793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:24.039268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:24.039712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:24.177381 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:24.185186 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-080402de-016d-455b-a93e-8261ef1e630c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1390 microversion: 2.1 time: 0.159779 Nov 02 22:43:24.185778 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3961/7800] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:24 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:24.505280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-3ed35046-3d6e-4bf6-97f0-5cfd8cb47034 req-0682811f-142a-41c2-9db2-d5935881fb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "559ec9b9-9bc8-4326-9790-6de965648428", "name": "network-vif-plugged", "status": "completed", "tag": "4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:43:24.515380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3ed35046-3d6e-4bf6-97f0-5cfd8cb47034 req-0682811f-142a-41c2-9db2-d5935881fb32 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:24.515858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3ed35046-3d6e-4bf6-97f0-5cfd8cb47034 req-0682811f-142a-41c2-9db2-d5935881fb32 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:24.516292 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-3ed35046-3d6e-4bf6-97f0-5cfd8cb47034 req-0682811f-142a-41c2-9db2-d5935881fb32 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:24.527703 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-3ed35046-3d6e-4bf6-97f0-5cfd8cb47034 req-0682811f-142a-41c2-9db2-d5935881fb32 service nova] Creating event network-vif-plugged:4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834 for instance 559ec9b9-9bc8-4326-9790-6de965648428 on n-h1-860863-4 Nov 02 22:43:24.532755 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-3ed35046-3d6e-4bf6-97f0-5cfd8cb47034 req-0682811f-142a-41c2-9db2-d5935881fb32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031272 Nov 02 22:43:24.533382 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3840/7801] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:43:25.208507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:25.209186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:25.216778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:25.217303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:25.217835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:25.218543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:25.219014 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:25.219459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:25.350948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:25.358812 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4bf909d6-37c9-45a8-9829-7259fac2ea0d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1390 microversion: 2.1 time: 0.154226 Nov 02 22:43:25.359382 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3962/7802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:25 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:26.380652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:43:26.381467 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:43:26.385547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:26.386279 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:26.392913 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:26.393439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:26.393880 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:26.394569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:26.395026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:26.395458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:26.526265 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:26.534684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b92dc01c-3386-4088-a3c7-039f89c39334 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1563 microversion: 2.1 time: 0.155841 Nov 02 22:43:26.535396 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3841/7803] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:26 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:26.557434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:26.558057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:26.560286 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:43:26.565329 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:26.565830 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:26.566281 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:26.566979 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:26.567443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:26.567881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:26.705855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:26.713480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f7d67b2-90fa-4e6d-9a77-bdb5f8a35c69 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1563 microversion: 2.1 time: 0.160397 Nov 02 22:43:26.714047 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3963/7804] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:26 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:28.944642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:43:28.945909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:28.948185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-61f4f6be-c264-4cfd-9ee9-8b41b6b6957d req-f91d8f42-9acd-4b1d-b9ed-f2e11a0469c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "559ec9b9-9bc8-4326-9790-6de965648428", "tag": "4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:43:28.953442 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:28.954204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:28.954818 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:28.955542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:28.956002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:28.956436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:28.961240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61f4f6be-c264-4cfd-9ee9-8b41b6b6957d req-f91d8f42-9acd-4b1d-b9ed-f2e11a0469c4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:28.962054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61f4f6be-c264-4cfd-9ee9-8b41b6b6957d req-f91d8f42-9acd-4b1d-b9ed-f2e11a0469c4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:28.962573 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-61f4f6be-c264-4cfd-9ee9-8b41b6b6957d req-f91d8f42-9acd-4b1d-b9ed-f2e11a0469c4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:28.975652 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-61f4f6be-c264-4cfd-9ee9-8b41b6b6957d req-f91d8f42-9acd-4b1d-b9ed-f2e11a0469c4 service nova] Creating event network-changed:4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834 for instance 559ec9b9-9bc8-4326-9790-6de965648428 on n-h1-860863-4 Nov 02 22:43:28.982018 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-61f4f6be-c264-4cfd-9ee9-8b41b6b6957d req-f91d8f42-9acd-4b1d-b9ed-f2e11a0469c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037759 Nov 02 22:43:28.982651 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3964/7805] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:43:29.104014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:43:29.113107 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-893d25d5-6f56-4221-8b81-5e7156eb0700 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1563 microversion: 2.1 time: 0.172863 Nov 02 22:43:29.113907 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3842/7806] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:43:28 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:43:54.369159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:43:54.371473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:43:54.375806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:43:54.376488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=34 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:43:54.381405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:54.381904 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:54.382361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:54.383081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:43:54.383553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:43:54.383996 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:43:54.441041 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf1c0720-57d3-4656-9685-97c87b055245 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action" status: 200 len: 24568 microversion: 2.1 time: 0.075995 Nov 02 22:43:54.441694 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3965/7807] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:43:54 2022] POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action => generated 24568 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:44:05.573482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d52e2652-5a66-4918-bf68-6fc5829d307a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:44:05.576354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:44:05.577065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=40 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:44:05.582027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e2652-5a66-4918-bf68-6fc5829d307a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:05.582514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e2652-5a66-4918-bf68-6fc5829d307a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:05.582954 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d52e2652-5a66-4918-bf68-6fc5829d307a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:05.605739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d52e2652-5a66-4918-bf68-6fc5829d307a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Going to try to stop instance {{(pid=121039) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 22:44:05.803930 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d52e2652-5a66-4918-bf68-6fc5829d307a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action" status: 202 len: 0 microversion: 2.1 time: 0.234406 Nov 02 22:44:05.804551 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3843/7808] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:44:05 2022] POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:44:05.814819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:05.815622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:05.823349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:05.823843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:05.824296 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:05.825024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:05.825494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:05.825933 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:05.967030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:05.975514 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-331d3f3c-2fac-442a-b77b-6b7623d1622c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.166163 Nov 02 22:44:05.976079 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3966/7809] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:05 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:07.001540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:07.002245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:07.008610 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:07.009124 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:07.009570 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:07.010256 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:07.010713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:07.011144 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:07.143897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:07.151731 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d4a67ac9-8d95-40af-b371-a233dc9e778c tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.155802 Nov 02 22:44:07.152242 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3844/7810] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:06 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:08.176817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:08.177407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:08.184992 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:08.185498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:08.185956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:08.186691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:08.187165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:08.188183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:08.322485 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:08.330775 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99e2a9d5-def2-4f6b-b862-73e6d5e732e1 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.158037 Nov 02 22:44:08.331346 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3967/7811] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:08 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:09.355252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:09.355872 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:09.362825 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:09.363350 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:09.363795 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:09.364490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:09.364968 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:09.365406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:09.498683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:09.507034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e73a1e8-a62b-4bce-88e7-fd0634131831 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.155848 Nov 02 22:44:09.507634 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3845/7812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:09 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:10.530147 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:10.530809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:10.539479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:10.542136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:10.542136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:10.542136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:10.542136 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:10.542594 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:10.679322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:10.687113 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c5ef6151-1351-4c0b-b069-8ccf50c1b37b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.160913 Nov 02 22:44:10.688245 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3968/7813] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:10 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:11.711354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:11.711965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:11.718807 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:11.719338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:11.719773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:11.720454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:11.720910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:11.721361 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:11.850770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:11.858504 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d46962f5-bd36-4db5-a469-99413e4e7696 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.151057 Nov 02 22:44:11.859581 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3846/7814] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:11 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:12.884947 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:12.885780 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:12.893930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:12.894436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:12.894895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:12.895629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:12.896109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:12.896555 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:13.041325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:13.049237 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-429fe946-d89a-43e6-a60e-740d06a9f186 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.170266 Nov 02 22:44:13.049833 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3969/7815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:12 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:44:14.073210 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:14.073867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:14.081558 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:14.082049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:14.082496 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:14.083195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:14.083657 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:14.084094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:14.228901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:14.237181 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-28b79b86-a196-4f4a-8b70-29ebd2797b46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.167997 Nov 02 22:44:14.237758 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3847/7816] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:14 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:15.260486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:15.261073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:15.268293 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:15.268792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:15.269297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:15.270012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:15.270477 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:15.270920 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:15.401002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:15.409366 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d13e1ddc-98c6-475a-90e3-960dd5da506a tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1692 microversion: 2.1 time: 0.152846 Nov 02 22:44:15.410106 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3970/7817] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:15 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:16.433809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:16.434463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:16.442675 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:16.449239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:16.449239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:16.449239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:16.449239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:16.449239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:16.580456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:16.588333 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7f21fc25-9e50-4d8e-8925-5a2a80a525cc tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1669 microversion: 2.1 time: 0.158372 Nov 02 22:44:16.589174 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3848/7818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:16 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:44:17.688259 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:44:17.690560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:17.697577 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:17.698205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:17.698697 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:17.699409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:17.699881 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:17.700327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:17.767008 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-35a93c88-ebe4-4c67-b8bc-7569257f6354 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action" status: 200 len: 38441 microversion: 2.1 time: 0.081993 Nov 02 22:44:17.767923 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3971/7819] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:44:17 2022] POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action => generated 38441 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:44:17.779620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4fb9cd63-4a31-4cd0-b63b-47030c5ccf42 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:44:17.787291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb9cd63-4a31-4cd0-b63b-47030c5ccf42 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:17.787783 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb9cd63-4a31-4cd0-b63b-47030c5ccf42 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:17.788229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4fb9cd63-4a31-4cd0-b63b-47030c5ccf42 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:17.810653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4fb9cd63-4a31-4cd0-b63b-47030c5ccf42 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Going to try to start instance {{(pid=121039) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 22:44:17.966684 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4fb9cd63-4a31-4cd0-b63b-47030c5ccf42 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action" status: 202 len: 0 microversion: 2.1 time: 0.190813 Nov 02 22:44:17.967354 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3849/7820] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:44:17 2022] POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:44:17.977034 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:17.977809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:17.985006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:17.985553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:17.986016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:17.986733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:17.987197 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:17.987637 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:18.132330 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:18.140270 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd341a5b-64ed-4c66-b874-ce3b4e82211b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1678 microversion: 2.1 time: 0.167631 Nov 02 22:44:18.140839 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3972/7821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:17 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:19.165004 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:19.165620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:19.172542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:19.173651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:19.174092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:19.174778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:19.175229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:19.175652 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:19.311227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:19.319429 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-121860b4-93d4-445e-a2d3-c93268111e46 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1678 microversion: 2.1 time: 0.158890 Nov 02 22:44:19.322930 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3850/7822] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:19 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:20.343754 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:20.344382 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:20.351820 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:20.352311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:20.352760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:20.353488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:20.353956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:20.354396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:20.489104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:20.496865 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cca485bd-fb2c-452f-a3ef-51eef5ed4d5d tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1682 microversion: 2.1 time: 0.157094 Nov 02 22:44:20.497541 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3973/7823] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:20 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:46.697162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:44:46.699389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:46.702293 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=16 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:44:46.703112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:44:46.707994 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:46.712062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:46.712062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:46.712062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:46.712062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:46.712062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:46.773401 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fccc04f1-a693-451b-9dd5-d79d648b5ea6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action" status: 200 len: 63003 microversion: 2.1 time: 0.080304 Nov 02 22:44:46.774091 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3851/7824] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:44:46 2022] POST /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428/action => generated 63003 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:44:54.414122 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:54.414660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:54.423490 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b2101cd5-a057-4182-aa4f-7ae6443d487a req-e52f6fd2-874b-472b-891c-88542802757b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "559ec9b9-9bc8-4326-9790-6de965648428", "tag": "4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:44:54.427353 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=18 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:44:54.428094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=50 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:44:54.440327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:54.443693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:54.443846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2101cd5-a057-4182-aa4f-7ae6443d487a req-e52f6fd2-874b-472b-891c-88542802757b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:54.443983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:54.444101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2101cd5-a057-4182-aa4f-7ae6443d487a req-e52f6fd2-874b-472b-891c-88542802757b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:54.444101 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2101cd5-a057-4182-aa4f-7ae6443d487a req-e52f6fd2-874b-472b-891c-88542802757b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:54.444311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:54.444311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:54.444311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:54.455401 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b2101cd5-a057-4182-aa4f-7ae6443d487a req-e52f6fd2-874b-472b-891c-88542802757b service nova] Creating event network-changed:4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834 for instance 559ec9b9-9bc8-4326-9790-6de965648428 on n-h1-860863-4 Nov 02 22:44:54.460878 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b2101cd5-a057-4182-aa4f-7ae6443d487a req-e52f6fd2-874b-472b-891c-88542802757b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042464 Nov 02 22:44:54.461726 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3852/7825] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:44:54.475857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:44:54.801021 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04278d12-55ea-417d-8fa3-4e882c8f5e1f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 204 len: 0 microversion: 2.1 time: 0.390699 Nov 02 22:44:54.801898 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3974/7826] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:44:54 2022] DELETE /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:44:54.812119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:54.813784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:54.821227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:54.827063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:54.827063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:54.827063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:54.827063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:54.827063 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:54.969433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:54.977788 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3cbfe955-9046-45e3-86f6-ea13538a6ba6 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1688 microversion: 2.1 time: 0.170961 Nov 02 22:44:54.978389 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3853/7827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:54 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:56.004031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:56.004744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:56.011897 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:56.012558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:56.013069 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:56.013773 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:56.014240 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:56.014680 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:56.147473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:56.155425 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8c8fdd6a-390f-4ad7-8694-a07a62e717b2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1688 microversion: 2.1 time: 0.155599 Nov 02 22:44:56.155933 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3975/7828] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:55 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:44:57.078713 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-c573b8e7-2d2f-4798-b423-fd96243f033e req-ccc093d5-982e-4447-884e-7362276e5f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "559ec9b9-9bc8-4326-9790-6de965648428", "name": "network-vif-deleted", "tag": "4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:44:57.089502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c573b8e7-2d2f-4798-b423-fd96243f033e req-ccc093d5-982e-4447-884e-7362276e5f1a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:57.090036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c573b8e7-2d2f-4798-b423-fd96243f033e req-ccc093d5-982e-4447-884e-7362276e5f1a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:57.090817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-c573b8e7-2d2f-4798-b423-fd96243f033e req-ccc093d5-982e-4447-884e-7362276e5f1a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:57.102922 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-c573b8e7-2d2f-4798-b423-fd96243f033e req-ccc093d5-982e-4447-884e-7362276e5f1a service nova] Creating event network-vif-deleted:4ec68bc6-3e1d-4e0e-9e6b-b189ea3ce834 for instance 559ec9b9-9bc8-4326-9790-6de965648428 on n-h1-860863-4 Nov 02 22:44:57.107877 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-c573b8e7-2d2f-4798-b423-fd96243f033e req-ccc093d5-982e-4447-884e-7362276e5f1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Nov 02 22:44:57.108577 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3854/7829] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:44:57.179629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:57.180309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:57.186814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:57.187316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:57.187766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:57.189166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:57.189632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:57.190077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:57.257786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:44:57.266810 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab9c2ea0-e8fa-4a27-a80d-69b1f2136139 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 200 len: 1350 microversion: 2.1 time: 0.090554 Nov 02 22:44:57.267328 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3976/7830] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:57 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 1350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:44:58.290723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:44:58.291433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 559ec9b9-9bc8-4326-9790-6de965648428] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:44:58.297952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:58.298441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:58.298885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:58.299578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:44:58.300035 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:44:58.300464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:44:58.313752 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] HTTP exception thrown: Instance 559ec9b9-9bc8-4326-9790-6de965648428 could not be found. Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Request method failure captured: Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 HTTP/1.1 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYvFPg8A0j1WSSIoKN6gTI98OlETYuXbac-jbhtzSUErHGKPjsHzUjvOFcKK5XIYwbL-ONPaiw7SDgD2hn02FR6EL-lMT0lroh9SdaulZB_YeCZpiqfyGxV0LG_xmDet15RZXCbY7sTXFyVv5f2gNGD10jj4yMYSSpzrh_ux6mYrh0-A Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: f78b1be258b34cf9a765d4a4e99fc287 Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 559ec9b9-9bc8-4326-9790-6de965648428 could not be found. Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '559ec9b9-9bc8-4326-9790-6de965648428'} Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 559ec9b9-9bc8-4326-9790-6de965648428 could not be found. Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 559ec9b9-9bc8-4326-9790-6de965648428 could not be found. Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:44:58.315399 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 559ec9b9-9bc8-4326-9790-6de965648428 could not be found. Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Returning 404 to user: Instance 559ec9b9-9bc8-4326-9790-6de965648428 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2ba6e10a-22a5-41c8-94d9-17f73f646a86 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428" status: 404 len: 111 microversion: 2.1 time: 0.031243 Nov 02 22:44:58.320999 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3855/7831] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:44:58 2022] GET /compute/v2.1/servers/559ec9b9-9bc8-4326-9790-6de965648428 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:45:01.970821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d0fdf4b-1cc3-47e3-ae7a-b03c9ac03c60 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '.version_select at 0x7f9b687b9af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:02.081973 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d0fdf4b-1cc3-47e3-ae7a-b03c9ac03c60 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-829423804" status: 202 len: 0 microversion: 2.1 time: 0.115570 Nov 02 22:45:02.082566 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3977/7832] 10.222.0.25 () {58 vars in 1281 bytes} [Wed Nov 2 22:45:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-829423804 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:45:02.114644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b0d21ca7-39d9-4680-adbe-49a720b9071b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: .version_select at 0x7f9b687998b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2126382633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhc1C5DxmlydU8K6CBef1dOPDbuAMxv1RUSrmer0eCSSiQjXKnn1wU2/VAdVqpTQG2k+F8HliHleP4KdyGRcYpF6oQtl0r+/WMDo+OrFxHvp2YsnoejUK4RbmbQDeP3PA=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:02.132346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b0d21ca7-39d9-4680-adbe-49a720b9071b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:45:02.137613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-b0d21ca7-39d9-4680-adbe-49a720b9071b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:45:02.227584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b0d21ca7-39d9-4680-adbe-49a720b9071b tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.116931 Nov 02 22:45:02.228113 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3856/7833] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:45:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:45:10.738078 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1065958817", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "networks": [{"uuid": "5f10b3af-2825-41c7-83c2-cc62923d1247"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2126382633", "security_groups": [{"name": "tempest-secgroup-smoke-1994496653"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:10.749608 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:10.868118 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] validate_networks() for [('5f10b3af-2825-41c7-83c2-cc62923d1247', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:45:11.312971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:45:11.313415 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:45:11.313907 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:45:11.314331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:45:11.314758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:45:11.324169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:11.324677 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:11.325185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:11.325940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:11.326416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:11.326867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:11.345544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:45:11.351946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Getting quotas for user f78b1be258b34cf9a765d4a4e99fc287 and project 14742f1d97404d05a7bb8b13ccf2a9bd. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:45:11.365378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:45:11.367759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:45:11.493923 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95f580d6-d813-4130-83e1-afb3b6d3f4f2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760074 Nov 02 22:45:11.494579 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3978/7834] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:45:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:45:11.505842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1143b8b0-c5af-4cba-9fe6-d743ab4ea9f5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:11.506465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1143b8b0-c5af-4cba-9fe6-d743ab4ea9f5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:11.509360 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=16 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:11.564960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1143b8b0-c5af-4cba-9fe6-d743ab4ea9f5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:11.573286 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1143b8b0-c5af-4cba-9fe6-d743ab4ea9f5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1267 microversion: 2.1 time: 0.071226 Nov 02 22:45:11.574155 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3857/7835] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:11 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:12.598182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:12.599072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:12.611038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:12.611038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:12.611038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:12.613625 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:12.614495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:12.615205 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:12.694945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:12.703350 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5f864904-7de9-4f07-8c34-073acedbb8f7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1271 microversion: 2.1 time: 0.111475 Nov 02 22:45:12.703938 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3979/7836] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:12 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:13.728129 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:13.729620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:13.737750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:13.738747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:13.739435 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:13.740359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:13.741027 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:13.741782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:13.821419 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:13.829416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-98dd2bf6-e412-499f-b8b3-272614a9bec7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1337 microversion: 2.1 time: 0.105393 Nov 02 22:45:13.830118 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3858/7837] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:13 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:14.855739 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:14.856336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:14.864653 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:14.865192 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:14.865730 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:14.866482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:14.866962 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:14.867409 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:15.040349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:15.051422 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72a8ef26-6abc-4d78-911e-5209968feae4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1393 microversion: 2.1 time: 0.200915 Nov 02 22:45:15.052185 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3980/7838] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:14 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1393 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:15.435010 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-0758501f-2a46-47b5-ae8c-0155ce036a7e req-440ce729-d9ce-455f-b3f8-4508bad9811a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13328878-a11c-4db0-bdb6-3d2dececedf0", "tag": "279d9116-8a6d-446f-9059-22c65a66a26d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:15.447523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0758501f-2a46-47b5-ae8c-0155ce036a7e req-440ce729-d9ce-455f-b3f8-4508bad9811a service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:15.448008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0758501f-2a46-47b5-ae8c-0155ce036a7e req-440ce729-d9ce-455f-b3f8-4508bad9811a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:15.448531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-0758501f-2a46-47b5-ae8c-0155ce036a7e req-440ce729-d9ce-455f-b3f8-4508bad9811a service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:15.461267 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-0758501f-2a46-47b5-ae8c-0155ce036a7e req-440ce729-d9ce-455f-b3f8-4508bad9811a service nova] Creating event network-changed:279d9116-8a6d-446f-9059-22c65a66a26d for instance 13328878-a11c-4db0-bdb6-3d2dececedf0 on n-h2-860863-4 Nov 02 22:45:15.466484 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-0758501f-2a46-47b5-ae8c-0155ce036a7e req-440ce729-d9ce-455f-b3f8-4508bad9811a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036176 Nov 02 22:45:15.467292 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3859/7839] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:45:16.077747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:16.078368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:16.086757 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:16.087274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:16.087742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:16.088479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:16.088981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:16.089436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:16.229228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:16.237744 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86f6ced8-4cda-42c3-8a25-78121419df05 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1393 microversion: 2.1 time: 0.163349 Nov 02 22:45:16.238206 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3981/7840] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:16 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:17.262452 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:17.263064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:17.265311 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:17.271628 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:17.272106 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:17.272542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:17.273249 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:17.273697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:17.274117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:17.527288 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:17.527288 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ac12815e-ea7c-4352-9e14-28a5ad96cce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1393 microversion: 2.1 time: 0.167043 Nov 02 22:45:17.527288 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3860/7841] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:17 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:18.446675 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:18.447254 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:18.454297 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:18.454811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:18.455272 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:18.455987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:18.457475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:18.457910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:18.598583 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:18.606635 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5239d5ba-ca01-4384-8666-3cc6683fdeb5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1393 microversion: 2.1 time: 0.164003 Nov 02 22:45:18.607217 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3982/7842] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:18 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:19.629836 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:19.630437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:19.639428 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:19.640183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:19.640773 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:19.641788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:19.642463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:19.642998 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:19.780894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:19.789004 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-65b66543-1f4b-4671-9f1d-1a0d1d9e0dc7 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1393 microversion: 2.1 time: 0.163093 Nov 02 22:45:19.789604 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3861/7843] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:19 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:19.952712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b86f411c-e22e-4f11-acc6-6f0c6a8f216e req-c4c9be37-59ad-4c57-b242-ea537faf2e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13328878-a11c-4db0-bdb6-3d2dececedf0", "name": "network-vif-plugged", "status": "completed", "tag": "279d9116-8a6d-446f-9059-22c65a66a26d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:19.964498 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b86f411c-e22e-4f11-acc6-6f0c6a8f216e req-c4c9be37-59ad-4c57-b242-ea537faf2e8b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:19.965022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b86f411c-e22e-4f11-acc6-6f0c6a8f216e req-c4c9be37-59ad-4c57-b242-ea537faf2e8b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:19.965472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b86f411c-e22e-4f11-acc6-6f0c6a8f216e req-c4c9be37-59ad-4c57-b242-ea537faf2e8b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:19.977631 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b86f411c-e22e-4f11-acc6-6f0c6a8f216e req-c4c9be37-59ad-4c57-b242-ea537faf2e8b service nova] Creating event network-vif-plugged:279d9116-8a6d-446f-9059-22c65a66a26d for instance 13328878-a11c-4db0-bdb6-3d2dececedf0 on n-h2-860863-4 Nov 02 22:45:19.982898 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b86f411c-e22e-4f11-acc6-6f0c6a8f216e req-c4c9be37-59ad-4c57-b242-ea537faf2e8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034061 Nov 02 22:45:19.983504 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3983/7844] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:45:20.811676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:20.812315 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:20.819204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:20.819691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:20.820134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:20.820826 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:20.821307 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:20.821739 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:20.962947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:20.970653 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-86b04636-29a6-473b-a534-30e8f8e3687e tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1393 microversion: 2.1 time: 0.162898 Nov 02 22:45:20.971236 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3862/7845] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:20 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:21.995360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:21.996073 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:21.998910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:21.999632 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:22.005420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:22.005915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:22.006367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:22.007072 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:22.007539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:22.007981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:22.140238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:22.148652 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-970385a9-8627-4e3b-b225-cde50530c55f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1566 microversion: 2.1 time: 0.157602 Nov 02 22:45:22.149368 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3984/7846] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:21 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:22.170817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:22.171373 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:22.173290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:22.179500 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:22.179969 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:22.180408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:22.181131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:22.181584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:22.182369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:22.317320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:22.325087 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4a464e56-d56d-4a6a-86b0-96c8bead4fbd tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1566 microversion: 2.1 time: 0.158128 Nov 02 22:45:22.325672 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3863/7847] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:22 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:24.536031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:24.536673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:24.539402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:24.544313 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:24.544862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:24.545492 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:24.545708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-7ace7406-c127-4e56-b6e8-94b09a2243b4 req-c39127e6-9bf3-489e-b3b0-f8547e1b5fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13328878-a11c-4db0-bdb6-3d2dececedf0", "tag": "279d9116-8a6d-446f-9059-22c65a66a26d"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:24.546361 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:24.546837 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:24.547280 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:24.557651 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ace7406-c127-4e56-b6e8-94b09a2243b4 req-c39127e6-9bf3-489e-b3b0-f8547e1b5fc0 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:24.559712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ace7406-c127-4e56-b6e8-94b09a2243b4 req-c39127e6-9bf3-489e-b3b0-f8547e1b5fc0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:24.559712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-7ace7406-c127-4e56-b6e8-94b09a2243b4 req-c39127e6-9bf3-489e-b3b0-f8547e1b5fc0 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:24.570758 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-7ace7406-c127-4e56-b6e8-94b09a2243b4 req-c39127e6-9bf3-489e-b3b0-f8547e1b5fc0 service nova] Creating event network-changed:279d9116-8a6d-446f-9059-22c65a66a26d for instance 13328878-a11c-4db0-bdb6-3d2dececedf0 on n-h2-860863-4 Nov 02 22:45:24.575827 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-7ace7406-c127-4e56-b6e8-94b09a2243b4 req-c39127e6-9bf3-489e-b3b0-f8547e1b5fc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033736 Nov 02 22:45:24.576738 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3864/7848] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:45:24.693247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:24.702861 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7adb4ee5-86d4-43e3-8609-7abba4cdcac4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1566 microversion: 2.1 time: 0.171649 Nov 02 22:45:24.703864 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3985/7849] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:24 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:45.944381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=9 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:45.945162 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=34 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:45.949369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:45.951605 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:45.959529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:45.966143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:45.966143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:45.966143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:45.966143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:45.966143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:46.011695 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97ac6ead-2634-41f3-b404-fef6f3bc1206 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action" status: 200 len: 24032 microversion: 2.1 time: 0.069633 Nov 02 22:45:46.012329 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3865/7850] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:45:45 2022] POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action => generated 24032 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:45:57.049826 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:57.050450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:57.054419 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=40 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:57.059556 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:57.060059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:57.060517 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:57.061304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:57.061778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:57.062227 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:57.086463 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lazy-loading 'flavor' on Instance uuid 13328878-a11c-4db0-bdb6-3d2dececedf0 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:45:57.304950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-850bea36-69c9-4f79-8ba0-42aed24b7161 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action" status: 202 len: 0 microversion: 2.1 time: 0.259671 Nov 02 22:45:57.305654 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3986/7851] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:45:57 2022] POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:45:57.314487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:57.315202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:57.318227 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:45:57.324012 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:57.324510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:57.324974 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:57.325683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:57.326143 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:57.326576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:57.469821 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:57.479308 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b3acf026-8080-4eb9-b266-bb3a42d12825 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1693 microversion: 2.1 time: 0.169187 Nov 02 22:45:57.480241 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3866/7852] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:57 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:45:58.505316 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:45:58.506088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:58.512303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:58.512809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:58.513301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:58.514012 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:58.514509 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:58.514940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:58.699167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:45:58.707222 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d2cf17f-f188-4ba0-a800-d5d7bba8c1a0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1676 microversion: 2.1 time: 0.207002 Nov 02 22:45:58.707799 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3987/7853] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:45:58 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:45:59.801951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:59.804186 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:59.812156 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:59.812635 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:59.813099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:59.813798 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:59.814247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:59.814673 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:59.867627 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-82a53226-68c6-4c28-83cc-9ae487bed0d5 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action" status: 200 len: 38445 microversion: 2.1 time: 0.069583 Nov 02 22:45:59.868204 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3867/7854] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:45:59 2022] POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action => generated 38445 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:45:59.879988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:45:59.880522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:45:59.887285 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:59.887774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:59.888229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:45:59.888938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:45:59.889414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:45:59.889852 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:00.058068 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a3c4012c-295d-4778-b4ee-b51d22c0a271 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action" status: 202 len: 0 microversion: 2.1 time: 0.181831 Nov 02 22:46:00.058748 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3988/7855] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:45:59 2022] POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:46:00.069618 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:00.070316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:00.077328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:00.077806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:00.078241 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:00.078960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:00.079409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:00.079828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:00.219665 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:00.227870 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4ee12732-82f9-47d1-9557-404234568e16 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1682 microversion: 2.1 time: 0.163683 Nov 02 22:46:00.228444 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3868/7856] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:00 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:01.255057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:01.255727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:01.262200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:01.262702 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:01.263159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:01.263864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:01.264337 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:01.264839 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:01.398352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:01.406320 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3be16a25-58c3-4570-8b80-1d328b3c9fd0 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1682 microversion: 2.1 time: 0.158346 Nov 02 22:46:01.406962 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3989/7857] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:01 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:02.431852 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:02.432463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:02.440683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:02.441369 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:02.441843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:02.442534 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:02.442992 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:02.443463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:02.622023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:02.629803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3763ed66-2eb2-4161-9818-c3fd462a614f tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1685 microversion: 2.1 time: 0.201959 Nov 02 22:46:02.630381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3869/7858] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:02 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1685 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:02.739342 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:02.741732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:02.749090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:02.749591 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:02.750077 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:02.751054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:02.751560 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:02.752019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:02.793796 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9bf82ad1-1756-47c6-a1d5-50c3788f76a4 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action" status: 200 len: 38445 microversion: 2.1 time: 0.059082 Nov 02 22:46:02.794451 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3990/7859] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:46:02 2022] POST /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0/action => generated 38445 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 22:46:03.856403 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:03.856919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:03.872338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:03.873173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:03.873629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:03.874328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:03.874964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:03.875391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:03.906324 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:46:03.914710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c353adb5-326e-4e25-ab9f-c7ccecf62be3 req-3062b3d0-a7f6-4af7-9656-512d9faeca66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13328878-a11c-4db0-bdb6-3d2dececedf0", "tag": "279d9116-8a6d-446f-9059-22c65a66a26d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:03.925230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c353adb5-326e-4e25-ab9f-c7ccecf62be3 req-3062b3d0-a7f6-4af7-9656-512d9faeca66 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:03.925761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c353adb5-326e-4e25-ab9f-c7ccecf62be3 req-3062b3d0-a7f6-4af7-9656-512d9faeca66 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:03.926213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c353adb5-326e-4e25-ab9f-c7ccecf62be3 req-3062b3d0-a7f6-4af7-9656-512d9faeca66 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:03.937150 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c353adb5-326e-4e25-ab9f-c7ccecf62be3 req-3062b3d0-a7f6-4af7-9656-512d9faeca66 service nova] Creating event network-changed:279d9116-8a6d-446f-9059-22c65a66a26d for instance 13328878-a11c-4db0-bdb6-3d2dececedf0 on n-h2-860863-4 Nov 02 22:46:03.942627 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c353adb5-326e-4e25-ab9f-c7ccecf62be3 req-3062b3d0-a7f6-4af7-9656-512d9faeca66 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084231 Nov 02 22:46:03.943231 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3991/7860] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:46:04.231918 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1f22be17-fbc1-424e-bb96-bfdea9110cb2 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 204 len: 0 microversion: 2.1 time: 0.379343 Nov 02 22:46:04.232646 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3870/7861] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:46:03 2022] DELETE /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:46:04.246884 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:04.247712 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:04.255497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:04.256002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:04.256459 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:04.257206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:04.257735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:04.258126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:04.393024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:04.401487 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48334480-be1c-463e-9ca3-0b9052f47039 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1691 microversion: 2.1 time: 0.159523 Nov 02 22:46:04.402067 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3992/7862] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:04 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:05.427040 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:05.427782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:05.434590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:05.435070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:05.435507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:05.436250 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:05.436650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:05.437103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:05.571511 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:05.579674 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0c44ea1c-02b8-4ff0-ac0c-ca6e40b92835 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1691 microversion: 2.1 time: 0.156904 Nov 02 22:46:05.580489 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3871/7863] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:05 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:06.232835 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-be59cca5-63e6-419c-ac87-6b42c245128b req-e1102ccb-b48c-4bbd-9af6-fd2bb32a51f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13328878-a11c-4db0-bdb6-3d2dececedf0", "name": "network-vif-deleted", "tag": "279d9116-8a6d-446f-9059-22c65a66a26d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:06.243926 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be59cca5-63e6-419c-ac87-6b42c245128b req-e1102ccb-b48c-4bbd-9af6-fd2bb32a51f4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:06.246263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be59cca5-63e6-419c-ac87-6b42c245128b req-e1102ccb-b48c-4bbd-9af6-fd2bb32a51f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:06.246263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-be59cca5-63e6-419c-ac87-6b42c245128b req-e1102ccb-b48c-4bbd-9af6-fd2bb32a51f4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:06.255918 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-be59cca5-63e6-419c-ac87-6b42c245128b req-e1102ccb-b48c-4bbd-9af6-fd2bb32a51f4 service nova] Creating event network-vif-deleted:279d9116-8a6d-446f-9059-22c65a66a26d for instance 13328878-a11c-4db0-bdb6-3d2dececedf0 on n-h2-860863-4 Nov 02 22:46:06.260658 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-be59cca5-63e6-419c-ac87-6b42c245128b req-e1102ccb-b48c-4bbd-9af6-fd2bb32a51f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031606 Nov 02 22:46:06.261282 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3993/7864] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:46:06.604597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:06.605253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:06.614305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:06.614305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:06.614305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:06.614305 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:06.614788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:06.615086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:06.651036 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:06.651833 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:06.652273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:06.652918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lazy-loading 'fault' on Instance uuid 13328878-a11c-4db0-bdb6-3d2dececedf0 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:46:06.699312 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f78b1be258b34cf9a765d4a4e99fc287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14742f1d97404d05a7bb8b13ccf2a9bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:06.708059 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-99715a44-644e-4480-bee4-2fdae1277f47 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 200 len: 1357 microversion: 2.1 time: 0.107556 Nov 02 22:46:06.708631 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3872/7865] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:06 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:07.733321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:07.734061 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] [instance: 13328878-a11c-4db0-bdb6-3d2dececedf0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:07.741038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:07.741528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:07.741980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:07.742673 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:07.743133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:07.743575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:07.756983 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] HTTP exception thrown: Instance 13328878-a11c-4db0-bdb6-3d2dececedf0 could not be found. Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Request method failure captured: Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 HTTP/1.1 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYvFPg8A0j1WSSIoKN6gTI98OlETYuXbac-jbhtzSUErHGKPjsHzUjvOFcKK5XIYwbL-ONPaiw7SDgD2hn02FR6EL-lMT0lroh9SdaulZB_YeCZpiqfyGxV0LG_xmDet15RZXCbY7sTXFyVv5f2gNGD10jj4yMYSSpzrh_ux6mYrh0-A Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/14742f1d97404d05a7bb8b13ccf2a9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 14742f1d97404d05a7bb8b13ccf2a9bd Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-602570672 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: f78b1be258b34cf9a765d4a4e99fc287 Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestNetworkAdvancedServerOps-602570672-project Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 13328878-a11c-4db0-bdb6-3d2dececedf0 could not be found. Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '13328878-a11c-4db0-bdb6-3d2dececedf0'} Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13328878-a11c-4db0-bdb6-3d2dececedf0 could not be found. Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13328878-a11c-4db0-bdb6-3d2dececedf0 could not be found. Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:46:07.758596 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13328878-a11c-4db0-bdb6-3d2dececedf0 could not be found. Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Returning 404 to user: Instance 13328878-a11c-4db0-bdb6-3d2dececedf0 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84b93193-1739-49e6-a1a6-966a3b682084 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0" status: 404 len: 111 microversion: 2.1 time: 0.032032 Nov 02 22:46:07.764019 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3994/7866] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:07 2022] GET /compute/v2.1/servers/13328878-a11c-4db0-bdb6-3d2dececedf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:46:11.495919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8e1afb21-10b5-4735-914b-ba173958dce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] Calling method '.version_select at 0x7f9b682ec310>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:11.565594 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8e1afb21-10b5-4735-914b-ba173958dce3 tempest-TestNetworkAdvancedServerOps-602570672 tempest-TestNetworkAdvancedServerOps-602570672-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2126382633" status: 202 len: 0 microversion: 2.1 time: 0.073662 Nov 02 22:46:11.566201 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3873/7867] 10.222.0.25 () {58 vars in 1284 bytes} [Wed Nov 2 22:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2126382633 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:46:26.440836 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=19 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:46:26.441935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:46:26.641164 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ffa70ec-8511-48b1-809e-9a2215b075dd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'create', calling method: .version_select at 0x7f9b6d156040>, body: {"keypair": {"name": "tempest-TestShelveInstance-534600795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHTtpAiaQ09uc/0zBopQxKRE+TsngtYJJvA3n3xmFQe8KsttxKRyiJ1zGdRa1ZnHkptJYbf3d3+rzoWllKfhPwXdfwvWU6WdsXXbp8QJxuV0uYZYNMFZsMvSfHl7SFnog=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:26.665127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9ffa70ec-8511-48b1-809e-9a2215b075dd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:46:26.670397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-9ffa70ec-8511-48b1-809e-9a2215b075dd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for user 871da447558e4fbb92b2f0c5aec946f9 and project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:46:26.743881 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ffa70ec-8511-48b1-809e-9a2215b075dd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.309512 Nov 02 22:46:26.744621 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3995/7868] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:46:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:46:29.055907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:46:29.057417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:46:29.065600 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1261675075", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-534600795", "security_groups": [{"name": "tempest-secgroup-smoke-1326644493"}], "networks": [{"uuid": "68ecbb41-c7fa-4c45-9a3c-3f0eb40c0c21"}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:29.177861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] validate_networks() for [('68ecbb41-c7fa-4c45-9a3c-3f0eb40c0c21', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:46:29.661095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:46:29.661528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:46:29.662001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:46:29.662503 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:46:29.662905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:46:29.677271 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:29.678185 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:29.678778 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:29.679535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:29.679997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:29.680426 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:29.710013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:46:29.716093 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for user 871da447558e4fbb92b2f0c5aec946f9 and project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:46:29.730790 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:46:29.733134 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:46:29.881446 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e4328906-52b9-474e-8418-f8e96068904f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.827244 Nov 02 22:46:29.882218 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3874/7869] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:46:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:46:29.893817 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e525f05-7d79-426b-b505-ab27296937df tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:29.894452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9e525f05-7d79-426b-b505-ab27296937df tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:29.973436 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e525f05-7d79-426b-b505-ab27296937df tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:29.981620 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e525f05-7d79-426b-b505-ab27296937df tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1246 microversion: 2.1 time: 0.091729 Nov 02 22:46:29.982631 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3996/7870] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:29 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:31.007158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:31.007940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:31.014026 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:31.016676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:31.016676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:31.016676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:31.016676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:31.016676 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:31.078274 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:31.086309 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8863068b-b4ae-4d55-844d-f2059698e342 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1250 microversion: 2.1 time: 0.084648 Nov 02 22:46:31.086879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3875/7871] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:31 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:46:32.109231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:32.109867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:32.121231 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:32.121735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:32.122213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:32.122923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:32.123399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:32.123840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:32.190793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:32.199185 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd9fc06f-65b6-409b-999e-52876f7ad4c6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1306 microversion: 2.1 time: 0.093873 Nov 02 22:46:32.208544 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3997/7872] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:32 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:33.224993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:33.227039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:33.237044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:33.238608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:33.239679 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:33.240393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:33.240861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:33.241328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:33.383794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:33.391699 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-faf24006-fda3-4fc0-bfe4-74c6844f7cff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1372 microversion: 2.1 time: 0.173606 Nov 02 22:46:33.392282 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3876/7873] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:33 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:33.763181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b672d946-2bf5-4736-bdf2-9be8ada96cb7 req-47a8fde2-8797-435c-8cd4-096a4e236897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:33.780721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b672d946-2bf5-4736-bdf2-9be8ada96cb7 req-47a8fde2-8797-435c-8cd4-096a4e236897 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:33.781507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b672d946-2bf5-4736-bdf2-9be8ada96cb7 req-47a8fde2-8797-435c-8cd4-096a4e236897 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:33.782162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b672d946-2bf5-4736-bdf2-9be8ada96cb7 req-47a8fde2-8797-435c-8cd4-096a4e236897 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:33.804105 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b672d946-2bf5-4736-bdf2-9be8ada96cb7 req-47a8fde2-8797-435c-8cd4-096a4e236897 service nova] Creating event network-changed:e9d59672-0cfc-4dec-8752-735fb11e0c47 for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d on n-h2-860863-4 Nov 02 22:46:33.810567 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b672d946-2bf5-4736-bdf2-9be8ada96cb7 req-47a8fde2-8797-435c-8cd4-096a4e236897 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051143 Nov 02 22:46:33.811180 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3998/7874] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:46:34.416258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:34.416896 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:34.424182 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:34.424669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:34.425145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:34.425853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:34.426436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:34.426868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:34.569741 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:34.577546 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-380047f2-8ae7-4cb2-b9f1-41f0d5f9520e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1372 microversion: 2.1 time: 0.165365 Nov 02 22:46:34.578120 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3877/7875] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:34 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:35.602441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:35.603184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:35.610268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:35.610764 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:35.611211 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:35.611914 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:35.612388 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:35.612828 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:35.744301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:35.751987 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b05e51b3-ef84-49b5-8502-d79cc135378c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1372 microversion: 2.1 time: 0.153992 Nov 02 22:46:35.752550 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3999/7876] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:35 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:36.775770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:36.780152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:36.782927 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:36.783417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:36.783858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:36.784545 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:36.785024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:36.785559 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:36.928986 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:36.936736 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-974705c1-8b89-4fc5-b069-b36f5efe4ba6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1372 microversion: 2.1 time: 0.165505 Nov 02 22:46:36.937340 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3878/7877] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:36 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:37.961182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:37.961805 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:37.968761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:37.969282 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:37.969733 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:37.970434 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:37.970896 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:37.971335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:38.104532 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:38.112284 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67e9c3be-ef07-4f3f-af46-d1befc019421 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1372 microversion: 2.1 time: 0.155757 Nov 02 22:46:38.112857 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4000/7878] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:37 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:38.346576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-049b5173-3c66-45e5-9295-2a18933bcddc req-5e5214c0-9917-4ddc-ab81-14335a45c82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "name": "network-vif-plugged", "status": "completed", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:38.356231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-049b5173-3c66-45e5-9295-2a18933bcddc req-5e5214c0-9917-4ddc-ab81-14335a45c82d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:38.356720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-049b5173-3c66-45e5-9295-2a18933bcddc req-5e5214c0-9917-4ddc-ab81-14335a45c82d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:38.357301 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-049b5173-3c66-45e5-9295-2a18933bcddc req-5e5214c0-9917-4ddc-ab81-14335a45c82d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:38.370023 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-049b5173-3c66-45e5-9295-2a18933bcddc req-5e5214c0-9917-4ddc-ab81-14335a45c82d service nova] Creating event network-vif-plugged:e9d59672-0cfc-4dec-8752-735fb11e0c47 for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d on n-h2-860863-4 Nov 02 22:46:38.375051 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-049b5173-3c66-45e5-9295-2a18933bcddc req-5e5214c0-9917-4ddc-ab81-14335a45c82d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093558 Nov 02 22:46:38.375879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3879/7879] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:46:39.135432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:39.136053 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:39.142938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:39.143438 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:39.143887 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:39.144612 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:39.145684 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:39.146160 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:39.287506 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:39.295305 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-72a81bc0-387a-46ec-b4a4-ef52a7126276 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1372 microversion: 2.1 time: 0.163918 Nov 02 22:46:39.295878 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4001/7880] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:39 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:40.317703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:46:40.318563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:46:40.324001 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:40.325238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:40.334859 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:40.335355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:40.335796 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:40.336569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:40.337055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:40.337489 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:40.490359 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:40.498089 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c43aaefe-a9b1-4b75-9d21-a5342e68a641 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1556 microversion: 2.1 time: 0.183238 Nov 02 22:46:40.498673 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3880/7881] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:40 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:40.520809 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:46:40.521479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:46:40.523462 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:46:40.529110 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:40.530981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:40.530981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:40.530981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:40.531324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:40.531629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:40.662807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:46:40.670685 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0a03613-ff23-437e-a3f5-dece74d79305 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1556 microversion: 2.1 time: 0.153847 Nov 02 22:46:40.671406 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4002/7882] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:46:40 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:46:42.566087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-b2608921-e227-42c1-96b4-c37b6e896f12 req-b29724be-e06f-4626-846a-20df7443ad53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:46:42.577003 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2608921-e227-42c1-96b4-c37b6e896f12 req-b29724be-e06f-4626-846a-20df7443ad53 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:46:42.577476 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2608921-e227-42c1-96b4-c37b6e896f12 req-b29724be-e06f-4626-846a-20df7443ad53 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:46:42.578108 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-b2608921-e227-42c1-96b4-c37b6e896f12 req-b29724be-e06f-4626-846a-20df7443ad53 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:46:42.590500 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-b2608921-e227-42c1-96b4-c37b6e896f12 req-b29724be-e06f-4626-846a-20df7443ad53 service nova] Creating event network-changed:e9d59672-0cfc-4dec-8752-735fb11e0c47 for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d on n-h2-860863-4 Nov 02 22:46:42.595648 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-b2608921-e227-42c1-96b4-c37b6e896f12 req-b29724be-e06f-4626-846a-20df7443ad53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033351 Nov 02 22:46:42.596254 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3881/7883] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:48:37.650267 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:48:37.650980 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d/action (ip 10.222.0.25) !!! Nov 02 22:48:37.651919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:48:37.652909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=32 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:48:37.657215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:48:37.657767 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:37.672708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:37.672708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:37.672708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:37.672708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:37.672708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:37.672708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:37.692239 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lazy-loading 'flavor' on Instance uuid 42b7bfdf-87e4-4abb-a538-69f229eb068d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:48:38.134858 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-582bc7d5-e8f6-446e-aa71-4514d71ec0bd tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d/action" status: 202 len: 0 microversion: 2.1 time: 0.486609 Nov 02 22:48:38.136105 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4003/7884] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:48:37 2022] POST /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:48:38.142859 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:48:38.143914 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 22:48:38.145201 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:48:38.145345 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d (ip 10.222.0.25) !!! Nov 02 22:48:38.146521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:48:38.147636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=36 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:48:38.152754 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:38.153441 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:38.161931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:38.161931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:38.161931 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:38.162275 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:38.162641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:38.163071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:38.305208 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:38.312227 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-2a69357c-dd90-45d3-b6a5-3815e98fcc73 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.171366 Nov 02 22:48:38.312828 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3882/7885] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:38 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:39.337762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:39.338519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:39.344795 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:39.345328 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:39.345783 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:39.346488 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:39.346958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:39.347401 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:39.487486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:39.495921 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-29337b80-69ad-4746-a115-204e60c14682 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.163849 Nov 02 22:48:39.496503 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4004/7886] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:39 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:40.520940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:40.521557 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:40.530504 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:40.530993 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:40.531439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:40.532136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:40.532594 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:40.533055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:40.539023 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48338. Nov 02 22:48:40.550154 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48340. Nov 02 22:48:40.667517 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:40.675295 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9ba1cc60-2485-49e0-9384-cbb4bca4250b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.158705 Nov 02 22:48:40.675879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3883/7887] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:40 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:41.698706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:41.699343 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:41.706184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:41.706693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:41.707146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:41.707855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:41.708321 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:41.708760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:41.846455 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:41.855101 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe226c5e-42c6-4273-a469-84e2a562ccbf tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.159825 Nov 02 22:48:41.855675 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4005/7888] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:41 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:42.878457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:42.879076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:42.886566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:42.887056 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:42.887502 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:42.888195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:42.888653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:42.889115 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:43.020612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:43.028376 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c13e2f5a-03d4-44da-8415-2c0d1e13257d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.153839 Nov 02 22:48:43.028968 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3884/7889] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:42 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:44.052759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:44.053413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:44.060774 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:44.061294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:44.061745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:44.062444 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:44.062909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:44.063346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:44.197413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:44.205972 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1af4318-28a0-437e-9cbb-5d29ca941ed6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.157088 Nov 02 22:48:44.210035 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4006/7890] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:44 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:45.230218 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:45.230832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:45.237660 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:45.238150 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:45.238593 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:45.239282 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:45.239738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:45.240173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:45.374245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:45.382027 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-133feb4c-76a0-42de-872b-371da3807c00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.156323 Nov 02 22:48:45.382607 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3885/7891] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:45 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:46.405606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:46.406172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:46.413057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:46.413554 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:46.414006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:46.414714 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:46.415184 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:46.415630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:46.549857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:46.558480 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3f9cf8e7-2b3a-4d39-af43-e1ed0bc97711 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.156684 Nov 02 22:48:46.558999 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4007/7892] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:46 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:47.581919 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:47.582563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:47.590005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:47.590576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:47.591016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:47.591703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:47.592152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:47.592576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:47.722394 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:47.730832 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-59f19f19-db18-4386-b2e3-f570ceeb6e44 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.152779 Nov 02 22:48:47.731420 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3886/7893] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:47 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:48.755355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:48.756007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:48.763928 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:48.764494 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:48.764973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:48.765698 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:48.766219 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:48.766664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:48.899895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:48.908497 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fbc7b27b-6925-4ef0-81cd-10e0ecd2a05d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1702 microversion: 2.1 time: 0.157084 Nov 02 22:48:48.909111 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4008/7894] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:48 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:49.934388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:49.934930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:49.941853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:49.942332 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:49.942767 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:49.943450 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:49.943897 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:49.944321 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:50.083212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:50.091620 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6e720b2a-e793-4069-a500-c05f2886d227 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1702 microversion: 2.1 time: 0.162636 Nov 02 22:48:50.092189 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3887/7895] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:49 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1702 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:50.864587 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-eae66484-395f-4bb5-915a-7409c82673aa req-0aaef1a9-fb21-4aa4-9296-1960e70ad5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "name": "network-vif-plugged", "status": "completed", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:48:50.876309 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eae66484-395f-4bb5-915a-7409c82673aa req-0aaef1a9-fb21-4aa4-9296-1960e70ad5cd service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:50.876813 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eae66484-395f-4bb5-915a-7409c82673aa req-0aaef1a9-fb21-4aa4-9296-1960e70ad5cd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:50.877301 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eae66484-395f-4bb5-915a-7409c82673aa req-0aaef1a9-fb21-4aa4-9296-1960e70ad5cd service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:50.890333 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-eae66484-395f-4bb5-915a-7409c82673aa req-0aaef1a9-fb21-4aa4-9296-1960e70ad5cd service nova] Creating event network-vif-plugged:e9d59672-0cfc-4dec-8752-735fb11e0c47 for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d on n-h2-860863-4 Nov 02 22:48:50.895703 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-eae66484-395f-4bb5-915a-7409c82673aa req-0aaef1a9-fb21-4aa4-9296-1960e70ad5cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Nov 02 22:48:50.896349 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4009/7896] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:48:51.115211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:51.115894 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:51.123112 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:51.123607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:51.124055 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:51.124763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:51.125258 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:51.125697 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:51.289229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:51.303498 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4bbcd022-5b97-40c1-813f-c792d2e03a17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.192091 Nov 02 22:48:51.310530 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3888/7897] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:51 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:52.335880 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:52.336716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:52.343856 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:52.344441 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:52.344982 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:52.346250 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:52.347327 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:52.348172 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:52.510984 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:52.520580 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20f83328-7c9d-4155-af72-0f3f7fdd438a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.191605 Nov 02 22:48:52.521768 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4010/7898] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:52 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:53.548608 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:53.549286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:53.565094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:53.565602 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:53.566053 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:53.567019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:53.567491 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:53.567930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:53.727650 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:53.738207 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6042dab3-d50b-4547-ae59-e5367020551c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.193450 Nov 02 22:48:53.738969 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3889/7899] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:53 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:54.764031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:54.765018 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:54.773654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:54.774788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:54.775066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:54.775823 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:54.776479 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:54.776964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:54.935584 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:54.944225 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6f6309e0-e16d-475c-aeb1-9eb219320a9d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.185093 Nov 02 22:48:54.945253 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4011/7900] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:54 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:55.968384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:55.970096 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:55.977577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:55.980507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:55.981069 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:55.981957 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:55.982357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:55.982799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:56.129303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:56.139976 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-9d2f64ad-dc47-4bf4-86bf-e3996cab6dc0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.175510 Nov 02 22:48:56.141853 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3890/7901] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:55 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:57.168971 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:57.169536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:57.178557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:57.178557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:57.178557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:57.180048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:57.180048 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:57.180596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:57.364974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:57.373966 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca2cdbcf-e779-4f19-91fa-ef0a4fa7e37d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.212172 Nov 02 22:48:57.375028 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4012/7902] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:57 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:58.398364 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:58.399883 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:58.407410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:58.408465 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:58.409222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:58.410380 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:58.411245 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:58.411962 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:58.567658 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:58.575788 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-48c01469-feeb-4d38-af42-6b5558cf04f1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.182534 Nov 02 22:48:58.576372 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3891/7903] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:58 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:48:59.600182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:48:59.600959 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:48:59.608643 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:59.609218 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:59.609682 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:59.610745 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:48:59.611221 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:48:59.612964 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:48:59.754097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:48:59.762635 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33a2cdb3-9fdb-476e-bcf2-927843be4281 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.166469 Nov 02 22:48:59.763219 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4013/7904] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:48:59 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:00.787355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:00.788078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:00.795228 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:00.795708 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:00.796146 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:00.796832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:00.797366 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:00.797800 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:00.936597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:00.944476 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-474287c0-feb8-45bb-b0d5-90cbd9018ea6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1697 microversion: 2.1 time: 0.161154 Nov 02 22:49:00.945089 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3892/7905] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:00 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:01.992843 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:02.114528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:02.122665 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8c6f6cf-3edc-4cc2-8820-50ee243c0dc2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1679 microversion: 2.1 time: 0.157357 Nov 02 22:49:02.123275 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4014/7906] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:01 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:03.153239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:03.153789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:03.160774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:03.161304 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:03.161755 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:03.162461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:03.162922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:03.163357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:03.300817 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:03.309587 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cc56a66f-ac65-42f1-a713-b1d451897a16 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1679 microversion: 2.1 time: 0.160516 Nov 02 22:49:03.310167 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3893/7907] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:03 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:04.332579 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:04.333241 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:04.340955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:04.341470 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:04.341935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:04.342669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:04.343125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:04.343572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:04.482987 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:04.490762 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2722903d-edfb-418d-88cf-e98759377d36 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1682 microversion: 2.1 time: 0.162090 Nov 02 22:49:04.491324 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4015/7908] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:04 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:04.514723 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:49:04.515357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:04.522623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:04.522923 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:04.523138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:04.523834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:04.524294 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:04.524726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:04.566221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121039) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 22:49:04.740146 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [762fb0b9-6594-4f4a-bc16-febd293ed956] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:49:04.883858 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d7aa2bfe-d40d-430a-849d-f3a70d97e412 req-dc006cac-6cd5-448e-94d5-38eeeeb08db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "name": "network-vif-unplugged", "status": "completed", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:49:04.894981 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d7aa2bfe-d40d-430a-849d-f3a70d97e412 req-dc006cac-6cd5-448e-94d5-38eeeeb08db9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:04.895474 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d7aa2bfe-d40d-430a-849d-f3a70d97e412 req-dc006cac-6cd5-448e-94d5-38eeeeb08db9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:04.895923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d7aa2bfe-d40d-430a-849d-f3a70d97e412 req-dc006cac-6cd5-448e-94d5-38eeeeb08db9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:04.908534 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.server_external_events [req-d7aa2bfe-d40d-430a-849d-f3a70d97e412 req-dc006cac-6cd5-448e-94d5-38eeeeb08db9 service nova] Unable to find a host for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d. Dropping event network-vif-unplugged {{(pid=121040) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 22:49:04.909461 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d7aa2bfe-d40d-430a-849d-f3a70d97e412 req-dc006cac-6cd5-448e-94d5-38eeeeb08db9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029979 Nov 02 22:49:04.910068 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4016/7909] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 22:49:05.748561 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [762fb0b9-6594-4f4a-bc16-febd293ed956] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48440. Nov 02 22:49:05.752266 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3feb1026-549d-4f9b-87fb-1a3fb8e551f5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d/action" status: 202 len: 0 microversion: 2.1 time: 1.242523 Nov 02 22:49:05.752890 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3894/7910] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:49:04 2022] POST /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d/action => generated 0 bytes in 1244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 22:49:05.761292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:05.762466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:05.769681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:05.770176 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:05.770626 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:05.771335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:05.771935 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:05.772376 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:05.909375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:05.917056 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aae61a36-cf0e-4c2c-8e5e-ab3eb2071a2d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1630 microversion: 2.1 time: 0.159855 Nov 02 22:49:05.917748 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4017/7911] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:05 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:06.941760 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:06.942400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:06.950024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:06.950626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:06.951064 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:06.951751 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:06.952205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:06.952682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:07.087232 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:07.096334 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fb29f3f3-52c5-4b13-8ae1-337bec6c91b1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1630 microversion: 2.1 time: 0.159643 Nov 02 22:49:07.096993 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3895/7912] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:06 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:08.119833 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:08.120458 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:08.123983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=31 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:49:08.128711 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:08.129253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:08.129706 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:08.130557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:08.131030 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:08.131472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:08.134169 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:49:08.272258 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:08.280993 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e703277-9249-43cb-98bb-fe39c8c3f394 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.165059 Nov 02 22:49:08.281689 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4018/7913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:08 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:09.304158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:09.304947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:09.308244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:49:09.313756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:09.314257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:09.314703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:09.315445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:09.315909 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:09.316338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:09.319145 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:49:09.470451 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:09.481484 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dc57b396-f4cf-4f33-aef3-ae5cc3de02c5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.180744 Nov 02 22:49:09.482866 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3896/7914] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:09 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:10.506719 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:10.507347 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:10.515486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:10.516004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:10.516443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:10.517186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:10.517654 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:10.518093 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:10.664811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:10.673266 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef0255f2-2dc9-4013-a33c-c602efb65ee6 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.170925 Nov 02 22:49:10.674065 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4019/7915] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:10 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:11.697530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:11.698183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:11.704858 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:11.705382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:11.705853 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:11.706527 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:11.706977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:11.707661 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:11.859355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:11.867178 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7abe4c1d-7c75-4ce7-9bdd-f21a79890016 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.174014 Nov 02 22:49:11.867770 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3897/7916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:11 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:49:12.892620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:12.893487 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:12.904182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:12.904182 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:12.904775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:12.905547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:12.906024 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:12.906475 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:13.087991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:13.109482 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9fc82395-8e62-44bd-b428-abc3a5b3367f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.220883 Nov 02 22:49:13.110076 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4020/7917] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:12 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:14.137792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:14.138459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:14.146519 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:14.147510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:14.148262 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:14.149383 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:14.150141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:14.150965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:14.304850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:14.313096 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bcb66173-6def-4384-834d-b210a893d2c4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.183581 Nov 02 22:49:14.313668 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3898/7918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:14 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:49:15.338238 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:15.338873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:15.346305 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:15.347345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:15.348356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:15.349551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:15.350574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:15.351531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:15.513493 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:15.521671 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b38ca419-51af-495c-a6d8-18d87082cba2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.187526 Nov 02 22:49:15.527387 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4021/7919] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:15 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:16.547291 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:16.547958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:16.559157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:16.559709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:16.565326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:16.565326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:16.565326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:16.565326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:16.723414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:16.732369 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0aea4ff9-a1db-4e61-977f-bdde43966253 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.189929 Nov 02 22:49:16.733032 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3899/7920] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:16 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:49:17.757988 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:17.758622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:17.766141 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:17.766640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:17.767098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:17.767804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:17.768276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:17.768721 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:17.902536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:17.910478 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a53c917-2a65-4056-bcae-88d70a77c523 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.156397 Nov 02 22:49:17.911047 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4022/7921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:17 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:18.934411 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:18.935049 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:18.941983 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:18.942471 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:18.942914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:18.943603 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:18.944062 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:18.944495 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:19.074743 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:19.082459 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-29153d50-367c-4424-9db5-4785c3a48e2a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.152575 Nov 02 22:49:19.083026 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3900/7922] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:18 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:20.106491 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:20.107125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:20.113967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:20.114469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:20.114923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:20.115633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:20.116103 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:20.116549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:20.249547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:20.257367 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5f310c2-7dfd-4c8e-aee9-5deecb1e9543 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.155380 Nov 02 22:49:20.257944 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4023/7923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:20 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:21.282107 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:21.282717 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:21.289705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:21.290194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:21.290637 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:21.291340 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:21.291799 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:21.292868 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:21.429475 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:21.438228 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-5c296838-27b8-4cf0-90c8-76ba5f66f75f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.159984 Nov 02 22:49:21.442948 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3901/7924] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:21 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:22.462392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:22.463006 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:22.470609 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:22.471109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:22.471566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:22.472276 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:22.472777 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:22.473247 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:22.603101 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:22.611891 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0cde0b7c-d778-49d8-ad58-c6841aa4c18d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.153719 Nov 02 22:49:22.612460 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4024/7925] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:22 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:23.012864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "name": "network-vif-plugged", "status": "completed", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:49:23.023813 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:23.024298 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:23.024738 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:23.036861 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] Creating event network-vif-plugged:e9d59672-0cfc-4dec-8752-735fb11e0c47 for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d on n-h2-860863-4 Nov 02 22:49:23.040437 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] [ae12b499-ba16-4b5c-93b9-3b3d9fd985c4] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:49:23.634403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:23.634929 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:23.642672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:23.643173 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:23.643621 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:23.644322 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:23.644786 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:23.645261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:23.782262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:23.789977 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33050fb8-c404-4fcc-9dcf-983c18d159ef tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.159683 Nov 02 22:49:23.790543 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4025/7926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:23 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:49:24.048445 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] [ae12b499-ba16-4b5c-93b9-3b3d9fd985c4] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48522. Nov 02 22:49:24.051827 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-6ee6b3b5-01c4-4896-a00c-2fe9651f1f19 req-e6cdf304-ab23-4632-aed0-f031d7466d0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043393 Nov 02 22:49:24.052470 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3902/7927] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:49:24.823804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:24.824645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:24.831645 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:24.832148 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:24.832604 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:24.833356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:24.833819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:24.834262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:24.968495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:24.976184 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cbbb1b1b-972f-4b84-82ad-f7ad016f7d21 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.156414 Nov 02 22:49:24.976756 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4026/7928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:24 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:49:26.002233 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:26.002941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:26.010138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:26.010629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:26.011095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:26.011941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:26.012400 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:26.012834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:26.155878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:26.163776 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ab083e88-f1a2-4326-b8e4-3455447edf59 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1688 microversion: 2.1 time: 0.167955 Nov 02 22:49:26.164372 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3903/7929] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:25 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:49:27.188527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:49:27.189137 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:49:27.191331 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 22:49:27.191478 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:49:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d (ip 10.222.0.25) !!! Nov 02 22:49:27.199224 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:27.199753 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:27.200208 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:27.200943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:49:27.201421 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:49:27.201869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:49:27.333500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:49:27.341661 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-59b93575-1d63-44ac-b2a7-3b536d3688ed tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1675 microversion: 2.1 time: 0.157407 Nov 02 22:49:27.342233 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4027/7930] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:49:27 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:50:41.407162 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=19 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:50:41.407932 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=59 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:50:41.416636 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:50:41.417226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:50:41.419912 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=15 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:50:41.420528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=43 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:50:41.426641 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:41.427142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:41.427588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:41.428289 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:41.428749 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:41.429216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:41.458166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:50:41.479553 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7599eff6-3687-45a9-b840-4e0a500581ea req-e78ddc76-1f25-400c-93fc-b37ad384d31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:50:41.489507 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7599eff6-3687-45a9-b840-4e0a500581ea req-e78ddc76-1f25-400c-93fc-b37ad384d31d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:41.490071 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7599eff6-3687-45a9-b840-4e0a500581ea req-e78ddc76-1f25-400c-93fc-b37ad384d31d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:41.490735 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7599eff6-3687-45a9-b840-4e0a500581ea req-e78ddc76-1f25-400c-93fc-b37ad384d31d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:41.503001 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7599eff6-3687-45a9-b840-4e0a500581ea req-e78ddc76-1f25-400c-93fc-b37ad384d31d service nova] Creating event network-changed:e9d59672-0cfc-4dec-8752-735fb11e0c47 for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d on n-h2-860863-4 Nov 02 22:50:41.508476 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7599eff6-3687-45a9-b840-4e0a500581ea req-e78ddc76-1f25-400c-93fc-b37ad384d31d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103233 Nov 02 22:50:41.509099 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4028/7931] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 22:50:41.706416 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c577e9a3-7d4c-42eb-a76d-901d34664872 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "DELETE /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 204 len: 0 microversion: 2.1 time: 0.303213 Nov 02 22:50:41.707382 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3904/7932] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:50:41 2022] DELETE /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:50:41.716758 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:50:41.717544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:50:41.724269 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:41.724788 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:41.726113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:41.727084 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:41.727567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:41.728020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:41.880864 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:50:41.888750 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b262b3b-7706-4b51-bb3a-e5e93fcec0ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.176976 Nov 02 22:50:41.889666 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4029/7933] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:50:41 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:50:42.913273 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:50:42.913980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:50:42.920973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:42.921461 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:42.922065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:42.922756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:42.923212 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:42.923644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:43.061455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:50:43.069655 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-71107066-c45d-4919-82f7-c1856bce374f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1681 microversion: 2.1 time: 0.160653 Nov 02 22:50:43.070457 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3905/7934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:50:42 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:50:43.542952 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-1e743e18-fa6d-488a-96de-fd04a3eb1bf2 req-373d0f5a-8aeb-4a31-accf-61f4c5b16b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b7bfdf-87e4-4abb-a538-69f229eb068d", "name": "network-vif-deleted", "tag": "e9d59672-0cfc-4dec-8752-735fb11e0c47"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:50:43.554009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1e743e18-fa6d-488a-96de-fd04a3eb1bf2 req-373d0f5a-8aeb-4a31-accf-61f4c5b16b0d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:43.554501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1e743e18-fa6d-488a-96de-fd04a3eb1bf2 req-373d0f5a-8aeb-4a31-accf-61f4c5b16b0d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:43.555804 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-1e743e18-fa6d-488a-96de-fd04a3eb1bf2 req-373d0f5a-8aeb-4a31-accf-61f4c5b16b0d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:43.566625 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-1e743e18-fa6d-488a-96de-fd04a3eb1bf2 req-373d0f5a-8aeb-4a31-accf-61f4c5b16b0d service nova] Creating event network-vif-deleted:e9d59672-0cfc-4dec-8752-735fb11e0c47 for instance 42b7bfdf-87e4-4abb-a538-69f229eb068d on n-h2-860863-4 Nov 02 22:50:43.571657 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-1e743e18-fa6d-488a-96de-fd04a3eb1bf2 req-373d0f5a-8aeb-4a31-accf-61f4c5b16b0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Nov 02 22:50:43.573216 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4030/7935] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:50:44.094014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:50:44.094611 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:50:44.101934 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:44.102724 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:44.103166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:44.103848 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:44.104303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:44.104725 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:44.141328 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:44.141822 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:44.142459 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:44.142922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lazy-loading 'fault' on Instance uuid 42b7bfdf-87e4-4abb-a538-69f229eb068d {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:50:44.185619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:50:44.194048 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c66733f7-e0bb-4942-86ac-8ef0e4ce94a5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 200 len: 1336 microversion: 2.1 time: 0.104248 Nov 02 22:50:44.194627 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3906/7936] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:50:44 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:50:45.219092 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:50:45.219811 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 42b7bfdf-87e4-4abb-a538-69f229eb068d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:50:45.226031 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:45.226528 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:45.226983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:45.227686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:50:45.228155 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:50:45.228599 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:50:45.242598 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] HTTP exception thrown: Instance 42b7bfdf-87e4-4abb-a538-69f229eb068d could not be found. Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Request method failure captured: Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d HTTP/1.1 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYvM8I9McGUt0o1OSsUW_g0ER-2uMYJJbHEGbBtYg8PtVLNqLbaude4DPmjcm1T2lAeCmmIOMMaUN_7DLofVMm0K91B8lPvNU6GMX_FeO1XBXqAs7bvAYAPmtF9Py0aRmopg275PrRTBcxtsfQD2mygXGGza1P7e9Egk503Z_T2FRp-c Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 4d9afee6da37498ab5be5a9377b2c0c5 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestShelveInstance-298886942 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestShelveInstance-298886942 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 4d9afee6da37498ab5be5a9377b2c0c5 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestShelveInstance-298886942 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestShelveInstance-298886942-project Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 871da447558e4fbb92b2f0c5aec946f9 Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestShelveInstance-298886942-project Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 42b7bfdf-87e4-4abb-a538-69f229eb068d could not be found. Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '42b7bfdf-87e4-4abb-a538-69f229eb068d'} Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b7bfdf-87e4-4abb-a538-69f229eb068d could not be found. Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b7bfdf-87e4-4abb-a538-69f229eb068d could not be found. Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:50:45.244230 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b7bfdf-87e4-4abb-a538-69f229eb068d could not be found. Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Returning 404 to user: Instance 42b7bfdf-87e4-4abb-a538-69f229eb068d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f193073-0504-46f5-8053-28c852b24e0e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d" status: 404 len: 111 microversion: 2.1 time: 0.031790 Nov 02 22:50:45.250370 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4031/7937] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:50:45 2022] GET /compute/v2.1/servers/42b7bfdf-87e4-4abb-a538-69f229eb068d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 22:50:45.447633 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e7a8f6ac-aa07-4865-97d0-bb556acbe7ca tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '.version_select at 0x7f9b638a6ee0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:50:45.527538 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e7a8f6ac-aa07-4865-97d0-bb556acbe7ca tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-534600795" status: 202 len: 0 microversion: 2.1 time: 0.083755 Nov 02 22:50:45.528237 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3907/7938] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Nov 2 22:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-534600795 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:50:45.554549 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c5a7eb8-ead9-44bc-b6de-74b7ca4cc43b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'create', calling method: .version_select at 0x7f9b6d1103a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1366133440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZS69Ybn7xUKKBOvSc9QATlLm0FonJtn8VuYj96CucTLlKmHkpD6o+jkZI1WjoSPujd/6rAvUZUxkYXBrG7uhn1RfdaPHEeVZGp5o+klACvNqodqcODFLFeod4ASj8osg=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:50:45.571589 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-1c5a7eb8-ead9-44bc-b6de-74b7ca4cc43b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:50:45.576722 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-1c5a7eb8-ead9-44bc-b6de-74b7ca4cc43b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for user 871da447558e4fbb92b2f0c5aec946f9 and project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:50:45.655152 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c5a7eb8-ead9-44bc-b6de-74b7ca4cc43b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.105530 Nov 02 22:50:45.655763 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4032/7939] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:50:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:51:09.835283 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-437705686", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1366133440", "security_groups": [{"name": "tempest-secgroup-smoke-386578012"}], "networks": [{"uuid": "68ecbb41-c7fa-4c45-9a3c-3f0eb40c0c21"}], "block_device_mapping_v2": [{"uuid": "2a7680a8-a1e2-4e80-baf1-066c2ed10018", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:51:09.847325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:09.847985 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:10.136576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.network.neutron [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] validate_networks() for [('68ecbb41-c7fa-4c45-9a3c-3f0eb40c0c21', None, None, None, None, None)] {{(pid=121039) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:51:10.505352 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Flavor limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:51:10.506729 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Image limits 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:51:10.507222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Flavor pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:51:10.507639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Image pref 0:0:0 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:51:10.508058 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.virt.hardware [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121039) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:51:10.517436 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:10.517982 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:10.518432 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:10.519196 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:10.519655 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:10.520205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:10.539956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:51:10.545277 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Getting quotas for user 871da447558e4fbb92b2f0c5aec946f9 and project 4d9afee6da37498ab5be5a9377b2c0c5. Resources: {'cores', 'ram', 'instances'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:51:10.604747 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Going to run 1 instances... {{(pid=121039) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:51:10.606900 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a7680a8-a1e2-4e80-baf1-066c2ed10018',volume_size=None,volume_type=None)] {{(pid=121039) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:51:10.991121 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e378d64a-eaa1-4881-915b-7f3256fab31f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.160435 Nov 02 22:51:10.992017 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3908/7940] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:51:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:51:11.000945 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:11.001755 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:11.002397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:11.008356 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ada8dbdd-1e1f-43bd-ba1b-d44061a74980 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:11.009097 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ada8dbdd-1e1f-43bd-ba1b-d44061a74980 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:11.123298 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ada8dbdd-1e1f-43bd-ba1b-d44061a74980 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:11.130299 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ada8dbdd-1e1f-43bd-ba1b-d44061a74980 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1088 microversion: 2.1 time: 0.131192 Nov 02 22:51:11.131400 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4033/7941] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:10 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1088 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:12.153253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:12.153878 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:12.161595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:12.162597 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:12.163061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:12.164099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:12.165653 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:12.167556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:12.234166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:12.242867 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-899a920d-5ebd-4751-bdf2-296d2896f066 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1130 microversion: 2.1 time: 0.093508 Nov 02 22:51:12.243454 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3909/7942] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:12 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1130 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:13.265806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:13.267000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:13.275378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:13.278098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:13.278098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:13.278098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:13.278098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:13.278098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:13.344105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:13.352377 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-393b1b26-47fa-4633-a61d-f798fddf04f8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1204 microversion: 2.1 time: 0.090268 Nov 02 22:51:13.356230 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4034/7943] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:13 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:14.375947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:14.376568 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:14.384152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:14.384889 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:14.385365 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:14.386076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:14.386539 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:14.386973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:14.530025 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:14.542034 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4d2ba09b-293d-4618-8c2e-262cbcf079b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1271 microversion: 2.1 time: 0.169779 Nov 02 22:51:14.549833 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3910/7944] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:14 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:15.181863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-389fdb05-6fd5-4783-995e-7a37337ae685 req-ee88896c-38e5-4d3e-a077-5ecd2f61d269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:51:15.192482 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-389fdb05-6fd5-4783-995e-7a37337ae685 req-ee88896c-38e5-4d3e-a077-5ecd2f61d269 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:15.194291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-389fdb05-6fd5-4783-995e-7a37337ae685 req-ee88896c-38e5-4d3e-a077-5ecd2f61d269 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:15.194291 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-389fdb05-6fd5-4783-995e-7a37337ae685 req-ee88896c-38e5-4d3e-a077-5ecd2f61d269 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:15.205746 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-389fdb05-6fd5-4783-995e-7a37337ae685 req-ee88896c-38e5-4d3e-a077-5ecd2f61d269 service nova] Creating event network-changed:d5c99122-6e43-4540-8778-eb37a72a3674 for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 on n-h1-860863-4 Nov 02 22:51:15.211630 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-389fdb05-6fd5-4783-995e-7a37337ae685 req-ee88896c-38e5-4d3e-a077-5ecd2f61d269 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101040 Nov 02 22:51:15.212651 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4035/7945] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:51:15.565272 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:15.565895 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:15.574204 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:15.574704 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:15.575152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:15.575863 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:15.576355 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:15.576788 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:15.719221 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:15.727841 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0e44b449-1c75-40c7-9968-3a1c19e44f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1271 microversion: 2.1 time: 0.166494 Nov 02 22:51:15.728421 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3911/7946] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:15 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:16.752658 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:16.753460 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:16.759787 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:16.760292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:16.760776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:16.761543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:16.762016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:16.762457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:16.896081 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:16.905901 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6bff5bf8-3c87-4f09-8892-80f6f78436b0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1271 microversion: 2.1 time: 0.158261 Nov 02 22:51:16.906603 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4036/7947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:16 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:17.930072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:17.930702 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:17.940190 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:17.940906 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:17.941381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:17.946389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:17.946943 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:17.947389 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:18.111318 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:18.120303 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d5018d3c-7f2b-46b7-a15e-16b0022b191e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1271 microversion: 2.1 time: 0.194686 Nov 02 22:51:18.120887 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3912/7948] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:17 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:19.143865 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:19.144546 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:19.151374 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:19.151871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:19.152320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:19.153040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:19.153503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:19.153940 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:19.284960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:19.292906 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d08d525-eae1-45e2-8ad0-fa7d938dd304 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.153026 Nov 02 22:51:19.293500 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4037/7949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:19 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:20.316454 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:20.317097 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:20.323945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:20.324429 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:20.324867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:20.325583 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:20.326038 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:20.326466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:20.464654 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:20.472404 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e73a0316-c293-44c3-b391-a819464e5284 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.159876 Nov 02 22:51:20.473008 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3913/7950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:20 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:21.495196 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:21.495821 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:21.498694 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:21.503486 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:21.505704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:21.505704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:21.505704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:21.505704 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:21.506290 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:21.640991 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:21.649767 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ade92d6-03ae-4fa9-9af1-4ccc0d4e1646 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.158470 Nov 02 22:51:21.650367 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4038/7951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:21 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:22.674029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:22.674599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:22.676409 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:22.677094 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:51:22.683592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:22.684072 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:22.684507 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:22.685260 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:22.685709 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:22.686131 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:22.820951 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:22.828596 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19ae5760-c658-4b0d-8e2a-7d8726aa3d05 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.158655 Nov 02 22:51:22.829191 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3914/7952] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:22 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:23.852980 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:23.853606 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:23.860397 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:23.860885 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:23.861362 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:23.862058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:23.862520 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:23.862958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:24.002597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:24.010942 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a3e3016d-4655-4843-8df5-293a1761931a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.162561 Nov 02 22:51:24.011514 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4039/7953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:23 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:25.034194 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:25.034750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:25.042278 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:25.042766 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:25.043211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:25.043905 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:25.044363 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:25.044804 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:25.174617 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:25.183002 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-6842b4e8-238d-4d44-ad09-3b2e22107fcc tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.152835 Nov 02 22:51:25.183579 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3915/7954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:25 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:51:26.206450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:26.207195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:26.215152 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:26.215644 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:26.216094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:26.216792 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:26.217283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:26.217723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:26.354185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:26.362269 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-930496ff-a8ec-4098-8901-a44ccd94c630 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.159816 Nov 02 22:51:26.362850 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4040/7955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:26 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:27.432758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:27.433408 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:27.439415 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:27.439901 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:27.440342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:27.441077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:27.441535 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:27.441965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:27.571137 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:27.579006 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b1f5ba5d-83c7-475d-9dfd-ba2c2786e919 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.197467 Nov 02 22:51:27.579599 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3916/7956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:27 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:28.604310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:28.604951 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:28.612002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:28.612510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:28.612993 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:28.613709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:28.614186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:28.614627 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:28.749411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:28.758018 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db0d2004-0d32-47c1-b6d4-7506b6eb5da9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.159015 Nov 02 22:51:28.758632 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4041/7957] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:28 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:29.781576 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:29.782207 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:29.789183 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:29.789674 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:29.790119 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:29.790809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:29.791266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:29.791698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:29.928195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:29.936553 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1a9ad464-1e77-4cf7-bb23-78170fa1e12b tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.158922 Nov 02 22:51:29.937159 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3917/7958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:29 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:30.372256 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c61cbd4c-ec13-44a7-bba6-930328c0e64b req-25045d59-9db2-4def-b841-1fc3dd1ef91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "name": "network-vif-plugged", "status": "completed", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:51:30.383396 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c61cbd4c-ec13-44a7-bba6-930328c0e64b req-25045d59-9db2-4def-b841-1fc3dd1ef91b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:30.383894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c61cbd4c-ec13-44a7-bba6-930328c0e64b req-25045d59-9db2-4def-b841-1fc3dd1ef91b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:30.384345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c61cbd4c-ec13-44a7-bba6-930328c0e64b req-25045d59-9db2-4def-b841-1fc3dd1ef91b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:30.395436 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c61cbd4c-ec13-44a7-bba6-930328c0e64b req-25045d59-9db2-4def-b841-1fc3dd1ef91b service nova] Creating event network-vif-plugged:d5c99122-6e43-4540-8778-eb37a72a3674 for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 on n-h1-860863-4 Nov 02 22:51:30.400545 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c61cbd4c-ec13-44a7-bba6-930328c0e64b req-25045d59-9db2-4def-b841-1fc3dd1ef91b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032149 Nov 02 22:51:30.401417 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4042/7959] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:51:30.959613 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:30.961024 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:30.968061 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:30.968541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:30.968997 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:30.969682 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:30.970161 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:30.970585 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:31.107809 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:31.115723 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-910320f7-6c13-4d4e-9694-30e6720252eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1259 microversion: 2.1 time: 0.159907 Nov 02 22:51:31.116305 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3918/7960] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:30 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:32.140631 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:32.141390 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:32.147630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:32.148283 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:32.148742 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:32.149481 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:32.149957 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:32.150403 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:32.285185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:32.293507 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-468b83eb-0637-4ac6-a98e-35909fe1af83 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1443 microversion: 2.1 time: 0.158158 Nov 02 22:51:32.294086 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4043/7961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:32 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:32.316051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:51:32.316663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:51:32.323493 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:32.324006 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:32.324445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:32.325173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:32.325626 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:32.326057 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:32.461666 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:51:32.469660 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a31e8be5-98ec-45b9-85b2-63a57bbf2787 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1443 microversion: 2.1 time: 0.157442 Nov 02 22:51:32.470240 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3919/7962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:51:32 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:51:34.371566 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fca9fb59-5617-44e0-be01-b3e41790b9ea req-38cf7be4-adbd-4710-b7f0-a46c95e85326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:51:34.383214 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fca9fb59-5617-44e0-be01-b3e41790b9ea req-38cf7be4-adbd-4710-b7f0-a46c95e85326 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:51:34.384127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fca9fb59-5617-44e0-be01-b3e41790b9ea req-38cf7be4-adbd-4710-b7f0-a46c95e85326 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:51:34.384759 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fca9fb59-5617-44e0-be01-b3e41790b9ea req-38cf7be4-adbd-4710-b7f0-a46c95e85326 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:51:34.396715 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fca9fb59-5617-44e0-be01-b3e41790b9ea req-38cf7be4-adbd-4710-b7f0-a46c95e85326 service nova] Creating event network-changed:d5c99122-6e43-4540-8778-eb37a72a3674 for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 on n-h1-860863-4 Nov 02 22:51:34.402455 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fca9fb59-5617-44e0-be01-b3e41790b9ea req-38cf7be4-adbd-4710-b7f0-a46c95e85326 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034747 Nov 02 22:51:34.403457 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4044/7963] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:54:01.858069 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 22:54:01.859006 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 22:54:01.859715 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:54:01.859857 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:54:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871/action (ip 10.222.0.25) !!! Nov 02 22:54:01.860889 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 22:54:01.861653 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:54:01.861803 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:54:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871/action (ip 10.222.0.25) !!! Nov 02 22:54:01.862582 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:01.863334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=68 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:01.868047 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:54:01.868584 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:01.877159 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:01.877644 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:01.878088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:01.878782 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:01.879240 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:01.879669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:01.904455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lazy-loading 'flavor' on Instance uuid 8cc08b8e-3822-407f-a5ad-75cbfc780871 {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:54:02.179610 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cd6aee37-f871-40dc-9fe0-0d15bbe1ffa1 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871/action" status: 202 len: 0 microversion: 2.1 time: 0.324005 Nov 02 22:54:02.180142 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3920/7964] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:54:01 2022] POST /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:54:02.186705 n-d-860863-4 devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:54:02.187530 n-d-860863-4 devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5fc7833-b4b4-43fd-a1c3-e65a3dcf6a0f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:54:02.188190 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 22:54:02.188392 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:54:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 (ip 10.222.0.25) !!! Nov 02 22:54:02.190122 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:54:02.190266 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:54:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 (ip 10.222.0.25) !!! Nov 02 22:54:02.191392 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:54:02.191529 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:54:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 (ip 10.222.0.25) !!! Nov 02 22:54:02.192965 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=26 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:02.193734 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=54 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:02.199461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:02.200903 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:02.219138 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:02.219642 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:02.220089 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:02.220806 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:02.228551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:02.228551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:02.360942 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:02.368821 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecc0cbd4-3965-4a90-9a99-3731620f3c3a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.184070 Nov 02 22:54:02.369442 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4045/7965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:02 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:03.395013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:03.395735 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:03.405090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:03.405578 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:03.406019 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:03.406710 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:03.407168 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:03.407595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:03.411902 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48896. Nov 02 22:54:03.412700 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48894. Nov 02 22:54:03.549623 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:03.558020 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0eb20a2f-bad1-4f6b-89dd-f7268be9c570 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.168173 Nov 02 22:54:03.558310 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3921/7966] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:03 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:54:04.581359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:04.582026 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:04.592323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:04.592863 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:04.593346 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:04.594064 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:04.594559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:04.595003 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:04.602096 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5fc7833-b4b4-43fd-a1c3-e65a3dcf6a0f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48902. Nov 02 22:54:04.602832 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 48900. Nov 02 22:54:04.729040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:04.737780 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ec82698-d028-4638-9648-1e514ffc7a51 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.160626 Nov 02 22:54:04.738367 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4046/7967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:04 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:05.760620 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:05.761329 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:05.768683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:05.769205 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:05.769646 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:05.770326 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:05.770775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:05.771200 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:05.900914 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:05.909129 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bbcc78c9-9d0b-446f-a5d4-6f6ec2de3e00 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.152308 Nov 02 22:54:05.909710 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3922/7968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:05 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:06.932678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:06.933348 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:06.940678 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:06.941217 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:06.941732 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:06.942443 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:06.942915 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:06.943364 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:07.080690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:07.088775 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6896263d-8a9f-4e94-86a8-6747b0ae7c84 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.159987 Nov 02 22:54:07.089384 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4047/7969] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:06 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:08.112439 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:08.113032 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:08.119837 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:08.120319 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:08.120758 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:08.121469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:08.122095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:08.122564 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:08.253556 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:08.261318 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-856268b9-a7f6-4f28-aebd-6c5ebfd774a3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.152857 Nov 02 22:54:08.261889 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3923/7970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:08 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:09.285210 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:09.285816 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:09.292595 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:09.293129 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:09.294195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:09.294930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:09.295399 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:09.295838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:09.428789 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:09.436575 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b801c4b-702d-40dc-a144-0cdc03b90a3e tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.155503 Nov 02 22:54:09.437177 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4048/7971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:09 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:10.459774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:10.460374 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:10.468179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:10.468663 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:10.469215 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:10.469902 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:10.470354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:10.470784 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:10.602222 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:10.610429 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-e5f843f4-aa8e-4724-aa11-848b4434954f tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.154565 Nov 02 22:54:10.611010 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3924/7972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:10 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:11.633575 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:11.634213 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:11.641125 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:11.641629 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:11.642087 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:11.642796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:11.643274 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:11.643724 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:11.771943 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:11.780371 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-120a6a91-cfa7-4f67-908d-4391d4fcfc42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.150729 Nov 02 22:54:11.780951 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4049/7973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:11 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:12.803812 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:12.804414 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:12.812247 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:12.812745 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:12.813226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:12.813924 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:12.814381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:12.814810 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:12.953588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:12.961268 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-67eb0cbb-bc3a-4af2-ab6c-0220ffa2d6c7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.161427 Nov 02 22:54:12.961845 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3925/7974] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:12 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:13.986449 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:13.987079 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:13.993983 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:13.994480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:13.994930 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:13.995894 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:13.996359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:13.996800 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:14.127638 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:14.135416 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff9b89c9-c6aa-4b45-8583-a15d258cdac4 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.153718 Nov 02 22:54:14.135983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4050/7975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:13 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:15.159335 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:15.160092 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:15.167167 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:15.167656 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:15.168095 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:15.168792 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:15.169280 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:15.169706 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:15.309153 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:15.317753 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-01d976f2-7296-496e-bf36-873fbdde08eb tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.162364 Nov 02 22:54:15.318339 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3926/7976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:15 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:16.341855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:16.342974 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:16.349999 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:16.350500 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:16.350954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:16.351661 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:16.352130 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:16.352574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:16.489628 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:16.497455 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aea2c8cd-97d0-40e7-bdfc-6ab208ef2f64 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.159776 Nov 02 22:54:16.498046 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4051/7977] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:16 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:17.521470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:17.522043 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:17.529323 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:17.534939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:17.534939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:17.534939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:17.534939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:17.534939 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:17.667211 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:17.676438 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3b4cbc32-e325-4941-928b-db8ef0e94d17 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1568 microversion: 2.1 time: 0.158393 Nov 02 22:54:17.681578 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3927/7978] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:17 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:17.699503 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:54:17.700126 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:17.707878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:17.708400 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:17.708862 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:17.715619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:17.715619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:17.715619 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:17.794766 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121040) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 22:54:18.090426 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19558bca-c98d-4105-9894-412781f2f6d9 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "POST /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871/action" status: 202 len: 0 microversion: 2.1 time: 0.394808 Nov 02 22:54:18.091052 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4052/7979] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:54:17 2022] POST /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:54:18.100257 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:18.100996 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:18.107530 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:18.108726 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:18.109342 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:18.110054 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:18.110512 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:18.110946 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:18.253066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:18.260912 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a103d9d2-e946-459d-81df-a8a270c0a5e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1516 microversion: 2.1 time: 0.164538 Nov 02 22:54:18.261602 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3928/7980] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:18 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:19.052319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6b33b87b-4b62-4d50-b7bb-88c6c48daf5c req-6ff9d9e2-7621-4ca1-8624-fdea0cf5c8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "name": "network-vif-unplugged", "status": "completed", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:54:19.062841 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6b33b87b-4b62-4d50-b7bb-88c6c48daf5c req-6ff9d9e2-7621-4ca1-8624-fdea0cf5c8cc service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:19.063324 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6b33b87b-4b62-4d50-b7bb-88c6c48daf5c req-6ff9d9e2-7621-4ca1-8624-fdea0cf5c8cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:19.063768 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6b33b87b-4b62-4d50-b7bb-88c6c48daf5c req-6ff9d9e2-7621-4ca1-8624-fdea0cf5c8cc service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:19.074106 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.compute.server_external_events [req-6b33b87b-4b62-4d50-b7bb-88c6c48daf5c req-6ff9d9e2-7621-4ca1-8624-fdea0cf5c8cc service nova] Unable to find a host for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871. Dropping event network-vif-unplugged {{(pid=121040) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 22:54:19.074993 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6b33b87b-4b62-4d50-b7bb-88c6c48daf5c req-6ff9d9e2-7621-4ca1-8624-fdea0cf5c8cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077428 Nov 02 22:54:19.075721 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4053/7981] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 22:54:19.285892 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:19.286595 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:19.293781 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:19.294295 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:19.294945 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:19.295705 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:19.296181 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:19.296640 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:19.437213 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:19.445205 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3a31f76c-2e26-42c3-84a8-cc4b3c052e42 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1518 microversion: 2.1 time: 0.163239 Nov 02 22:54:19.445791 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3929/7982] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:19 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:20.470143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:20.471420 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:20.478375 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:20.478871 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:20.479323 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:20.480028 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:20.480497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:20.481016 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:20.613464 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:20.621464 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-22f7ac42-89a0-4509-b1e5-34a28f31f3d8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1518 microversion: 2.1 time: 0.155693 Nov 02 22:54:20.622041 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4054/7983] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:20 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:21.645768 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:21.646401 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:21.653850 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:21.654338 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:21.654780 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:21.656070 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:21.656563 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:21.657029 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:21.800770 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:21.808848 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a498099a-2cbd-488a-958c-84cdd276fac5 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1518 microversion: 2.1 time: 0.167243 Nov 02 22:54:21.809460 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3930/7984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:21 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:22.832113 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:22.832744 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:22.839891 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:22.840432 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:22.840973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:22.841948 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:22.842411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:22.843004 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:22.984117 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:22.992388 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-036cf1af-72d5-4127-ad6d-f8f1cdcde0c8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1518 microversion: 2.1 time: 0.164296 Nov 02 22:54:22.992982 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4055/7985] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:22 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:24.016195 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:24.016841 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:24.024120 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:24.024612 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:24.025080 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:24.025791 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:24.026244 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:24.026672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:24.162268 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:24.170024 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-32b47357-9b6b-4669-a7f6-313fea36b450 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1518 microversion: 2.1 time: 0.158179 Nov 02 22:54:24.170604 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3931/7986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:24 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:25.196015 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:25.196574 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:25.203664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:25.204159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:25.204614 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:25.205349 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:25.205819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:25.206263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:25.345050 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:25.353283 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20dea688-dda8-4995-b308-b67dec16851d tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.161272 Nov 02 22:54:25.353900 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4056/7987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:25 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:26.202253 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ffc12e17-a4dd-4f66-83c1-b9ea9d5756c1 req-9a6e3fe7-8acc-4518-bd03-fd8b26c930b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:54:26.214619 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ffc12e17-a4dd-4f66-83c1-b9ea9d5756c1 req-9a6e3fe7-8acc-4518-bd03-fd8b26c930b5 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:26.215103 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ffc12e17-a4dd-4f66-83c1-b9ea9d5756c1 req-9a6e3fe7-8acc-4518-bd03-fd8b26c930b5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:26.215541 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ffc12e17-a4dd-4f66-83c1-b9ea9d5756c1 req-9a6e3fe7-8acc-4518-bd03-fd8b26c930b5 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:26.230330 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ffc12e17-a4dd-4f66-83c1-b9ea9d5756c1 req-9a6e3fe7-8acc-4518-bd03-fd8b26c930b5 service nova] Creating event network-changed:d5c99122-6e43-4540-8778-eb37a72a3674 for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 on n-h2-860863-4 Nov 02 22:54:26.235610 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ffc12e17-a4dd-4f66-83c1-b9ea9d5756c1 req-9a6e3fe7-8acc-4518-bd03-fd8b26c930b5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037133 Nov 02 22:54:26.236225 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3932/7988] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:54:26.378102 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:26.378840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:26.386183 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:26.386692 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:26.387165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:26.387910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:26.388664 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:26.389144 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:26.532499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:26.541043 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1a086486-8399-4bd4-ae28-0f54a9af9f8a tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.167394 Nov 02 22:54:26.541713 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4057/7989] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:26 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:27.565787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:27.566501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:27.572861 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:27.577750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:27.577750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:27.577750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:27.577750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:27.577750 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:27.720410 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:27.728452 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f0b830f8-52e9-45fc-b3bb-948b3b7574ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.168503 Nov 02 22:54:27.729057 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3933/7990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:27 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:28.752622 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:28.753232 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:28.760159 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:28.760659 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:28.761149 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:28.761857 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:28.762360 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:28.762807 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:28.904501 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:28.913058 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9e50f6f8-24e6-4d60-86ac-d78e3377a881 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.165216 Nov 02 22:54:28.922909 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4058/7991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:28 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:29.937417 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:29.938039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:29.945076 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:29.945565 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:29.946009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:29.946700 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:29.947157 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:29.947591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:30.078873 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:30.086798 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-f3383165-4a3f-4b05-a539-8fcaec51a67c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.153338 Nov 02 22:54:30.087377 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3934/7992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:29 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:31.110699 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:31.111359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:31.118194 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:31.118686 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:31.119134 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:31.119829 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:31.120325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:31.120761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:31.253708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:31.261335 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3edcb6d-2e3d-460b-ad89-591da497756c tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.154563 Nov 02 22:54:31.261904 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4059/7993] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:31 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:32.285357 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:32.285942 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:32.288703 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=31 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:32.293457 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:32.293940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:32.294382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:32.295071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:32.295525 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:32.295958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:32.298569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:32.428179 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:32.435833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a43fff94-20a4-4bb6-8468-f4f052eaf6e7 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.154539 Nov 02 22:54:32.436408 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3935/7994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:32 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:33.459601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:33.460229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:33.463559 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:33.475057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:33.475057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:33.475057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:33.475057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:33.475057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:33.475057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:33.475057 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:54:33.609098 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:33.617214 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2874866a-68a1-4a02-a666-00f90d6ba0db tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.161535 Nov 02 22:54:33.617798 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4060/7995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:33 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:34.642202 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:34.642835 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:34.649550 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:34.650002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:34.650437 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:34.651117 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:34.651567 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:34.651990 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:34.781683 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:34.789519 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-37f13cf7-1422-45f4-8889-220238b769b3 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.151547 Nov 02 22:54:34.790304 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3936/7996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:34 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:35.813264 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:35.813873 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:35.820252 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:35.820743 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:35.821215 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:35.821909 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:35.822372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:35.822814 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:35.951989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:35.960990 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7377bb8d-bc5b-4eca-b658-29aaf9deebaa tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.152364 Nov 02 22:54:35.961573 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4061/7997] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:35 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:36.985358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:36.985972 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:36.992815 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:36.993404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:36.993849 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:36.994540 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:36.994995 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:36.995427 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:37.128078 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:37.135926 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-b34feb9a-aa02-4999-b201-11664f3c5f04 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.154562 Nov 02 22:54:37.136511 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3937/7998] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:36 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:38.160387 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:38.162810 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:38.168070 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:38.168580 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:38.169066 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:38.169790 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:38.170261 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:38.170709 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:38.305630 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:38.314813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8d686c5-aa99-4bb5-94fe-72661761e798 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.158459 Nov 02 22:54:38.315777 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4062/7999] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:38 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:38.395966 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-2afa3877-de0a-4909-9090-7d764b4b7263 req-635946d0-d0b7-4604-8630-260a84cf0dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "name": "network-vif-plugged", "status": "completed", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:54:38.406647 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2afa3877-de0a-4909-9090-7d764b4b7263 req-635946d0-d0b7-4604-8630-260a84cf0dbe service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:38.408588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2afa3877-de0a-4909-9090-7d764b4b7263 req-635946d0-d0b7-4604-8630-260a84cf0dbe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:38.408588 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-2afa3877-de0a-4909-9090-7d764b4b7263 req-635946d0-d0b7-4604-8630-260a84cf0dbe service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:38.418833 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-2afa3877-de0a-4909-9090-7d764b4b7263 req-635946d0-d0b7-4604-8630-260a84cf0dbe service nova] Creating event network-vif-plugged:d5c99122-6e43-4540-8778-eb37a72a3674 for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 on n-h2-860863-4 Nov 02 22:54:38.424744 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-2afa3877-de0a-4909-9090-7d764b4b7263 req-635946d0-d0b7-4604-8630-260a84cf0dbe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Nov 02 22:54:38.425358 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3938/8000] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:54:39.338913 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:39.339539 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:39.346752 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:39.347245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:39.347696 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:39.348394 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:39.348859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:39.349325 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:39.817662 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:39.825618 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-44cfdc62-69dd-49ea-9b49-b23da1335453 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1574 microversion: 2.1 time: 0.490650 Nov 02 22:54:39.826738 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4063/8001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:39 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1574 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:54:40.850971 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:54:40.851763 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:54:40.857838 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:40.858316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:40.859362 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:40.860071 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:54:40.860521 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:54:40.860965 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:54:40.994066 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:54:41.002584 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-7cb7d95d-94da-4d03-80b3-6a15f03c94e2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1561 microversion: 2.1 time: 0.156769 Nov 02 22:54:41.003172 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3939/8002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:54:40 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:18.054670 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:56:18.057531 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 22:56:18.057531 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=9 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:18.057746 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=7 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:18.058336 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=25 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:18.058715 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=23 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:18.064248 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:18.064765 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:18.075832 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:18.076338 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:18.076791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:18.077547 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:18.078022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:18.078465 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:18.111206 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 22:56:18.128088 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-05acc106-116d-4097-9237-b9c3d6ab2062 req-695baef8-d228-4b4e-abf9-a4d72f96c993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:56:18.141087 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-05acc106-116d-4097-9237-b9c3d6ab2062 req-695baef8-d228-4b4e-abf9-a4d72f96c993 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:18.141736 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-05acc106-116d-4097-9237-b9c3d6ab2062 req-695baef8-d228-4b4e-abf9-a4d72f96c993 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:18.143806 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-05acc106-116d-4097-9237-b9c3d6ab2062 req-695baef8-d228-4b4e-abf9-a4d72f96c993 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:18.160570 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-05acc106-116d-4097-9237-b9c3d6ab2062 req-695baef8-d228-4b4e-abf9-a4d72f96c993 service nova] Creating event network-changed:d5c99122-6e43-4540-8778-eb37a72a3674 for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 on n-h2-860863-4 Nov 02 22:56:18.165840 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-05acc106-116d-4097-9237-b9c3d6ab2062 req-695baef8-d228-4b4e-abf9-a4d72f96c993 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113202 Nov 02 22:56:18.166450 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3940/8003] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:56:18.361814 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4936d884-95a7-4746-b9cd-22225a6f00e8 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 204 len: 0 microversion: 2.1 time: 0.312201 Nov 02 22:56:18.362638 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4064/8004] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 22:56:18 2022] DELETE /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 22:56:18.371325 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:18.372044 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:18.379223 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:18.379720 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:18.380166 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:18.381110 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:18.381354 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:18.381789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:18.573501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:18.581568 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-0b1f8a12-e663-4e57-bce7-d8261f6c92f2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.214602 Nov 02 22:56:18.582518 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3941/8005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:18 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:19.606331 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:19.607068 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:19.614094 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:19.614597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:19.615059 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:19.615771 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:19.616245 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:19.616695 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:19.796613 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:19.804787 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-66090fbb-2c3d-4e2a-a96c-1bb712caf2d2 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1567 microversion: 2.1 time: 0.202971 Nov 02 22:56:19.805486 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4065/8006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:19 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:20.374083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-72950b0e-fbc7-4b09-ba99-cfe48fe2f29b req-abc73822-7385-4dba-8c28-3bf09b0b1247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cc08b8e-3822-407f-a5ad-75cbfc780871", "name": "network-vif-deleted", "tag": "d5c99122-6e43-4540-8778-eb37a72a3674"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:56:20.385482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-72950b0e-fbc7-4b09-ba99-cfe48fe2f29b req-abc73822-7385-4dba-8c28-3bf09b0b1247 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:20.388358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-72950b0e-fbc7-4b09-ba99-cfe48fe2f29b req-abc73822-7385-4dba-8c28-3bf09b0b1247 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:20.388358 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-72950b0e-fbc7-4b09-ba99-cfe48fe2f29b req-abc73822-7385-4dba-8c28-3bf09b0b1247 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:20.398108 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-72950b0e-fbc7-4b09-ba99-cfe48fe2f29b req-abc73822-7385-4dba-8c28-3bf09b0b1247 service nova] Creating event network-vif-deleted:d5c99122-6e43-4540-8778-eb37a72a3674 for instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 on n-h2-860863-4 Nov 02 22:56:20.403176 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-72950b0e-fbc7-4b09-ba99-cfe48fe2f29b req-abc73822-7385-4dba-8c28-3bf09b0b1247 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033387 Nov 02 22:56:20.403766 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3942/8007] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:56:20.830040 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:20.830674 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:20.837650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:20.838143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:20.838596 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:20.839300 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:20.840450 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:20.840963 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:20.905536 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:20.912583 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e16ec85-2d48-4020-931c-2b9b1a9cfe89 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1219 microversion: 2.1 time: 0.086485 Nov 02 22:56:20.913424 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4066/8008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:20 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:21.937100 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:21.937803 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:21.943941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:21.944424 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:21.944862 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:21.945569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:21.946022 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:21.946448 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:22.010445 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:22.019008 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a250462f-1bf0-4bc4-b8d0-f1668996baa0 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1219 microversion: 2.1 time: 0.087146 Nov 02 22:56:22.019789 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3943/8009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:21 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:23.042146 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:23.042775 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:23.049898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:23.050516 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:23.051121 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:23.051936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:23.052469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:23.053010 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:23.120145 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:23.128813 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad19f235-197f-4b53-ba7d-99cac82acb91 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1219 microversion: 2.1 time: 0.090600 Nov 02 22:56:23.129541 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4067/8010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:23 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:24.156375 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:24.157033 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:24.164599 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:24.165136 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:24.165590 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:24.166466 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:24.166987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:24.167455 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:24.232479 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:24.241908 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8607d92f-88ae-4444-b234-f96a752328af tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1219 microversion: 2.1 time: 0.093974 Nov 02 22:56:24.242696 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3944/8011] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:24 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:25.268368 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:25.269049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:25.276303 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:25.277762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:25.282938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:25.282938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:25.282938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:25.282938 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:25.312770 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:25.313386 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:25.313848 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:25.314551 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lazy-loading 'fault' on Instance uuid 8cc08b8e-3822-407f-a5ad-75cbfc780871 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 22:56:25.357268 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871da447558e4fbb92b2f0c5aec946f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9afee6da37498ab5be5a9377b2c0c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:25.365455 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55db269d-f72e-4011-a73e-f973c8b133ff tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 200 len: 1224 microversion: 2.1 time: 0.101037 Nov 02 22:56:25.366075 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4068/8012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:25 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:26.389470 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:26.390090 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] [instance: 8cc08b8e-3822-407f-a5ad-75cbfc780871] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:26.397422 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:26.397922 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:26.398418 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:26.399086 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:26.399544 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:26.399973 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:26.414705 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.wsgi [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] HTTP exception thrown: Instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 could not be found. Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Request method failure captured: Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: request: GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 HTTP/1.1 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: Accept: application/json Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: Accept-Encoding: identity Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: Connection: close Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: Content-Length: 0 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: Content-Type: application/json Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: Host: 10.222.0.25 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: Openstack-System-Scope: None Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: User-Agent: python-urllib3/1.26.12 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Auth-Token: gAAAAABjYvM8I9McGUt0o1OSsUW_g0ER-2uMYJJbHEGbBtYg8PtVLNqLbaude4DPmjcm1T2lAeCmmIOMMaUN_7DLofVMm0K91B8lPvNU6GMX_FeO1XBXqAs7bvAYAPmtF9Py0aRmopg275PrRTBcxtsfQD2mygXGGza1P7e9Egk503Z_T2FRp-c Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Id: None Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Domain-Name: None Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Identity-Status: Confirmed Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Is-Admin-Project: True Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Id: default Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Domain-Name: Default Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Id: 4d9afee6da37498ab5be5a9377b2c0c5 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Project-Name: tempest-TestShelveInstance-298886942 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Role: member,reader Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Roles: member,reader Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4d9afee6da37498ab5be5a9377b2c0c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant: tempest-TestShelveInstance-298886942 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Id: 4d9afee6da37498ab5be5a9377b2c0c5 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-Tenant-Name: tempest-TestShelveInstance-298886942 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-User: tempest-TestShelveInstance-298886942-project Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Id: default Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-User-Domain-Name: Default Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-User-Id: 871da447558e4fbb92b2f0c5aec946f9 Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: X-User-Name: tempest-TestShelveInstance-298886942-project Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: method: > Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: exception: Instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 could not be found. Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: action_args: {'id': '8cc08b8e-3822-407f-a5ad-75cbfc780871'} Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 could not be found. Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 could not be found. Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 22:56:26.416393 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 could not be found. Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: ERROR nova.api.openstack.wsgi Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Returning 404 to user: Instance 8cc08b8e-3822-407f-a5ad-75cbfc780871 could not be found. {{(pid=121039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-8cc9194c-240d-4365-b8da-7d09134bf771 tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871" status: 404 len: 111 microversion: 2.1 time: 0.032959 Nov 02 22:56:26.421629 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3945/8013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:26 2022] GET /compute/v2.1/servers/8cc08b8e-3822-407f-a5ad-75cbfc780871 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 22:56:26.651876 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aec15af1-a075-4057-acde-c7f8141ed1ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] Calling method '.version_select at 0x7f9b60379e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:26.745735 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aec15af1-a075-4057-acde-c7f8141ed1ee tempest-TestShelveInstance-298886942 tempest-TestShelveInstance-298886942-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1366133440" status: 202 len: 0 microversion: 2.1 time: 0.097619 Nov 02 22:56:26.746414 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4069/8014] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Nov 2 22:56:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1366133440 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 22:56:48.041320 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=12 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:48.043140 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=24 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:48.229505 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-91bce7cd-c5fb-45f8-9155-584be2d88455 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Action: 'create', calling method: .version_select at 0x7f9b68727c10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1031119658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH85OE9sLC4TO2Nu/RNAdaQoTfbGtvntxYYp0hEGMA8XpGB4v+7A5V++F+tY2MVK1T2/lsh4uyIB1QJIEB5loliQof+9CIBx9rmvYdJ2A4SEiDB+NIe9PQST7ky5Xba6yg=="}} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:56:48.246384 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-91bce7cd-c5fb-45f8-9155-584be2d88455 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Getting quotas for project 73b532f222b24653b324a4032b9e8861. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:56:48.252589 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.quota [None req-91bce7cd-c5fb-45f8-9155-584be2d88455 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Getting quotas for user 69b3b464d00741fdb3adbd931b88ee89 and project 73b532f222b24653b324a4032b9e8861. Resources: {'key_pairs'} {{(pid=121039) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:56:48.374454 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-91bce7cd-c5fb-45f8-9155-584be2d88455 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.338930 Nov 02 22:56:48.381424 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3946/8015] 10.222.0.25 () {60 vars in 1159 bytes} [Wed Nov 2 22:56:48 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:56:50.786919 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:50.787793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:56:50.793336 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1658268021", "imageRef": "612221e9-0156-4770-a8ac-3a978f4e721c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1031119658", "security_groups": [{"name": "tempest-secgroup-smoke-574669015"}], "networks": [{"uuid": "179c32e3-f425-448a-904b-37132e3f96be"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:56:50.908838 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] validate_networks() for [('179c32e3-f425-448a-904b-37132e3f96be', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:56:51.308727 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:56:51.309299 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:56:51.309842 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:56:51.311000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:56:51.311000 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:56:51.319672 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:51.320168 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:51.320620 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:51.321392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:51.321859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:51.322304 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:51.340531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Getting quotas for project 73b532f222b24653b324a4032b9e8861. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:56:51.346228 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Getting quotas for user 69b3b464d00741fdb3adbd931b88ee89 and project 73b532f222b24653b324a4032b9e8861. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:56:51.359294 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:56:51.361660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='612221e9-0156-4770-a8ac-3a978f4e721c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:56:51.460345 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0e0c670-cb80-477c-9768-77c74ef4014f tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.675755 Nov 02 22:56:51.461351 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4070/8016] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:56:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:56:51.473604 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-97ff11fc-57a9-4b4f-994c-b465628bb287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:51.474930 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-97ff11fc-57a9-4b4f-994c-b465628bb287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:51.541456 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-97ff11fc-57a9-4b4f-994c-b465628bb287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:51.549696 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-97ff11fc-57a9-4b4f-994c-b465628bb287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1249 microversion: 2.1 time: 0.081047 Nov 02 22:56:51.550298 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3947/8017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:51 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:52.574522 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-929c1d86-268d-4c06-99d7-16e735d53f9e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:52.575158 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-929c1d86-268d-4c06-99d7-16e735d53f9e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:52.631597 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-929c1d86-268d-4c06-99d7-16e735d53f9e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:52.638921 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-929c1d86-268d-4c06-99d7-16e735d53f9e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1249 microversion: 2.1 time: 0.069253 Nov 02 22:56:52.639492 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4071/8018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:52 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:53.662712 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:53.663331 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:53.674518 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:53.675009 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:53.675536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:53.676264 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:53.676843 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:53.677391 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:53.741077 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:53.749067 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-ff032d56-ad88-4ed0-b8fc-400f8850cbe4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1301 microversion: 2.1 time: 0.090548 Nov 02 22:56:53.749653 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3948/8019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:53 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:54.775861 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:54.776473 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:54.784009 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:54.784510 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:54.785049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:54.785762 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:54.786262 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:54.786708 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:55.017372 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:55.025935 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a179cd97-1cf7-4e2c-b1d3-b8389f034526 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1374 microversion: 2.1 time: 0.253989 Nov 02 22:56:55.026894 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4072/8020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:54 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1374 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:55.903958 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-dc5af592-8f1f-4db3-b179-12625906e3af req-8fb13a40-f52e-4218-9513-07c9a5cc33a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9465fd-95b0-49a5-8e29-3d127851194d", "tag": "7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:56:55.915693 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc5af592-8f1f-4db3-b179-12625906e3af req-8fb13a40-f52e-4218-9513-07c9a5cc33a2 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:55.916287 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc5af592-8f1f-4db3-b179-12625906e3af req-8fb13a40-f52e-4218-9513-07c9a5cc33a2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:55.916794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-dc5af592-8f1f-4db3-b179-12625906e3af req-8fb13a40-f52e-4218-9513-07c9a5cc33a2 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:55.929109 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-dc5af592-8f1f-4db3-b179-12625906e3af req-8fb13a40-f52e-4218-9513-07c9a5cc33a2 service nova] Creating event network-changed:7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c for instance 3c9465fd-95b0-49a5-8e29-3d127851194d on n-h2-860863-4 Nov 02 22:56:55.934725 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-dc5af592-8f1f-4db3-b179-12625906e3af req-8fb13a40-f52e-4218-9513-07c9a5cc33a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035537 Nov 02 22:56:55.935347 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3949/8021] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:56:56.049275 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:56.050022 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:56.056977 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:56.057558 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:56.058086 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:56.058889 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:56.059435 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:56.059949 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:56.269691 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:56.277331 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3c74dd7-34cd-496e-a04e-f7ad895fc09a tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1374 microversion: 2.1 time: 0.232130 Nov 02 22:56:56.277940 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4073/8022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:56 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:57.301842 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:57.302438 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:57.308698 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:57.310149 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:57.310587 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:57.311382 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:57.312121 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:57.312856 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:57.448566 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:57.457179 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-89df0b0c-bedb-44fb-82b5-c31754654404 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1374 microversion: 2.1 time: 0.160429 Nov 02 22:56:57.457877 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3950/8023] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:57 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:58.479725 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:58.480307 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:58.487472 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:58.487969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:58.488414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:58.489140 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:58.489605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:58.490049 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:58.625180 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:58.633329 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f20c7f0d-7b61-4cdc-b69a-a7649332a917 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1374 microversion: 2.1 time: 0.157516 Nov 02 22:56:58.633911 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4074/8024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:58 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:56:59.656433 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:56:59.657075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:56:59.664065 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:59.664547 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:59.665005 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:59.665774 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:56:59.666226 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:56:59.666649 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:56:59.798772 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:56:59.806752 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-3c482b4b-f71a-419a-a87f-a9703d7b4dfe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1374 microversion: 2.1 time: 0.155035 Nov 02 22:56:59.807322 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3951/8025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:56:59 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:57:00.830104 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:57:00.830796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:57:00.838017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:00.840954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:00.840954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:00.840954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:00.840954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:00.841531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:00.979796 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:57:00.988430 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1dae5ae1-d320-432e-9c9f-4b770680d50b tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1374 microversion: 2.1 time: 0.162242 Nov 02 22:57:00.989028 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4075/8026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:57:00 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:57:01.051286 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-add016a2-e9ac-4d6b-bd12-c0bde3326ede req-73808ce6-18ff-41e0-9a65-2307ab855e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9465fd-95b0-49a5-8e29-3d127851194d", "name": "network-vif-plugged", "status": "completed", "tag": "7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:57:01.062303 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-add016a2-e9ac-4d6b-bd12-c0bde3326ede req-73808ce6-18ff-41e0-9a65-2307ab855e81 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:01.062785 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-add016a2-e9ac-4d6b-bd12-c0bde3326ede req-73808ce6-18ff-41e0-9a65-2307ab855e81 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:01.063216 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-add016a2-e9ac-4d6b-bd12-c0bde3326ede req-73808ce6-18ff-41e0-9a65-2307ab855e81 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:01.074155 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-add016a2-e9ac-4d6b-bd12-c0bde3326ede req-73808ce6-18ff-41e0-9a65-2307ab855e81 service nova] Creating event network-vif-plugged:7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c for instance 3c9465fd-95b0-49a5-8e29-3d127851194d on n-h2-860863-4 Nov 02 22:57:01.079402 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-add016a2-e9ac-4d6b-bd12-c0bde3326ede req-73808ce6-18ff-41e0-9a65-2307ab855e81 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031962 Nov 02 22:57:01.082349 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3952/8027] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:57:02.011427 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:57:02.012065 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:57:02.013967 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:57:02.019750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:02.025504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:02.025504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:02.025504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:02.025504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:02.025504 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:02.160801 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:57:02.169668 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e075fc2-251b-4af7-b041-03621b7b2238 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1374 microversion: 2.1 time: 0.162155 Nov 02 22:57:02.170262 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4076/8028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:57:02 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:57:03.190013 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=6 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:57:03.195477 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:57:03.196184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:57:03.203844 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:03.204393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:03.204828 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:03.205607 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:03.206089 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:03.206514 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:03.340681 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:57:03.349028 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-1b322b27-a063-4ca5-b95e-a30167f92f82 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1560 microversion: 2.1 time: 0.159890 Nov 02 22:57:03.349619 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3953/8029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:57:03 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:57:03.376234 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:57:03.376892 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:57:03.378750 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:57:03.384319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:03.389352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:03.389352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:03.389352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:03.389352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:03.389352 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:03.521229 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:57:03.529381 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e8178f6a-082e-4bad-8e0a-f0268b90f652 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1560 microversion: 2.1 time: 0.157699 Nov 02 22:57:03.529983 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4077/8030] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:57:03 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:57:05.588732 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ac39be0f-0bbd-4f70-9a7e-0554d7dfb012 req-d370bdab-9896-494c-b304-0bab6c5c238b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9465fd-95b0-49a5-8e29-3d127851194d", "tag": "7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:57:05.599460 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ac39be0f-0bbd-4f70-9a7e-0554d7dfb012 req-d370bdab-9896-494c-b304-0bab6c5c238b service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:57:05.599938 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ac39be0f-0bbd-4f70-9a7e-0554d7dfb012 req-d370bdab-9896-494c-b304-0bab6c5c238b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:57:05.600372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ac39be0f-0bbd-4f70-9a7e-0554d7dfb012 req-d370bdab-9896-494c-b304-0bab6c5c238b service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:57:05.611397 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ac39be0f-0bbd-4f70-9a7e-0554d7dfb012 req-d370bdab-9896-494c-b304-0bab6c5c238b service nova] Creating event network-changed:7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c for instance 3c9465fd-95b0-49a5-8e29-3d127851194d on n-h2-860863-4 Nov 02 22:57:05.616691 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ac39be0f-0bbd-4f70-9a7e-0554d7dfb012 req-d370bdab-9896-494c-b304-0bab6c5c238b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031750 Nov 02 22:57:05.617670 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3954/8031] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:59:01.066592 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 22:59:01.067421 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 22:59:01.068466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:01.069320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=38 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:01.074186 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1073562007"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:59:01.079109 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:01.083418 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:01.083917 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:01.084367 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:01.085090 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:01.085557 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:01.085997 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:01.486009 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fc3e2f2a-f117-4a9a-96c1-806a859fe02d tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "POST /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d/action" status: 202 len: 0 microversion: 2.1 time: 0.422089 Nov 02 22:59:01.486586 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4078/8032] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 22:59:01 2022] POST /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 22:59:07.599421 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 22:59:07.601296 n-d-860863-4 devstack@n-api.service[121039]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 22:59:07.605793 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:07.611075 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=30 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:07.612498 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 22:59:07.612648 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 22:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 22:59:07.630334 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-77513af0-5dc9-441f-86b3-16d6e6171b5c req-436fe083-3125-4714-8bfd-b82678d3b6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9465fd-95b0-49a5-8e29-3d127851194d", "name": "network-vif-plugged", "status": "completed", "tag": "7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:59:07.655463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-77513af0-5dc9-441f-86b3-16d6e6171b5c req-436fe083-3125-4714-8bfd-b82678d3b6ce service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:07.655941 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-77513af0-5dc9-441f-86b3-16d6e6171b5c req-436fe083-3125-4714-8bfd-b82678d3b6ce service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:07.656372 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-77513af0-5dc9-441f-86b3-16d6e6171b5c req-436fe083-3125-4714-8bfd-b82678d3b6ce service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:07.675803 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-77513af0-5dc9-441f-86b3-16d6e6171b5c req-436fe083-3125-4714-8bfd-b82678d3b6ce service nova] Creating event network-vif-plugged:7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c for instance 3c9465fd-95b0-49a5-8e29-3d127851194d on n-h2-860863-4 Nov 02 22:59:07.681756 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-77513af0-5dc9-441f-86b3-16d6e6171b5c req-436fe083-3125-4714-8bfd-b82678d3b6ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084301 Nov 02 22:59:07.682996 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3955/8033] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:59:17.164722 n-d-860863-4 devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:59:17.165587 n-d-860863-4 devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f5fc7833-b4b4-43fd-a1c3-e65a3dcf6a0f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 22:59:17.166124 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:17.166939 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:17.167705 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 22:59:17.167847 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 22:59:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Nov 02 22:59:17.179495 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1890292312", "imageRef": "cccc45b5-6173-494a-b1b9-fa2d93135a49", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1031119658", "security_groups": [{"name": "tempest-secgroup-smoke-574669015"}], "networks": [{"uuid": "179c32e3-f425-448a-904b-37132e3f96be"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:59:17.287405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] validate_networks() for [('179c32e3-f425-448a-904b-37132e3f96be', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 22:59:17.713457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 22:59:17.713936 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 22:59:17.714405 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 22:59:17.714824 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 22:59:17.715246 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 22:59:17.724707 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:17.725310 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:17.725776 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:17.726535 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:17.727011 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:17.727469 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:17.745778 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Getting quotas for project 73b532f222b24653b324a4032b9e8861. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 22:59:17.751150 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.quota [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Getting quotas for user 69b3b464d00741fdb3adbd931b88ee89 and project 73b532f222b24653b324a4032b9e8861. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 22:59:17.764058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 22:59:17.766617 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cccc45b5-6173-494a-b1b9-fa2d93135a49',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 22:59:17.872950 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ce5821a-9ac3-4a8e-87f3-5b9b808025b4 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709525 Nov 02 22:59:17.873605 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4079/8034] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Nov 2 22:59:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 22:59:17.886406 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c772363f-0845-4b48-914f-1cf84fa55972 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:17.887104 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c772363f-0845-4b48-914f-1cf84fa55972 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:17.905720 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d433c87-c8dd-47eb-818c-d606f1ef7cf9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49424. Nov 02 22:59:17.914308 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] [79a19d22-c586-4cc5-a8b1-eb688fdbac8c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49422. Nov 02 22:59:17.969952 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c772363f-0845-4b48-914f-1cf84fa55972 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:17.980743 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c772363f-0845-4b48-914f-1cf84fa55972 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1249 microversion: 2.1 time: 0.099569 Nov 02 22:59:17.981381 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3956/8035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:17 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1249 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:59:19.010650 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:19.011278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:19.025651 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:19.026166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:19.026660 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:19.027392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:19.027869 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:19.028320 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:19.034229 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] [f5fc7833-b4b4-43fd-a1c3-e65a3dcf6a0f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49440. Nov 02 22:59:19.041302 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] [f30cf0f6-854e-437c-b565-099ad129f865] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 49438. Nov 02 22:59:19.097461 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:19.105287 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f6fe3c81-92d5-48f3-b510-506ed3ba9ebd tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1253 microversion: 2.1 time: 0.098617 Nov 02 22:59:19.105865 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4080/8036] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:19 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1253 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:19.629051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-a616af83-dde5-4eeb-a8f2-eec6040e2db3 req-97cd391f-14c9-42a9-b70b-9972d7110414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9465fd-95b0-49a5-8e29-3d127851194d", "name": "network-vif-unplugged", "status": "completed", "tag": "7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:59:19.639669 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a616af83-dde5-4eeb-a8f2-eec6040e2db3 req-97cd391f-14c9-42a9-b70b-9972d7110414 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:19.640214 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a616af83-dde5-4eeb-a8f2-eec6040e2db3 req-97cd391f-14c9-42a9-b70b-9972d7110414 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:19.640643 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-a616af83-dde5-4eeb-a8f2-eec6040e2db3 req-97cd391f-14c9-42a9-b70b-9972d7110414 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:19.651972 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-a616af83-dde5-4eeb-a8f2-eec6040e2db3 req-97cd391f-14c9-42a9-b70b-9972d7110414 service nova] Creating event network-vif-unplugged:7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c for instance 3c9465fd-95b0-49a5-8e29-3d127851194d on n-h2-860863-4 Nov 02 22:59:19.657123 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-a616af83-dde5-4eeb-a8f2-eec6040e2db3 req-97cd391f-14c9-42a9-b70b-9972d7110414 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089842 Nov 02 22:59:19.657728 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3957/8037] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:59:20.127923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:20.129181 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:20.136263 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:20.136859 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:20.137344 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:20.138074 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:20.138542 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:20.138986 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:20.212178 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:20.220702 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2616d456-bb8b-47dd-a5ae-63ceca88da30 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1309 microversion: 2.1 time: 0.096786 Nov 02 22:59:20.221612 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4081/8038] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:20 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:21.252440 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:21.253184 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:21.261834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:21.262528 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:21.263430 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:21.264762 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:21.265482 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:21.266114 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:21.918910 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:21.932216 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-fdae953d-f365-4387-bbbc-3e3c62892ab1 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.686123 Nov 02 22:59:21.933482 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3958/8039] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:21 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:59:22.787872 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-997e98bc-2058-482c-9757-19ff0a680494 req-018119e4-cb99-4de0-bb83-237205e87444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d27b90a-a07f-4a71-b52c-0505c47d6e2d", "tag": "cbdff370-efe4-46c4-9e5d-f8fcbeeaa644"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:59:22.799355 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-997e98bc-2058-482c-9757-19ff0a680494 req-018119e4-cb99-4de0-bb83-237205e87444 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:22.799946 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-997e98bc-2058-482c-9757-19ff0a680494 req-018119e4-cb99-4de0-bb83-237205e87444 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:22.800519 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-997e98bc-2058-482c-9757-19ff0a680494 req-018119e4-cb99-4de0-bb83-237205e87444 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:22.813960 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-997e98bc-2058-482c-9757-19ff0a680494 req-018119e4-cb99-4de0-bb83-237205e87444 service nova] Creating event network-changed:cbdff370-efe4-46c4-9e5d-f8fcbeeaa644 for instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d on n-h1-860863-4 Nov 02 22:59:22.819485 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-997e98bc-2058-482c-9757-19ff0a680494 req-018119e4-cb99-4de0-bb83-237205e87444 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122148 Nov 02 22:59:22.821211 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4082/8040] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:59:22.962023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:22.963691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:22.978688 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:22.979501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:22.980155 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:22.981569 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:22.982238 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:22.982891 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:23.133116 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:23.142180 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-c7b01404-47fa-439a-a752-df79e23855a3 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.188137 Nov 02 22:59:23.143075 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3959/8041] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:22 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:24.169017 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:24.169681 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:24.176648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:24.177253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:24.177716 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:24.178428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:24.178893 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:24.179332 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:24.330898 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:24.341734 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed6ba1e9-02f6-4df2-92e8-dc912e1ef7bf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.178002 Nov 02 22:59:24.342445 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4083/8042] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:24 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:25.367632 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:25.368252 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:25.375243 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:25.375734 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:25.376180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:25.376886 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:25.377371 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:25.377805 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:25.556173 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:25.564028 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-313ecb2f-8d58-4bd4-94f0-2983d9632c8c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.200326 Nov 02 22:59:25.564879 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3960/8043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:25 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:26.615527 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:26.616278 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:26.623452 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:26.623954 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:26.624416 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:26.625166 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:26.625648 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:26.626095 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:26.777975 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:26.787273 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6408da37-99b7-4085-87a8-cc9c2026b1f6 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.175741 Nov 02 22:59:26.788177 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4084/8044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:26 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:27.811695 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:27.812316 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:27.819834 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:27.820333 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:27.821141 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:27.822388 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:27.822987 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:27.825501 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:27.974381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell0:SELECT=2 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:28.037907 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:28.048610 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-19d7e8ad-1736-432f-a0ed-2534b274ce23 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.240721 Nov 02 22:59:28.059531 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3961/8045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:27 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:29.083335 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:29.083966 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:29.086844 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:29.087531 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 22:59:29.092359 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:29.093133 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:29.093598 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:29.094315 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:29.094791 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:29.095235 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:29.239853 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:29.247756 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1521409d-5151-438f-8059-059c1bb86287 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.168417 Nov 02 22:59:29.248346 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4085/8046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:29 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:30.271832 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:30.272381 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:30.279180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:30.279662 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:30.280098 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:30.280787 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:30.281266 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:30.281691 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:30.412515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:30.420179 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-31051332-b264-4186-bdea-b6425b04ebc7 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.152503 Nov 02 22:59:30.420751 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3962/8047] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:30 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:31.444466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:31.445044 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:31.451878 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:31.452378 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:31.452834 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:31.453567 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:31.454035 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:31.454484 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:31.586710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:31.594465 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a2074e7b-904c-4627-b9bc-2bde1a779e53 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.154788 Nov 02 22:59:31.595040 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4086/8048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:31 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:32.618393 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:32.619041 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:32.625929 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:32.626416 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:32.626885 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:32.627577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:32.628034 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:32.629002 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:32.768642 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:32.776896 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-cb7608cf-cb60-4a63-993d-337c598a291e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.162310 Nov 02 22:59:32.777412 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3963/8049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:32 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:33.800060 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:33.800640 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:33.808119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:33.808624 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:33.809119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:33.809840 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:33.810311 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:33.810760 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:33.944038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:33.952003 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b995d0e0-4eb1-4d05-8f7b-c817d0813881 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.156015 Nov 02 22:59:33.952581 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4087/8050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:33 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:34.976639 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:34.977577 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:34.984510 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:34.985180 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:34.985686 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:34.986395 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:34.986857 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:34.987290 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:35.126591 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:35.135800 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-954650bd-c0ac-49e4-920c-480ac901cdb9 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.163764 Nov 02 22:59:35.136402 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3964/8051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:34 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:36.160581 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:36.161167 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:36.168007 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:36.168511 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:36.168994 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:36.169710 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:36.170185 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:36.170633 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:36.300690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:36.308393 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb36d9fb-78dc-4536-af3c-02d30f718a09 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.152646 Nov 02 22:59:36.308988 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4088/8052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:36 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:36.639327 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-d3facfc9-d349-4abd-95e2-c9879f1b0e43 req-070d2cbf-066e-4c96-b7e8-b22ec6319501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27b90a-a07f-4a71-b52c-0505c47d6e2d", "name": "network-vif-plugged", "status": "completed", "tag": "cbdff370-efe4-46c4-9e5d-f8fcbeeaa644"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:59:36.650014 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d3facfc9-d349-4abd-95e2-c9879f1b0e43 req-070d2cbf-066e-4c96-b7e8-b22ec6319501 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:36.650487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d3facfc9-d349-4abd-95e2-c9879f1b0e43 req-070d2cbf-066e-4c96-b7e8-b22ec6319501 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:36.650918 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-d3facfc9-d349-4abd-95e2-c9879f1b0e43 req-070d2cbf-066e-4c96-b7e8-b22ec6319501 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:36.662053 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-d3facfc9-d349-4abd-95e2-c9879f1b0e43 req-070d2cbf-066e-4c96-b7e8-b22ec6319501 service nova] Creating event network-vif-plugged:cbdff370-efe4-46c4-9e5d-f8fcbeeaa644 for instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d on n-h1-860863-4 Nov 02 22:59:36.667175 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-d3facfc9-d349-4abd-95e2-c9879f1b0e43 req-070d2cbf-066e-4c96-b7e8-b22ec6319501 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031573 Nov 02 22:59:36.667823 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3965/8053] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 22:59:37.331772 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:37.332407 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:37.339350 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:37.339855 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:37.340319 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:37.341058 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:37.341537 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:37.341995 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:37.476013 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:37.483760 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-351739af-b752-462f-8330-5ca2273338d0 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1374 microversion: 2.1 time: 0.156523 Nov 02 22:59:37.484343 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4089/8054] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:37 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 22:59:38.508158 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:38.508854 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:38.516464 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:38.516964 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:38.517405 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:38.518127 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:38.518980 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:38.519487 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:38.659904 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:38.667720 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-a08a3bfd-a525-4bb1-b029-ae8bbd24a5cc tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1559 microversion: 2.1 time: 0.164633 Nov 02 22:59:38.668297 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3966/8055] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:38 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:38.690512 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 22:59:38.691874 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 22:59:38.698973 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:38.699480 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:38.699937 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:38.700676 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:38.701200 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:38.701669 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:38.834339 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 22:59:38.842129 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89a7e87a-6268-464e-8d6e-c2971aee8ffe tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1559 microversion: 2.1 time: 0.155596 Nov 02 22:59:38.842712 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4090/8056] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 22:59:38 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 22:59:40.830680 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-efca59d8-6f84-4b6d-b157-e06fe197762f req-36cb9088-c98a-4b08-993c-a08f893ac7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d27b90a-a07f-4a71-b52c-0505c47d6e2d", "tag": "cbdff370-efe4-46c4-9e5d-f8fcbeeaa644"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 22:59:40.841039 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-efca59d8-6f84-4b6d-b157-e06fe197762f req-36cb9088-c98a-4b08-993c-a08f893ac7f9 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 22:59:40.841513 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-efca59d8-6f84-4b6d-b157-e06fe197762f req-36cb9088-c98a-4b08-993c-a08f893ac7f9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 22:59:40.841940 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-efca59d8-6f84-4b6d-b157-e06fe197762f req-36cb9088-c98a-4b08-993c-a08f893ac7f9 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 22:59:40.854172 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-efca59d8-6f84-4b6d-b157-e06fe197762f req-36cb9088-c98a-4b08-993c-a08f893ac7f9 service nova] Creating event network-changed:cbdff370-efe4-46c4-9e5d-f8fcbeeaa644 for instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d on n-h1-860863-4 Nov 02 22:59:40.859690 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-efca59d8-6f84-4b6d-b157-e06fe197762f req-36cb9088-c98a-4b08-993c-a08f893ac7f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033118 Nov 02 22:59:40.860663 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3967/8057] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 22:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:19.810414 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 23:01:19.811772 n-d-860863-4 devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:01:19.811923 n-d-860863-4 devstack@n-api.service[121040]: Wed Nov 2 23:01:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d/action (ip 10.222.0.25) !!! Nov 02 23:01:19.813191 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=64 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 23:01:19.817295 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1217634127"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:19.819799 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:19.827002 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:19.827499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:19.827956 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:19.828665 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:19.829170 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:19.829615 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:20.414604 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e6ad712-129e-4b19-99d5-e88825477774 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "POST /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d/action" status: 202 len: 0 microversion: 2.1 time: 0.605309 Nov 02 23:01:20.415256 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4091/8058] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Nov 2 23:01:19 2022] POST /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 23:01:27.157775 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_api:SELECT=28 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 23:01:27.158515 n-d-860863-4 devstack@n-api.service[121039]: DEBUG dbcounter [-] [121039] Writing DB stats nova_cell1:SELECT=56 {{(pid=121039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 23:01:27.159551 n-d-860863-4 devstack@n-api.service[121039]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 23:01:27.159697 n-d-860863-4 devstack@n-api.service[121039]: Wed Nov 2 23:01:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Nov 02 23:01:27.167052 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-25704e84-2fea-4a61-ae5b-c5e729e8da0f req-5eef52c5-494d-4f0c-90b4-f026298ff0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27b90a-a07f-4a71-b52c-0505c47d6e2d", "name": "network-vif-plugged", "status": "completed", "tag": "cbdff370-efe4-46c4-9e5d-f8fcbeeaa644"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:27.184152 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-25704e84-2fea-4a61-ae5b-c5e729e8da0f req-5eef52c5-494d-4f0c-90b4-f026298ff0d3 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:27.184629 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-25704e84-2fea-4a61-ae5b-c5e729e8da0f req-5eef52c5-494d-4f0c-90b4-f026298ff0d3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:27.185099 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-25704e84-2fea-4a61-ae5b-c5e729e8da0f req-5eef52c5-494d-4f0c-90b4-f026298ff0d3 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:27.196635 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-25704e84-2fea-4a61-ae5b-c5e729e8da0f req-5eef52c5-494d-4f0c-90b4-f026298ff0d3 service nova] Creating event network-vif-plugged:cbdff370-efe4-46c4-9e5d-f8fcbeeaa644 for instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d on n-h1-860863-4 Nov 02 23:01:27.201872 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-25704e84-2fea-4a61-ae5b-c5e729e8da0f req-5eef52c5-494d-4f0c-90b4-f026298ff0d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046252 Nov 02 23:01:27.203814 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3968/8059] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 23:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:36.739020 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 23:01:36.739797 n-d-860863-4 devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 23:01:36.745119 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:36.745969 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:36.754457 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:36.754960 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:36.755413 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:36.756127 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:36.756601 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:36.757075 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:36.786143 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 23:01:36.809008 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-e41e6365-c524-4761-aa15-601fe1ddae0f req-7beaf4f6-5afc-4f13-8b8d-11e4fb5a18b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d27b90a-a07f-4a71-b52c-0505c47d6e2d", "tag": "cbdff370-efe4-46c4-9e5d-f8fcbeeaa644"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:36.821737 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e41e6365-c524-4761-aa15-601fe1ddae0f req-7beaf4f6-5afc-4f13-8b8d-11e4fb5a18b4 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:36.822529 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e41e6365-c524-4761-aa15-601fe1ddae0f req-7beaf4f6-5afc-4f13-8b8d-11e4fb5a18b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:36.823142 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-e41e6365-c524-4761-aa15-601fe1ddae0f req-7beaf4f6-5afc-4f13-8b8d-11e4fb5a18b4 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:36.837662 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-e41e6365-c524-4761-aa15-601fe1ddae0f req-7beaf4f6-5afc-4f13-8b8d-11e4fb5a18b4 service nova] Creating event network-changed:cbdff370-efe4-46c4-9e5d-f8fcbeeaa644 for instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d on n-h1-860863-4 Nov 02 23:01:36.843360 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-e41e6365-c524-4761-aa15-601fe1ddae0f req-7beaf4f6-5afc-4f13-8b8d-11e4fb5a18b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103736 Nov 02 23:01:36.843889 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3969/8060] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 23:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:01:37.115436 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8db2b4d4-5bd5-4152-a7cb-f6f5049b39c8 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 204 len: 0 microversion: 2.1 time: 0.378378 Nov 02 23:01:37.116074 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4092/8061] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 23:01:36 2022] DELETE /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:01:37.126463 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:37.127176 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:37.133956 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:37.134458 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:37.134977 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:37.135864 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:37.136378 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:37.137133 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:37.332229 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:01:37.341647 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-44eed1f0-78ca-44d1-89f1-3965a363e8de tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1684 microversion: 2.1 time: 0.219465 Nov 02 23:01:37.342249 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3970/8062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:37 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1684 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:01:38.371105 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:38.371741 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:38.378582 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:38.379083 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:38.379544 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:38.380251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:38.380723 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:38.381195 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:38.516466 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:01:38.524836 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6b82830-b389-4ea9-9c3f-f37968ecc50c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1684 microversion: 2.1 time: 0.158453 Nov 02 23:01:38.525452 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4093/8063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:38 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:01:39.194592 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [req-ffbefb26-3710-40fb-bc00-4b32c7fdfcd2 req-6c708faa-a65b-41cf-94f5-e92141221b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27b90a-a07f-4a71-b52c-0505c47d6e2d", "name": "network-vif-unplugged", "status": "completed", "tag": "cbdff370-efe4-46c4-9e5d-f8fcbeeaa644"}]} {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:39.207284 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ffbefb26-3710-40fb-bc00-4b32c7fdfcd2 req-6c708faa-a65b-41cf-94f5-e92141221b64 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:39.207789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ffbefb26-3710-40fb-bc00-4b32c7fdfcd2 req-6c708faa-a65b-41cf-94f5-e92141221b64 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:39.208239 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [req-ffbefb26-3710-40fb-bc00-4b32c7fdfcd2 req-6c708faa-a65b-41cf-94f5-e92141221b64 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:39.223148 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.compute.server_external_events [req-ffbefb26-3710-40fb-bc00-4b32c7fdfcd2 req-6c708faa-a65b-41cf-94f5-e92141221b64 service nova] Creating event network-vif-unplugged:cbdff370-efe4-46c4-9e5d-f8fcbeeaa644 for instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d on n-h1-860863-4 Nov 02 23:01:39.229303 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [req-ffbefb26-3710-40fb-bc00-4b32c7fdfcd2 req-6c708faa-a65b-41cf-94f5-e92141221b64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040330 Nov 02 23:01:39.229942 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3971/8064] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 23:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:39.527910 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-dda4beda-ddb3-46a6-9d24-8e35ad3d8629 req-639127c1-adf7-457c-9a4e-60602e8c328d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27b90a-a07f-4a71-b52c-0505c47d6e2d", "name": "network-vif-deleted", "tag": "cbdff370-efe4-46c4-9e5d-f8fcbeeaa644"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:39.538525 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dda4beda-ddb3-46a6-9d24-8e35ad3d8629 req-639127c1-adf7-457c-9a4e-60602e8c328d service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:39.539088 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dda4beda-ddb3-46a6-9d24-8e35ad3d8629 req-639127c1-adf7-457c-9a4e-60602e8c328d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:39.539543 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-dda4beda-ddb3-46a6-9d24-8e35ad3d8629 req-639127c1-adf7-457c-9a4e-60602e8c328d service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:39.548542 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:39.549404 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:39.550902 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-dda4beda-ddb3-46a6-9d24-8e35ad3d8629 req-639127c1-adf7-457c-9a4e-60602e8c328d service nova] Creating event network-vif-deleted:cbdff370-efe4-46c4-9e5d-f8fcbeeaa644 for instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d on n-h1-860863-4 Nov 02 23:01:39.556551 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-dda4beda-ddb3-46a6-9d24-8e35ad3d8629 req-639127c1-adf7-457c-9a4e-60602e8c328d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033369 Nov 02 23:01:39.557042 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:39.557525 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4094/8065] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 23:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:39.557756 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:39.558206 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:39.558917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:39.559497 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:39.559874 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:39.631306 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:01:39.642101 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-4b98a78e-1f12-4e77-b390-8939e9e06110 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 200 len: 1498 microversion: 2.1 time: 0.098006 Nov 02 23:01:39.642699 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3972/8066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:39 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 1498 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 23:01:40.667402 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:40.668038 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 8d27b90a-a07f-4a71-b52c-0505c47d6e2d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:40.674292 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:40.674793 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:40.675251 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:40.675955 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:40.676428 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:40.676867 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:40.693948 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] HTTP exception thrown: Instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d could not be found. Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Request method failure captured: Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d HTTP/1.1 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYvWqu66wzJaJPzmLFPTxYPd0ixD1biM8NrZzyVHP61x6OyMQt_AKtBGVVvEBAkcw1P6EoaOtgQez5mo5hiZwx59qvMtA6d3VpGAKhaLNnDGL0iJDNUBcpRYiEYrjbntleu_DWzj0ODWEsMOhibEQKjlKRseLD1I889r7Hm3vCnou324 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 73b532f222b24653b324a4032b9e8861 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestSnapshotPattern-1071530520 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73b532f222b24653b324a4032b9e8861"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b532f222b24653b324a4032b9e8861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73b532f222b24653b324a4032b9e8861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b532f222b24653b324a4032b9e8861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestSnapshotPattern-1071530520 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 73b532f222b24653b324a4032b9e8861 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestSnapshotPattern-1071530520 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestSnapshotPattern-1071530520-project Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 69b3b464d00741fdb3adbd931b88ee89 Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestSnapshotPattern-1071530520-project Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d could not be found. Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '8d27b90a-a07f-4a71-b52c-0505c47d6e2d'} Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d could not be found. Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d could not be found. Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 23:01:40.696253 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d could not be found. Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Returning 404 to user: Instance 8d27b90a-a07f-4a71-b52c-0505c47d6e2d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78fd4c67-fff4-4820-ae96-d2cf4b2ffabf tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d" status: 404 len: 111 microversion: 2.1 time: 0.035565 Nov 02 23:01:40.700693 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4095/8067] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:40 2022] GET /compute/v2.1/servers/8d27b90a-a07f-4a71-b52c-0505c47d6e2d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:01:43.175028 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:43.175524 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:43.177895 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7ed03e7d-590d-4ae8-8d28-254ede7ebbd4 req-77c59adc-b203-4afe-a65f-0a6615a61105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9465fd-95b0-49a5-8e29-3d127851194d", "tag": "7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:43.183846 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:43.184347 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:43.184794 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:43.185672 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:43.186138 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:43.186571 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:43.189886 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ed03e7d-590d-4ae8-8d28-254ede7ebbd4 req-77c59adc-b203-4afe-a65f-0a6615a61105 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:43.190668 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ed03e7d-590d-4ae8-8d28-254ede7ebbd4 req-77c59adc-b203-4afe-a65f-0a6615a61105 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:43.191189 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7ed03e7d-590d-4ae8-8d28-254ede7ebbd4 req-77c59adc-b203-4afe-a65f-0a6615a61105 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:43.204667 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7ed03e7d-590d-4ae8-8d28-254ede7ebbd4 req-77c59adc-b203-4afe-a65f-0a6615a61105 service nova] Creating event network-changed:7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c for instance 3c9465fd-95b0-49a5-8e29-3d127851194d on n-h2-860863-4 Nov 02 23:01:43.213751 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7ed03e7d-590d-4ae8-8d28-254ede7ebbd4 req-77c59adc-b203-4afe-a65f-0a6615a61105 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039230 Nov 02 23:01:43.213960 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Going to try to terminate instance {{(pid=121039) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 23:01:43.215177 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4096/8068] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 23:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 23:01:43.447598 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-dbf163dd-41dc-45f6-b3d9-de2985944b3e tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 204 len: 0 microversion: 2.1 time: 0.275980 Nov 02 23:01:43.448673 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3973/8069] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Nov 2 23:01:43 2022] DELETE /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 23:01:43.459572 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:43.461605 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:43.468392 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:43.469001 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:43.469548 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:43.470490 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:43.471054 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:43.471497 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:43.611901 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:01:43.620213 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3362d36-6040-4cfc-9bff-9635e1cb7c35 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1685 microversion: 2.1 time: 0.166595 Nov 02 23:01:43.620891 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4097/8070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:43 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:01:44.644353 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:44.645109 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:44.652453 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:44.652947 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:44.653398 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:44.654083 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:44.654536 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:44.654963 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:44.868523 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:01:44.876718 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-87d825f3-6403-4e6f-9d3a-6d871f706565 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1685 microversion: 2.1 time: 0.236487 Nov 02 23:01:44.877530 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3974/8071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:44 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1685 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:01:45.474747 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5dc81323-addc-4d81-8e3d-60a798f5eb5c req-71e1828f-9178-4b90-a5d5-1971c0a44fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9465fd-95b0-49a5-8e29-3d127851194d", "name": "network-vif-deleted", "tag": "7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 23:01:45.485411 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5dc81323-addc-4d81-8e3d-60a798f5eb5c req-71e1828f-9178-4b90-a5d5-1971c0a44fc6 service nova] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:45.485900 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5dc81323-addc-4d81-8e3d-60a798f5eb5c req-71e1828f-9178-4b90-a5d5-1971c0a44fc6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:45.486345 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5dc81323-addc-4d81-8e3d-60a798f5eb5c req-71e1828f-9178-4b90-a5d5-1971c0a44fc6 service nova] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:45.498073 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5dc81323-addc-4d81-8e3d-60a798f5eb5c req-71e1828f-9178-4b90-a5d5-1971c0a44fc6 service nova] Creating event network-vif-deleted:7cd3b0e1-2d48-4d60-aca5-2f1bc7e3874c for instance 3c9465fd-95b0-49a5-8e29-3d127851194d on n-h2-860863-4 Nov 02 23:01:45.503203 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5dc81323-addc-4d81-8e3d-60a798f5eb5c req-71e1828f-9178-4b90-a5d5-1971c0a44fc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032445 Nov 02 23:01:45.503799 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4098/8072] 10.222.0.25 () {64 vars in 1317 bytes} [Wed Nov 2 23:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 23:01:45.909051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:45.909051 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.compute.api [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121039) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:45.910498 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:45.911023 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:45.911469 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:45.912231 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:45.912690 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:45.913248 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:45.945867 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:45.946346 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:45.946789 n-d-860863-4 devstack@n-api.service[121039]: DEBUG oslo_concurrency.lockutils [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:45.947237 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.objects.instance [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lazy-loading 'fault' on Instance uuid 3c9465fd-95b0-49a5-8e29-3d127851194d {{(pid=121039) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 23:01:45.992917 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.policy [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b3b464d00741fdb3adbd931b88ee89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b532f222b24653b324a4032b9e8861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121039) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 23:01:46.000900 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-bf0a8625-b5ba-4205-bdfa-f68b7035002c tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 200 len: 1339 microversion: 2.1 time: 0.103353 Nov 02 23:01:46.001455 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3975/8073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:45 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 23:01:47.024819 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:47.025586 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] [instance: 3c9465fd-95b0-49a5-8e29-3d127851194d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 23:01:47.032989 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:47.033499 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:47.033958 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:47.034690 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Acquiring lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 23:01:47.035165 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 23:01:47.035611 n-d-860863-4 devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Lock "8809d7fb-a74e-4b3a-b326-8109cb51ca98" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 23:01:47.049136 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] HTTP exception thrown: Instance 3c9465fd-95b0-49a5-8e29-3d127851194d could not be found. Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Request method failure captured: Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d HTTP/1.1 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: Accept: application/json Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: Accept-Encoding: identity Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: Connection: close Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: Content-Length: 0 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: Content-Type: application/json Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: Host: 10.222.0.25 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: Openstack-System-Scope: None Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjYvWqu66wzJaJPzmLFPTxYPd0ixD1biM8NrZzyVHP61x6OyMQt_AKtBGVVvEBAkcw1P6EoaOtgQez5mo5hiZwx59qvMtA6d3VpGAKhaLNnDGL0iJDNUBcpRYiEYrjbntleu_DWzj0ODWEsMOhibEQKjlKRseLD1I889r7Hm3vCnou324 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Id: None Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Domain-Name: None Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Identity-Status: Confirmed Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Is-Admin-Project: True Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Id: default Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Domain-Name: Default Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Id: 73b532f222b24653b324a4032b9e8861 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Project-Name: tempest-TestSnapshotPattern-1071530520 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Role: member,reader Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Roles: member,reader Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_73b532f222b24653b324a4032b9e8861"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b532f222b24653b324a4032b9e8861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/73b532f222b24653b324a4032b9e8861"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/73b532f222b24653b324a4032b9e8861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}] Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant: tempest-TestSnapshotPattern-1071530520 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Id: 73b532f222b24653b324a4032b9e8861 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestSnapshotPattern-1071530520 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-User: tempest-TestSnapshotPattern-1071530520-project Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Id: default Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-User-Domain-Name: Default Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-User-Id: 69b3b464d00741fdb3adbd931b88ee89 Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: X-User-Name: tempest-TestSnapshotPattern-1071530520-project Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: method: > Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: exception: Instance 3c9465fd-95b0-49a5-8e29-3d127851194d could not be found. Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: action_args: {'id': '3c9465fd-95b0-49a5-8e29-3d127851194d'} Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9465fd-95b0-49a5-8e29-3d127851194d could not be found. Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9465fd-95b0-49a5-8e29-3d127851194d could not be found. Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 23:01:47.050761 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9465fd-95b0-49a5-8e29-3d127851194d could not be found. Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Returning 404 to user: Instance 3c9465fd-95b0-49a5-8e29-3d127851194d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-00ba9159-8ba1-47e8-883e-151496cc4b10 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d" status: 404 len: 111 microversion: 2.1 time: 0.031840 Nov 02 23:01:47.054923 n-d-860863-4 devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4099/8074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Nov 2 23:01:47 2022] GET /compute/v2.1/servers/3c9465fd-95b0-49a5-8e29-3d127851194d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 23:01:47.292016 n-d-860863-4 devstack@n-api.service[121039]: DEBUG nova.api.openstack.wsgi [None req-d805ec75-0659-45b4-a693-252cc6354998 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] Calling method '.version_select at 0x7f9b683a63a0>' {{(pid=121039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 23:01:47.362121 n-d-860863-4 devstack@n-api.service[121039]: INFO nova.api.openstack.requestlog [None req-d805ec75-0659-45b4-a693-252cc6354998 tempest-TestSnapshotPattern-1071530520 tempest-TestSnapshotPattern-1071530520-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1031119658" status: 202 len: 0 microversion: 2.1 time: 0.074628 Nov 02 23:01:47.362726 n-d-860863-4 devstack@n-api.service[121039]: [pid: 121039|app: 0|req: 3976/8075] 10.222.0.25 () {58 vars in 1257 bytes} [Wed Nov 2 23:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1031119658 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)